Procurement / vendor management Evaluator

Accountabilities:

• • Evaluate AI-generated procurement and vendor management work products against defined, domain-specific quality standards and evaluation rubrics.
  • Review documents, spreadsheets, presentations, and other business artifacts for accuracy, relevance, rigor, and professional quality.
  • Assess whether outputs reflect sound procurement principles, practical vendor management knowledge, and appropriate business judgment.
  • Identify factual inaccuracies, inconsistencies, omissions, or other substantive issues that could affect the quality of an output.
  • Review visual and presentation quality, identifying formatting, aesthetic, organization, and communication issues where relevant.
  • Provide clear, structured, and evidence-based written feedback explaining identified strengths, weaknesses, and areas for improvement.
  • Apply professional procurement expertise consistently when assessing AI-generated materials.
  • Contribute to the broader evaluation of AI capabilities by providing high-quality domain judgments across assigned projects.

  Requirements:

  • At least 5 years of relevant professional experience in procurement and/or vendor management.
  • Native-level or professional fluency in English, with strong written and verbal communication skills.
  • Highly proficient in Microsoft Office and Google Workspace, particularly Google Slides and/or PowerPoint.
  • Strong understanding of procurement processes, vendor relationships, commercial documentation, and professional business practices.
  • Ability to critically evaluate complex business materials for factual accuracy, logical consistency, quality, and practical applicability.
  • Excellent attention to detail and the ability to identify both substantive and presentation-related issues.
  • Strong written reasoning skills, with the ability to communicate evaluation findings clearly and objectively.
  • Ability to work independently, follow structured evaluation criteria, and apply professional judgment consistently.
  • An advanced degree such as a Master's or higher from a reputable institution is considered an advantage.

  Benefits:

  • Fully remote working arrangement.
  • Flexible, hourly engagement that can be completed around your existing schedule.
  • Opportunity to apply your procurement and vendor management expertise to real-world AI evaluation projects.
  • Direct contribution to improving the accuracy, quality, and usefulness of emerging AI systems.
  • Independent contractor engagement.
  • Weekly payments through Stripe or Wise based on services rendered.
  • Projects may be extended, shortened, or concluded early depending on project requirements and performance.
  • No requirement to relocate or work from a traditional office environment.
  • Referral opportunity offering up to $480 for each successful referral, subject to applicable restrictions.