Applied Economics & Finance Benchmark Specialist

Accountabilities:

• • Author original, challenging multiple-choice questions across areas such as algorithmic trading and market microstructure, macroprudential policy, behavioral finance and experimental economics, urban economics, tokenomics, and decentralized finance.
  • Design questions that assess deep conceptual understanding and advanced reasoning rather than simple factual recall.
  • Ensure every assessment is self-contained, unambiguous, precisely defined, and includes all information necessary for a candidate to solve the problem.
  • Assign an appropriate difficulty level to each question: Medium for introductory undergraduate content, Hard for advanced undergraduate content, or Expert for postgraduate-level and above material.
  • Develop one correct answer alongside nine plausible but subtly incorrect alternatives capable of challenging highly knowledgeable solvers.
  • Provide clear, structured step-by-step solutions in Markdown, explaining the reasoning and intermediate steps required to reach the correct answer.
  • Support each question with 1–5 reputable academic references, including peer-reviewed research, university publications, or other authoritative sources.
  • Review and verify pre-written questions for factual accuracy, clarity, completeness, precision, and solvability, making and documenting edits where necessary.
  • Apply strong academic judgment to ensure benchmark content meets rigorous standards and provides meaningful evaluation of AI capabilities.

  Requirements:

  • PhD or doctoral candidacy in Economics, Finance, or a closely related discipline is strongly preferred.
  • A Master’s degree may be considered for candidates with exceptional expertise in a relevant economics or finance specialization.
  • Strong command of graduate-level economic theory, quantitative methods, financial modeling, and analytical reasoning.
  • Demonstrated expertise in one or more relevant domains, such as financial markets, macroeconomics, behavioral economics, urban economics, algorithmic trading, or decentralized finance.
  • Academic research experience is highly valuable; CFA, CPA, or relevant professional finance experience is also a strong advantage.
  • Excellent written English, with the ability to communicate sophisticated technical and academic concepts accurately, clearly, and concisely.
  • Strong attention to detail and a rigorous approach to fact-checking, logical consistency, and problem formulation.
  • Ability to distinguish between genuinely challenging questions and questions that are merely ambiguous or unnecessarily complex.
  • Comfortable working independently on structured, asynchronous assignments while consistently meeting quality and delivery expectations.
  • Candidates must be able to work as independent contractors and should note that H1-B and STEM OPT sponsorship is not currently supported.

  Benefits:

  • Fully remote and asynchronous working environment.
  • Flexible schedule with an expected commitment of 10+ hours per week.
  • Opportunity to contribute directly to projects focused on training and improving advanced AI systems.
  • Competitive compensation based on services rendered.
  • Weekly payments through Stripe or Wise.
  • Opportunity to collaborate with leading AI researchers and apply specialized subject-matter expertise to frontier technology.
  • Potential to work on projects that can be extended, shortened, or concluded based on project needs and performance.
  • Opportunity to deepen your experience in AI evaluation, large language models, and benchmark development.
  • Work designed to avoid access to confidential or proprietary information belonging to other employers, clients, or institutions.
  • Global, expertise-driven environment where specialized knowledge can have a direct impact on the development of next-generation AI systems.
  • Referral opportunity offering up to $400 per successful referral, subject to applicable restrictions.