Data Science Expert

Role Overview

We are collaborating with a top AI research institution to recruit experienced data scientists. Your primary responsibility is to assess how effectively AI systems perform practical data science tasks. Instead of generating deliverables yourself, you will define and establish what constitutes high-quality work by developing detailed grading standards tailored to specific tasks, and then rigorously score completed work samples with well-explained written reasons.

Primary Responsibilities

• Develop accurate, task-specific grading standards for various data science outputs such as analyses, models, dashboards, experimental results, and written recommendations.
• Evaluate both AI-produced and human-prepared samples using these criteria, providing comprehensive written justifications for all scores.
• Apply uniform and evidence-backed judgment to ensure scores are consistent and defensible.
• Incorporate structured input from senior reviewers and rapidly refine your evaluations accordingly.

Ideal Candidate Profile

• Possess over five years of professional experience in data science within an industry setting.
• Have experience in business operations, product, or growth data science roles at leading technology firms.
• Demonstrate expertise in experimental design and A/B testing, proficiency in metric creation, skilled use of SQL and Python for analysis, and the ability to communicate insights effectively to senior stakeholders.
• Exhibit outstanding written communication skills.
• Be detail-focused, consistent, and receptive to peer evaluation and calibration of your judgment.
• Previous experience with AI training, model evaluation, or human-data interaction projects is highly advantageous.

Application Procedure

• Submit your resume or relevant technical credentials for consideration.
• Selected candidates might be requested to complete a short technical test or provide further information.

Equal Opportunity

We welcome applications from all qualified individuals regardless of legally protected characteristics and are prepared to provide reasonable accommodations on request.

Contract and Payment Conditions

• Position involves engagement as an independent contractor.
• Fully remote work with flexibility to complete assignments on your own schedule.
• Project duration may vary: extended, shortened, or terminated early based on organizational needs and individual performance.
• Payments are disbursed weekly through Stripe or Wise upon completion of services.