Stellenbeschreibung

About the Role

We are representing a prominent AI research organization seeking skilled Data Science Experts to assist in assessing the effectiveness of AI systems performing complex real-world data science tasks. This position involves developing rigorous evaluation frameworks and critically reviewing AI-generated outcomes with objective, evidence-supported feedback rather than direct modeling or business analysis work.

Key Responsibilities

Create comprehensive, task-specific evaluation standards for data science deliverables such as data analyses, predictive and statistical models, dashboards and visualizations, experimental outcomes, and executive-level insights.
Assess both AI-produced and human-generated outputs using structured scoring methods.
Provide thorough written rationales for each evaluation to maintain technical precision and consistency.
Employ analytical judgment to generate reproducible, defensible assessments.
Integrate reviewer feedback to continuously enhance evaluation procedures.
Work collaboratively across teams to elevate AI training processes and uphold evaluation quality standards.

Qualifications

Minimum of five years' industry experience in Data Science.
Strong expertise in business operations, product or growth analytics, or related analytical domains within technology firms.
Proficiency in experimental design, A/B testing, statistical methods, SQL, Python, metric development, and interpreting analysis into actionable business insights.
Exceptional written communication skills capable of explaining technical reasoning clearly.
Meticulous attention to detail and ability to apply consistent evaluations using structured rubrics.
Ability to accept feedback constructively and collaborate on standardizing evaluation criteria.
Preferred experience includes contributing to AI evaluation, training or data annotation projects, familiarity with large language models, AI-assisted analytics, or machine learning workflows, and experience mentoring or reviewing analytical teams.

Additional Information

Engagement is as an independent contractor.
Work is fully remote with flexible hours.
Project length may vary depending on needs and performance.
Compensation ranges from $120 to $170 per hour, paid weekly upon approved work completion.
H1-B and STEM OPT visa sponsorships are not available.

Application Process

Submit your resume or detailed technical background to initiate consideration.
Selected candidates may be asked to complete a brief technical evaluation or provide further details of expertise.

Why Work With Us?

Influence the advancement of next-generation AI capable of sophisticated analytical reasoning.
Use your professional data science skills on impactful AI evaluation projects.
Enjoy remote employment with flexible schedule options.
Collaborate with an experienced professional network focused on AI quality and reasoning development.

We encourage candidates of diverse backgrounds to apply and are committed to equitable recruitment with reasonable accommodations.

Data Science Expert