Software Engineer - AI Code Evaluation and Benchmarking (Remote)
Remote · Tempo total
Seja o primeiro a se candidatar
- Experiência
- 3+ anos
- Salário
- —
- Vagas
- 1
- Publicado
- há 5 horas
- Modo de trabalho
- Trabalhe em casa
- Educação
- Bachelor's or master's degree in computer science, software engineering, or related discipline
- Elegibilidade
- This role is open to candidates with relevant software engineering experience and educational qualifications in related technical fields. US candidates are specifically preferred for this position.
- Retomar
- Obrigatório candidatar-se
Descrição da vaga
Role Summary
We are recruiting for a Software Engineer specializing in AI code evaluation and benchmarking to join a client organization remotely. This position is full-time and offers a competitive salary tied to experience. The engineer will focus on verifying the coding abilities of advanced AI models by ensuring their outputs are accurate, efficient, and reliable in realistic software engineering contexts.
Key Responsibilities
- Inspect AI-generated code for accuracy, efficiency, maintainability, and compliance with specified requirements.
- Analyze software tasks and confirm that AI-provided solutions meet expected outcomes.
- Debug and replicate issues within various programming environments and verify resolutions.
- Evaluate the correctness of model-produced explanations, logic, and implementation strategies.
- Develop and upkeep evaluation datasets, benchmarks, and grading rubrics for coding challenges.
Required Qualifications and Skills
- Possess a Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related technical discipline.
- Have over three years of professional software engineering experience.
- Proficient in at least one programming language including Python, Java, C/C++, Go, Swift, Objective-C, PHP, or SQL.
- Strong knowledge of data structures, algorithms, software design patterns, and debugging techniques.
- Experienced in conducting thorough code reviews, identifying corner cases, failure scenarios, and limitations in AI-based software engineering solutions.
Opportunity Highlights
This is a distinctive chance to collaborate with a leading company in AI, contributing to the refinement of large language models through meticulous human feedback and evaluation. It suits software engineers passionate about code analysis, debugging, problem solving, and applying expert technical judgment to complex coding scenarios.
Equal Employment Opportunity
Applicants are evaluated solely on skills and qualifications regardless of background. We welcome candidates from diverse experiences and prior employment histories.