Job description

About the Role

We are seeking a dedicated AI Quality Analyst to join our client’s team on a full-time remote basis. The position involves evaluating and enhancing a new AI personalization feature that integrates data from previous conversations, emails, search histories, and activities to deliver contextually relevant responses. The role combines creative prompt design with analytical evaluation of AI output.

Key Responsibilities

Conduct assessments of personalized AI responses using your personal experiences as a contextual basis.
Create innovative multi-turn prompts to test the AI model’s capacity to accurately incorporate personal data sources.
Critically analyze AI outputs for accuracy, relevance, appropriateness of personalized information, and detect forced or incorrect connections.
Perform comparative reviews of AI-generated responses to identify subtle quality differences in relevance and precision.
Provide comprehensive feedback to improve the AI’s personalization capabilities.

Required Skills and Qualifications

Fluency in English with strong reading and writing skills.
Experience in prompt engineering or designing test scenarios for AI systems.
Capability to perform detailed and nuanced analysis of ambiguous AI responses.
Understanding of personalization concepts and evaluation metrics used in AI.
Meticulous attention to detail to identify minor inconsistencies in model results.
Willingness to use your primary Google account with enabled personal data sources for evaluation purposes.
Availability to work full-time within your local timezone, supporting a global 24-hour operation.

Additional Information

The compensation is competitive and will be determined based on your experience. This position offers a chance to contribute to cutting-edge AI technologies within a globally recognized leader in the technology and internet industry. We are committed to equal employment opportunities and welcome applicants of all backgrounds, evaluated solely on their skills and expertise.