Quality Analyst (Remote)

Role Summary

This position is for a Quality Analyst working remotely to assess and improve AI personalization features by evaluating AI-generated responses that incorporate information from past interactions and personal data sources.

Primary Responsibilities

• Assess personalized AI responses utilizing personal experience as context.
• Create innovative multi-turn prompts to test the AI model’s integration of personal data like email and search activity.
• Evaluate responses for accuracy, relevance, and proper personalization; identify errors or forced associations.
• Analyze side-by-side AI response comparisons to detect nuanced differences in quality.
• Provide comprehensive feedback to enhance AI personalization functions.

Required Skills and Qualifications

• Fluency in English with strong reading and writing skills.
• Experience in AI prompt engineering or AI test case design.
• Analytical ability to interpret subtle and ambiguous AI outputs.
• Understanding of AI personalization concepts and metrics.
• Keen attention to detail to spot minor discrepancies.
• Willingness to enable personal data sources on a primary Google account for testing.
• Availability to work full-time aligned with the candidate's local time zone to support global operations.

Additional Information

The opportunity allows collaboration with a leading technology firm focused on cutting-edge AI development that impacts business outcomes significantly. The company commits to equal employment opportunity based on skills and qualifications without discrimination.