ملازمت کی تفصیل

About the Role

We are looking for a dedicated Senior Quality Engineer specializing in IT to ensure high standards in quality, reliability, and security for cutting-edge AI-driven applications. This role involves validating both conventional software and AI-centric products such as Large Language Models (LLMs), Retrieval-Augmented Generation (RAG) frameworks, and autonomous AI agents. The position requires close cooperation with software engineers, AI developers, product managers, and business stakeholders to implement comprehensive quality assurance practices throughout the Software Development Life Cycle (SDLC).

Primary Responsibilities

Devise, formulate, and carry out thorough test strategies, plans, and cases.
Conduct functional, regression, integration, system-level, and user acceptance tests.
Create and sustain automated testing suites for web platforms, APIs, and server-side components.
Perform API testing utilizing tools such as Postman and REST Assured.
Ensure data consistency, backend processes, and seamless system integrations.
Identify, prioritize, and monitor defects throughout testing stages.
Partner with development teams to resolve issues and meet delivery timelines.

Test AI-enabled applications including Large Language Models (LLMs), RAG pipelines, and autonomous AI workflows.
Design and apply prompt validation along with robustness assessments.
Detect hallucinations and validate factual accuracy.
Implement bias, fairness, toxicity, and safety evaluations.
Verify AI guardrails, content moderation, and policy adherence.
Develop AI evaluation datasets and conduct ground-truth comparisons.
Use automated evaluation frameworks and benchmarking metrics to gauge AI quality.
Validate comprehensive AI workflows, orchestration, and agent communication.

Collaborate with technical and business teams to define and achieve quality goals.
Engage actively in Agile and Scrum activities including sprint planning, evaluations, and retrospectives.
Enhance QA methodologies, automation frameworks, and AI testing processes continually.
Support CI/CD initiatives by embedding automated tests within deployment pipelines.

Required Experience and Skills

3 to 5 years in software quality assurance and testing.
Practical experience with enterprise web application and API testing.
Hands-on knowledge of testing AI-driven or generative AI solutions.
Expertise in functional testing areas like planning, design, execution, regression, and defect management.
Proficiency with automation tools including Selenium, Playwright, or Cypress.
Programming skills in Python, JavaScript/TypeScript, or Java.
API and integration testing using Postman, REST Assured, Swagger/OpenAPI, or similar frameworks.
Direct experience testing AI components such as LLMs, RAG pipelines, prompt engineering, hallucination detection, bias and fairness, guardrails, AI workflow validation, and AI evaluation tools.

Preferred Competencies and Certifications

Familiarity with CI/CD pipeline integration and automated testing.
Knowledge of Agile and Scrum project methodologies.
Understanding of cloud-native architectures and microservices.
Experience with performance testing tools like JMeter, LoadRunner, or k6.
Security testing expertise and vulnerability assessment skills.
Experience with container technologies such as Docker and Kubernetes.
Working knowledge of cloud platforms including Azure, AWS, or Google Cloud.
Certifications like ISTQB Certified Tester, Certified Selenium Professional, Microsoft Azure AI Fundamentals, AWS AI Practitioner, or equivalent in AI technologies.

Core Attributes

Strong analytical reasoning and problem-solving capabilities.
High attention to detail with a quality-focused mindset.
Effective collaborator within cross-functional teams.
Excellent communication and stakeholder engagement skills.
A passion for continuous learning in AI and emerging tech fields.
Capacity to manage various priorities in a dynamic environment.

Senior Quality Engineer

جہاں آپ کام کریں گے۔