QA Lead – AI / ML Systems

Codvo.ai

12 years

0 Lacs

pune maharashtra india

Posted:2 days ago| Platform:

Apply

Skills Required

ai ml software leadership strategies compliance development deployment data engineering drive model testing analysis evaluation drift interpretability azure aws sagemaker vertex verification test traceability documentation audit python communication

Work Mode

On-site

Job Type

Full Time

Job Description

About the Role

QA Lead – AI Systems

QA frameworks, validation strategies, and compliance processes

Key Responsibilities

Own and drive QA strategy
for AI systems across the model, data, and product lifecycle.
Lead
AI model validation
efforts, covering LLM/RAG testing, bias analysis, and performance evaluation.
Define and implement
AI Evaluation Metrics
(accuracy, fairness, drift, explainability) aligned with business and regulatory expectations.
Establish frameworks for
Explainability Testing (SHAP, LIME, XAI)
and ensure interpretability of AI outcomes.
Collaborate with Data Science and MLOps teams to validate models within
cloud environments
(Azure ML, AWS Sagemaker, Vertex AI).
Drive
verification and validation (V&V)
for AI models and applications under
FDA and SaMD compliance frameworks
.
Ensure test traceability, documentation, and audit readiness in line with
ISO 13485, IEC 62304, and ISO 14971
.
Develop
Python-based automation
for AI testing, data validation, and model evaluation pipelines.
Provide technical leadership to QA teams, ensuring alignment with AI/ML development best practices.
Collaborate with cross-functional teams (Product, Data, Regulatory, Engineering) to identify risks, gaps, and opportunities for test optimization.
Present validation findings, risks, and recommendations to senior stakeholders and regulatory reviewers.

Required Qualifications

Bachelor’s or Master’s degree in
Computer Science, Data Engineering, Biomedical Engineering
, or related field.
8–12 years of total QA experience
, with
2–3 years directly in AI/ML or GenAI QA
.
Proven experience in
AI Model Validation, LLM/RAG Testing, and AI Evaluation Metrics
.
Strong knowledge of
MLOps
concepts and cloud platforms (
Azure ML, AWS Sagemaker, Vertex AI
).
Understanding of
FDA AI/ML Compliance
,
SaMD testing
, and
regulated software QA
.
Hands-on expertise in
Python automation
and testing AI/ML pipelines.
Excellent documentation and communication skills with ability to produce
traceable validation artifacts

More Jobs at Codvo.ai

Back End Architect (Remote)

Pune, Maharashtra, India

5 - 8 yrs

Salary: Not disclosed

Full Stack Architect

Pune, Maharashtra, India

8 - 8 yrs

Salary: Not disclosed

Demand Gen Content Specialist / Writer SO (Remote)

Pune, Maharashtra, India

4.0 - 8.0 yrs

Salary: Not disclosed

Salesforce Marketing Cloud Developer (Remote)

Pune, Maharashtra, India

3.0 - 3.0 yrs

Salary: Not disclosed

MS Word Template Developer (VBA & Formatting Specialist)

India

6.0 - 6.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.