Automation Tester

5 years

0 Lacs

Posted:21 hours ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Company Description

About SutherlandArtificial Intelligence. Automation.Cloud engineering. Advanced analytics.For business leaders, these are key factors of success. For us, they’re our core expertise.We work with iconic brands worldwide. We bring them a unique value proposition through market-leading technology and business process excellence.We’ve created over 200 unique inventions under several patents across AI and other critical technologies. Leveraging our advanced products and platforms, we drive digital transformation, optimize critical business operations, reinvent experiences, and pioneer new solutions, all provided through a seamless “as a service” model.For each company, we provide new keys for their businesses, the people they work with, and the customers they serve. We tailor proven and rapid formulas, to fit their unique DNA.We bring together human expertise and artificial intelligence to develop digital chemistry. This unlocks new possibilities, transformative outcomes and enduring relationships.SutherlandUnlocking digital performance. Delivering measurable results.We are hiring a quality-focused AI Tester to design and execute validation frameworks for AI models and systems. Reporting to the AI Manager, this role ensures that AI solutions meet accuracy, performance, reliability, and ethical compliance benchmarks before production deployment.

Key Responsibilities:

  • Develop and execute test plans and cases for AI/ML models, GenAI solutions, and agent-based systems.
  • Validate model outputs for accuracy, precision, recall, latency, and interpretability across diverse datasets.
  • Conduct bias testing, data drift analysis, and adversarial robustness validation.
  • Collaborate with AI developers, data scientists, and business analysts to define acceptance criteria.
  • Automate testing pipelines and integrate with CI/CD environments where applicable.
  • Maintain traceability matrices, defect logs, and model validation documentation.

Qualifications

Required Qualifications:

  • 3–5 years of experience in software testing or QA, with at least 1–2 years in AI/ML or data-centric testing.
  • Strong understanding of AI model evaluation metrics, data sampling, and validation techniques.
  • Experience using testing frameworks (e.g., PyTest, Great Expectations) and visualization tools.
  • Familiarity with Python, JSON, and REST APIs.
  • Bachelor’s degree in Computer Science, Statistics, or a related field.

Preferred Skills:

  • Experience testing LLMs, GenAI prompts, or RAG workflows.
  • Exposure to responsible AI frameworks and model audit practices.
  • ISTQB or other QA certifications are a plus.

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Sutherland logo
Sutherland

Business Process Outsourcing (BPO)

Denver

RecommendedJobs for You

Bengaluru, Karnataka, India

Hyderabad, Telangana, India

Chennai, Tamil Nadu, India

Bengaluru, Karnataka

Chennai, Tamil Nadu, India