Senior Software Test Engineer-GenAI Testing Kongsberg Digital

3.0 - 7.0 years

0 Lacs

karnataka

On-site

As a Senior QA Engineer at our company, you will be leading quality assurance for Generative AI (GenAI) solutions within our Digital Twin platform. Your role will involve focusing on the evaluation, reliability, and guardrails of AI-powered systems in production, going beyond traditional QA practices. Your responsibilities will include designing and implementing end-to-end QA strategies for applications using Node.js integrated with LLMs, RAG, and Agentic AI workflows. You will establish benchmarks and quality metrics for GenAI components, develop evaluation datasheets for LLM behavior validation, and conduct data quality testing for RAG databases. Additionally, you will perform A/B testing, define testing methodologies, collaborate with developers and AI engineers, build QA automation, and lead internal capability development by mentoring QA peers on GenAI testing practices. To be successful in this role, you should have at least 6 years of experience in software quality assurance, with a minimum of 3 years of experience in GenAI or LLM-based systems. You should possess a deep understanding of GenAI quality dimensions, experience in creating and maintaining LLM evaluation datasets, and familiarity with testing retrieval pipelines and RAG architectures. Preferred skills include experience with GenAI tools/platforms, exposure to evaluating LLMs in production settings, familiarity with prompt tuning and few-shot learning in LLMs, and basic scripting knowledge in Python, JavaScript, or TypeScript. If you are a passionate and forward-thinking QA Engineer with a structured QA discipline, hands-on experience in GenAI systems, and a strong sense of ownership, we encourage you to apply for this high-impact role within our innovative team.,

Posted 5 days ago

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.