AI Engineer ( Quality ,Performance) Novizco Infotech

2.0 - 7.0 years

7 - 17 Lacs

Bengaluru

Remote

Job Title: AI Engineer Quality & Performance Job Description: We are seeking a highly skilled AI Engineer - Quality & Performance to ensure the accuracy, robustness, and ethical integrity of AI-generated responses. In this role, you will leverage AI validation frameworks, adversarial testing tools, and responsible AI principles to assess and enhance AI systems. If you are passionate about AI security, performance evaluation, and responsible AI practices, wed love to hear from you! Key Responsibilities: AI Response Validation: Evaluate AI-generated responses for accuracy, coherence, relevance, and alignment with defined standards. AI Red Teaming: Utilize tools such as Pyrit, NVIDIA Garak, Giskard AI, Attest, and TruLens to conduct adversarial testing and identify vulnerabilities, biases, or security risks in AI models. AI Ground Truth Check: Develop and refine validation datasets using frameworks like PromptFlow, Cerberus, CheckList, and FairBench to ensure factual integrity and reliability of AI outputs. AI Performance Evaluation: Implement benchmarking strategies using tools such as OpenAI Eval, DeepEval, Dynabench, and LM Harness to measure AI model efficiency, robustness, and responsiveness. AI Quality Assurance: Apply automated validation frameworks such as DeepChecks, Great Expectations, and Robustness Gym to maintain high standards in AI response generation. Responsible AI Validation: Leverage tools like Fairlearn, Aequitas, and AI Fairness 360 to assess AI fairness, mitigate biases, and enforce ethical AI principles. Prompt Rewriting & Validation: Analyze and refine AI prompts using PromptFoo and Helium to optimize response quality and consistency across diverse applications. Qualifications: Education: Bachelors or Masters degree in Computer Science, AI, Engineering, or a related field (or equivalent practical experience). Experience: 2-8 years of experience in AI engineering, software development, or automation testing. Minimum 1 year of experience working with red teaming frameworks (e.g., Pyrite, Attest) and AI validation tools (e.g., Fairlearn, DeepChecks). Strong understanding of AI security, fairness principles, and adversarial testing methodologies. Technical Skills: Proficiency in programming languages such as Python, JavaScript, or relevant AI evaluation scripting. Experience in AI bias detection, robustness testing, and prompt engineering. Familiarity with machine learning workflows, AI policy frameworks, and ethical AI implementation. Key Competencies: Strong analytical and problem-solving skills in AI validation and red teaming. Attention to detail when assessing AI-generated responses. Creativity and critical thinking in designing and refining AI prompts. Excellent written and verbal communication skills for reporting AI evaluation results. Ability to work in a fast-paced, collaborative environment with multidisciplinary teams. Why Join Us? Work with cutting-edge AI validation frameworks to shape the future of responsible AI. Engage in AI security, fairness assessments, and red teaming to enhance AI resilience. Be part of an innovative and dynamic team at the forefront of AI model evaluation. Competitive compensation package with strong career growth opportunities.

Posted 2 weeks ago

Apply

GEN AI Architect- Chennai Grid Dynamics

12.0 - 18.0 years

35 - 40 Lacs

Chennai

Work from Office

Tech stack required: Programming languages: Python Public Cloud: AzureFrameworks: Vector Databases such as Milvus, Qdrant/ ChromaDB, or usage of CosmosDB or MongoDB as Vector stores. Knowledge of AI Orchestration, AI evaluation and Observability Tools. Knowledge of Guardrails strategy for LLM. Knowledge on Arize or any other ML/LLM observability tool. Experience: Experience in building functional platforms using ML, CV, LLM platforms. Experience in evaluating and monitoring AI platforms in production Nice to have requirements to the candidate Excellent communication skills, both written and verbal. Strong problem-solving and critical-thinking abilities. Effective leadership and mentoring skills. Ability to collaborate with cross-functional teams and stakeholders. Strong attention to detail and a commitment to delivering high-quality solutions. Adaptability and willingness to learn new technologies. Time management and organizational skills to handle multiple projects and priorities.

Posted 1 month ago

Apply

QA Automation Engineer (Python + API Testing) Novizco Infotech

3.0 - 5.0 years

10 - 20 Lacs

Bengaluru

Remote

Role & responsibilities We are seeking a highly skilled QA Automation Engineer with 3-5 years of experience in software development, SDET, or QA automation, with a strong focus on backend systems, APIs, or complex data pipelines. This role demands deep expertise in Python programming and a strong understanding of automation tools, CI/CD processes, and API testingparticularly within evolving AI-driven environments. Design, implement, and maintain robust automation frameworks using Python (Pytest or similar). Conduct thorough testing of backend systems , data pipelines, and RESTful APIs . Build test cases and scripts to support automated validation of AI-integrated services. Use tools like Postman or the requests library for API testing. Manage source control with Git and integrate tests into CI/CD pipelines (Jenkins, GitLab CI, GitHub Actions). Analyze and document defects with clarity, and collaborate with developers for resolution. Continuously adapt and learn new testing approaches for modern AI/ML-powered systems . Must-Have Skills 35 years of experience in software development, QA automation, or SDET roles. Strong hands-on programming skills in Python . Proven experience with automation frameworks like Pytest . Solid experience in REST API testing and tools like Postman or requests. Familiarity with CI/CD tools such as Jenkins, GitLab CI, or GitHub Actions. Excellent communication skills with the ability to articulate technical concepts clearly. Fast learner with the ability to adapt quickly to evolving AI/ML technologies . Preferred Qualifications Experience with cloud platforms (AWS, GCP, Azure), especially AI/ML services. Exposure to testing AI-based features or systems, especially in the telecom domain . Knowledge of UI automation tools like Selenium or Playwright (nice to have) Familiarity with structured testing of AI service pipelines and performance benchmarking. What We Offer Remote work flexibility Competitive compensation based on skill and experience Opportunity to work on cutting-edge AI-powered platforms A collaborative, learning-first culture with global project exposure

Posted 2 months ago

Apply

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.