Jobs
Interviews
Rapid7 logo

Senior AI Platform Engineer

5 years

0 Lacs

Pune Maharashtra India

Posted:1 week ago| Platform: Linkedin logo

Apply

Skills Required

ai design development engineering test latency library documentation experimentation openai vertex api data governance compliance slack azure support prototyping deployment coordination automation evaluation metrics reliability analyze visualize enablement tooling ml stack python json collaboration communication

Work Mode

On-site

Job Type

Contractual

Job Description

Overview


We are looking for a hybrid AI Platform Engineer to lead the design of high-performance prompts and the development of custom AI agents and integrations across our internal platforms. Collaborating closely with our AI Platform Manager and functional business units, this role bridges the creative precision of prompt engineering with the technical fluency required to build and deploy powerful LLM-based tools using APIs, system integrations, and emerging AI infrastructure.


Key Responsibilities

  • Prompt Engineering & Optimization

  • Design, test, and refine prompts for general and use-case-specific applications.
  • Evaluate and improve LLM output quality based on accuracy, latency, hallucination, and user satisfaction.
  • Maintain a scalable prompt library with robust documentation and experimentation tracking.

  • Custom Agent & GPT Development

  • Build and maintain custom GPTs (via OpenAI) or Google Agents (Gemini, Vertex AI).
  • Configure tools, memory, system prompts, and API-calling capabilities for agent workflows.
  • Ensure agents follow internal data governance and compliance policies.


  • API & Platform Integration

  • Integrate LLM functionality into internal systems (e.g., dashboards, Slack, CRMs, internal portals).
  • Work with APIs from OpenAI, Google Cloud, Azure, and others to create functional pipelines.
  • Support rapid prototyping and deployment of AI features in close coordination with product and automation teams.


  • Evaluation & Instrumentation

  • Define key performance metrics (quality, reliability, usage patterns).
  • Collaborate with data engineering to log, analyze, and visualize LLM performance.
  • Implement feedback loops to continuously optimize prompt and agent behavior.

  • Enablement & Documentation

  • Provide tooling and guidance to business users and product teams for prompt-based workflows.
  • Contribute to internal AI playbooks and best practices around prompt usage and API integration.


Requirements

  • 5+ years of experience in AI/ML, NLP applications, or full-stack product development
  • Hands-on experience with OpenAI APIs, Google Cloud Vertex/Gemini, or similar platforms
  • Strong experience with prompt engineering and LLM evaluation methods
  • Proficiency in Python and working with APIs, JSON, and vector databases
  • Familiarity with LangChain, LlamaIndex, or custom agent frameworks
  • Excellent collaboration and communication skills

More Jobs at Rapid7

SE II AI Engineer

Pune, Maharashtra, India

Experience: Not specified

|

Salary: Not disclosed

Service Desk Engineer

Pune, Maharashtra, India

Experience: Not specified

|

Salary: Not disclosed

MLOPS Engineer

Pune

2.0 - 7.0 yrs
|

INR 11 - 21 Lacs

Sales Manager

Kolkata, Mumbai, New Delhi, Hyderabad, Pune, Chennai, Bengaluru

4.0 - 7.0 yrs
|

INR 6 - 9 Lacs

Platform Operations Engineer II

Pune, Maharashtra, India

2.0 - 2.0 yrs
|

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Rapid7 logo
Rapid7

Cybersecurity

Boston

RecommendedJobs for You

Rapid7 logo

Senior AI Platform Engineer

Rapid7

Pune, Maharashtra, India

Rapid7 logo

Senior AI Platform Engineer

Rapid7

Pune, Maharashtra, India