LLMOps Engineer - GenAI Platforms

About the Role:

---------------------

focus on establishing monitoring, governance, security, and operational best practices

Key Responsibilities:

-------------------------

• Design and implement governance frameworks for GenAI platforms, ensuring compliance with internal policies and external regulations (e.g., GDPR, AI Act).
• Define and enforce responsible AI practices including fairness, transparency, explainability, and auditability.
• Implement robust security protocols including IAM, data encryption, secure API access, and model sandboxing.
• Collaborate with security teams to conduct risk assessments and ensure secure deployment of LLMs.
• Build and maintain scalable LLMOps pipelines for model training, fine-tuning, evaluation, deployment, and monitoring.
• Automate model lifecycle management with CI/CD, versioning, rollback, and observability.
• Develop and manage GenAI agents capable of reasoning, planning, and tool use.
• Integrate and orchestrate LLMs from multiple providers (e.g., OpenAI, Anthropic, Cohere, Google, Azure OpenAI) to support hybrid and fallback strategies.
• Optimize prompt engineering, context management, and agent memory for production use.
• Ensure high availability, low latency, and cost-efficiency of GenAI workloads across cloud and hybrid environments.
• Implement monitoring and alerting for model drift, hallucinations, and performance degradation.
• Partner with GenAI developers to embed best practices and reusable components (SDKs, templates, APIs).
• Provide technical guidance and documentation to accelerate development and ensure platform consistency.

Qualifications:

------------------

• Bachelors or Masters degree in Computer Science, Engineering, or related field.

• 3-5 years of experience in MLOps, DevOps, or platform engineering, with 2+ years in LLM/GenAI environments.

• Deep understanding of LLMs, GenAI agents, prompt engineering, and inference optimization.
• Experience with LangChain, LlamaIndex, Langraph or similar agent frameworks.
• Hands-on with MLflow, or equivalent tools.
• Proficient in Python, containerization (Docker) and cloud platforms (AWS/GCP/Azure).
• Familiarity with AI governance frameworks and responsible AI principles.
• Experience with vector databases (e.g., FAISS, Pinecone), RAG pipelines, and model evaluation frameworks.
• Knowledge of Responsible AI, red-teaming, and OWASP security principles.

Joining:

----------

• We must fill this position urgently.

  Candidates who can start within 2 weeks

  will be our priority.

Location:

-----------

• Bangalore Hybrid