Platform Architect — GenAI/LLM Systems

7 years

0 Lacs

Posted:4 days ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Title:

Location:

Experience:

Employment Type:


About the Role

We are seeking a skilled and passionate Platform Architect – GenAI/ LLM Systems to join our team.


What You’ll Do

  • Architect scalable, cloud-native infrastructure to support enterprise-grade GenAI and LLM-powered applications.
  • Design and deploy secure, reliable API gateways, orchestration layers (Airflow, Kubeflow), and CI/CD workflows for ML and LLM pipelines
  • Collaborate with data and ML engineering teams to enable low-latency LLM inference and vector-based search platforms across GCP (or multi-cloud)
  • Define and implement a semantic layer and data abstraction strategy to enable consistent and governed consumption of data across LLM and analytics use cases.
  • Implement robust data governance frameworks including role-based access control (RBAC), data lineage, cataloging, observability, and metadata management.
  • Guide architectural decisions around embedding stores, vector databases, LLM tooling, and prompt orchestration (e.g., LangChain, LlamaIndex)
  • Establish compliance and security standards to meet enterprise SLA, privacy, and auditability requirements.


What Sets You Apart

  • 7+ years of experience as a Platform/Cloud/Data Architect, ideally within GenAI, Data Platforms, or LLM systems.
  • Strong cloud infrastructure experience on GCP (preferred), AWS, or Azure, including Kubernetes, Docker, Terraform/IaC.
  • Demonstrated experience building and scaling LLM-powered architectures using OpenAI, Vertex AI, LangChain, LlamaIndex, etc.

  • Familiarity with semantic layers, data catalogs, lineage tracking, and governed data delivery across APIs and ML pipelines.
  • Track record of deploying production-grade GenAI/LLM services that meet performance, compliance, and enterprise integration requirements.
  • Strong communication and cross-functional leadership skills — ability to translate business needs into scalable architecture

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

RecommendedJobs for You