Software Engineer, AI-Powered Advertising Agents

About the role

PubMatic is looking for engineers with expertise in Generative AI and AI agent development. You will be responsible for building and optimizing advanced AI agents that leverage the latest technologies in Retrieval-Augmented Generation (RAG), vector databases, and large language models (LLMs). You will work on developing state-of-the-art solutions that enhance Generative AI capabilities and enable our platform to handle complex information retrieval, contextual generation, and adaptive interactions.

What You'll do

• Collaborate with engineers, architects, product managers, and UX designers to develop innovative AI solutions for new customer use-cases.
• Work independently and iterate quickly based on customer feedback to make product tweaks.
• Implement and optimize LLMs for specific use cases, including fine-tuning models, deploying pre-trained models, and evaluating their performance.
• Develop AI agents powered by RAG systems, integrating external knowledge sources to improve the accuracy and relevance of generated content.
• Design, implement, and optimize vector databases (e.g., FAISS, Pinecone, Weaviate) for efficient and scalable vector search, and work on various vector indexing algorithms.
• Create sophisticated prompts and fine-tune them to improve the performance of LLMs in generating precise and contextually relevant responses.
• Utilize evaluation frameworks and metrics (e.g., Evals) to assess and improve the performance of generative models and AI systems.
• Work with data scientists, engineers, and product teams to integrate AI-driven capabilities into customer-facing products and internal tools.
• Stay up to date with the latest research and trends in LLMs, RAG, and generative AI technologies to drive innovation in the companys offerings.
• Continuously monitor and optimize models to improve their performance, scalability, and cost efficiency

We'd Love for You to Have

• Strong understanding of large language models (GPT, BERT, T5, etc.) and their underlying principles, including transformer architecture and attention mechanisms.
• Proven experience building AI agents with Retrieval-Augmented Generation to enhance model performance using external data sources (documents, databases).
• In-depth knowledge of vector databases, vector indexing algorithms, and experience with technologies like FAISS, Pinecone, Weaviate, or Milvus.
• Ability to craft complex prompts to guide the output of LLMs for specific use cases, enhancing model understanding and contextuality.
• Familiarity with Evals and other performance evaluation tools for measuring model quality, relevance, and efficiency.
• Proficiency in Python and experience with machine learning libraries such as TensorFlow, PyTorch, and Hugging Face Transformers.
• Experience with data preprocessing, vectorization, and handling large-scale datasets.
• Ability to present complex technical ideas and results to both technical and non-technical stakeholders.

Nice-to-Have

• Experience in building AI agents using graph-based architectures, including knowledge graph embeddings and graph neural networks (GNNs).
• Experience with training small base models using custom data, including data collection, pre-processing, and fine-tuning models to specific domains or tasks.
• Familiarity with deploying AI models on cloud platforms (AWS, GCP, Azure) and containerization technologies (Docker, Kubernetes).
• Publication or contributions to research in AI, LLMs, or related fields.

Qualifications

• Should have a bachelors degree in engineering (CS / IT) or equivalent degree from a well-known Institutes / Universities.

If interested, please visit the link below to apply:

https://pubmatic.com/job/?gh_jid=4615220008