Senior Java Developer with GenAI

We are seeking a skilled Senior Java Backend Engineer to join our team dedicated to constructing scalable and high-performance backend systems for Generative AI applications. You will play a pivotal role in the design of APIs, coordination of AI agents, and integration of Large Language Models (LLMs) into systems ready for production. This position is optimal for backend developers enthusiastic about modern AI technologies and distributed systems. Responsibilities include designing, building, and managing scalable backend services using Java and the Spring Boot framework. You will also be responsible for creating APIs to facilitate LLM integration, supporting AI agent orchestration workflows, and architecting microservices for RAG (Retrieval-Augmented Generation) and other LLM-driven systems. Optimizing performance through efficient caching strategies and integrating with multiple LLM providers such as OpenAI, Gemini, and Claude are key aspects of this role. Additionally, implementing real-time streaming features for conversational AI systems and ensuring robust system observability will be part of your responsibilities. **Key Responsibilities:** - Design, build, and maintain scalable backend services using Java and the Spring Boot framework - Develop APIs to enable LLM integration and support AI agent orchestration workflows - Architect microservices to power RAG and other LLM-driven systems - Optimize performance through efficient caching strategies and vector database interactions - Integrate and manage connections with multiple LLM providers, including rate limiting and failover handling - Implement real-time streaming features for conversational AI systems - Ensure robust system observability with logging, monitoring, and tracing **Required Skills & Qualifications:** - 3+ years of experience with Java and Spring Boot - Strong understanding of RESTful API design principles and microservices architecture - Proficiency with core Spring modules like Spring Security, Spring Data JPA, and Spring Cloud - Experience with relational and NoSQL databases such as PostgreSQL, MongoDB, and Redis - Familiarity with message brokers like RabbitMQ or Apache Kafka - Expertise in caching mechanisms and system performance tuning - Experience in integrating LLM APIs and vector databases into backend services - Knowledge of AI agent orchestration frameworks and RAG systems - Proficiency in developing streaming responses using WebSockets - Working knowledge of prompt templating and management systems **Nice to Have:** - Experience in fine-tuning LLMs and managing model deployment pipelines - Knowledge of self-hosted LLM environments and infrastructure management - Exposure to observability tools such as LangSmith or custom monitoring setups - Familiarity with natural language to SQL systems or BI applications powered by LLMs,