8 Confluent Kafka Jobs

Technical Skills Must Have: 8+ years overall IT industry experience, with 5+ years in a solution or technical architect role using service and hosting solutions such as private/public cloud IaaS, PaaS and SaaS platforms. 5+ years of hands-on development experience with event driven architecture-based implementation. Achieved one or more of the typical solution and technical architecture certifications e.g. Microsoft, MS Azure Certification, TOGAF, AWS Cloud Certified, SAFe, PMI, and SAP etc. Hand-on experience with: o Claims-based authentication (SAML/OAuth/OIDC), MFA, JIT, and/or RBAC / Ping etc. o Architecting Mission critical technology components with DR capabilities. o Multi-geography, multi-tier service design and management. o Project financial management, solution plan development and product cost estimation. o Supporting peer teams and their responsibilities; such as infrastructure, operations, engineering, info-security. o Configuration management and automation tools such as Azure DevOps, Ansible, Puppet, Octopus, Chef, Salt, etc. o Software development full lifecycle methodologies, patterns, frameworks, libraries and tools. o Relational, graph and/or unstructured data technologies such as SQL Server, Azure SQL, Cosmos, Azure Data Lake, HD Insights, Hadoop, Neo4j etc. o Data management and data governance technologies. o Experience in data movement and transformation technologies. o AI and Machine Learning tools such as Azure ML etc. o Architecting mobile applications that are either independent applications or supplementary addons (to intranet or extranet). o Cloud security controls including tenant isolation, encryption at rest, encryption in transit, key management, vulnerability assessments, application firewalls, SIEM, etc. o Apache Kafka, Confluent Kafka, Kafka Streams, and Kafka Connect. o Proficient in NodeJS, Java, Scala, or Python languages.

We offer joint operations and digitalization services for Global Business Services and work closely alongside the entire Shared Services organization. We make efficient use of the possibilities of new technologies such as Business Process Management (BPM) and Robotics as enablers for efficient and effective implementations. We are looking for Data Engineer (AWS, Confluent & Snaplogic ) Data Integration : Integrate data from various Siemens organizations into our data factory, ensuring seamless data flow and real-time data fetching. Data Processing : Implement and manage large-scale data processing solutions using AWS Glue, ensuring efficient and reliable data transformation and loading. Data Storage : Store and manage data in a large-scale data lake, utilizing Iceberg tables in Snowflake for optimized data storage and retrieval. Data Transformation : Apply various data transformations to prepare data for analysis and reporting, ensuring data quality and consistency. Data Products : Create and maintain data products that meet the needs of various stakeholders, providing actionable insights and supporting data-driven decision-making. Workflow Management : Use Apache Airflow to orchestrate and automate data workflows, ensuring timely and accurate data processing. Real-time Data Streaming : Utilize Confluent Kafka for real-time data streaming, ensuring low-latency data integration and processing. ETL Processes : Design and implement ETL processes using SnapLogic , ensuring efficient data extraction, transformation, and loading. Monitoring and Logging : Use Splunk for monitoring and logging data processes, ensuring system reliability and performance. Youd describe yourself as: Experience : 3+ relevant years of experience in data engineering, with a focus on AWS Glue, Iceberg tables, Confluent Kafka, SnapLogic, and Airflow. Technical Skills : Proficiency in AWS services, particularly AWS Glue. Experience with Iceberg tables and Snowflake. Knowledge of Confluent Kafka for real-time data streaming. Familiarity with SnapLogic for ETL processes. Experience with Apache Airflow for workflow management. Understanding of Splunk for monitoring and logging. Programming Skills : Proficiency in Python, SQL, and other relevant programming languages. Data Modeling : Experience with data modeling and database design. Problem-Solving : Strong analytical and problem-solving skills, with the ability to troubleshoot and resolve data-related issues. Preferred Qualities: Attention to Detail : Meticulous attention to detail, ensuring data accuracy and quality. Communication Skills : Excellent communication skills, with the ability to collaborate effectively with cross-functional teams. Adaptability : Ability to adapt to changing technologies and work in a fast-paced environment. Team Player : Strong team player with a collaborative mindset. Continuous Learning : Eagerness to learn and stay updated with the latest trends and technologies in data engineering.

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Cloud Solution Delivery Lead Consultant to join our team in bangalore, Karn?taka (IN-KA), India (IN). Data Engineer Lead Robust hands-on experience with industry standard tooling and techniques, including SQL, Git and CI/CD pipelines mandiroty Management, administration, and maintenance with data streaming tools such as Kafka/Confluent Kafka, Flink Experienced with software support for applications written in Python & SQL Administration, configuration and maintenance of Snowflake & DBT Experience with data product environments that use tools such as Kafka Connect, Synk, Confluent Schema Registry, Atlan, IBM MQ, Sonarcube, Apache Airflow, Apache Iceberg, Dynamo DB, Terraform and GitHub Debugging issues, root cause analysis, and applying fixes Management and maintenance of ETL processes (bug fixing and batch job monitoring) Training & Certification . Apache Kafka Administration Snowflake Fundamentals/Advanced Training . Experience 8 years of experience in a technical role working with AWS At least 2 years in a leadership or management role About NTT DATA NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. Visit us at NTT DATA endeavors to make accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at . This contact information is for accommodation requests only and cannot be used to inquire about the status of applications. NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. For our EEO Policy Statement, please click . If you'd like more information on your EEO rights under the law, please click . For Pay Transparency information, please click.

Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients . Powered by our purpose - the relentless pursuit of a world that works better for people - we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI. Inviting applications for the role of Principal Consultant, Senior Java Developer In this role, we are inviting applications for the role of Senior Java Developer with working experience in Microservices. Responsibilities Must have skills: JAVA, Spring/ SpringBoot , REST API, Microservices - JAVA or NODE.JS, JBOSS, SQL, MS Azure (Azure EventHub, Confluent Kafka, Azure App Service Environment, ASP) or AWS equivalent. Working Knowledge: Bitbucket, GIT, Confluence, JIRA, Strong experience in DevOps pipeline, CI/ CD and related tools Nice to Have: Kubernetes, MQ, OAuth and Event Driven messaging, Postman, O/S (Windows, Linux), Jboss scripting/CLI, prior FI experience. Readiness and motivation to work autonomously in a lead capacity on a diverse range of activities ( e.g. design, support of technical business solutions) and can be relied on to coach, educate and monitor the work of others. Primary subject matter expertise in multiple areas you%27re seasoned in counselling clients and project teams on all aspects of research, analysis, design, hardware and software support, development of technical solutions and testing. Involvement coaching and advising clients, partners and project teams capable of being an internal expert resource in technical information exchange. Commitment to and belief in the quality of your deliverables. Qualifications we seek in you Minimum Qualifications BE/ B Tech/ MCA or equivalent Excellent Communication skills Preferred Qualifications/ Skills Experience of software development including architecting, designing and coding Strong expertise in API, Microservices development and integration using Java/Spring Boot, Node.js Expert knowledge of the business, broader organization, technical environment, standards, processes, tools, procedures, multiple programming languages, operating systems, solutions design and other relevant technology areas from a design/support/solutions perspective. Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation. For more information, visit Follow us on X, Facebook, LinkedIn, and YouTube. Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a %27starter kit,%27 paying to apply, or purchasing equipment or training.

Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients . Powered by our purpose - the relentless pursuit of a world that works better for people - we serve and transform leading enterprises, including the Fortune Global 500, with our deep business and industry knowledge, digital operations services, and expertise in data, technology, and AI. Inviting applications for the role of Lead Consultant, Senior Java Developer In this role, we are inviting applications for the role of Senior Java Developer with working experience in Microservices. Responsibilities Must have skills: JAVA, Spring/ SpringBoot , REST API, Microservices - JAVA or NODE.JS, JBOSS, SQL, MS Azure (Azure EventHub, Confluent Kafka, Azure App Service Environment, ASP) or AWS equivalent. Working Knowledge: Bitbucket, GIT, Confluence, JIRA, Strong experience in DevOps pipeline, CI/ CD and related tools Nice to Have: Kubernetes, MQ, OAuth and Event Driven messaging, Postman, O/S (Windows, Linux), Jboss scripting/CLI, prior FI experience. Readiness and motivation to work autonomously in a lead capacity on a diverse range of activities ( e.g. design, support of technical business solutions) and can be relied on to coach, educate and monitor the work of others. Primary subject matter expertise in multiple areas you%27re seasoned in counselling clients and project teams on all aspects of research, analysis, design, hardware and software support, development of technical solutions and testing. Involvement coaching and advising clients, partners and project teams capable of being an internal expert resource in technical information exchange. Commitment to and belief in the quality of your deliverables. Qualifications we seek in you Minimum Q ualifications BE/ B Tech/ MCA or equivalent Excellent Communication skills Preferred Q ualifications / Skills Experience of software development including architecting, designing and coding Strong expertise in API, Microservices development and integration using Java/Spring Boot, Node.js Expert knowledge of the business , broader organization, technical environment, standards, processes, tools, procedures, multiple programming languages, operating systems, solutions design and other relevant technology areas from a design/support/solutions perspective. Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws.Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation. For more information, visit Follow us on X, Facebook, LinkedIn, and YouTube. Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a %27starter kit,%27 paying to apply, or purchasing equipment or training.

10+ years of software development experience building large scale distributed data processing systems/application, Data Engineering or large scale internet systems. Experience of at least 4 years in Developing/ Leading Big Data solution at enterprise scale with at least one end to end implementation Strong experience in programming languages Java/J2EE/Scala. Good experience in Spark/Hadoop/HDFS Architecture, YARN, Confluent Kafka , Hbase, Hive, Impala and NoSQL database. Experience with Batch Processing and AutoSys Job Scheduling and Monitoring Performance analysis, troubleshooting and resolution (this includes familiarity and investigation of Cloudera/Hadoop logs) Work with Cloudera on open issues that would result in cluster configuration changes and then implement as needed Strong experience with databases such as SQL,Hive, Elasticsearch, HBase, etc Knowledge of Hadoop Security, Data Management and Governance Primary Skills: Java/Scala, ETL, Spark, Hadoop, Hive, Impala, Sqoop, HBase, Confluent Kafka, Oracle, Linux, Git, Jenkins CI/CD

About the Role: We are looking for a Senior Engineering Manager with 10+ years of experience and 2 years of people management experience to help scale and modernize Myntra's data platform. The ideal candidate will have a strong background in building scalable data platforms using a combination of open-source technologies and enterprise solutions. The role demands deep technical expertise in data ingestion, processing, serving, and governance, with a strategic mindset to scale the platform 10x to meet the ever-growing data needs across the organization. This is a high-impact role requiring innovation, engineering excellence and system stability, with an opportunity to contribute to OSS projects and build data products leveraging available data assets. Key Responsibilities: Design and scale Myntra's data platform to support growing data needs across analytics, ML, and reporting. Architect and optimize streaming data ingestion pipelines using Debezium, Kafka (Confluent), Databricks Spark and Flink. Lead improvements in data processing and serving layers, leveraging Databricks Spark, Trino, and Superset. Good understanding of open table formats like Delta and Iceberg. Scale data quality frameworks to ensure data accuracy and reliability. Build data lineage tracking solutions for governance, access control, and compliance. Collaborate with engineering, analytics, and business teams to identify opportunities and build / enhance self-serve data platforms. Improve system stability, monitoring, and observability to ensure high availability of the platform. Work with open-source communities and facilitate contributing to OSS projects aligned with Myntras tech stack. Implement cost-efficient, scalable architectures for handling 10B+ daily events in a cloud environment. Management Responsibilities: Technical Guidance : This role will play the engineering lead role for teams within Myntra Data Platform. You will provide technical leadership to a team of excellent data engineers; this requires that you have the technical depth to make complex design decisions and the hands-on ability to lead by example. Execution and Delivery : You will be expected to instill and follow good software development practices and ensure timely delivery of high-quality products. You should be familiar with agile practices as well as be able to adapt these to the needs of the business, with a constant focus on product quality. Team management : You will be responsible for hiring and mentoring your team; helping individuals grow in their careers, having constant dialogue about their aspirations and sharing prompt, clear and actionable feedback about performance. Qualifications: Education: Bachelor's or Masters degree in Computer Science, Information Systems, or a related field. Experience: 10+ years of experience in building large-scale data platforms. 2+ years of people management experience. Expertise in big data architectures using Databricks, Trino, and Debezium. Strong experience with streaming platforms, including Confluent Kafka. Experience in data ingestion, storage, processing, and serving in a cloud-based environment. Experience implementing data quality checks using Great Expectations. Deep understanding of data lineage, metadata management, and governance practices. Strong knowledge of query optimization, cost efficiency, and scaling architectures. Familiarity with OSS contributions and keeping up with industry trends in data engineering. Soft Skills: Strong analytical and problem-solving skills with a pragmatic approach to technical challenges. Excellent communication and collaboration skills to work effectively with cross-functional teams. Ability to lead large-scale projects in a fast-paced, dynamic environment. Passion for continuous learning, open-source collaboration, and building best-in-class data products.

We are looking for a highly skilled Senior Java Developer with strong hands-on experience in cloud platforms, specifically in migrating Java-based applications from AWS to Azure. The ideal candidate will have a deep understanding of Java, Spring Boot, Kubernetes, and both AWS and Azure services, with direct experience in infrastructure, refactoring code for Azure compatibility, and deploying applications in containerized environments. Key Responsibilities: Lead and execute the migration of Java applications from AWS to Azure environments. Analyze source architecture, source code, and AWS service dependencies to identify necessary code and infrastructure remediation. Perform hands-on refactoring and configuration changes to enable application deployment on Azure. Migrate applications and services including EKS to AKS, AWS S3 to Azure Blob Storage, and AWS SDK to Azure SDK. Implement and manage Azure services such as AKS, Azure Functions, Azure App Services, VMs, APIM, and others. Design and update CI/CD pipelines, deployment scripts, and manage Kubernetes environments using Helm charts. Provide application testing support, troubleshooting, and ensure smooth deployment on Azure. Configure and manage related services like Apigee, Kafka connectors, and Azure Blob Storage. Collaborate with DevOps and Infra teams to ensure readiness of IaaS and PaaS environments on Azure. Participate in PostgreSQL data migration (Aurora to Azure PostgreSQL good to have). Required Qualifications & Skills: 8+ years of hands-on experience in Java / Spring Boot application development. Proven experience in cloud migration projects, specifically AWS to Azure. Hands-on experience with AKS, Azure Functions, and Azure DevOps. Experience with AWS and Azure services for application development and deployment. Deep understanding of Azure infrastructure services (IaaS/PaaS). Strong understanding of microservices architecture, containerization, Kubernetes, and Helm. Experience with Apigee, Confluent Kafka, and Spring Boot REST APIs. Proven experience in: AWS to Azure SDK conversion (Must Have) EKS to AKS migration (Must Have) S3 to Azure Blob Storage migration PostgreSQL (Aurora) data migration (Good to Have) Skills : - Senior Java Developer, Java, Spring Boot, Kubernetes, AWS, Azure, AWS to Azure migration, cloud platforms, EKS to AKS migration, AWS S3 to Azure Blob Storage, AWS SDK to Azure SDK, Azure Functions, Azure App Services, Azure VMs, Azure APIM, CI/CD pipelines, deployment scripts, Helm charts, containerized environments, Apigee, Confluent Kafka, Kafka connectors, Azure Blob Storage, IaaS, PaaS, Aurora PostgreSQL, Azure PostgreSQL, application development, microservices, application deployment, cloud migration, Azure infrastructure, Azure DevOps, Spring Boot REST APIs, code remediation, source code analysis, application troubleshooting, application testing support, application refactoring, DevOps collaboration, cloud-native applications, Location : - Hyderabad,Bengaluru,Coimbatore,Pune