459 Apache Flink Jobs

We are seeking a highly motivated and skilled Data Engineer with strong background in data architecture, ETL processes, and data warehousing. As a Data Engineer, you will play a critical role in designing, developing, and maintaining our data pipelines, ensuring the availability of high-quality and reliable data for analytics and reporting. Responsibilities: Design, implement, and maintain scalable ETL pipelines to extract, transform, and load data from various sources into our data warehouse. Develop efficient and robust data integration processes that ensure data accuracy, consistency, and reliability. Perform data profiling and analysis to identify data quality issues and implement correc...

AI Platform Eng :• Strong Python skills (automation, ML pipelines, APIs). • Hands-on experience with: o Kubernetes, Docker o GPU workload orchestration o Terraform/Pulumi/IaC o Vector databases (Weaviate, FAISS, Pinecone) o Model serving frameworks (Triton, TorchServe, KServe) o Streaming & batch processing (Kafka, Spark, Flink) • Experience with LLM frameworks, multimodal models, and embeddings. • Strong grasp of DevOps + MLOps + LLMOps concepts. • Knowledge of: o Media codecs, streaming formats, FFmpeg o Multimodal RAG o Video AI and ASR pipelines o AI governance and responsible AI

We are seeking a highly skilled and experienced Senior Data Engineer (Azure+DBT) with strong expertise in Streaming Data and Big Data Technologies . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Strong expertise in: Azure Cloud Services o Databricks (including workflows and notebooks) PySpark and Python o SQL (complex queries, performance tuning) Azure Data Factory (ADF) DBT (Data Build Tool) o ServiceNow (incident and change management) Experience in reverse engineering and legacy system modernization is a plus. Excellent problem-solving and communication skills.

Monday to Friday (WFO) Timings : 9 am to 6 pm Desired Skills Expertise: Strong experience and mathematical understanding in one or more of Natural Language Understanding, Computer Vision, Machine Learning, and Optimization Proven track record in effectively building and deploying ML systems using frameworks such as PyTorch, TensorFlow, Keras, scikit-learn, etc. Expertise in modular, typed, and object-oriented Python programming Proficiency with core data science languages (such as Python, R, Scala), and familiarity & flexibility with data systems (e.g., SQL, NoSQL, knowledge graphs) Experience with financial data analysis, time series forecasting, and risk modeling Knowledge of financial reg...

Job Summary: We are seeking a highly skilled Lead Data Engineer to join our dynamic team. The ideal candidate will possess a strong background in data engineering, with a focus on designing and implementing robust data solutions. This role requires expertise in AWS, PySpark, and Apache Flink for real-time streaming applications. The Lead Data Engineer will be responsible for architecting data solutions that meet business needs while ensuring scalability, reliability, and performance. Responsibilities: Design and implement data pipelines and architectures to support real-time data processing and analytics. Collaborate with cross-functional teams to gather requirements and translate them into ...

We are seeking a highly skilled and experienced Senior Data Engineer (Azure+DBT) with strong expertise in Streaming Data and Big Data Technologies . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Strong expertise in: Azure Cloud Services o Databricks (including workflows and notebooks) PySpark and Python o SQL (complex queries, performance tuning) Azure Data Factory (ADF) DBT (Data Build Tool) o ServiceNow (incident and change management) Experience in reverse engineering and legacy system modernization is a plus. Excellent problem-solving and communication skills.

SUMMARY Working knowledge on big data technologies should be more than 6. Increase the no. of years for Sr profiles Excellent working knowledge on SQL Proficient with spark and any one or both programming language e.g. Scala and/or Python Demonstrated working knowledge with kafka, Airflow, DBT, Flink, Apache Iceberg, Datadog Experience with snowflake will be a big positive Experience with CI/CD framework implementation in conjunction with any popular code repository like Github

SUMMARY Working knowledge on big data technologies should be more than 6. Increase the no. of years for Sr profiles Excellent working knowledge on SQL Proficient with spark and any one or both programming language e.g. Scala and/or Python Demonstrated working knowledge with kafka, Airflow, DBT, Flink, Apache Iceberg, Datadog Experience with snowflake will be a big positive Experience with CI/CD framework implementation in conjunction with any popular code repository like Github

Head of Engineering, AI Safety Services Enable responsible AI innovation at the speed of progress. The impact youll make Accelerate responsible innovation by providing world-class AI safety services that allow our customers to quickly deploy new models and applications without compromising on safety. Influence the industry by establishing best practices, scalable tools, and clear benchmarks that set the standard for AI safety. Drive customer success through tools and platforms that integrate seamlessly into customer workflows, enabling safe and rapid innovation. What youll do Lead and inspire your team (AI engineers, platform engineers, and a product manager): Set clear goals, mentor team me...

Educational Requirements Bachelor of Engineering Service Line Information Systems Responsibilities Deploy, configure, and manage Kafka clusters across development, staging, and production environments. Ensure platform reliability, scalability, and performance through proactive monitoring, tuning, and capacity planning. Manage and maintain Kafka components such as Kafka Connect, Schema Registry, and REST Proxy. Implement platform-level security including access controls, TLS encryption, and audit logging. Monitor platform health using observability tools and respond to alerts and incidents. Collaborate with application and data engineering teams to support integration and usage of Kafka. Main...

We are seeking a highly skilled and experienced Senior Data Engineer (Azure+DBT) with strong expertise in Streaming Data and Big Data Technologies . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Strong expertise in: Azure Cloud Services o Databricks (including workflows and notebooks) PySpark and Python o SQL (complex queries, performance tuning) Azure Data Factory (ADF) DBT (Data Build Tool) o ServiceNow (incident and change management) Experience in reverse engineering and legacy system modernization is a plus. Excellent problem-solving and communication skills.

We are seeking a highly skilled and experienced Senior Data Engineer with strong expertise in Streaming Data and Big Data Technologies , AWS & Scala Mandatory . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Key Responsibilities: Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data . Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway . Work extensively with streaming platforms like Kafka, Flink, Spark Streaming . Develop and optimize data ingestion workflows using Apache ...

We have developed API gateway aggregators using frameworks like Hystrix and spring-cloud-gateway for circuit breaking and parallel processing. Our serving microservices handle more than 15K RPS on normal days and during saledays this can go to 30K RPS. Being a consumer app, these systems have SLAs of ~10ms Our distributed scheduler tracks more than 50 million shipments periodically fromdifferent partners and does async processing involving RDBMS. We use an in-house video streaming platform to support a wide variety of devices and networks. What Youll Do Design and implement scalable and fault-tolerant data pipelines (batch and streaming) using frameworks like Apache Spark , Flink , and Kafka...

About The Role Job Title :Industry & Function AI Data Engineer + S&C GN Management Level :09 - Consultant Location :Primary - Bengaluru, Secondary - Gurugram Must-Have Skills :Data Engineering expertise, Cloud platforms:AWS, Azure, GCP, Proficiency in Python, SQL, PySpark and ETL frameworks Good-to-Have Skills :LLM Architecture, Containerization tools:Docker, Kubernetes, Real-time data processing tools:Kafka, Flink, Certifications like AWS Certified Data Analytics Specialty, Google Professional Data Engineer,Snowflake,DBT,etc. Job Summary : As a Data Engineer, you will play a critical role in designing, implementing, and optimizing data infrastructure to power analytics, machine learning, an...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Apache Kafka, Apache Spark Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, facilitating discussions to address challenges, and guiding the team in implementing effective solutions. ...

What you'll do You are a capable, self-motivated data engineer. You will be a member of the data engineering team working on tasks ranging from design, development, operations of data warehouse, data platform and data pipelines. We enjoy working closely with each other utilizing an Agile development methodology. Priorities can change quickly, but our team members are able to stay ahead to delight every one of our customers whether they are internal or external to Viasat. The day-to-day Develop ETL processes delivering high-quality code, following coding best practices. Create and implement complex analytical data models that support reporting and analytics business requirements. Support and ...

Role & responsibilities Bachelors or masters degree in computer science, Engineering, Mathematics, or related field. 5+ years’ experience in Python development, with a strong emphasis on data engineering. Proven experience with AWS cloud services for data engineering and analytics. Expertise in designing algorithms and system architectures for high-performance data processing. Strong hands-on experience with ETL frameworks, data warehousing, and distributed systems (e.g., Spark, Hadoop). Deep understanding of database technologies (SQL, NoSQL) and data modeling. Experience with logging, monitoring, and dashboarding tools (e.g., CloudWatch, Grafana, DataDog). Experience with big data tools an...

Why this job matters ? The Network Operational Intelligence Engineering function is essential to our transformation, it is a central team within Network Architecture & Engineering, responsible for the delivery of product roadmaps, technical vision and quality across Fulfilment and Assurance that underpin our network and perimeter capabilities and products. Reporting to the Senior Engineering Manager you will serve as a Senior Software Engineer, ensuring that our systems and tools realise business value. Your role is responsible for technical design and delivery of solutions across the network tools and applications landscape from Planning to analytics driven AIOps. All built to industry lead...

Java Developer 4+ Years Immediate Joiner Remote Opportunity Skills Required: Java Development - 4 + years Big Data Technologies Apache Storm Apache Flink Spark Streaming Kafka NoSQL Database ( Cassandra, Elasticsearch, MongoDB) AWS, GCP or Azure Docker

We are seeking a highly skilled and experienced Senior Data Engineer (Azure+DBT) with strong expertise in Streaming Data and Big Data Technologies . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Strong expertise in: Azure Cloud Services o Databricks (including workflows and notebooks) PySpark and Python o SQL (complex queries, performance tuning) Azure Data Factory (ADF) DBT (Data Build Tool) o ServiceNow (incident and change management) Experience in reverse engineering and legacy system modernization is a plus. Excellent problem-solving and communication skills.

We are seeking a highly skilled and experienced Senior Data Engineer with strong expertise in Streaming Data and Big Data Technologies , AWS & Scala Mandatory . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Key Responsibilities: Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data . Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway . Work extensively with streaming platforms like Kafka, Flink, Spark Streaming . Develop and optimize data ingestion workflows using Apache ...

We are seeking a highly skilled and experienced Senior Data Engineer with strong expertise in Streaming Data and Big Data Technologies , AWS & Scala Mandatory . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Key Responsibilities: Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data . Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway . Work extensively with streaming platforms like Kafka, Flink, Spark Streaming . Develop and optimize data ingestion workflows using Apache ...

We are seeking a highly skilled and experienced Senior Data Engineer with strong expertise in Streaming Data and Big Data Technologies , AWS & Scala Mandatory . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks. Key Responsibilities: Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data . Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway . Work extensively with streaming platforms like Kafka, Flink, Spark Streaming . Develop and optimize data ingestion workflows using Apache ...

Data Platform - Design and build an in house data warehouse for near real time data sharing multiple products, including partnerships, multi-tenancy and RBAC Preferably someone with experience using these technologies like: Flink, Airflow, Hudi, Delta

Lead Data Engineer Experience Range: 10 - 20 years Location: Bengaluru, India We are looking for a Data Engineer to architect and guide the development of scalable data solutions across the enterprise. Youll be instrumental in shaping our data strategy, driving best practices, and mentoring a team of engineers while partnering with cross-functional stakeholders. Bonus: Experience in Ad Tech, particularly Linear or Addressable Advertising, is a strong plus. Preferred: Experience supporting Business Intelligence (BI) data platforms, dashboards, and reporting environments is highly valuable. Responsibilities and Duties of the Role: Champion core engineering principles including pipeline reliabi...