Posted:1 day ago|
Platform:
On-site
Full Time
We're looking for a skilled Data Engineer with expertise in AWS Managed Streaming for Apache Kafka (MSK) to design, build, and maintain high-performance data pipelines. You'll work closely with data architects and software engineers to ensure seamless data integration and streaming capabilities using AWS MSK.
- Design, develop, and manage real-time data pipelines using AWS MSK
- Integrate AWS MSK with various data sources and consumers
- Monitor and optimize AWS MSK cluster performance and costs
- Collaborate with DevOps to ensure optimal performance and uptime
- Implement security best practices for data streaming and storage
- Document technical processes and best practices
- Work with AWS services like S3, Glue, and Lambda for data processing and integration
- Bachelor’s degree in computer science, Engineering, or a related field
- 3-5 years of experience working with AWS MSK or Apache Kafka in a production environment
- Strong understanding of distributed systems, real-time data processing, and cloud-based data streaming
- Proficiency in programming languages such as Python
- Experience with AWS services like S3, Glue, and Lambda
- Excellent problem-solving and debugging skills
- Experience with containerization technologies like Docker and Kubernetes
- Familiarity with other messaging systems like RabbitMQ or Apache Pulsar
- Experience with data serialization formats like Avro, Protobuf, or JSON
- Knowledge of Snowflake or other cloud-based data warehousing solutions
Interested candidate can apply or share the updated resume on jahanavi.kaudiki@bpmlinks.com
BPMLinks
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
Hyderabad
16.0 - 18.0 Lacs P.A.
Hyderabad
16.0 - 18.0 Lacs P.A.
Hyderabad
16.0 - 18.0 Lacs P.A.
Hyderabad
19.2 - 35.0 Lacs P.A.
Mumbai
5.0 - 8.0 Lacs P.A.
Kolkata
6.0 - 10.0 Lacs P.A.
Bengaluru
30.0 - 35.0 Lacs P.A.
Bengaluru
30.0 - 35.0 Lacs P.A.
Bengaluru
30.0 - 35.0 Lacs P.A.
Bengaluru
20.0 - 25.0 Lacs P.A.
