JOB SPECIFIC DUTIES & RESPONSIBILITIES ● Design, develop, and optimize data pipelines for processing large volumes of structured and unstructured data using Apache Spark and AWS technologies. ● Develop APIs and microservices using container frameworks like OpenShift, Docker, and Kubernetes. ● Work with diverse data formats such as PARQUET, ORC, and CSV. ● Leverage data streaming and messaging platforms including Apache Kafka for real-time data processing. ● Build scalable solutions on AWS leveraging services like ElasticSearch/OpenSearch. ● Implement big data querying using tools such as Presto or Trino. ● Collaborate with platform and vendor deployment teams to ensure seamless integration of data sources. ● Work closely with data architects to provision and support sustainable infrastructure patterns. ● Contribute to data access strategies and data modeling in alignment with architectural principles. ● Communicate technical concepts effectively to non-technical stakeholders and vice versa. Show more Show less

More Jobs at Mitra AI

Senior Data Engineer

Gurugram, Haryana, India

Experience: Not specified

Salary: Not disclosed

SAS Solution Designer

India

15.0 - 15.0 yrs

Salary: Not disclosed

Rocket UniData/ UniVerse Engineer

India

2.0 - 2.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

Mitra AI

3 Jobs

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

Senior Data Engineer