Aws Data Engineer

Estrel Ai

5 - 8 years

18 - 22 Lacs

Pune Gurugram Bengaluru

Posted:1 day ago| Platform:

Apply

Skills Required

Pyspark Aws Lambda AWS CDK Aws Glue Python Eventbridge DynamoDB

Work Mode

Hybrid

Job Type

Full Time

Job Description

Job Title:

aditya.rao@estrel.ai

Updated Resume
Current CTC Expected CTC Notice Period / Availability (Looking only for Immediate Joiner) LinkedIn Profile

Job Overview:

Data Engineer

Key Responsibilities:

Design and implement scalable and robust data pipelines using
Python
and frameworks like
Pytest
and
PySpark
.
Work extensively with
AWS cloud services
such as
AWS CDK
,
S3
,
Lambda
,
DynamoDB
,
EventBridge
,
Kinesis
,
CloudWatch
,
AWS Glue
, and
Lake Formation
.
Implement data governance and data security protocols, including handling of
sensitive data
and
encryption practices
.
Develop microservices and APIs using
FastAPI
,
GraphQL
, and
Pydantic
.
Design and maintain solutions for
real-time streaming
and
event-driven architecture
.
Follow
SDLC best practices
, ensuring code quality through
TDD (Test-Driven Development)
and robust documentation.
Use
GitLab
for version control, and manage deployment pipelines with
CI/CD
.
Collaborate with cross-functional teams to align data architecture and services with business objectives.

Required Skills:

Proficiency in
Python v3.6+
Experience with Python frameworks:
Pytest
,
PySpark
Strong knowledge of
AWS tools & services
Experience with
FastAPI
,
GraphQL
, and
Pydantic
Expertise in
real-time data processing
,
eventing
, and
microservices
Good understanding of
Data Governance
,
Security
, and
LakeFormation
Familiarity with
GitLab
,
CI/CD pipelines
, and
TDD
Strong problem-solving and analytical skills
Excellent communication and team collaboration skills

Preferred Qualifications:

AWS Certification(s) (e.g., AWS Certified Data Analytics Specialty, Solutions Architect)
Experience with
DataZone
,
data cataloging
, or
metadata management tools
Experience in high-compliance industries (e.g., finance, healthcare) is a plus

More Jobs at Estrel Ai

Azure Data Engineer

Pune, Gurugram, Bengaluru

5.0 - 7.0 yrs

INR 12 - 18 Lacs

Aws Data Engineer

Pune, Gurugram, Bengaluru

5.0 - 8.0 yrs

INR 18 - 22 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.