Remote Data Enigneer

Go Digital Technology Consulting

8 - 12 years

10 - 15 Lacs

Remote India

Posted:22 hours ago| Platform: Foundit logo

Apply

Skills Required

etl architecture PySpark/Spark SQL CI/CD pipeline

Work Mode

Remote

Job Type

Full Time

Job Description

Data Engineer

Responsibilities

Collaborate with business stakeholders and technical teams to gather requirements and translate them into scalable data solutions.
Design, build, and maintain robust, secure, and high-performance
ETL/ELT data pipelines
.
Ensure adherence to data quality, governance, and compliance standards.
Work with architects and engineering leads to follow best practices and optimize for performance.
Communicate insights and technical decisions effectively with cross-functional stakeholders.
Participate in Agile ceremonies and deliver iterative improvements in data infrastructure.

Required Qualifications

Proven hands-on experience with
AWS data engineering services
, including
AWS Glue, Athena, EMR, Redshift, Lambda, Kinesis, S3, Step Functions, and CloudWatch
.
Expertise in building data pipelines using
PySpark/Spark SQL
.
Strong
SQL and Python skills
, with experience in large-scale data transformation and ingestion.
Knowledge of Spark internals (joins, partitioning, memory management) and performance tuning via Spark UI.
Experience with
Git, CI/CD pipelines
, and working in Agile environments.
Understanding of partitioning, schema design, and query performance optimization.

Desired Qualifications

Experience with workflow orchestration tools like
Apache Airflow
or AWS Step Functions.
Exposure to streaming platforms such as
Kafka, Kinesis, etc
.
Working knowledge of
AWS SDKs
(e.g., Boto3) for automation and integration.
Familiarity with modern ETL/ELT patterns and data modeling techniques.
Basic proficiency in shell scripting for automation and support tasks.

More Jobs at Go Digital Technology Consulting

Associate Data Scientist

Mumbai

2.0 - 5.0 yrs

INR 6 - 10 Lacs

Associate Data Test Engineer

Mumbai

1.0 - 4.0 yrs

INR 2 - 6 Lacs

Associate Data Engineer

Mumbai

Experience: Not specified

INR 2 - 3 Lacs

Data Scientist

Pune, Mumbai (All Areas)

3.0 - 5.0 yrs

INR 4 - 9 Lacs

Senior Full Stack Developer

Mumbai, Pune

3.0 - 8.0 yrs

INR 9 - 19 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.