Posted:3 weeks ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Major skillset:

GCP

,

Pyspark

,

SQL

,

Python

,

Cloud Architecture

,

ETL

,

Automation

  • 4+ years of Experience in Data Engineering, Management with strong focus on Spark for building production ready Data Pipelines.
  • Experienced with analyzing large data sets from multiple data sources and build automated testing and validations.
  • Knowledge of Hadoop eco-system and components like HDFS, Spark, Hive, Sqoop
  • Strong Python experience
  • Hands on SQL, HQL to write optimized queries
  • Strong hands-on experience with GCP Big Query, Data Proc, Airflow DAG, Dataflow, GCS, Pub/sub, Secret Manager, Cloud Functions, Beams.
  • Ability to work in fast passed collaborative environment work with various stakeholders to define strategic optimization initiatives.
  • Deep understanding of distributed computing, memory turning and spark optimization.
  • Familiar with CI/CD workflows, Git.
  • Experience in designing modular, automated, and secure ETL frameworks.

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
EXL logo
EXL

Business Process Management / Analytics

New York

RecommendedJobs for You

Chennai, Tamil Nadu, India