Senior Data Engineer

Job Title: Senior Data Engineer

Location: Noida | Gurgaon | Hyderabad | Bangalore (Hybrid – 2 days/month in office)

Experience: 8+ years

Employment Type: Full-time | Hybrid

Skills: PySpark | Databricks | ADF | Big Data | Hadoop | Hive

About the Role:

Senior Data Engineer

Key Responsibilities:

• Design, build, and maintain scalable and efficient data pipelines using

  PySpark

  and

  Databricks

• Develop ETL workflows and orchestrate data pipelines using

  Azure Data Factory (ADF)

• Work with structured and unstructured data across the

  Hadoop ecosystem

  (HDFS, Hive, Spark)
• Optimize data processing and storage for high performance and reliability
• Collaborate with data scientists, analysts, and business teams to ensure data availability and quality
• Implement data governance, data quality, and security best practices
• Monitor and troubleshoot production data pipelines and jobs
• Document technical solutions and standard operating procedures

Required Skills & Qualifications:

• 8+ years of hands-on experience in data engineering and big data technologies
• Proficiency in

  PySpark

  ,

  Databricks

  , and

  Azure Data Factory (ADF)

• Strong experience with

  Big Data

  technologies:

  Hadoop

  ,

  Hive

  ,

  Spark

  ,

  HDFS

• Solid understanding of data modeling, warehousing concepts, and performance tuning
• Familiarity with cloud data platforms, preferably

  Azure

• Strong SQL skills and experience in managing large-scale data systems
• Excellent problem-solving, debugging, and communication skills

Nice to Have:

• Experience with

  Delta Lake

  ,

  Apache Airflow

  , or

  Kafka

• Exposure to

  CI/CD for data pipelines

• Knowledge of

  data lake architectures

  and

  data mesh

  principles