Home
Jobs

Data Engineer

5 - 10 years

5 - 10 Lacs

Posted:1 day ago| Platform: Foundit logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

MSCI Services

Responsibilities:

  • Design, develop, and maintain

    data pipelines and ETL/ELT processes

    using PySpark/Databricks/BigQuery/Airflow/Composer.
  • Optimize performance for large datasets through techniques such as

    partitioning, indexing, and Spark optimization

    .
  • Collaborate with cross-functional teams to resolve technical issues and gather requirements.
  • Ensure

    data quality and integrity

    through data validation and cleansing processes.
  • Analyze existing

    SQL queries, functions, and stored procedures

    for performance improvements.
  • Develop

    database routines

    like procedures, functions, and views/MV.
  • Participate in

    data migration projects

    and understand technologies like Delta Lake/Warehouse/BigQuery.
  • Debug and solve complex problems in data pipelines and processes.

Qualifications:

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Strong understanding of

    distributed data processing platforms

    like Databricks and BigQuery.
  • Proficiency in

    Python, PySpark, and SQL

    programming languages.
  • Experience with

    performance optimization for large datasets

    .
  • Strong

    debugging and problem-solving skills

    .
  • Fundamental knowledge of

    cloud services

    , preferably Azure or GCP.
  • Excellent communication and teamwork skills.

Nice to Have:

  • Experience in

    data migration projects

    .
  • Understanding of technologies like

    Delta Lake/Warehouse

    .

Mock Interview

Practice Video Interview with JobPe AI

Start Performance Optimization Interview Now
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

RecommendedJobs for You

Kolkata, Mumbai, New Delhi, Hyderabad, Pune, Chennai, Bengaluru

Kolkata, Mumbai, New Delhi, Hyderabad, Pune, Chennai, Bengaluru