Data Engineer

3 years

0 Lacs

Posted:2 weeks ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Sia is a next-generation, global management consulting group. Founded in 1999, we were born digital. Today our strategy and management capabilities are augmented by data science, enhanced by creativity and driven by responsibility. We’re optimists for change and we help clients initiate, navigate and benefit from transformation. We believe optimism is a force multiplier, helping clients to mitigate downside and maximize opportunity. With expertise across a broad range of sectors and services, our 3,000 consultants serve clients worldwide from 48 locations in 19 countries. Our expertise delivers results. Our optimism transforms outcomes.

Strategy & Management Consulting

Sia’s Strategy & Management Consulting global footprint and expertise in more than 40 sectors and services allow us to enhance our clients' businesses worldwide. We guide their projects and initiatives in strategy, business transformation, IT & digital strategy.

Financial Services Business Unit

We are looking for a talented and motivated Data Engineer with strong experience in PySpark and Python to design, build, and maintain scalable data pipelines and infrastructure. The successful candidate will support the delivery of data-driven insights by transforming raw data into clean, curated datasets for analytics and machine learning applications. Java experience is a plus and will be useful in hybrid environments.

Key Responsibilities:

  • Develop and optimize robust, scalable data pipelines using PySpark and Python

  • Clean, transform, and enrich large-scale datasets from structured and unstructured sources

  • Implement data ingestion, ETL/ELT workflows, and integration strategies across cloud and on-prem platforms

  • Collaborate with data scientists, analysts, and business stakeholders to understand data requirements

  • Ensure data quality, integrity, and lineage throughout the data lifecycle

  • Participate in performance tuning, troubleshooting, and production support

  • Contribute to best practices in data engineering, including code versioning, testing, and CI/CD

Qualifications

Required Qualifications:

  • Bachelor’s degree in Computer Science, Data Engineering, or related field

  • 3+ years of experience in data engineering with a focus on PySpark and Python

  • Strong hands-on experience with distributed data processing frameworks (e.g., Apache Spark)

  • Solid understanding of SQL, data modeling, and relational databases

  • Experience working with cloud platforms (e.g., AWS, Azure, GCP)

  • Familiarity with workflow orchestration tools (e.g., Airflow, Azure Data Factory)

Preferred Qualifications:

  • Java experience for supporting hybrid data platforms and legacy integrations

  • Exposure to data lakes, delta lakes, and modern data architectures

  • Knowledge of containerization (Docker), Kubernetes, and CI/CD pipelines

  • Familiarity with data governance, security, and compliance frameworks

Additional Information

We believe in supporting our team professionally and personally.


OUR COMMITMENT TO DIVERSITY

At Sia, we believe in fostering a diverse, equitable and inclusive culture where our employees and partners are valued and thrive in a sense of belonging. We are committed to recruiting and developing a diverse network of employees and investing in their growth by providing unique opportunities for professional and cultural immersion. Our commitment toward inclusion motivates dynamic collaboration with our clients, building trust by creating an inclusive environment of curiosity and learning which affects lasting impact.

website

Sia is an equal opportunity employer. All aspects of employment, including hiring, promotion, remuneration, or discipline, are based solely on performance, competence, conduct, or business needs.

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

Chennai, Tamil Nadu, India