Jobs
Interviews
Sprouts.ai logo

Sprouts.ai - Data Engineer

6 - 10 years

0 Lacs

chandigarh chandigarh india

Posted:1 day ago| Platform: Linkedin logo

Apply

Skills Required

data design processing power workflow orchestration spark pyspark apache governance support analytics ai etl reliability integrity profiling monitoring database migration ml engineering airflow sql aws gcp azure devops kafka marketing crm elasticsearch postgresql cutting

Work Mode

On-site

Job Type

Full Time

Job Description

Job Summary

We are looking for an experienced Data Engineer to design, build, and maintain scalable data pipelines and processing systems that power our modern data platform. The ideal candidate will have hands-on expertise in distributed data processing, data lake/lakehouse systems, and workflow orchestration using modern tools such as Spark, PySpark, Apache Iceberg, Apache Hudi, and Apache Airflow.This role will be central in enabling reliable data ingestion, transformation, and governance-ready pipelines to support analytics, AI, and operational use cases across the organization.

Key Responsibilities

  • Build and maintain scalable ETL/ELT pipelines for batch and streaming data using PySpark and Airflow.
  • Develop and optimize data ingestion workflows from multiple structured and unstructured data sources.
  • Implement data lake and lakehouse solutions using Spark with Apache Iceberg, Hudi, or Delta Lake.
  • Ensure data quality, reliability, and integrity through validation, profiling, and monitoring frameworks and automations using AI.
  • Support database migration efforts and cross-system data reconciliation.
  • Collaborate with data scientists, analysts, and platform engineers to enable analytics and ML use cases.
  • Contribute to data governance practices, including schema evolution, versioned data catalogs (e.g., Nessie), and metadata management.
  • Troubleshoot and optimize data jobs for performance and cost efficiency.

Required Skills & Qualifications

  • 6- 10 years of experience in data engineering with strong exposure to big data platforms.
  • Hands-on experience with PySpark for distributed data processing.
  • Solid understanding of modern table formats (Apache Iceberg, Hudi, Delta) and versioned data catalogs.
  • Experience with Apache Airflow (or equivalent) for workflow orchestration.
  • Strong SQL skills with experience in data modeling and performance tuning.
  • Exposure to cloud data platforms (AWS, GCP, Azure) and managed services.
  • Experience with handling large-scale datasets (TBs-100s of TBs).
  • Understanding of DevOps practices for CI/CD of data pipelines.

Nice To Have

  • Experience in streaming data frameworks (Kafka, Flink, Spark Streaming).
  • Knowledge of Sales, Marketing, or CRM domains (Accounts, Contacts data).
  • Exposure to Elasticsearch, PostgreSQL, or Vector databases.

Why Join Us

  • Work on cutting-edge open-source data technologies at scale
  • Grow your expertise in lakehouse, streaming, and AI-ready data architectures.
  • Contribute to building a governance-ready, modern data platform from the ground up using AI
  • Collaborate in a fast-paced, innovation-driven culture.
(ref:hirist.tech)

More Jobs at Sprouts.ai

AI Intern(AI Agent Developer Intern)

Bengaluru, Karnataka, India

Experience: Not specified

|

Salary: Not disclosed

Sprouts.ai - Artificial Intelligence Engineer - Python Programming

Chandigarh, Chandigarh, India

3.0 - 3.0 yrs
|

Salary: Not disclosed

Artificial Intelligence Engineer

chandigarh

3.0 - 7.0 yrs
|

Salary: Not disclosed

Sprouts.ai - Senior Data Architect - ETL/PySpark

chandigarh, chandigarh, india

10.0 - 10.0 yrs
|

Salary: Not disclosed

Sprouts.ai - Data Engineer

chandigarh, chandigarh, india

6.0 - 10.0 yrs
|

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Sprouts.ai logo
Sprouts.ai

RecommendedJobs for You

Sprouts.ai logo

Sprouts.ai - Data Engineer

Sprouts.ai

chandigarh, chandigarh, india

Sprouts.ai logo

Sprouts.ai - Data Engineer

Sprouts.ai

chandigarh, chandigarh, india