8 - 12 years

35 - 40 Lacs

Posted:2 weeks ago| Platform: Naukri logo

Apply

Work Mode

Hybrid

Job Type

Full Time

Job Description

Key Responsibilities:

  • Develop and maintain scalable data pipelines in Databricks to support the migration

of data from Oracle-based Data Warehouse (DWH) and Operational Data Store

(ODS) systems.

  • Analyze and understand existing Oracle schemas, stored procedures, and data

transformation logic.

  • Translate PL/SQL logic into PySpark/Databricks SQL.
  • Develop and maintain Delta Lake-based datasets with appropriate partitioning,

indexing, and optimization strategies.

  • Perform data validation and reconciliation post-migration, including row count,

data integrity, and accuracy checks.

  • Build reusable and modular data ingestion and transformation frameworks using

Databricks Notebooks, Jobs, and Workflows.

  • Collaborate with DevOps teams for CI/CD pipeline integration and efficient

deployment.

  • Optimize performance of existing pipelines and queries in Databricks.
  • Document architecture, transformation logic, and data lineage clearly for

operational transparency.

  • Utilize some ETL codes from Pentaho and TIBCO, Perl to support legacy ETL

understanding and potential migration to PySpark/Databricks SQL

Mandatory Skills & Experience:

  • 6 to 8 years of experience in data engineering, with strong experience in Oracle

DWH/ODS environments.

  • Minimum 3+ years hands-on experience in Databricks (including PySpark, SQL,

Delta Lake, Workflows).

  • Strong understanding of Lakehouse architecture, cloud data platforms, and big

data processing.

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Mumba Technologies
Mumba Technologies

Information Technology

San Francisco

RecommendedJobs for You

Chennai, Bengaluru, PAN India