Databricks Developer

3 - 10 years

0 Lacs

Posted:2 days ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Contractual

Job Description

Job Title:

Location:

Experience:

Employment Type:

Notice Period:


About the Role:

Databricks Developer


Key Responsibilities:

  • Design and develop scalable data pipelines using

    Databricks

    ,

    Apache Spark

    , and

    Delta Lake

    .
  • Implement

    ETL/ELT

    workflows for processing large volumes of structured and unstructured data.
  • Collaborate with data scientists, analysts, and stakeholders to define data models and deliver business insights.
  • Optimize queries and performance on big data platforms.
  • Integrate data from various sources including

    Azure Data Lake

    ,

    SQL

    , and

    NoSQL

    systems.
  • Build reusable code and libraries for future use in the data pipeline framework.
  • Maintain and enhance data governance, quality, and security standards.
  • Troubleshoot and resolve technical issues and support production pipelines.


Required Skills & Experience:

  • 3 to 10 years of experience in

    data engineering

    or

    big data development

    .
  • Strong hands-on experience in

    Databricks

    and

    Apache Spark

    (PySpark preferred).
  • Proficient in

    Python

    and/or

    Scala

    for data processing.
  • Solid understanding of

    data warehousing concepts

    ,

    data lakes

    , and

    data lakehouse architecture

    .
  • Experience working with

    Azure Cloud

    services (ADF, ADLS, Synapse) or

    AWS Glue/EMR

    is a plus.
  • Strong experience in

    SQL

    and

    performance tuning

    of queries.
  • Experience in CI/CD integration and version control (e.g., Git, Azure DevOps).
  • Good understanding of

    Delta Lake

    ,

    MLFlow

    , and

    Notebooks

    .


Nice to Have:

  • Databricks certification (Developer or Data Engineer Associate/Professional).
  • Knowledge of

    streaming frameworks

    like Kafka or Structured Streaming.
  • Exposure to

    Airflow

    ,

    Azure Data Factory

    , or similar orchestration tools.

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

RecommendedJobs for You

Pune, Maharashtra, India