Jobs
Interviews
KPI Partners logo

Associate Director - Databricks

14 years

0 Lacs

Hyderabad Telangana India

Posted:4 days ago| Platform: Linkedin logo

Apply

Skills Required

databricks technology data drive cutting service collaboration integrity engineering leadership management communication costing staffing architecture strategy governance etl orchestration optimization azure integration design spark pyspark python processing code automation sql querying writing analytics unity reporting power tableau looker compensation

Work Mode

On-site

Job Type

Full Time

Job Description

About the Company:



About the Role:



Responsibilities:



  • 14+ years in data engineering, including 3+ years in leadership/director-level roles
  • Proven experience with Databricks, Delta Lake, and cloud data architecture
  • Strong track record of project delivery, team management, and client success
  • Excellent communication and leadership skills in fast-paced environments
  • Oversee and deliver multiple Databricks-based data engineering projects
  • Manage project budgets, costing, staffing, and client expectations
  • Lead and mentor engineering teams across engagements
  • Collaborate with clients on architecture, strategy, governance, and reporting
  • Ensure high-quality delivery aligned with best practices and business value



Qualifications:



  • Databricks – Full-platform expertise for scalable data solutions: Strong hands-on experience with Databricks for building and managing ETL pipelines, Delta Lake, notebooks, and job orchestration. Skilled in cluster optimization, workspace management, and integrating Databricks with Azure services.
  • Cloud – Azure (preferred), or similar cloud environments: Deep hands-on experience with Azure data services such as Azure Data Lake, Azure Synapse, Azure Data Factory, and integration with Databricks. Ability to design and deploy cloud-native data architectures.
  • Data Engineering – Spark, PySpark, and Python for scalable data processing: Strong background in building scalable, high-performance ETL/ELT pipelines using Spark and PySpark. Ability to write optimized, production-grade Python code for data transformation, orchestration, and automation in distributed environments.
  • Data Warehousing & SQL – Designing and querying enterprise data models: Proven experience in designing data warehouses or lakehouses, dimensional modeling, and writing complex SQL queries for analytics and reporting.
  • Governance – Implementation and management of Unity Catalog: Hands-on experience implementing Unity Catalog for managing metadata, access control, and data lineage in Databricks.
  • Reporting Tools – Power BI or similar (Tableau, Looker, etc.): Ability to work with business teams to build insightful dashboards and visualizations using Power BI.



Required Skills:



  • Strong hands-on experience with Databricks
  • Deep hands-on experience with Azure data services
  • Strong background in building scalable ETL/ELT pipelines
  • Proven experience in designing data warehouses or lakehouses
  • Hands-on experience implementing Unity Catalog
  • Ability to work with business teams to build dashboards



Preferred Skills:



  • Experience with additional cloud environments
  • Familiarity with other reporting tools



Pay range and compensation package:



Equal Opportunity Statement:

More Jobs at KPI Partners

Oracle Fusion Techno Functional Consultant (Lead)

Bengaluru

10 - 19 yrs
|

INR 30 - 40 Lacs

Senior Data Architect

Hyderabad, Pune, Bengaluru

8 - 10 yrs
|

INR 30 - 45 Lacs

Junior Data Modeller

Hyderabad, Pune, Bengaluru

2.0 - 6.0 yrs
|

INR 10 - 15 Lacs

Data Scientist

Pune

5.0 - 10.0 yrs
|

INR 8 - 12 Lacs

Power BI Developer

Hyderabad, Pune, Bengaluru

3.0 - 7.0 yrs
|

INR 7 - 11 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
KPI Partners logo
KPI Partners

Business Consulting and Services

Newark CA

RecommendedJobs for You

KPI Partners logo

Associate Director - Databricks

KPI Partners

Hyderabad, Telangana, India

KPI Partners logo

Associate Director - Databricks

KPI Partners

Hyderabad, Telangana, India