Lead Data Engineer (Databricks Expert – with MS BI Stack)

10 years

0 Lacs

Posted:1 week ago| Platform: Linkedin logo

Apply

Work Mode

Remote

Job Type

Full Time

Job Description


Lead Data Engineer (Databricks Expert – with MS BI Stack Preferred)

10+ Years (with 5+ Years in Databricks) – Immediate Joiners Preferred

Bengaluru (Remote)

Full-Time – Remote


Job Description:

Lead Data Engineer with deep hands-on expertise in Databricks to lead the development of scalable data processing pipelines, real-time analytics workflows, and enterprise-level data lakehouses


Databricks expertise is mandatory, experience with Microsoft BI Stack (SSIS, SSRS, SSAS, SSMS)


Key Responsibilities:

design and implementation of scalable, high-performance data pipelines using Databricks (Delta Lake, PySpark, SQL, MLflow).


data architecture, modeling, and governance strategies.


optimize ETL/ELT workflows and automate data transformation processes.


Collaborate with analysts and data scientists to support advanced analytics and ML model integration.


high-performing data systems in a cloud-native environment.


Translate business requirements into technical solutions with reusable, modular designs.


code quality, CI/CD, testing, and observability for Databricks pipelines.


Work with MS BI Stack (SSIS, SSRS, SSAS) to support enterprise reporting systems.


Required Qualifications:

10+ years of overall experience in data engineering, with 5+ years of strong hands-on Databricks experience.


Proven expertise in PySpark, Databricks SQL, and Delta Lake.


data lakehouses, distributed systems, and data warehousing.


Strong experience with cloud platforms, preferably Azure.


Proficient in Python and processing large structured/unstructured datasets.


leading end-to-end Databricks projects, from ingestion to analytics.


CI/CD, Git workflows, job orchestration, and monitoring.


Exceptional problem-solving and performance optimization capabilities.


Experience with Microsoft BI Stack (SSIS, SSRS, SSAS, SSMS).


Familiarity with Power BI or similar data visualization tools.


data security, compliance, and governance frameworks.


Agile/Scrum practices and cross-functional team collaboration.


Why Join Us?

Opportunity to lead high-impact data initiatives using cutting-edge platforms like Databricks.


Innovative and fast-paced culture with a focus on learning and growth.


Access to certifications, learning resources, and mentoring opportunities.


Remote work flexibility with supportive and transparent leadership.


How to Apply:

If you're a Databricks expert ready to take the lead in driving data engineering excellence, send your resume to

📩 careers@saradysol.com with the subject line:

“Lead Data Engineer – Databricks (Remote)”


You can also apply via LinkedIn’s Easy Apply feature.

Let’s build the future of data together! 🚀


Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now