Azure Databricks Developer

Azure Databricks Developer

Job Title:

Job Summary:

We are hiring an experienced Azure Databricks Developer to join our dynamic data engineering team. The ideal candidate will have strong expertise in building and optimizing big data solutions using Azure Databricks, Spark, and other Azure data services.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines using Azure Databricks and Apache Spark.
  
• Integrate and manage large datasets using Azure Data Lake, Azure Data Factory, and other Azure services.
  
• Implement Delta Lake for efficient data versioning and performance optimization.
  
• Collaborate with cross-functional teams including data scientists and BI developers.
  
• Ensure best practices for data security, governance, and compliance.
  
• Monitor performance and troubleshoot Spark clusters and data pipelines.
  

Skills & Requirements:

• Minimum 5 years of experience in data engineering with at least 2+ years in Azure Databricks.
  
• Proficiency in Apache Spark (PySpark/Scala).
  
• Strong hands-on experience with Azure services ADF, ADLS, Synapse Analytics.
  
• Expertise in building and managing ETL/ELT pipelines.
  
• Strong SQL skills and experience with performance tuning.
  
• Experience with CI/CD pipelines and Azure DevOps is a plus.
  
• Good understanding of data modeling, partitioning, and data lake architecture.

  Role & responsibilities

Preferred candidate profile