Azure Data Engineer - Python/SQL/ETL

Key Responsibilities

• Develop and maintain cloud-native data pipelines and analytics solutions on Azure and Databricks.
• Implement ETL/ELT processes using Databricks Delta Lakehouse architecture.
• Build real-time structured streaming pipelines using PySpark.
  

Database & Modelling

• Perform data modeling and schema design for relational databases, preferably PostgreSQL.
• Write optimized and reusable SQL queries for data extraction, transformation, and analysis.
  

Automation & CI/CD Integration

• Design and deploy CI/CD pipelines to support automated builds, testing, and deployment of data pipelines.
• Security & Compliance
• Ensure all solutions adhere to security-first development principles and organizational data governance : :
• Bachelors degree in Computer Science, Information Technology, or a related :
• 3 to 5 years of experience in data engineering with a focus on Azure and : Skills :
• Databricks
• Python
• PySpark
• SQL
  

Preferred Skills

• Experience in data modeling with PostgreSQL
• Understanding of Delta Lake architecture
• Exposure to real-time processing with Structured Streaming
• Familiarity with secure coding practices and compliance in data environments
• Strong problem-solving and analytical abilities
• Ability to work in a fast-paced, collaborative environment