Azure Data Engineer

About Company : Our Client is a leading Indian multinational IT services and consulting firm. It provides digital transformation, cloud computing, data analytics, enterprise application integration, infrastructure management, and application development services. The company caters to over 700 clients across industries such as banking and financial services, manufacturing, technology, media, retail, and travel & hospitality.

Its industry-specific solutions are designed to address complex business challenges by combining domain expertise with deep technical capabilities. With a global workforce of over 80,000 professionals and a presence in more than 50 countries.

Job Title: Azure Data Engineer

Locations: PAN INDIA

Experience: 10 +Years

Employment Type: Contract to Hire

Work Mode : Work From Office

Notice Period : Immediate to 15 Days

We are seeking a highly skilled Data Engineer / BI Specialist with expertise in big data processing, cloud-based analytics, and advanced visualization technologies. The ideal candidate will have hands-on experience with Apache Airflow, Apache Spark, Azure data services, Python programming, and emerging technologies like IoT and AR/VR/MR. You will be responsible for designing, building, and optimizing large-scale data pipelines and delivering insightful analytics solutions.

Key Responsibilities:

• Design, develop, and maintain scalable ETL/ELT pipelines using Apache Airflow, Apache Spark, Azure Data Factory, and Databricks.
• Integrate and manage structured and unstructured data from diverse sources, including Azure Cosmos DB, Azure Data Lake, and Azure Synapse Analytics.
• Implement IoT data ingestion, processing, and analytics solutions using Azure IoT services.
• Develop and deploy Python scripts for automation, data transformation, and analytics workflows.
• Create dashboards, visualizations, and reports to support data-driven decision-making (e.g., Power BI, immersive AR/VR/MR analytics).
• Collaborate with cross-functional teams to gather requirements, optimize pipelines, and ensure high data quality.
• Ensure solutions follow security, compliance, and data governance best practices.

Mandatory Skills:

• Apache Airflow
• Apache Spark
• Python
• Azure Cosmos DB
• Azure Data Factory
• Azure IoT
• Azure Synapse Analytics
• Azure Data Lake
• Databricks
• AR/VR/MR

Required Experience & Qualifications:

• 5+ years of experience in data engineering, cloud analytics, or BI development.
• Strong SQL skills and experience with data modeling.
• Proficiency in distributed data processing frameworks.
• Experience working in Microsoft Azure cloud environments.
• Strong problem-solving skills and ability to work with large-scale datasets.

Preferred Skills:

• Experience with AI/ML integrations into analytics pipelines.
• Familiarity with real-time data streaming solutions (Kafka, Event Hubs).
• Exposure to immersive analytics using AR/VR/MR.