Data Engineer

Job Title: Data Engineer

Location: Remote

Experience: 7+ Years

Shift Timing: 11:00 AM – 8:30 PM IST

Job Summary:

We are looking for a highly skilled and experienced Data Engineer with 7+ years of experience in designing, building, and maintaining scalable data pipelines and infrastructure. The ideal candidate will have strong expertise in Python, Microsoft Azure, Azure App Services, Azure Service Bus, and Azure Databricks.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines using modern data engineering tools and platforms.

• Build and deploy robust ETL/ELT processes to support business intelligence and analytics initiatives.

• Work with cross-functional teams to understand business requirements and translate them into technical specifications.

• Develop and manage Azure-based data solutions, including Azure Data Lake, Azure Databricks, Azure App Services, and Azure Service Bus.

• Write clean, reusable, and efficient Python code to manipulate, process, and analyze large datasets.

• Monitor and optimize data workflows for performance, reliability, and scalability.

• Ensure data quality and implement data governance practices.

• Troubleshoot and resolve data-related issues promptly.

Required Skills:

• 7+ years of hands-on experience in Data Engineering.

• Strong programming skills in Python.

• Expertise in Microsoft Azure cloud services, particularly:

o Azure Data Factory

o Azure App Services

o Azure Service Bus

o Azure Databricks

• Proficient in building and optimizing data pipelines, architectures, and data sets.

• Experience working with structured and unstructured data.

• Familiarity with CI/CD pipelines and version control systems like Git.

• Strong analytical and problem-solving skills.

Preferred Qualifications:

• Azure certifications (e.g., Azure Data Engineer Associate).

• Experience with DevOps tools and practices in data engineering environments.

• Knowledge of data warehousing concepts and tools.

• Experience with real-time data processing and messaging systems.