Azure Data Engineer

MyCareernet

0 years

0 Lacs

Coimbatore Tamil Nadu India

Posted:12 hours ago| Platform:

Apply

Skills Required

azure data spark databricks python processing apache integration erp design sql relational messaging kafka rabbitmq tuning agile pyspark optimization engineering technology

Work Mode

On-site

Job Type

Full Time

Job Description

Company:IT Services Organization

Key Skills:

Roles and Responsibilities:

Develop and maintain scalable data processing systems using Apache Spark and Azure Databricks.
Implement data integration from various sources including RDBMS, ERP systems, and files.
Design and optimize SQL queries, stored procedures, and relational schemas.
Build stream-processing systems using technologies such as Apache Storm or Spark-Streaming.
Utilize messaging systems like Kafka or RabbitMQ for data ingestion.
Ensure performance tuning of Spark jobs for optimal efficiency.
Collaborate with cross-functional teams to deliver high-quality data solutions.
Lead and mentor a team of data engineers, fostering a culture of continuous improvement and Agile practices.

Skills Required:

Proficient in Apache Spark and Azure Databricks
Strong experience with Azure ecosystem and Python
Working knowledge of Pyspark (Nice-to-Have)
Experience in data integration from varied sources
Expertise in SQL optimization and stream-processing systems
Familiarity with Kafka or RabbitMQ
Ability to lead and mentor engineering teams
Strong understanding of distributed computing principles

Education:

More Jobs at MyCareernet

Software Engineer

Pune, Maharashtra, India

5 - 8 yrs

Salary: Not disclosed

Quality Assurance Engineer

Hyderabad, Telangana, India

3 - 5 yrs

Salary: Not disclosed

Data Analyst

Pune, Maharashtra, India

Experience: Not specified

Salary: Not disclosed

Business Analyst

Mumbai, Maharashtra, India

Experience: Not specified

Salary: Not disclosed

Software Engineer - Java Full Stack

Hyderabad, Telangana, India

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.