Cloud & Data Engineering Specialist (Azure/AWS/GCP | Kafka|Databricks

Cloud & Data Engineering Specialist

Remote Work

Contract Duration: 6 months

Exp Level: 3 - 4 years (Must be able to work according to JD)

Work Timings: (2:30 pm to 11:30 pm IST)

We are seeking two highly skilled Cloud & Data Engineering Specialists to join our dynamic team. These roles will focus on designing, building, and optimizing scalable cloud-based solutions, data pipelines, and analytics platforms. The ideal candidates will have strong expertise in cloud platforms, data engineering, and modern technologies, with a focus on delivering robust, secure, and efficient data solutions.

Position 1: Cloud & Data Engineering Specialist (Resource 1)

Key Responsibilities:

Design, develop, and maintain cloud-based solutions on Azure or AWS.

Implement and manage real-time data streaming and messaging systems using Kafka.

Develop scalable applications and services using Java and Python.

Deploy, manage, and monitor containerized applications using Kubernetes.

Build and optimize big data processing pipelines using Databricks.

Manage and maintain databases, including SQL Server and Snowflake, and write complex SQL scripts.

Work with Unix/Linux commands to manage and monitor system operations.

Collaborate with cross-functional teams to ensure seamless integration of cloud-based solutions.

Key Skills:

Expertise in Azure or AWS cloud platforms.

Proficiency in Kafka, Java, Python, and Kubernetes.

Hands-on experience with Databricks for big data processing.

Strong database management skills with SQL Server, Snowflake, and advanced SQL scripting.

Solid understanding of Unix/Linux commands.

Position 2: Cloud & Data Engineering Specialist (Resource 2)

Key Responsibilities:

Design and implement cloud solutions across Azure, AWS, and GCP platforms.

Develop and optimize data pipelines using PySpark, Python, and SQL.

Build and manage ETL workflows using Azure Data Factory (ADF).

Work with big data technologies such as Apache Spark and Databricks to process large datasets.

Design and deliver dashboards and reports using Tableau and Power BI.

Implement DevOps practices, including version control with Git, CI/CD pipelines, and containerization using Docker.

Collaborate with stakeholders to gather requirements and deliver scalable data solutions.

Key Skills:

Proficiency in Azure, AWS, and GCP cloud platforms.

Strong programming skills in Python, SQL, and PySpark.

Experience with Snowflake and SQL Server databases.

Expertise in ETL tools like Azure Data Factory (ADF).

Hands-on experience with Apache Spark and Databricks for big data processing.

Proficiency in reporting tools such as Tableau and Power BI.

Knowledge of DevOps practices, including Git, CI/CD pipelines, and Docker.

General Requirements for Both Roles:

Bachelors degree in Computer Science, Engineering, or a related field (or equivalent experience).

3+ years of experience in cloud and data engineering roles.

Strong problem-solving and analytical skills.

Excellent communication and collaboration abilities.

Proven ability to work in a fast-paced, agile environment.

Send resume to kalaivanan.balasubramaniam@covalensedigital.com

Thanks

kalai

8015302990