Data Engineer

About the Role

We are seeking a highly skilled and motivated Senior Data Engineer with hands-on experience across AWS, Azure, and GCP data ecosystems. The ideal candidate will be responsible for designing, building, and maintaining scalable data pipelines and architectures that support advanced analytics and real-time data processing.

Key Responsibilities

Technical Responsibilities

• Data Pipeline Development: Design and implement robust ETL/ELT pipelines using cloud-native tools.
• Cloud Expertise:
• AWS: EMR, Kinesis, Redshift, Glue
• Azure: HDInsight, Synapse Analytics, Stream Analytics
• GCP: Cloud Dataproc, Dataflow, Composer
• Data Modeling: Develop and optimize data models for analytics and reporting.
• Data Governance: Ensure data quality, security, and compliance across platforms.
• Automation & Orchestration: Use tools like Apache Airflow, AWS Step Functions, and GCP Composer for workflow orchestration.
• Monitoring & Optimization: Implement monitoring, logging, and performance tuning for data pipelines.

Collaboration & Communication

• Work closely with data scientists, analysts, and business stakeholders to understand data needs.
• Translate business requirements into scalable technical solutions.
• Participate in code reviews, architecture discussions, and agile ceremonies.

Required Qualifications

Technical Skills

• Strong programming skills in Python, SQL, and optionally Scala or Java.
• Deep understanding of distributed computing, data warehousing, and stream processing.
• Experience with data lake architectures, data mesh, and real-time analytics.
• Proficiency in CI/CD practices and infrastructure as code (e.g., Terraform, CloudFormation).

Certifications (Preferred)

• AWS Certified Data Analytics – Specialty
• Microsoft Certified: Azure Data Engineer Associate
• Google Professional Data Engineer

Soft Skills & Attributes

• Analytical Thinking: Ability to break down complex problems and design scalable solutions.
• Communication: Strong verbal and written communication skills to explain technical concepts to non-technical stakeholders.
• Collaboration: Team player with a proactive attitude and the ability to work in cross-functional teams.
• Adaptability: Comfortable working in a fast-paced, evolving environment with shifting priorities.
• Ownership: High sense of accountability and a drive to deliver high-quality solutions.