Senior Data Engineer

Job Title: Senior Data Engineer – Data Quality, Ingestion & API Development Work Location: Trivandrum / Kochi (Remote or Onsite) Job Type: Full-time Experience Level: Senior Level Industry: IT Services | Cloud & Data Engineering Shift: US Overlapping Hours Notice Period: Immediate joiners only Preferred Candidates: Based in Kerala, Tamil Nadu, or Karnataka About the Role We are seeking a highly skilled Senior Data Engineer to lead the development of robust data ingestion frameworks , enforce data quality , and create high-performance APIs using a modern AWS-based tech stack. This role requires a minimum of 10 years of experience , including 5+ years specifically working on AWS platforms , and demands strong hands-on skills in Python, PySpark, AWS Glue, Lambda, CI/CD, DynamoDB, and EMR . This is a high-impact engineering position for professionals who can thrive in a fast-paced, cloud-first environment , working in US overlapping hours . Key Responsibilities Data Ingestion & Engineering Architect and develop scalable ETL/ELT pipelines using AWS Glue, Lambda, EMR, and Step Functions. Integrate diverse data sources into secure and optimized ingestion frameworks. Data Quality & Monitoring Implement automated data validation, error handling, and quality checks to ensure integrity. Set up end-to-end monitoring, logging , and alerting systems for real-time issue resolution. API Development Design, build, and document secure, high-performance RESTful APIs for seamless integrations. Collaboration & Agile Development Work cross-functionally with stakeholders, data scientists, and DevOps teams. Actively participate in Agile ceremonies , code reviews, and CI/CD pipeline management (GitLab preferred). Mandatory Skills & Experience Total Experience: 10+ years in Data Engineering roles AWS Expertise: Minimum 5 years of experience with AWS services Core Skills: Python, PySpark AWS Glue, Lambda, EMR CI/CD pipelines (GitLab or equivalent) DynamoDB, S3, Step Functions Strong understanding of data quality frameworks and API-driven architectures Preferred Qualifications Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field Familiarity with data lakehouse architectures Exposure to Kinesis, Firehose, SQS is a plus Additional Information Work Location: Trivandrum / Kochi (Hybrid or Onsite) Shift: US Overlapping Hours Notice Period: Immediate Joiners Only Preferred Location: Kerala, Tamil Nadu, Karnataka Employment Type: Full-Time Ready to build scalable, cloud-native data platforms that power real-time insights? Apply now and become part of a dynamic, high-impact engineering team. Show more Show less