AWS Python Engineer

Job Description: We are seeking a Senior Data Engineer with over 5 years of experience in Python, SQL, PySpark, and various AWS services such as Lambda, Glue Jobs, and Athena. This position is located in Hyderabad and necessitates on-site work. As a Senior Data Engineer, you will be tasked with constructing robust data pipelines, creating scalable ETL solutions, and overseeing cloud-based data systems. Key Responsibilities: - Designing, developing, and enhancing large-scale ETL/ELT pipelines utilizing PySpark and AWS Glue. - Deploying serverless workflows using AWS Lambda, Athena, and S3 for data processing and querying purposes. - Crafting efficient and scalable SQL queries to handle data in Redshift, Athena, and other data platforms. - Collaborating with diverse teams to comprehend business data requirements and devise suitable solutions. - Establishing and managing infrastructure using CloudFormation or similar Infrastructure-as-Code tools. - Integrating APIs and overseeing message queues utilizing SNS and SQS for both real-time and batch processing requirements. - Identifying, monitoring, and improving the performance of data pipelines and cloud solutions. Required Skills: - Over 5 years of practical experience in: - Python and SQL - PySpark - AWS Glue Jobs, AWS Lambda, Athena - Profound familiarity with AWS Redshift, S3, CloudFormation, SNS, and SQS. - Sound comprehension of data modeling, ETL frameworks, and distributed data systems. - Proficiency in API integrations and consuming RESTful services.,