AWS Data Engineer

The AWS Data Engineer will design, develop, and maintain scalable data pipelines and architectures using AWS Glue, Amazon Redshift, AWS Lambda, and Amazon S3. This role requires expertise in AWS Kinesis, AWS CloudFormation, Apache Spark, Python, and AWS IAM to ensure secure and efficient data processing. The candidate will leverage AWS Data Pipeline, AWS Athena, Docker, Terraform, and Apache Airflow to automate workflows and optimize data integration. Proficiency in AWS CloudWatch, Scala, SQL, PySpark, CI/CD, and DevOps practices is essential for monitoring and continuous improvement.
Strong problem-solving skills and critical thinking will drive innovative solutions to complex data challenges. Effective communication and collaboration are vital for working with cross-functional teams and stakeholders. Attention to detail and time management will ensure timely delivery of high-quality data solutions. Adaptability and project management skills will support evolving business needs and technology landscapes. Responsibilities: Demonstrate expert knowledge in AWS Glue, Amazon Redshift, AWS Lambda, Amazon S3, and Apache Spark to build and optimize data solutions. Design, implement, and maintain robust data pipelines and ETL processes using AWS Data Pipeline, Apache Airflow, and Python to support analytics and reporting. Develop infrastructure as code using AWS CloudFormation and Terraform to automate deployment and ensure scalable cloud environments. Monitor data workflows and system performance with AWS CloudWatch and implement CI/CD pipelines to enhance deployment efficiency and reliability.
Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and deliver actionable insights. Apply best practices in AWS IAM for secure access control and compliance across data platforms and services. Manage containerized applications using Docker and integrate DevOps methodologies to streamline development and operational processes. Qualifications: Bachelor's degree in Computer Science, Information Technology, or a related field is required.,Candidates must have 5-8 years of professional experience in data engineering with a focus on AWS technologies.,Proven experience in designing and managing cloud-based data infrastructure and pipelines is essential. We invite skilled AWS Data Engineers with 5-8 years of experience and expertise in AWS Glue, Redshift, Lambda, and related technologies to join our team. Candidates should excel in problem solving, effective communication, and project management to drive innovative data solutions in a collaborative and dynamic environment.