AWS DevOps Engineer - CI/CD Pipeline

Responsibilities

• Design, develop, and implement data pipelines and ETL processes using AWS services.
• Collaborate directly with our FinOps teams and market units across the organization to understand data requirements and deliver solutions that meet business needs.
• Optimize and manage data storage solutions using AWS services such as S3, RDS, and NoSQL databases.
• Ensure data quality, integrity, and security across all data engineering projects.
• Monitor and troubleshoot data workflows to ensure high availability and performance.
• Design and build advanced and interactive dashboards using tools such as AWS QuickSight and Power BI.
• Create and oversee a cloud billing dashboard to track, manage and optimize cloud costs and Reserved Instance purchases
• Build a dashboard that provides secure self-service capabilities to all teams on cloud spend
• Knowledge of DevOps practices and CI/CD pipelines.
• Stay updated with the latest AWS technologies and best practices to continuously improve our data infrastructure.
• Solve technical problems and create viable tooling
• Design and implement shared services in cloud infrastructure.
• Use best appropriate infrastructure automation tools to provision cloud infrastructure components
• Attend important Agile events and finish assigned work packages / tasks
• Ensure smooth handover of project deliverables to internal and external customers
• Actively contributing to internal projects such as tooling and documentation
• Mentor new team member
• Promote the use of automation to solve technical challenges
  

Skills

• Bachelor's degree in computer science, Information Technology, or a related field.
• Proven experience as a Cloud Developer or Data Engineer, with a focus on AWS.
• Strong proficiency in AWS services such as EKS, EC2, S3, Lambda, Glue.
• Solid understanding of data modeling, ETL processes, and data warehousing concepts.
• Strong proficiency in Python
• Familiarity with infrastructure as code tools like CloudFormation or Terraform.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.
• Experience in building and utilizing REST APIs.
• Experience building and running Kubernetes Background Tasks with Batch-Jobs.
• Hands on experience Git-Hub Action
  

Preferred Qualifications

• AWS Certified DevOps Engineer
• Professional and or AWS Certified Data Engineer - Associate
• Knowledge of DevOps practices and CI/CD pipelines.
• Knowledge in using Flask framework to create dynamic websites, APIs or microservices is a plus.