Analytic Foundations Enabler Stream

Key Skills:

Roles & Responsibilities:

• Lead and support technology teams in designing, developing, and managing data engineering and CI/CD pipelines, and infrastructure.
• Act as an Infrastructure/DevOps SME in designing and implementing solutions for risk analytics systems transformation, both tactical and strategic, aligned with regulatory and business initiatives.
• Collaborate with other technology teams, IT support teams, and architects to drive improvements in product delivery.
• Manage daily interactions with IT and central DevOps/infrastructure teams to ensure continuous support and delivery.
• Grow the technical expertise within the engineering community by mentoring and sharing knowledge.
• Design, maintain, and improve the full software delivery lifecycle.
• Enforce process discipline and improvements in areas like agile software delivery, production support, and DevOps pipeline development.

Experience Requirement:

• 6-8 years of experience in platform engineering, SRE roles, and managing distributed/big data infrastructures.
• Strong hands-on experience with the Hadoop ecosystem, big data pipelines, and Delta Lake.
• Proven expertise in Cloudera Hadoop cluster management including HDFS, YARN, and Spark.
• In-depth knowledge of networking, Linux, HDFS, and DevSecOps tools like Docker, Kubernetes, and Jenkins.
• Skilled in containerization with Docker and orchestration using Kubernetes.
• Hands-on experience with designing and managing large-scale tech projects, including REST API standards.
• Experience with monitoring and logging tools such as Prometheus, Grafana, and Splunk.
• Global collaboration experience with IT and support teams across geographies.
• Strong coding skills in Spark (PySpark) and Python with at least 3 years of experience.
• Expertise in Infrastructure as Code (IaC) tools such as Terraform and Ansible.
• Working knowledge of GCP or other cloud platforms and their data engineering products is preferred.
• Familiarity with agile methodologies, with strong problem-solving and team collaboration skills.

Education: