Hadoop DE / Senior Software Engineer

Some careers shine brighter than others.

If you re looking for a career that will help you stand out, join HSBC, and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.

HSBC is one of the largest banking and financial services organizations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realize their ambitions.

We are currently seeking an experienced professional to join our team in the role of Senior Software Engineer

Key Responsibilities:

• Expertise in Scala-Spark/Python-Spark development and should be able to Work with Agile application dev team to implement data strategies.
• Design and implement scalable data architectures to support the banks data needs.
• Develop and maintain ETL (Extract, Transform, Load) processes.
• Ensure the data infrastructure is reliable, scalable, and secure.
• Oversee the integration of diverse data sources into a cohesive data platform.
• Ensure data quality, data governance, and compliance with regulatory requirements.
• Monitor and optimize data pipeline performance.
• Troubleshoot and resolve data-related issues promptly.
• Implement monitoring and alerting systems for data processes.
• Troubleshoot and resolve technical issues optimizing system performance ensuring reliability.
• Create and maintain technical documentation for new and existing system ensuring that information is accessible to the team.
• Implementing and monitoring solutions that identify both system bottlenecks and production issues.