Senior Spark Developer

The Senior Spark Developer will be responsible for integrating and maintaining the Quantexa platform, a spark based software provided by a UK fintech, into our existing systems to enhance our anti-money laundering capabilities. This role requires a deep expertise in Spark development, as well as an ability to analyze and understand underlying data. Additionally, the candidate should have an interest in exploring open-source applications distributed by Apache, Kubernetes, OpenSearch and Oracle.

Responsibilities

Integrate and upgrade the Quantexa tool with our existing systems for enhanced anti-money laundering measures.

Develop and maintain Spark-based applications deployed on Kubernetes clusters.

Conduct data analysis to understand and interpret underlying data structures.

Collaborate with cross-functional teams to ensure seamless integration and functionality.

Stay updated with the latest trends and best practices in Spark development and Kubernetes.

Work on tasks assigned by Lead independently. Take ownership of tasks assigned.

Adhering to the given timelines by Lead with first time right

Develop programs in optimal manner without compromising core architecture/design

Work on the technologies efficiently and produce best fit deliveries

Be proactive and provide status to the team lead.

Adheres to all compliance & project related processes

Gain functional knowledge on applications worked upon

Upgrade Technical skill by self-learning/taking

Key Responsibilities

Integrate and upgrade the Quantexa tool with our existing systems for enhanced anti-money laundering measures.

Develop and maintain Spark-based applications deployed on Kubernetes clusters.

Conduct data analysis to understand and interpret underlying data structures.

Collaborate with cross-functional teams to ensure seamless integration and functionality.

Stay updated with the latest trends and best practices in Spark development and Kubernetes.

Required Qualifications

5+ years of experience in development

Extensive experience in Hadoop, Spark, Scala development (5 years min).

Strong analytical skills and experience in data analysis (SQL), data processing (such as ETL), parsing, data mapping and handling real-life data quality issues.

Excellent problem-solving abilities and attention to detail.

Strong communication and collaboration skills.

Experience in Agile development

High quality coding skill, incl. code control, unit testing, design, and documentation (code, test). Experience with tools such as sonar. Experience with GIT, Jenkins.

Experience with development and deployment of spark application and deployment on Kubernetes clusters

Hands-on development experience (Java, Scala, etc.) via system integration projects, Python, Elastic (optional).

Other/Specific Qualifications

• Fluent in English
• Team player
• Strong analytical skills
• Quality oriented and well organized
• Willing to work under pressure and mission oriented
• Excellent Oral and Written Communication Skills, Motivational Skills, Results-Oriented