Data Engineer

Our client is a global technology company headquartered in Santa Clara, California. it focuses on helping organizations harness the power of data to drive digital transformation, enhance operational efficiency, and achieve sustainability. over 100 years of experience in operational technology (OT) and more than 60 years in IT to unlock the power of data from your business, your people and your machines. We help enterprises store, enrich, activate and monetise their data to improve their customers’ experiences, develop new revenue streams and lower their business costs. Over 80% of the Fortune 100 trust our client for data solutions.

.

• Job Title:

  Quantexa certified engineer

• Location:

  PAN INDIA

• Experience:

  9 to 12 Years

• Job Type:

  Contract to hire.

• Notice Period:

  Immediate joiners

  .

• Mandatory Skills:

  Quantexa certification, Scala, Spark, Azure databricks

Job Summary:

• ROLE PURPOSE
• The purpose of the Data Engineer is to design, build and unit test data pipelines and jobs for Projects and Programmes on Azure Platform. This role is purposed for Quantexa Fraud platform programme, Quantexa certified engineer is a preferred.
• Analyse business requirements and support and maintain Quantexa platform.
• Build and deploy new/changes to data mappings, sessions, and workflows in Azure Cloud Platform – key focus area would be Quantexa platform on Azure.
• Develop both batch (using Azure Databricks) and real time (Kafka and Kubernetes) pipelines and jobs to extract, transform and load data to platform.
• Perform ETL routines performance tuning, troubleshooting, support, and capacity estimation.
• Conduct thorough testing of ETL code changes to ensure quality deliverables
• Provide day-to-day support and mentoring to end users who are interacting with the data
• Profile and understand large amounts of source data available, including structured and semi-structured/web activity data
• Analyse defects and provide fixes
• Provide release notes for deployments
• Support Release activities
• Problem solving attitude
• Keep up to date with new skills - Develop technology skills in other areas of Platform
• Exposure to Fraud, financial crime, customer insights or compliance-based projects that utilize detection and prediction models
• Experienced in ETL tools like databricks (Spark) and data projects
• Experience with Kubernetes to deliver real time data ingestion and transformation using scala.
• Scala knowledge would be highly desirable, Python knowledge is a plus
• Strong knowledge of SQL
• Strong Analytical skills
• Azure DevOps knowledge
• Experience with local IDE, design documentations, Unit testing