Freelance Opportunity: Lead Data Engineer – MDM & Azure Data Pipelines

Company Description

ThreatXIntel is a startup cyber security company that offers customized and affordable solutions to protect businesses and organizations from cyber threats. With a focus on cloud security, web and mobile security testing, and DevSecOps, we aim to provide peace of mind to our clients. Our proactive approach involves continuous monitoring and testing to identify vulnerabilities before they can be exploited.

Role Description

business-focused Lead Data Engineer

master data strategies

Key Responsibilities

• Develop and maintain a

  Client Master MDM solution

  across institutional and wealth management data domains.
• Collaborate with data stewards, product owners, and business stakeholders to gather and analyze data requirements.
• Design and build

  cloud-based data pipelines

  using

  Azure Data Factory (ADF)

  ,

  DBT

  ,

  FiveTran

  , and

  Snowflake

  .
• Work with

  Semarchy MDM

  (preferred) or

  Informatica MDM

  to manage master data lifecycle and workflows.
• Develop scalable solutions using

  SQL

  ,

  Python

  , or

  Java

  for high-performance data transformation.
• Optimize data pipelines for

  scalability, performance, and reliability

  .
• Ensure

  data accuracy, integrity, and quality

  through proactive monitoring and troubleshooting.
• Translate complex data and business problems into

  robust, reusable technical solutions

  .
• Promote best practices in

  data governance

  ,

  data modeling

  , and

  data quality management

  .
• Communicate technical solutions clearly with business and engineering teams.

Required Skills & Experience

• 5+ years

  of experience in

  data engineering

  , with a focus on

  Master Data Management

• In-depth knowledge of

  MDM principles

  , architectures, and tools (Semarchy preferred, Informatica acceptable)
• Strong experience with

  Azure-based data pipeline tools

  :

  ADF

  ,

  Snowflake

  ,

  DBT

  ,

  FiveTran

• Strong

  SQL development

  skills (must-have)
• Programming experience in

  Python

  or

  Java

• Proficiency in

  data modeling

  ,

  ETL architecture

  , and

  data warehousing concepts

• Hands-on experience with

  data quality

  ,

  governance

  , and

  monitoring frameworks

• Experience in fast-paced or startup-like environments with agile execution

Nice to Have

• Familiarity with

  wealth management

  or

  institutional asset management

  data models
• Understanding of

  data lineage

  ,

  metadata management

  , and

  compliance regulations