Senior Data Engineer

Senior Data Engineer

Key Responsibilities

• Snowflake & Big Data Migration

  : Lead and execute

  data migration from on-premise or traditional databases to Snowflake

  within a Big Data environment, addressing challenges related to

  scalability, data storage formats, concurrency requests, and streaming data ingestion

  .

• Proof of Concept Development

  : Demonstrate the

  ability to build quick Proof of Concepts (POCs)

  as per evolving requirements, validating technical feasibility and business value.

• Data Lake & Data Management

  : Conduct comprehensive

  analysis on large amounts of historical data

  , determining its suitability for

  Data Lake and Delta Lake setup

  . This includes expertise in

  data clean-up, data management, filtering, and efficient loading into Snowflake

  .

• Data Model Experimentation & Optimization

  : Conduct experiments with

  different types of data models

  , meticulously

  analyzing performance

  to identify and implement the most effective approaches.

• Advanced Snowflake Utilization

  : Leverage

  expertise in Snowflake advanced concepts

  by effectively setting up

  resource monitors, RBAC controls, virtual warehouse sizing, performing query performance tuning, utilizing zero-copy clone, and time travel features

  .

• Database & Scripting Proficiency

  : Apply

  strong proficiency in RDBMS, complex SQL, PL/SQL, and Python

  for data manipulation, scripting, and pipeline development.

Skills

• Must have experience in

  Big Data and Snowflake

  .
• Proven experience with

  Snowflake data migration

  (from on-prem to cloud or traditional DBs).
• Expertise in

  scalability, data storage formats, concurrency requests, and streaming data ingestion

  .
• Ability to build quick

  Proof of Concepts

  .
• Strong analytical skills for

  large amounts of historical data

  , including suitability for

  Data Lake, Delta Lake setup, data clean-up, data management, and filtering

  .
• Experience in

  conducting experiments with different types of data models

  and analyzing performance.

• Expertise in Snowflake advanced concepts

  (resource monitors, RBAC controls, virtual warehouse sizing, query performance tuning, zero-copy clone, time travel).

• Strong Proficiency in RDBMS, complex SQL, PL/SQL, and Python

  .

Qualifications

• Proven experience as a Data Engineer with a focus on Big Data and Cloud Data Warehousing, specifically Snowflake.
• Demonstrable track record of leading data migration projects and optimizing data solutions.
• Strong problem-solving abilities and a deep understanding of data architecture best practices.