Senior Cloud / Data Platform Engineer

Key Responsibilities

Oversight & Optimisation of Data Lakehouse & Architecture, Data Engineering & Pipelines

• Understand

  lakehouse architectures

  that unify structured and semi-structured data at scale
• Strong experience of Implementing, monitoring

  job scheduling and orchestration

  using

  Airflow

  ,

  Azure Data Factory

  , and

  CI/CD triggers and

  with

  Azure Dataflows

  ,

  Databricks

  , and

  Delta Lake

  for real-time/batch processing, Managing

  schema evolution

  ,

  data versioning

  (e.g., Delta Lake), and pipeline adaptability
• Pipeline performance tuning for

  latency, resource usage, and throughput optimization

Cloud Infrastructure & Automation

• Infra automation using

  Terraform, Azure Bicep, and AWS CDK

• Setting up

  scalable cloud storage

  (Data Lake Gen2, S3, Blob, RDS, etc.)
• Administering

  RBAC

  , secure key vault access, and compliance-driven access controls
• Tuning infrastructure and services for

  cost efficiency

  and

  compute optimization

Full-Stack Cloud Data Platform Design

• Designing

  end-to-end Azure/AWS data platforms

  including ingestion, transformation, storage, and serving layers
• Interfacing with

  BI/AI teams

  to ensure data readiness, semantic modeling, and ML enablement
• Familiarity with metadata management, lineage tracking, and data catalog integration

Enterprise Readiness & Delivery

• Experience working with

  MNCs and large enterprises

  with strict processes, approvals, and data governance
• Capable of evaluating

  alternative tools/services

  across clouds for architecture flexibility and cost-performance balance
• Hands-on with

  CI/CD

  ,

  monitoring

  , and

  security best practices

  in regulated environments (BFSI, Pharma, Manufacturing)
• Lead

  cost-performance optimization

  across Azure and hybrid cloud environments
• Design modular, scalable infrastructure using

  Terraform / CDK / Bicep

  with a DevSecOps mindset
• Explore

  alternative cloud tools/services

  across compute, storage, identity, and monitoring to propose optimal solutions
• Drive

  RBAC, approval workflows, and governance controls

  in line with typical enterprise, MNC deployment security protocols
• Support BI/data teams with

  infra tuning

  ,

  pipeline stability

  , and

  client demo readiness

• Collaborate with client-side architects, procurement, and finance teams for approvals and architectural alignment

Ideal Profile

• 47 years

  of experience in cloud infrastructure and platform engineering
• Strong hold on

  Microsoft Azure

  , with hands-on exposure to

  AWS / GCP / Snowflake

  acceptable
• Skilled in

  IaC tools

  (Terraform, CDK),

  CI/CD

  , monitoring (Grafana, Prometheus), and cost optimization tools
• Comfortable proposing

  innovative, multi-vendor architectures

  that balance cost, performance, and compliance
• Prior experience working with

  large global clients or regulated environments

  (e.g., BFSI, Pharma, Manufacturing)

Preferred Certifications

• Microsoft Azure Administrator / Architect (Associate/Expert)

• AWS Solutions Architect / FinOps Certified

• Bonus: Snowflake, DevOps Professional, or Data Platform certifications