AWS Databrick Engineer

Interested can also apply with

Sanjeevan Natarajan - 94866 21923

sanjeevan.natarajan@careernet.in

Role & responsibilities

• Technical Leadership

  Lead a team of data engineers and developers; define technical strategy, best practices, and architecture for data platforms.

• End-to-End Solution Ownership

  Architect, develop, and manage scalable, secure, and high-performing data solutions on AWS and Databricks.

• Data Pipeline Strategy

  Oversee the design and development of robust data pipelines for ingestion, transformation, and storage of large-scale datasets.

• Data Governance & Quality

  Enforce data validation, lineage, and quality checks across the data lifecycle. Define standards for metadata, cataloging, and governance.

• Orchestration & Automation

  Design automated workflows using Airflow, Databricks Jobs/APIs, and other orchestration tools for end-to-end data operations.

• Cloud Cost & Performance Optimization

  Implement performance tuning strategies, cost optimization best practices, and efficient cluster configurations on AWS/Databricks.

• Security & Compliance

  Define and enforce data security standards, IAM policies, and compliance with industry-specific regulatory frameworks.

• Collaboration & Stakeholder Engagement

  Work closely with business users, analysts, and data scientists to translate requirements into scalable technical solutions.

• Migration Leadership

  Drive strategic data migrations from on-prem/legacy systems to cloud-native platforms with minimal risk and downtime.

• Mentorship & Growth

  Mentor junior engineers, contribute to talent development, and ensure continuous learning within the team.

Preferred candidate profile

• Python

  ,

  SQL

  ,

  PySpark

  ,

  Databricks

  ,

  AWS

  (Mandatory)

• Leadership Experience

  in Data Engineering/Architecture

• Added Advantage:

  Experience in

  Life Sciences / Pharma