Data Technical Lead

Key Skills

Roles & Responsibilities

• Lead a team of data engineers and developers, defining technical strategy, best practices, and architecture for data platforms.
• Architect, develop, and manage scalable, secure, and high-performing data solutions on AWS and Databricks.
• Oversee the design and development of robust data pipelines for ingestion, transformation, and storage of large-scale datasets.
• Enforce data validation, lineage, and quality checks across the data lifecycle, defining standards for metadata, cataloging, and governance.
• Design automated workflows using Airflow, Databricks Jobs/APIs, and other orchestration tools for end-to-end data operations.
• Implement performance tuning strategies, cost optimization best practices, and efficient cluster configurations on AWS/Databricks.
• Define and enforce data security standards, IAM policies, and ensure compliance with industry-specific regulatory frameworks.
• Work closely with business users, analysts, and data scientists to translate requirements into scalable technical solutions.
• Drive strategic data migrations from on-prem/legacy systems to cloud-native platforms with minimal risk and downtime.
• Mentor junior engineers, contribute to talent development, and ensure continuous learning within the team.

Experience Requirement

• 6-9 years of hands-on experience in data engineering with expertise in Python, SQL, PySpark, Databricks, and AWS.
• Strong leadership experience in data engineering or data architecture roles, with a proven track record in leading teams and delivering large-scale data solutions.
• Expertise in designing and developing data pipelines, optimizing performance, and ensuring data quality.
• Solid experience with cloud platforms (AWS, Databricks), data governance, and security best practices.
• Experience in data migration strategies and leading transitions from on-premises to cloud-based environments.
• Experience in the Life Sciences or Pharma domain is highly preferred, with a deep understanding of industry-specific data requirements.
• Strong communication and interpersonal skills with the ability to collaborate across teams and engage stakeholders.

Education