Senior Data Engineer

Role OverviewWe are looking for a Senior Data Engineer who will play a key role in designing, building, and maintaining data ingestion frameworks and scalable data pipelines. The ideal candidate should have strong expertise in platform architecture, data modeling, and cloud-based data solutions to support real-time and batch processing needs.What you'll be doing:Design, develop, and optimise DBT models to support scalable data transformationsArchitect and implement modern ELT pipelines using DBT and orchestration tools like Apache Airflow and PrefectLead performance tuning and query optimization for DBT models running on Snowflake, Redshift, or DatabricksIntegrate DBT workflows & pipelines with AWS services (S3, Lambda, Step Functions, RDS, Glue) and event-driven architecturesImplement robust data ingestion processes from multiple sources, including manufacturing execution systems (MES), Manufacturing stations, and web applicationsManage and monitor orchestration tools (Airflow, Prefect) for automated DBT model executionImplement CI/CD best practices for DBT, ensuring version control, automated testing, and deployment workflowsTroubleshoot data pipeline issues and provide solutions for optimizing cost and performanceWhat you'll have:5+ years of hands-on experience with DBT, including model design, testing, and performance tuning5+ years of Strong SQL expertise with experience in analytical query optimization and database performance tuning5+ years of programming experience, especially in building custom DBT macros, scripts, APIs, working with AWS services using boto33+ years of Experience with orchestration tools like Apache Airflow, Prefect for scheduling DBT jobsHands-on experience in modern cloud data platforms like Snowflake, Redshift, Databricks, or Big QueryExperience with AWS data services (S3, Lambda, Step Functions, RDS, SQS, CloudWatch)Familiarity with serverless architectures and infrastructure as code (CloudFormation/Terraform)Ability to effectively communicate timelines and deliver MVPs set for the sprintStrong analytical and problem-solving skills, with the ability to work across cross-functional teamsNice to haves:Experience in hardware manufacturing data processingContributions to open-source data engineering toolsKnowledge of Tableau or other BI tools for data visualizationUnderstanding of front-end development (React, JavaScript, or similar) to collaborate effectively with UI teams or build internal tools for data visualization