Senior Data Engineer (Machine Learning)

Job Description

Senior Data Engineer with ML About the Role We are seeking an experienced Senior Data Engineer with 5-10 years of experience to join our data team. In this role, you will design, build, and maintain robust data pipelines that support both training and inference for our machine learning systems. You will work closely with data scientists to ensure seamless integration between data infrastructure and ML models. Key Responsibilities - Design, develop, and maintain scalable data pipelines for ML training and inference - Collaborate with data scientists to optimize data flows for model training and deployment - Implement and maintain ETL processes to transform raw data into formats suitable for analysis - Ensure data quality, reliability, and accessibility across the organization - Build and optimize data infrastructure to support ML operations - Troubleshoot and resolve data pipeline issues in production environments Required Qualifications - Bachelor's degree in Computer Science, Engineering, or related technical field - 5-10 years of professional experience in data engineering - Strong programming skills in Python or scala. - Extensive experience with data processing frameworks (Apache Spark) - Proficiency in SQL - Experience building and maintaining ML training and inference pipelines - Experience with AWS data services - Experience with version control systems and CI/CD practices Preferred Skills - Experience with MLOps tools and practices (MLflow, Kubeflow, etc.) - Expeirence with Databricks - Familiarity with feature stores and feature engineering best practices - Understanding of distributed computing principles and optimization techniques - Experience with data modeling and data warehouse design Personal Attributes - Strong problem-solving skills with attention to detail - Excellent communication skills to collaborate with technical and non-technical stakeholders - Self-motivated with the ability to work independently and lead projects - Adaptable to changing requirements and technologies - Passion for building reliable, scalable data systems Show more Show less