Job
Description
About the Role
We are seeking a highly skilled Senior Data Engineer to design, build, and optimize scalable data platforms that empower data-driven decision-making. This role requires deep technical expertise in modern data engineering frameworks, architectural patterns, and cloud-native solutions on AWS. You will be a key contributor to our data strategy, ensuring data quality, governance, and reliability while mentoring other engineers in the team.Key ResponsibilitiesDesign, develop, and own robust, scalable, and maintainable data pipelines (batch & real-time).Architect and implement Data Lake, Data Warehouse, and Lakehouse solutions using modern frameworks and architectural patterns.Ensure data quality, governance, and integrity across the entire data lifecycle.Monitor, troubleshoot, and optimize the performance of data pipelines.Contribute to and enforce best practices, design principles, and technical documentation.Partner with cross-functional teams to translate business requirements into effective technical solutions.Provide mentorship and guidance to junior data engineers, fostering continuous learning and growth.Good to Have Skills:Bachelors degree in Computer Science, Information Systems, or related field (Masters degree preferred).8+ years of experience as a Data Engineer, with a proven track record of building large-scale, production-grade pipelines.Expertise in AWS Data Services (S3, Glue, Athena, EMR, Kinesis, etc.).Strong proficiency in SQL and deep understanding of file formats (Parquet, Delta Lake, Apache Iceberg, Hudi, CDC patterns).Hands-on experience with stream processing frameworks (Apache Flink, Kafka Streams, or PySpark).Proficiency in Apache Airflow or similar workflow orchestration tools.Strong knowledge of database systems (relational & NoSQL) and data warehousing concepts.Experience with data integration tools and cloud-based data platforms.Excellent problem-solving skills and ability to work independently in fast-paced environments.Strong communication and collaboration skills to work effectively with both technical and business stakeholders.Passion for emerging technologies and keeping pace with industry best practices.