Senior Data Engineer

Data Driven is a Udacity core value. Udacity Data Engineering Team is looking for a Software Engineer to help us to design and develop Udacity's company-wide data solutions in support of that value. The ideal candidate will be comfortable talking to data analysts, data scientists and business stakeholders, understand the data that powers their products, generalize it and implement common fact tables across the company.

This is a high-impact opportunity and you'll be a part of a global Data Team of highly talented Software Engineers, Data Analysts and Data Scientists based primarily in India and North America. The system you will be working on consists of a cloud-based data lake and is built completely on a cloud-native environment on AWS, using technologies such as Apache Spark, Airflow, Postgres and Redshift.

About Udacity Data Engineering

• We prioritize the quality and trustworthiness of the data
• We embrace common and proven software engineering practices to achieve quality while maximizing the productivity
• We promote collective and shared ownership of our technical assets
• We value the flexibility needed in working in a global while balance and minimize non-work hour involvement in all locations

How You Can Help

• Design and develop infrastructure and tools for the systems powering all of Udacity's data, analytics and reporting
• Work with analysts to generalize the data points behind their work to form multi-dimensional data stores
• Building out the lakehouse for analytics, machine learning and AI use cases with strong focus on accuracy and reliability using technologies such as Spark, Airflow, dbt and Iceberg on AWS
• Working with stakeholders from other departments and successfully translating their requirements to engineering solutions
• Being a champion and thought leader of effective agile software development practice and producing high quality readable code in such a setting

What We Need From You

• BS or MS in Computer Science , MIS or related degrees
• 6+ years of experience working in the software industry, with at least 3 of which in data engineering
• Solid understanding and experience practicing Agile software development methodologies such as test driven development
• Good understanding in the principles of building robust data processing pipeline and track record of putting them in practice
• Proven ability to trace, identify and resolve issue in data, infrastructure and code
• Hands-on experience working with Apache Spark, cloud data storage and relational databases
• Hands-on experience working on cloud platforms, preferably AWS
• Proficiency in Python, Scala and SQL
• Experience working with generative AI is desired
• Experience working with US or Europe based remote teams is a strong plus

Benefits:

Experience a rewarding work environment with Udacity's perks and benefits!

• At Udacity, we offer you the flexibility of working from home. We also have in-person collaboration spaces in Mountain View, Cairo, Dubai and Noida and continue to build opportunities for team members to connect in person
• Flexible working hours
• Paid time off
• Comprehensive medical insurance coverage for you and your dependents
• Employee wellness resources and initiatives (access to wellness platforms like Headspace)
• Quarterly wellness day off
• Personalized career development
• Unlimited access to Udacity Nanodegrees