Principal Data Engineer

Role Overview: As a technical architect and hands-on lead for Data Engineering practices within the Smart Supply Chain initiative at Amgen, your primary responsibility is to design, build, maintain, analyze, and interpret data to provide actionable insights for driving business decisions. You will work with large datasets, develop reports, support data governance initiatives, and visualize data to ensure accessibility, reliability, and efficient management. Your role will also involve architecting, building, and optimizing enterprise-grade data pipelines using Databricks and AWS-native services. Key Responsibilities: - Design, develop, and maintain data solutions for data generation, collection, and processing - Assist in the design and development of the data pipeline as a key team member - Create data pipelines and ensure data quality through ETL processes for migrating and deploying data across systems - Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions - Own data pipeline projects from inception to deployment, managing scope, timelines, and risks - Collaborate with cross-functional teams to understand data requirements and design solutions meeting business needs - Develop and maintain data models, data dictionaries, and documentation for data accuracy and consistency - Implement data security and privacy measures to protect sensitive data - Utilize cloud platforms (preferably AWS, Databricks) to build scalable and efficient data solutions - Collaborate effectively with product teams - Work with Data Architects, Business SMEs, and Data Scientists to design and develop end-to-end data pipelines for fast-paced business needs across geographic regions - Identify and resolve complex data-related challenges - Adhere to best practices for coding, testing, and designing reusable code/components - Explore new tools and technologies to improve ETL platform performance - Participate in sprint planning meetings and provide technical implementation estimations - Monitor data governance activities continuously and report on compliance, data quality issues, and governance initiatives" effectiveness Qualifications Required: - 12-17 years of experience in Computer Science, IT, or related field Additional Details: The company is looking for individuals with hands-on experience in big data technologies like Databricks, Apache Spark, and AWS services. Proficiency in data analysis tools such as SQL and Python, as well as experience with data visualization tools like Tableau and Power BI, is essential. Furthermore, experience in orchestrating large-scale data pipelines, data modeling, and data warehousing concepts are highly valued. Strong communication, collaboration, critical-thinking, and problem-solving skills are also essential for this role.,