Data Engineer - Pyspark

The Data Engineer is responsible for creating high-quality data products that support the Banks regulatory requirements and data-driven decision-making. As a Data Engineer, you will lead by example, collaborate closely with customers, and address any obstacles that may arise. Your expertise in data architecture standards, data warehousing, data structures, and business intelligence will play a crucial role in contributing to business outcomes within an agile team. Your key responsibilities will include developing and maintaining scalable, extensible, and highly available data solutions, prioritizing critical business needs while aligning with the broader architectural vision, identifying and mitigating risks in the data supply chain, adhering to and enhancing technical standards, and designing and building analytical data models. To excel in this role, you must possess a First-Class Degree in Engineering/Technology along with 9 to 11 years of experience in implementing data-intensive solutions using agile methodologies. You should have a strong background in relational databases and proficiency in SQL for data querying, transformation, and manipulation. Experience in data modeling for analytical purposes, automating data pipelines, utilizing cloud native technologies, and a willingness to explore new technologies are essential. Effective communication, problem-solving abilities, mentoring skills, and the capacity to independently lead and deliver medium-sized components are also key attributes. In terms of technical skills, you must have hands-on experience in ETL and proficiency in data integration platforms such as Ab Initio, Apache Spark, Talend, or Informatica. Additionally, familiarity with big data platforms like Hadoop, Hive, or Snowflake, expertise in data warehousing concepts, relational and NoSQL database design, data modeling techniques, programming languages like Python, Java, or Scala, and exposure to DevOps practices and data governance principles are crucial. Valuable technical skills include proficiency in Ab Initio, knowledge of public cloud data platforms, data quality and controls, containerization platforms, and working with various file formats. Experience with job schedulers, business intelligence tools, and relevant certifications would be advantageous. This position falls under the Technology Job Family Group within the Digital Software Engineering Job Family and is a full-time role. If you require accommodations due to a disability, please refer to the Accessibility at Citi policy. For more information on Citis EEO Policy Statement and your rights, please review the provided resources.,