Lead Data Engineer

The Data Analytics Senior Programmer Analyst role at our organization involves active participation in the establishment and implementation of new or revised application systems and programs in collaboration with the Technology team. Your primary objective will be to contribute to applications systems analysis and programming activities. Your responsibilities will include utilizing your knowledge of applications development procedures and concepts, along with basic knowledge of other technical areas, to identify and define necessary system enhancements. This may involve using script tools, analyzing code, and consulting with users, clients, and other technology groups on issues to recommend programming solutions. Additionally, you will be responsible for installing and supporting customer exposure systems and applying fundamental knowledge of programming languages for design specifications. As a Data Analytics Senior Programmer Analyst, you will also be expected to analyze applications to identify vulnerabilities and security issues, conduct testing and debugging, and serve as an advisor or coach to new or lower-level analysts. You will play a key role in problem identification, information analysis, and making evaluative judgments to recommend and implement solutions. Your ability to operate with a limited level of direct supervision, exercise independence of judgment and autonomy, and act as a subject matter expert to senior stakeholders and/or other team members will be crucial in this role. Furthermore, you will need to appropriately assess risk when making business decisions, ensuring compliance with applicable laws, rules, and regulations, safeguarding the firm's reputation, and protecting Citigroup, its clients, and assets. This involves applying sound ethical judgment, escalating control issues with transparency, and managing reporting effectively. Qualifications: - 8-12 years of experience in Python programming - Strong knowledge of Object-oriented programming & Data Structures - Good understanding of design patterns - Experience with Python frameworks such as Flask and Django - Strong technical skills in Big data Pyspark & Hadoop ecosystem components (HDFS, Hbase, Hive, Pig) - Proficiency in Spark performance tuning and optimization techniques - Databases knowledge extending to PL/SQL, SQL, and Transact-SQL, with Oracle experience as a plus - Processing data in various file types including flat files, XML, Parquet, CSV, data frames, etc. - Strong knowledge of REST web services - Exposure to UI frameworks and understanding of UI architecture - Experience with source code management tools like Git - Familiarity with Agile methodology - Proficiency in issue tracking tools like Jira Education: - Bachelors degree/University degree or equivalent experience Please note that this job description offers a high-level overview of the typical work performed. Additional job-related duties may be assigned as required.,