Data Testing Architect

Skills requiredStrong SQL(minimum 6-7 years experience), Datawarehouse, ETLData and Client Platform Tech project provides all data related services to internal and external clients of SST business. Ingestion team is responsible for getting and ingesting data into Datalake. This is Global team with development team at Shanghai, Pune, Dublin and Tampa.Ingestion team uses all Big Data technologies like Impala, Hive, Spark and HDFS. Ingestion team uses Cloud technologies such as Snowflake for cloud data storage.Responsibilities:You will gain an understanding of the complex domain model and define the logical and physical data model for the Securities Services business.You will also constantly improve the ingestion, storage and performance processes by analyzing them and possibly automating them wherever possible.You will be responsible for defining standards and best practices for the team in the areas of Code Standards, Unit Testing, Continuous Integration, and Release Management.You will be responsible for improving performance of queries from lake tables viewsYou will be working with a wide variety of stakeholders source systems, business sponsors, product owners, scrum masters, enterprise architects and possess excellent communication skills to articulate challenging technical details to various class of people.You will be working in Agile Scrum and complete all assigned tasks JIRAs as per Sprint timelines and standards.Qualifications5 8 years of relevant experience in Data Development, ETL and Data Ingestion and Performance optimization.Strong SQL skills are essential experience writing complex queries spanning multiple tables is required.Knowledge of Big Data technologies Impala, Hive, Spark nice to have.Working knowledge of performance tuning of database queries understanding the inner working of the query optimizer, query plans, indexes, partitions etc.Experience in systems analysis and programming of software applications in SQL and other Big Data Query Languages.Working knowledge of data modelling and dimensional modelling tools and techniques.Knowledge of working with high volume data ingestion and high volume historic data processing is required.Exposure to scripting language like shell scripting, python is required.Working knowledge of consulting project management techniques methodsKnowledge of working in Agile Scrum Teams and processes.Experience in data quality, data governance, DataOps and latest data management techniques a plus.EducationBachelors degree University degree or equivalent experience