AI Data Engineer

Job Description

The main function of an AI Data Engineer is to construct and maintain data pipelines, ETL processes, and data storage systems to facilitate efficient data collection, processing, and analysis. They ensure data quality and accessibility for data-driven decision-making, collaborating closely with data scientists and analysts. Job Responsibilities: Work with senior management, technical and client teams in order to determine data requirements, business data implementation approaches, best practices for advanced data manipulation, storage and analysis strategies Write and code logical and physical database descriptions and specify identifiers of database to management system Design, implement, automate and maintain large scale enterprise data ETL processes Modify existing databases and database management systems and/or direct programmers and analysts to make changes Test programs or databases, correct errors and make necessary modifications Optimize queries across massive datasets to minimize load time and resource usage Ensure efficient data retrieval, especially as data continues to grow year over year Build and maintain data validation protocols to address quality issues, such as misassigned building IDs and other anomalies Automate validation checks to streamline data ingestion, thereby enhancing data integrity and trustworthiness Qualifications: Bachelor's degree in a technical field such as computer science, computer engineering or related field required 5-10 years applicable experience required Experience with database technologies Knowledge of the ETL process Strong knowledge of SQL scripting language Strong written and oral communication skills Strong troubleshooting and problem solving skills Demonstrated history of success Desire to be working with data and helping businesses make better data driven decisions Experience with PowerBI Experience with Power Query Experience working with various data sources which vary between disparate excel sheets to automated tables in database Preferred Qualifications: Proficiency in Python Experience with data ingestion tools (notebooks) and leveraging AI capabilities through Python scripting to enhance efficiency and scalability Experience with Microsoft Fabric Master's degree in a technical field such as computer science, computer engineering or related field required. Need to be a SQL, data warehouse/lake wizard