Data Engineer

Role & responsibilities As a part of Tonik Data Analytics team candidate will be responsible for Develop and enhance the Data Lake Framework for ingestion of data from various sources and providing reports to downstream systems/users. Work with the different Tonik IT Teams to implement the data requirements. Develop Data Pipelines based on requirement on Key GCP Services i.e. BigQuery, Airflow, GCS using Python/SQL language. Ensure the proper GCP Standards are followed for the implementation. Preferred candidate profile Handson experience in any one of the Programming languages (Python, Java). Working experience in cloud platform (AWS/GCP/Azure). Experience in Design pattern & designing scalable solutions Handson experience in SQL and able to convert the requirements to a standard, scalable, cost effective and with better performance. Should be aware of the Data Engineering principals and Data pipeline techniques. Communicate effectively with stakeholders and other team members. Implemented E2E automated pipeline to ingest the data from different formats (csv, fixed width, json etc.) Closely work with various business teams to design and implement modern, scalable data solutions using a range of new and emerging technologies from the Google Cloud Platform. Work with Agile and implementation approaches in the delivery. Experienced and should have hands-on experience in the following key offerings from GCP or equivalent services from AWS. Composer/Airflow, BigQuery, Dataflow, Cloud Storage, Apache Beam, Data Proc Should have good understanding on the Security related configuration and arrangements in BigQuery and how to handle the data securely while sharing. Nice to have exposure/knowledge on the ML and pipelines