Data Engineer

Responsibilities

CONTRACT TO HIRE

You will collaborate with the team to design, develop, and maintain data pipelines, data platforms using Cloud ecosystems like GCP, Azure, Snowflake etc. You will be responsible for creating and managing the end-to-end data pipeline using custom scripts in python, R language or any third party tools like Dataflow, Airflow, AWS Glue, Fivetran, Alteryx etc. The data pipelines built will be used for managing various operations from data acquisition, data storage to data transformation and visualization. You will also work closely with cross-functional teams to identify data-driven solutions to business problems and help clients make data-driven decisions.

You will also be also expected to help build dashboards or any custom reports in Google sheets or Excel. Basic to mid level proficiency in creating and editing dashboards on at least one tool is a must.

Qualifications

• 2+ of experience in using

  python language

  to perform Data Engineering, Data Modeling, Data Warehousing and Data Analytics and ETL (Extract Transform Load)
• Familiarity with GUI based ETL tools like Azure data factory, AWS Glue, Fivetran, Talend, Pentaho etc. for data integration and other data operations.
• Strong programming skills in SQL, and/ or R. Python. This is a must-have skill.
• Experience in designing and implementing data pipelines and data platforms in cloud and on-premise systems
• Basic to mid level proficiency in data visualization on any of the industry accepted tools like Power BI, Looker studio or Tableau is a plus.
• Understanding of data integration and data governance principles
• Knowledge of cloud platforms such as Snowflake, AWS or Azure
• Excellent analytical and problem-solving skills and good communication and interpersonal skills
• Bachelor's or Master's degree in Data Science, Computer Science, or a related field