Data Engineer

Data Engineer

Astreya offers comprehensive IT support and managed services. These services include Data

Center and Network Management, Digital Workplace Services (like Service Desk, Audio Visual, and

IT Asset Management), as well as Next-Gen Digital Engineering services encompassing Software

Engineering, Data Engineering, and cybersecurity solutions. Astreya's expertise lies in creating

seamless interactions between people and technology to help organizations achieve operational

excellence and growth.

Job Description

We are seeking experienced Data Engineer to join our analytics division.

• You will be aligned with our Data Analytics and BI vertical. You will have to conceptualize and own the build out of problem-solving data marts for consumption by data science and BI teams, evaluating design and operational tradeoffs within systems.
• Design, develop, and maintain robust data pipelines and ETL processes using data platforms for the organization's centralized data warehouse.
• Create or contribute to frameworks that improve the efficacy of logging data, while working with the Engineering team to triage issues and resolve them.
• Validate data integrity throughout the collection process, performing data profiling to identify and comprehend data anomalies.
• Influence product and cross-functional (engineering, data science, operations, strategy) teams to identify data opportunities to drive impact.

Requirements

Experience & Education

• Bachelor's degree in Computer Science, Mathematics, a related field, or equivalent practical experience.
• 5 years of experience coding with SQL or one or more programming languages (e.g., Python, Java, R, etc.) for data manipulation, analysis, and automation
• 5 years of experience designing data pipelines (ETL) and dimensional data modeling for synchronous and asynchronous system integration and implementation.
• Experience in managing troubleshooting technical issues, and working with Engineering and Sales Services teams.

Preferred qualifications:

• Master’s degree in Engineering, Computer Science, Business, or a related field.
• Experience with cloud-based services relevant to data engineering, data storage, data processing, data warehousing, real-time streaming, and serverless computing.
• Experience with experimentation infrastructure, and measurement approaches in a technology platform.
• Experience with data processing software (e.g., Hadoop, Spark) and algorithms (e.g., MapReduce, Flume).