Senior Data Engineer

The Data Engineer will be responsible for development of data software applications, data platforms and data products. This Engineer will closely work with application engineers, data engineers, data scientists and CRM to design, document, develop, test and implement solutions. This engineer will work with other engineers, and individually contribute to the development including defining engineering standards, data analysis, data modeling, coding, testing/QA, code review, deployment, operational readiness, and agile management.

Responsibilities

• Be a key contributor to deliver on-time, on budget, high value complex projects
• Take technical responsibility for all stages and/or iterations in a software component
• Specify and ensure the design and development of technology solutions properly fulfills all business requirements
• Ensure project stakeholders receive regular communications about status of the work
• Anticipate change management requirements and ensure effective solution adoption by ensuring appropriate knowledge transfer, training and deployment readiness
• Document design approaches, code artifacts, communicate to and participate in knowledge sharing
• Highly organized and adaptable to dynamic work schedule with effective time management and prioritization skills
• Provide technical guidance to associates, colleagues and/or customers
• Communicate difficult concepts and negotiate with others to adopt a different point of view
• Interpret internal/external business challenges and recommend best-practices to improve products, processes, or services
• Ability to work in multi-project environment and support multiple internal departments
• Knowledge of industry best practice approach and standards
• Ability to multi-task and effectively delegate tasks to teams

Qualifications

• Computer Science Degree or equivalent
• 6 to 8 years of working experience in a commercial software development environment
• 5+ years of experience as an engineer in data platform centric environments
• Hands-on experience in Data Engineering
• Extensive knowledge of data platform paradigms and software architecture
• Experience with cloud development on the Amazon Web Services (AWS) platform with services including API Gateway, Lambda, EC2, ECS, SQS, SNS, Dynamo DB, Redshift and Aurora
• Expert-level Pyspark, Python & SQL skills
• Ability to comprehend and implement detailed project specifications as well as the ability to adapt to various technologies and simultaneously work on multiple projects
• Strong problem-solving skills of different complexities required
• Excellent proactive communications and planning skills

Qualifications

• Computer Science Degree or equivalent
• 6 to 8 years of working experience in a commercial software development environment
• 5+ years of experience as an engineer in data platform centric environments
• Hands-on experience in Data Engineering
• Expert-level Pyspark, Python & SQL skills
• Strong problem-solving skills of different complexities required and Excellent proactive communications and planning skills