Sr Data Engineer (Python)

The Opportunity:

As a Senior Data Engineer, you'll develop data pipeline solutions that help address business data needs, which require an understanding of the business context and technical skills to create reliable solutions. Beyond data pipelines, this rule must help be a data storyteller and have exposure building and using AI. Youd also mentor junior members and collaborate with peers.

What you'll Do:

Engineering

- Structured data models typically in Cloud Databases

- Semi-structured data models on storage buckets

- Python & SQL for collecting, enriching, cleansing, and other transform data.

- Data APIs in Python Flask containers

- Leverage AI for analytics and accelerate of development

- Data visualizations and dashboards using Tableau.

• Optimization solutions for costs and performance

• Infrastructure as code (Terraform)

• Execute automated deployment processes on Jenkins or GitHub Actions.

Technical Specification:

• Assist business analysts with collecting stakeholders requirements.

• Translate business requirements into detailed technical specifications.

• Create as-build documentation and run books for operations.

Continuously Learn

• Stay updated on the latest technical advancements, especially within GenAI

• Recommend changes based on advancements in Data Engineering and AI

• Embrace change and collaborate with team members by sharing and learning knowledge

What you'll Bring:

Experience:

• 5+ years of experience in data engineering, with a strong focus on Python programming, data pipeline development, and API design.

• Proven experience working with container technologies such as Docker

• Hands-on experience leverage AI.

• Proficiency in SQL and experience working with various relational and NoSQL databases.

• Strong knowledge of data warehousing concepts, ETL processes, and data modeling techniques.

• Excellent problem-solving skills, attention to detail, and the ability to work independently and as part of a team.

• Experience with cloud-based (AWS, GCP, Azure) data storage and processing platforms

Bonus Skills:

• GenAI prompt engineer,

• Machine Learning (TensorFlow, PyTorch or Similar)

• Knowledge of big data technologies

• Experience with Pandas, Spacy and NLP libraries

• Familiarity with data visualization tools such as Tableau, Power BI, or Looker.

• Experience in agile development methodologies

• Optimization of data pipeline for costs and performance

Communication:

• Strong communication and collaboration skills in English, with the ability to work effectively with both technical and non-technical stakeholders.

• Experience translating complex ideas into simple examples

Education & Certifications:

• bachelors degree in computer science, IT, engineering or a related field

• Relevant certifications in BI, AI, data engineering, or data visualization tools are highly desirable.