Data Lead

Role Overview:

• Experience in working with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.
• Create and maintain data models, including schema design and optimization.
• Create and manage data pipelines that automate the flow of data, ensuring data quality and consistency.
• Participate in requirements analysis.
• End delivery of key modules.
• Design and architect key modules.
• Create a data-driven culture with business intelligence.
• Create a complicated data model in Power BI Building a great data model to simplify the disarray. Work with dimensions, hierarchy etc.
• Write clean, scalable code using Python/Scala and PySpark (must have) programming languages
• Test and deploy applications and systems.
• Revise, update, refactor and debug code.
• Be part of a fast-paced team providing leading IT solutions to Condeco business clients.
• Mentoring team members
• Ideas and implementation in engineering hackathons

What will make you successful

• Degree in Data Science, Statistics, Computer Science or other related fields or an equivalent combination of education and experience.
• Minimum 7 years of experience in Data Engineering.
• Must have been on lead role in past for at-least 2 years.
• Proficiency in programming languages commonly used in data engineering, such as Python, PySpark, SQL.
• Experience in Azure cloud computing platform, such as developing ETL processes using Azure Data Factory, big data processing and analytics with Azure Databricks.
• Excellent communication.
• Experience in strong problem-solving and troubleshooting skills.
• 2-4 years of experience in Analytics/Visualization & good project work experience using tools like Looker, MS Power BI, Tableau, IBM Cognos etc.
• Expert in creating a complicated data model with dimensions, hierarchy etc.
• Workflow Tools: Atlassian (Jira, Confluence), Git, O365, MS Teams / Slack.
• Knowledge of reducing the added cost, complexity, and security risks of multiple solutions with an analytics platform that scales from individuals to the organization.

Good to have:

• Experience of NOSQL/COSMOS DB/MONGO DB