Tech Lead, Data Architecture

Job Description

In this role, you will design, develop, and lead the adoption of Snowflake-based solutions to ensure scalable, efficient, and secure data systems that empower our business analytics and decision-making processes. As a Snowflake Advisor, you will collaborate with cross-functional teams, lead data initiatives, and act as the subject matter expert for Snowflake across the organization. What you will do: Define and implement best practices for data modelling, schema design, query optimization in Snowflake Develop and manage ETL/ELT workflows to ingest, transform and load data into Snowflake from various resources Integrate data from diverse systems like databases, APIs, flat files, cloud storage etc. into Snowflake Use tools like Streamsets, Informatica or dbt to streamline data transformation processes Monitor or tune Snowflake performance including warehouse sizing, query optimizing and storage management Manage Snowflake caching, clustering and partitioning to improve efficiency Analyze and resolve query performance bottlenecks Monitor and resolve data quality issues within the warehouse Collaborate with data analysts, data engineers and business users to understand reporting and analytic needs Work closely with DevOps team for automation, deployment and monitoring Plan and execute strategies for scaling Snowflake environments as data volume grows Monitor system health and proactively identify and resolve issues Implement automations for regular tasks Enable seamless integration of Snowflake with BI Tools like Power BI and create dashboards Support ad hoc query requests while maintaining system performance Create and maintain documentation related to data warehouse architecture, data flow, and processes Provide technical support, troubleshooting, and guidance to users accessing the data warehouse Optimize Snowflake queries and manage performance Keep up to date with emerging trends and technologies in data warehousing and data management Good working knowledge of Linux operating system Working experience on GIT and other repository management solutions Good knowledge of monitoring tools like Dynatrace, Splunk Serve as a technical leader for Snowflake-based projects, ensuring alignment with business goals and timelines Provide mentorship and guidance to team members in Snowflake implementation, performance tuning and data management Collaborate with stakeholders to define and prioritize data warehousing initiatives and roadmaps Act as point of contact for Snowflake-related queries, issues and initiatives What you will need to have: Must have 8 to 10 years of experience in data management tools like Snowflake, Streamsets, Informatica Should have experience on monitoring tools like Dynatrace, Splunk Should have experience on Kubernetes cluster management CloudWatch for monitoring and logging and Linux OS experience Ability to track progress against assigned tasks, report status, and proactively identify issues Demonstrate the ability to present information effectively in communications with peers and project management team Highly organized and works well in a fast paced, fluid and dynamic environment What would be great to have: Experience in EKS for managing Kubernetes cluster Containerization technologies such as Docker and Podman AWS CLI for command-line interactions CI/CD pipelines using Harness S3 for storage solutions and IAM for access management Banking and Financial Services experience Knowledge of software development life cycle best practices