Associate Technical Architect Azure Data Engineer

Role & responsibilities

The purpose of this role is to oversee the development of our database marketing solutions, using database technologies such as Microsoft SQL Server/Azure, Amazon Redshift, Google BigQuery. The role will be involved in design, specifications, troubleshooting and issue resolution. The ability to communicate to both technical and non-technical audiences is key.

Business Title

Years of Experience

Must have skills

1. Database (one or more of MS SQL Server, Oracle, Cloud SQL, Cloud Spanner, etc.)
2. Data Warehouse (one or more of Big Query, SnowFlake, etc.) 3. ETL tool (two or more of Cloud Data Fusion, Dataflow, Dataproc, Pub/Sub, Composer, Cloud Functions, Cloud Run, etc.) 4. Experience in Cloud platforms - GCP 5. Python, PySpark, Project & resource management 6. SVN, JIRA, Automation workflow (Composer, Cloud Scheduler, Apache Airflow, Tidal, Tivoli or similar)

Good to have skills

1. UNIX shell scripting, SnowFlake, Reshift, Familiar with NoSQL such as MongoDB, etc
2. ETL tool (Databricks / AWS Glue / AWS Lambda / Amazon Kinesis / Amazon Firehose / Azure Data Factory / ADF / DBT / Talend, Informatica, IICS (Informatica cloud) ) 3. Experience in Cloud platforms - AWS / Azure 4. Client-facing skills

Job Descreption

The Technical Lead / Technical Consultant is a core role and focal point of the project team responsible for the whole technical solution and managing the day to day delivery. The role will focus on the technical solution architecture, detailed technical design, coaching of the development/implementation team and governance of the technical delivery. Technical ownership of the solution from bid inception through implementation to client delivery, followed by after sales support and best practise advice. Interactions with internal stakeholders and clients to explain technology solutions and a clear understanding of clients business requirements through which to guide optimal design to meet their needs.

Key responsibiltes

• Ability to design simple to medium data solutions for clients by using cloud architecture using GCP
  • Strong understanding of DW, data mart, data modelling, data structures, databases, and data ingestion and transformation. • Working knowledge of ETL as well as database skills • Working knowledge of data modelling, data structures, databases, and ETL processes • Strong understand of relational and non-relational databases and when to use them • Leadership and communication skills to collaborate with local leadership as well as our global teams • Translating technical requirements into ETL/ SQL application code • Document project architecture, explain detailed design to team and create low level to high level design • Create technical documents for ETL and SQL developments using Visio, PowerPoint and other MS Office package • Will need to engage with Project Managers, Business Analysts and Application DBA to implement ETL Solutions • Perform mid to complex level tasks independently • Support Client, Data Scientists and Analytical Consultants working on marketing solution • Work with cross functional internal team and external clients • Strong project Management and organization skills. Ability to lead 1 2 projects of team size 2 3 team members. • Code management systems which includes Code review, deployment, cod • Work closely with the QA / Testing team to help identify/implement defect reduction initiatives • Work closely with the Architecture team to make sure Architecture standards and principles are followed during development • Performing Proof of Concepts on new platforms/ validate proposed solutions • Work with the team to establish and reinforce disciplined software development, processes, standards, and error recovery procedures are deployed • Must understand software development methodologies including waterfall and agile • Distribute and manage SQL development Work across the team • The candidate must be willing to work during overlapping hours with US-based teams to ensure effective collaboration and communication, typically between [e.g., 6:00 PM to 11:00 PM IST], depending on project needs.

Education Qulification

Bachelors or Master Degree in Computer Science

Certification (Must):

Shift timing

GMT (UK Shift) - 2 PM to 11 PM