AZURE DATA ENGINEER

Roles & Responsibilities: Strong experience in Azure Functions, Azure Data Factory, Azure Sql, Azure Key Vault Strong Experience in Azure Data Bricks, Notebooks, ADLS, Delta Lake Experience in building data pipelines and analysis tools using Python, PySpark, Scala, SQL Proficient in integrating, transforming, and consolidating data from various structured and unstructured data. Knowledge on Autosys jobs, Batch scripts Hands on experience in using Agile methodology, Azure DevOps(CI/CD Pipeline) Knowledge on Streaming platforms (Kafka, Solace queue), Azure App Services, Azure Stream Analytics, Power BI Knowledge on Ability to work independently as well as in a team Roles & Responsibilities: Design and implement storage solutions using Azure services such as Azure SQL and Azure Data Lake Storage. Design and implement ETL using ADF data pipelines to move and transform data from various sources into cloud-based data warehouses Implement business solution using Azure DataBricks. Align with DevOps strategy to promote the code to Production. Think out of the solution to create reusable Databricks components Should have working experience in migration and modernization projects Involve in due diligence phases to transform the requirements to implementation Good communication skills Behavioural Competencies : Proven experience of delivering process efficiencies and improvements Clear and fluent English (both verbal and written) Ability to build and maintain efficient working relationships with remote teams Demonstrate ability to take ownership of and accountability for relevant products and services Ability to plan, prioritise and complete your own work, whilst remaining a team player Willingness to engage with and work in other technologies