Cloud Data Engineer/Developer

As a candidate for the role, you are expected to have a thorough understanding of collaboration in software development teams and shared software repositories and their concepts. Additionally, you should possess experience with Jira for effective project management. You should also have practical experience with at least one of the following tools for reporting and analysis: SSIS, SSAS, SSRS, or Power BI. Your expertise in using these tools will be crucial for generating insights and reports. In terms of Azure Data Factory and Synapse pipelines development, you are required to have a comprehensive understanding of how Data Factory pipelines function and their integration with other Azure services. Your ability to design and implement pipelines, as well as utilize Databricks and/or Synapse Delta Lake for BI purposes, will be essential. Furthermore, your role will involve Spark development, where you will need practical experience in Spark and understanding of its interaction within Synapse and Databricks Notebooks. Knowledge of Spark design, data structures, mpp flows, and expertise in Spark SQL usage within Databricks or Synapse Notebooks is also expected from you. Having an understanding of Kafka and its role in streaming is essential, along with knowledge of integrating Kafka with Spark and other persistence services. This is a permanent position requiring a minimum of 7 years of experience in Azure cloud and Git. Your expertise in these areas will be crucial for success in this role.,