Senior Engineer - BI and Data, Azure

Company Brief

“House of Shipping provides business consultancy and advisory services for Shipping & Logistics companies. House of Shipping's commitment to their customers begins with developing an understanding of their business fundamentals.

Currently House of Shipping is recruiting for an Executive - SAP Support to join our team.

Job Purpose:

The successful candidate will be responsible for designing, implementing, and managing data solutions using Azure Data services to support our organization's data-driven decision-making processes.

This role involves developing robust, scalable, and high-performance data pipelines and architectures that ensure the efficient Extraction, Transformation, and Loading (ETL) operation of data from various sources into the Data warehouse (or) Data Lakehouse.

Roles & Responsibilities:

• Data Solution Design:

  Design and develop data solutions on Azure that meets the business requirements and technical specifications.

• Data Integration:

  Develop and manage data integration workflows using Azure Data Factory and other relevant tools.

• Data Storage:

  Implement and manage data storage solutions using Azure Synapse SQL Pool, Azure Synapse Analytics, Azure Data Lake Storage, and other Azure services.

• Performance Optimization:

  Monitor and optimize the performance of data pipelines, queries, and storage solutions to ensure efficient data processing.

• Cost Management:

  Monitor the utilization of cloud services and adjust the properties to make it cost effective.

• Collaboration:

  Work closely with Data analyst, Developers and Business stakeholders to understand data requirements and deliver effective solutions.

• Troubleshooting:

  Identify and resolve data-related issues, ensuring data accuracy, reliability, and availability.

• Documentation:

  Create and maintain documentation for data solutions, processes, and best practices.

Competencies and Skills:

• Proficiency in Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Storage.
• Exposure in Microsoft Fabric.
• Strong SQL skills and experience with any RDBMS systems (e.g. Oracle, SQL Server, SAP BW).
• Experience with data modeling, ELT batch design, and data integration techniques.
• Experience with programming languages such as Python.
• Experience with developing solutions with Serverless architecture using Azure Functions.
• Experience in Spark and Streaming services (e.g. Kafka, Azure Event Hub).
• Familiarity with Azure AI services is a plus.
• Familiarity with PowerBI and Data Lake house architecture is a plus.

Preferred Certifications:

• Microsoft Certified: Azure Data Engineer Associate (or)
• Microsoft Certified: Fabric Analytics Engineer Associate