Data Engineer-Data Platforms-Azure

Job Description

As a Data Engineer specializing in DBT, you'll be joining one of IBM Consulting's Client Innovation Centers here in Hyderabad. In this role, you'll contribute your deep technical and industry expertise to a variety of public and private sector clients, driving innovation and adopting new technologies. Your Responsibilities Establish and implement best practices for DBT workflows , ensuring efficiency, reliability, and maintainability. Collaborate with data analysts, engineers, and business teams to align data transformations with business needs. Monitor and troubleshoot data pipelines to ensure accuracy and performance. Work with Azure-based cloud technologies to support data storage, transformation, and processing. Required Qualifications Education : Bachelor's Degree Technical & Professional Expertise : Strong MS SQL and Azure Databricks experience. Ability to implement and manage data models in DBT , focusing on data transformation and alignment with business requirements. Experience ingesting raw, unstructured data into structured datasets within a cloud object store. Proficiency in utilizing DBT to convert raw, unstructured data into structured datasets , enabling efficient analysis and reporting. Skilled in writing and optimizing SQL queries within DBT to enhance data transformation processes and improve overall performance. Preferred Qualifications Education : Master's Degree Technical & Professional Expertise : Ability to establish best DBT processes to improve performance, scalability, and reliability. Experience in designing, developing, and maintaining scalable data models and transformations using DBT in conjunction with Databricks . Proven interpersonal skills, contributing to team efforts and achieving results as required.