Senior Microsoft Fabric Data Engineer

Ciklum

We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4, 000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live.

About the role:

We are seeking a highly skilled and experienced Senior Microsoft Fabric Data Engineer to design, develop, and optimize advanced data solutions leveraging the Microsoft Fabric platform.

You will be responsible for building robust, scalable data pipelines, integrating diverse and large-scale data sources, and enabling sophisticated analytics and business intelligence capabilities. This role requires extensive hands-on expertise with Microsoft Fabric, a deep understanding of Azure data services, and mastery of modern data engineering practices.

• Lead the design and implementation of highly scalable and efficient data pipelines and data warehouses using Microsoft Fabric and a comprehensive suite of Azure services (Data Factory, Synapse Analytics, Azure SQL, Data Lake)


• Develop, optimize, and oversee complex ETL/ELT processes for data ingestion, transformation, and loading from a multitude of disparate sources, ensuring high performance with large-scale datasets


• Ensure the highest level of data integrity, quality, and governance throughout the entire Fabric environment, establishing best practices for data management


• Collaborate extensively with stakeholders, translating intricate business requirements into actionable, resilient, and optimized data solutions


• Proactively troubleshoot, monitor, and fine-tune data pipelines and workflows for peak performance and efficiency, particularly in handling massive datasets


• Architect and manage workspace architecture, implement robust user access controls, and enforce data security in strict compliance with privacy regulations


• Automate platform tasks and infrastructure management using advanced scripting languages (Python, PowerShell) and Infrastructure as Code (Terraform, Ansible) principles


• Document comprehensive technical solutions, enforce code modularity, and champion best practices in version control and documentation across the team


• Stay at the forefront of Microsoft Fabric updates, new features, and contribute significantly to continuous improvement initiatives and the adoption of cutting-edge technologies

• Minimum of 5+ years of progressive experience in data engineering, with at least 3 years of hands-on, in-depth work on Microsoft Fabric and a wide array of Azure data services


• Exceptional proficiency in SQL, Python, and advanced data transformation tools (e. g. , Spark, PySpark notebooks)


• Mastery of data warehousing concepts, dimensional modeling, and advanced ETL best practices


• Extensive experience with complex hybrid cloud and on-premises data integration scenarios


• Profound understanding of data governance, security protocols, and compliance standards


• Excellent problem-solving, analytical, and communication skills, with the ability to articulate complex technical concepts clearly to both technical and non-technical audiences

• Experience with Power BI, Azure Active Directory, and managing very large-scale data infrastructure


• Strong familiarity with Infrastructure as Code and advanced automation tools


• Bachelor s degree in Computer Science, Engineering, or a related field (or equivalent extensive experience)

• Care: your mental and physical health is our priority. We ensure comprehensive company-paid medical insurance, as well as financial and legal consultation


• Tailored education path: boost your skills and knowledge with our regular internal events (meetups, conferences, workshops), Udemy licence, language courses and company-paid certifications


• Growth environment: share your experience and level up your expertise with a community of skilled professionals, locally and globally


• Flexibility: hybrid work mode at Chennai or Pune


• Opportunities: we value our specialists and always find the best options for them. Our Resourcing Team helps change a project if needed to help you grow, excel professionally and fulfil your potential


• Global impact: work on large-scale projects that redefine industries with international and fast-growing clients


• Welcoming environment: feel empowered with a friendly team, open-door policy, informal atmosphere within the company and regular team-building events