Data Engineer

Position Name: Microsoft Fabric Developer Company Overview: CloudFulcrum is a leading Salesforce DevOps transformation company specializing in Copado as a Service, Test Automation, and Release Management for Salesforce Applications. Our innovative solutions, including OpsBridge and our Salesforce DevOps consulting, help organizations streamline and accelerate their DevOps processes. Job Description: We are seeking a talented Microsoft Fabric Developer with DP-600 certification, 2 years of experience in Microsoft Fabric, and at least 4 years of experience in data engineering to join our dynamic team. Key Responsibilities Microsoft Fabric Development : • Design, develop, and deploy scalable solutions using the Microsoft Fabric platform, including Synapse Data Engineering, Data Integration, Data Science, and Data Warehouse. • Implement and optimize end-to-end data pipelines, integrating data from diverse sources such as Azure Data Lake, on-premises databases, and third-party systems. • Leverage Power BI for advanced visualization and reporting. Data Engineering • Design and build robust data architectures to process, transform, and store structured and unstructured data. • Develop batch and real-time data processing solutions using Azure Data Factory, Azure Databricks, and Event Hubs. • Ensure the reliability, scalability, and performance of data workflows. Integration And Collaboration • Collaborate with cross-functional teams, including data scientists, business analysts, and cloud architects, to align solutions with client requirements. • Work closely with Azure DevOps teams to establish CI/CD pipelines for seamless deployment of data solutions. Performance And Optimization • Monitor and tune data pipelines to optimize performance and reduce costs. • Implement best practices for data partitioning, indexing, and caching within Microsoft Fabric. Security And Compliance • Ensure compliance with data governance policies and security frameworks, leveraging tools like Azure Purview. • Implement robust security measures, including role-based access controls and data encryption. Training And Knowledge Sharing • Act as a subject matter expert for Microsoft Fabric, mentoring junior team members and conducting knowledge-sharing sessions. • Stay updated on the latest Microsoft Fabric features and advancements to recommend innovative solutions . Documentation And Reporting • Prepare detailed technical documentation, including architecture diagrams, data flow designs, and troubleshooting guides. • Generate reports on data usage, pipeline performance, and system health for internal stakeholders and clients. Qualifications Required : • Microsoft DP-600 certification (Designing and Implementing a Data Platform in Microsoft Azure). • 2+ years of hands-on experience in Microsoft Fabric development. • 4+ years of overall experience in data engineering, with a focus on Azure cloud technologies. • Strong expertise in SQL, Python, and Spark for data processing. • Proficiency in Azure Data Factory, Azure Synapse Analytics, Power BI, and Azure Databricks. • Solid understanding of data modeling, ETL pipelines, and big data architectures. Preferred • Experience with Azure Machine Learning or AI/ML pipelines in Microsoft Fabric. • Familiarity with Cosmos DB, Azure Stream Analytics, and Kubernetes. • Knowledge of data governance tools like Azure Purview. • Exposure to DevOps practices for data engineering, including CI/CD pipelines in Azure DevOps. Key Skills • Advanced knowledge of Microsoft Fabric tools and architecture. • Expertise in building real-time and batch processing pipelines. • Strong problem-solving and analytical skills. • Excellent written and verbal communication for technical and non-technical audiences. • Collaborative mindset with a commitment to meeting project deadlines. What We Offer • Opportunity to work on high-impact projects with Microsoft's cutting-edge technologies. • Access to continuous learning and professional development opportunities. • A supportive and collaborative team environment with exposure to global clients. Show more Show less