Microsoft Fabric Engineer

Overview:

We are looking for an experienced Microsoft Fabric Engineer to join our Digital & Data team in Abu Dhabi and support the design, development and continuous improvement of our enterprise data platform.

The successful candidate will be responsible for building scalable, secure and reliable data solutions using Microsoft Fabric, transforming data from multiple business systems into governed, reusable data products that support analytics, reporting, operational insights and customer data initiatives.

This role requires strong expertise in Microsoft Fabric, SQL, Python/PySpark, data engineering and modern cloud-based data architectures, with the ability to manage the full data lifecycle from ingestion and transformation through to deployment, monitoring and optimisation.

Duties & Responsibilities:

• Design, develop and maintain scalable enterprise data solutions using Microsoft Fabric, including OneLake, Lakehouses, Warehouses, Data Factory pipelines, Dataflow Gen2, notebooks and Spark jobs.
• Build and manage reliable data ingestion pipelines integrating multiple enterprise systems, databases, APIs and approved external platforms.
• Develop and maintain Bronze, Silver and Gold data layers using Medallion Architecture to ensure structured, accurate and reusable data products.
• Implement data transformation processes using SQL, Python and PySpark, applying Delta and Parquet formats and appropriate dimensional modelling techniques.
• Develop automated data quality controls, including validation, reconciliation, duplicate detection, completeness checks and exception management.
• Optimise SQL queries, Spark workloads, storage structures, refresh schedules and Fabric capacity utilisation to improve performance and efficiency.
• Design and maintain secure data access controls using role-based access control, row-level security and Microsoft Entra ID.
• Implement data governance practices covering lineage, ownership, privacy, auditability and controlled data sharing.
• Manage source-controlled development, CI/CD pipelines and deployment processes across Development, Test and Production environments.
• Develop monitoring, alerting and operational support procedures to ensure data availability, reliability and timely incident resolution.
• Troubleshoot pipeline failures, data quality issues and performance bottlenecks, conducting root-cause analysis and implementing corrective actions.
• Collaborate with business stakeholders, data analysts, architects, application teams and vendors to translate business requirements into effective technical solutions.
• Support integration with enterprise applications such as Dynamics 365, Oracle Fusion, SharePoint, ticketing and point-of-sale systems.
• Develop and maintain data models and datasets that support Power BI reporting, analytics and customer data initiatives.
• Prepare technical documentation covering architecture, data mappings, transformation rules, security, deployment and operational procedures.
• Support knowledge sharing, technical reviews and continuous improvement of data engineering standards and practices.

Job Specifications:

• Typically 5+ years of experience in data engineering, data platforms or analytics engineering, or equivalent experience delivering complex data solutions.
• Typically 3+ years of hands‑on Microsoft Fabric experience , or closely related Azure data services experience with demonstrated ability to apply that knowledge to Microsoft Fabric.
• Strong practical knowledge of Microsoft Fabric , including OneLake, Lakehouses, Warehouses, Data Factory pipelines, Dataflow Gen2, notebooks, Spark and deployment pipelines.
• Advanced proficiency in SQL and Python/PySpark for data ingestion, transformation, validation, automation and troubleshooting.
• Proven experience developing and maintaining production‑grade ETL/ELT pipelines and analytical data products.
• Strong understanding of Medallion Architecture, dimensional modelling, fact and dimension tables, slowly changing dimensions and semantic models.
• Hands‑on experience with Delta and Parquet formats, Lakehouse architecture, partitioning and data lifecycle management.
• Experience integrating REST APIs, relational databases, files and enterprise applications.
• Strong knowledge of Microsoft Azure data services and integration with Power BI semantic models.
• Experience with Git, Azure DevOps, CI/CD pipelines, automated testing and deployment across multiple environments.
• Understanding of data security and governance, including RBAC, RLS, Microsoft Entra ID, data lineage and auditability.
• Experience with performance tuning, monitoring, logging, incident management and data quality frameworks.
• Familiarity with Dynamics 365, Microsoft Customer Insights or Customer 360 solutions is an advantage.
• Strong analytical thinking, troubleshooting, problem-solving and communication skills.
• Ability to work independently, collaborate with cross-functional teams and communicate technical concepts to non‑technical stakeholders.
• Bachelor's degree in Computer Science, Data Engineering, Information Systems, Software Engineering or a related discipline, or equivalent practical experience.
• Microsoft Fabric Data Engineer Associate certification, relevant Azure certifications or Power BI certification are advantageous.

#J-18808-Ljbffr