Belal E.

Project to transform the existing BI chain (SAP DataServices + Oracle) to a modern platform based on Microsoft Fabric, ingestion via FULL/DELTA flat files, Delta Lake storage, and Power BI reporting.

Technologies: Fabric, PySpark, Delta Lake, SQL, Data Pipelines, Power BI

Conducted a POC in Microsoft Fabric for an NIP validation service based on the Biała Lista (Polish official VAT register), intended for integration as an internal microservice or part of an existing tool (TRAX).

Daily ingestion of official files (7z/JSON) into a Lakehouse (bronze / silver / gold) via Spark notebooks and Fabric pipelines, with data quality enhancement and historization.

Modeling of cache tables (pl_vat_cache, pl_vat_status, pl_vat_hash) in a Data Warehouse to quickly determine the status of an NIP at a given time.

Exposed a GraphQL endpoint allowing, from an NIP provided by a client application, to retrieve its status (active / inactive / unknown), its validation date, and, if applicable, the associated IBAN.

Provided integration examples (Python / REST-like API) to facilitate future industrialization (integration into an internal tool or deployment as a microservice).

Technical environment: Microsoft Fabric (Lakehouse, Warehouse, Pipelines, Notebooks), PySpark, T-SQL, GraphQL, Azure Entra ID.

Main missions:

BI & Automation: Design and deployment of Power BI and SSRS reports for production and commercial monitoring. Implementation of two automated processes with SSIS and Talend to ensure data integration reliability and industrialization.

Reporting: Design and deployment of +90 multilingual reports (FR, EN, ES, NL) for the Transfo Service laboratory, dedicated to the analysis and monitoring of transformers across Europe.

Purchasing: Implementation of purchasing reporting with Power BI, based on the exploitation of data extracted from SAP BO, to optimize the monitoring of purchase and delivery orders.