Specialized in building robust data platforms that transform complex, multi-source data into structured, governed, and consumable assets. Experienced in lakehouse architecture, scalable data pipelines, and semantic data layers to support business intelligence and AI use cases. Focused on delivering production-grade data systems aligned with enterprise requirements, including governance, security, data quality, and fine-grained access controls across Dev/Stage/Prod environments.

Muhammad Bilal

Specialized in building robust data platforms that transform complex, multi-source data into structured, governed, and consumable assets. Experienced in lakehouse architecture, scalable data pipelines, and semantic data layers to support business intelligence and AI use cases. Focused on delivering production-grade data systems aligned with enterprise requirements, including governance, security, data quality, and fine-grained access controls across Dev/Stage/Prod environments.

Available to hire

Specialized in building robust data platforms that transform complex, multi-source data into structured, governed, and consumable assets. Experienced in lakehouse architecture, scalable data pipelines, and semantic data layers to support business intelligence and AI use cases.

Focused on delivering production-grade data systems aligned with enterprise requirements, including governance, security, data quality, and fine-grained access controls across Dev/Stage/Prod environments.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
See more

Work Experience

Technical Project Manager / Senior Data Engineer at ILI.Digital
January 1, 2026 - Present
Led design and implementation of a scalable enterprise data platform integrating heterogeneous sources including TYPO3 CMS, HubSpot CRM, and relational SQL databases for unified data access across business systems. Architected an Azure-based lakehouse using Azure Data Lake and Data Bricks with Medallion architecture (Bronze/Silver/Gold) for standardized ingestion, transformation, and governance across multiple systems with planned scalability to 30+ sources. Built dual data consumption layers to transform curated Silver data into dimensional models for Azure Synapse Analytics and Power BI dashboards, while also enabling AI chatbot integration via embeddings generated and stored in PostgreSQL for semantic querying. Established robust Dev/Stage/Prod environment architecture with synchronized resources and deployment consistency to ensure maintainability, scalability, and production reliability. Implemented fine-grained, scope-based data access controls at table and column level using RBA
Senior Data Engineer at Tkxel Lahore
January 1, 2025 - January 1, 2026
Architected end-to-end Medallion architecture (Bronze→Silver→Gold) processing 15+ entities to enable Power BI reporting for supply chain operations. Designed a scalable data ingestion framework using parallel processing and intelligent load balancing to extract data from multiple sources into the Bronze layer. Implemented a metadata-driven rule engine ingesting real-time data from Microsoft Dynamics 365, evaluating configurable business rules stored in control tables, and persisting results into rule-specific datasets for dynamic automated insights in Tableau dashboards. Built sophisticated Silver transformation pipelines with historical tracking, schema evolution detection, and complex business logic. Implemented automated data reconciliation comparing Azure File Share sources against the Silver layer with multi-level granularity checks. Developed comprehensive monitoring and logging framework including ingestion metrics, error handling, proactive alerting, and email notifications
Senior Data Engineer at Octopus Digital (An AVANCEON subsidiary company)
July 1, 2022 - December 1, 2024
Implemented and architected a robust infrastructure for real-time data analytics by setting up and managing an Azure cloud data lake. Integrated and synchronized diverse data sources including ERP systems, real-time PLC/sensors data, and third-party software. Orchestrated business intelligence and support systems with seamless data flow for informed decision-making and operational efficiency improvements. Executed PySpark ETL notebooks using Synapse Analytics in an Apache Spark environment to translate business requirements and transform data into a Snowflake data warehouse. Developed complex queries and optimized data retrieval for performance, enabling fast insights into real-time PLC/sensor and ERP data using Kusto Query Language (KQL) and SQL. Managed a dynamic team of data engineers, orchestrating daily scrum meetings, sprint reviews, and user story management.
Data / Application Engineer at AVANCEON MEA, Lahore
April 1, 2021 - June 1, 2022
Spearheaded implementation of an end-to-end data platform providing near real-time business insights. Engineered a comprehensive data analytics platform from inception, strategically reducing marketing costs through data-driven insights. Managed a dynamic team of data engineers coordinating daily scrum meetings, sprint reviews, and user story management. Engineered ELT pipelines extracting data from diverse sources including microservices databases, REST APIs, flat files, and third-party platforms. Revamped SQL queries to enhance application performance by over 30%. Integrated user events for near real-time insights into third-party affiliate tracking platforms and collaborated with QA to resolve production-related issues.
Software Intern
December 1, 2020 - March 1, 2021
Established secure connection between Azure IoT Hub and Advantech Edge device through certificate authentication validation in a test environment. Configured OPC Server on Advantech device, established a link with their in-built application, and stored sensor raw tag values in Azure Database. Identified, documented, and reported bugs, errors, and other issues in exclusive software applications developed by the product team.
Software Developer at Global SNI, Lahore
January 1, 2020 - September 1, 2020
Designed and developed an e-commerce platform to buy Biddefender subscription products using C# and .NET. Designed a Document Management System with digital signatures and client onboarding application built in ASP.NET MVC with MSSQL Server as database. Created responsive user-friendly pages and screens using HTML5, CSS3, JavaScript, Bootstrap, and related frontend technologies. Implemented seamless integrations with third-party APIs including payment gateways (JazzCash, PayPal), OTP verification services, and scheduling cron jobs for automated tasks inside the application.

Education

Bachelor of Electrical Engineering at University of Engineering & Technology Lahore
September 1, 2016 - October 1, 2020

Qualifications

Add your qualifications or awards here.

Industry Experience

Software & Internet, Computers & Electronics, Professional Services