I am a Senior Data Engineer with 9+ years of experience building scalable data platforms in the energy sector. I design cloud-native data solutions using Azure Databricks, AWS, Python, and PySpark to tackle complex business challenges and enable real-time decision-making. I excel at data modeling, ETL/ELT orchestration, and performance tuning to drive efficiency and reduce costs, delivering data products that power analytics and machine learning across supply chains and commodity trading. I’m comfortable translating technical concepts for non-technical stakeholders and thrive in Agile environments that require collaboration across teams.

Ismail O. Shittu

I am a Senior Data Engineer with 9+ years of experience building scalable data platforms in the energy sector. I design cloud-native data solutions using Azure Databricks, AWS, Python, and PySpark to tackle complex business challenges and enable real-time decision-making. I excel at data modeling, ETL/ELT orchestration, and performance tuning to drive efficiency and reduce costs, delivering data products that power analytics and machine learning across supply chains and commodity trading. I’m comfortable translating technical concepts for non-technical stakeholders and thrive in Agile environments that require collaboration across teams.

Available to hire

I am a Senior Data Engineer with 9+ years of experience building scalable data platforms in the energy sector. I design cloud-native data solutions using Azure Databricks, AWS, Python, and PySpark to tackle complex business challenges and enable real-time decision-making. I excel at data modeling, ETL/ELT orchestration, and performance tuning to drive efficiency and reduce costs, delivering data products that power analytics and machine learning across supply chains and commodity trading. I’m comfortable translating technical concepts for non-technical stakeholders and thrive in Agile environments that require collaboration across teams.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate

Work Experience

Senior Data Engineer at Longview Systems
March 1, 2023 - November 12, 2025
Articulated the architecture and benefits of an Azure-based data platform to stakeholders, built API-driven ingestion pipelines, and designed scalable data pipelines with Python, Azure Data Factory, and Databricks for multi-source data ingestion and transformation. Led data organization within Databricks (Unity Catalog), established structured Data Lake folders, automated dependency management, and implemented bronze/silver/gold data layers. Created and executed Databricks workflows to automate data processes, validated table integrity, and migrated pipelines to Databricks Serverless, reducing runtime by ~40% and improving developer productivity. Implemented CI/CD with Databricks Asset Bundle (DAB) and redesigned Power BI reports with advanced data models.
Senior Data Engineer Consultant at IOS Data Technologies Inc.
November 1, 2022 - November 12, 2025
Designed a cloud-native data lakehouse architecture for AI/ML analytics and built data pipelines to support multiple ML products, including feature selection and exploratory data analysis. Automated end-to-end data workflows for operational dashboards, integrated SQL Server, Azure Function Apps, and ADLS Gen2, and ingested data from APIs. Processed unstructured data (documents/media) using Databricks and integrated with SQL Server for structured outputs, while leveraging GraphRAG components (Neo4j, Qdrant) for AI-driven analytics. Advanced cloud DevOps practices with Azure DevOps CI/CD, and implemented serverless data pipelines on AWS (Glue, Lambda, S3) with cross-cloud governance. Also secured data access with IAM roles and policies.
Senior Data Engineer ing Consultant at Suncor Energy Services
February 28, 2023 - February 28, 2023
Reviewed technical architectures and optimized ingestion and transformation pipelines. Built Azure Data Factory pipelines to load data from iLogistics, Lenel, SAP BW, and other sources into a Data Lake, transforming and enriching data for downstream consumption. Leveraged AWS S3 for archival in a primarily Azure environment and utilized Job Manager to orchestrate pipeline dependencies. Parameterized mount points, implemented PySpark-based ETL in Databricks, and loaded data from ECAT Delta into transformed tables. Created Power Automate flows for file operations, used Azure Synapse Serverless to query data, and powered Power BI dashboards. Implemented predictive analytics models to forecast equipment failures, reducing downtime and improving maintenance efficiency.
BI Analytics Architect at Canadian Association of Petroleum Producers
May 31, 2022 - May 31, 2022
Sourced data from AER, Petrinex, CCEI, EIA, Bloomberg, and Statistics Canada; designed an Azure Synapse MPP data warehousing architecture; integrated AWS and Azure technologies for a scalable solution. Created ETL logic and Polybase-based loading into ADLS Gen2, deployed three Dedicated SQL Pools, and automated ADF pipelines with CI/CD across Dev/UAT/Prod. Monitored Synapse pipelines, Stream Analytics, and data lake storage, and provided troubleshooting. Built Power BI visuals and established a Data Catalog with governance via Azure Purview. Implemented a data quality framework using statistical analyses to identify and correct anomalies.
Senior Data Engineer and BI Developer at Arap Technologies Inc.
May 31, 2021 - May 31, 2021
Implemented Azure Data Factory pipelines to ingest data into Data Lake Gen2, performed transformations using Data Flow, HDInsight, and Databricks, and stored refined data for ML and analytics. Built an SQL Data Warehouse, developed ADF pipelines, and migrated data to ECAT Delta staging. Created Power BI reports, built ADF monitoring, and enabled real-time streaming via IoT Hub and Stream Analytics. Developed COVID-19 prediction models using time-series and regression techniques achieving around 85% accuracy, enabling data-driven public health insights.
Data Engineer and BI Developer at Arap Technologies Inc.
July 31, 2019 - July 31, 2019
Participated in requirements gathering, designed dimensional models (star/snowflake), produced Source-to-Target Mappings, performed data profiling, and built SSIS-based ETL workflows. Developed data warehouses (SSAS cubes), dashboards (Power BI/Tableau), and implemented SCD Type 1/2 using SSIS. Created SQL objects (tables, views, procedures, triggers) and delivered end-to-end data integration across on-prem and cloud environments.
Data Analyst at Kaysat Enterprise Solutions
August 31, 2014 - August 31, 2014
Gathered requirements, conducted exploratory data analysis, and cleaned disparate data sources. Built visualizations and dashboards using Tableau to communicate insights to stakeholders, leveraging Python (Pandas/Numpy) for data processing and analysis.

Education

Master of Science (MSc), Chemical Engineering at KHALIFA UNIVERSITY, ABU DHABI, UAE
January 11, 2030 - January 1, 2016
Bachelor of Engineering (B.Eng), Chemical Engineering at Federal University of Technology, Minna, Nigeria
January 11, 2030 - January 1, 2011
National Diploma (OND), Chemical Engineering at Kaduna Polytechnic, Nigeria
January 11, 2030 - January 1, 2005

Qualifications

Microsoft Certified: Fabric Data Engineer Associate
June 1, 2025 - November 12, 2025
Microsoft Certified: Azure Data Engineer Associate
April 1, 2022 - November 12, 2025
Databricks Certified Data Engineer Associate
March 1, 2024 - November 12, 2025

Industry Experience

Energy & Utilities, Professional Services, Software & Internet, Telecommunications

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate