Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

I am Sheldon Birch-Lucas, a data-focused Systems Analyst (Data Developer) with a track record of building and refining data pipelines in Azure Synapse and Azure Databricks to deliver clean, reliable datasets for accounting and oil sands reporting teams. I routinely create and maintain data quality dashboards and notebooks across numerous tables and schemas to safeguard data integrity from source systems through to business units. I also manage CI/CD pipelines to ensure deployments meet business requirements with traceable changes. In a DataOps consultant capacity at CGI, I ensured Apache Airflow, Azure Data Factory, and Databricks pipelines processed billions of rows daily without data loss or duplicates. I designed and maintained pipelines to ingest data from SCADA, Excel, and IoT devices, stored in Databricks Delta and Azure Synapse, and built Power BI dashboards to monitor data health and duplication across databases. I’m passionate about scalable data platforms, reliability, and clear data storytelling through dashboards and reports.…I am Sheldon Birch-Lucas, a data-focused Systems Analyst (Data Developer) with a track record of building and refining data pipelines in Azure Synapse and Azure Databricks to deliver clean, reliable datasets for accounting and oil sands reporting teams. I routinely create and maintain data quality dashboards and notebooks across numerous tables and schemas to safeguard data integrity from source systems through to business units. I also manage CI/CD pipelines to ensure deployments meet business requirements with traceable changes. In a DataOps consultant capacity at CGI, I ensured Apache Airflow, Azure Data Factory, and Databricks pipelines processed billions of rows daily without data loss or duplicates. I designed and maintained pipelines to ingest data from SCADA, Excel, and IoT devices, stored in Databricks Delta and Azure Synapse, and built Power BI dashboards to monitor data health and duplication across databases. I’m passionate about scalable data platforms, reliability, and clear data storytelling through dashboards and reports.

Sheldon Birch-Lucas

Data Scientist, Data Analyst, Full Stack Developer, +5





I am Sheldon Birch-Lucas, a data-focused Systems Analyst (Data Developer) with a track record of building and refining data pipelines in Azure Synapse and Azure Databricks to deliver clean, reliable datasets for accounting and oil sands reporting teams. I routinely create and maintain data quality dashboards and notebooks across numerous tables and schemas to safeguard data integrity from source systems through to business units. I also manage CI/CD pipelines to ensure deployments meet business requirements with traceable changes. In a DataOps consultant capacity at CGI, I ensured Apache Airflow, Azure Data Factory, and Databricks pipelines processed billions of rows daily without data loss or duplicates. I designed and maintained pipelines to ingest data from SCADA, Excel, and IoT devices, stored in Databricks Delta and Azure Synapse, and built Power BI dashboards to monitor data health and duplication across databases. I’m passionate about scalable data platforms, reliability, and clear data storytelling through dashboards and reports.…I am Sheldon Birch-Lucas, a data-focused Systems Analyst (Data Developer) with a track record of building and refining data pipelines in Azure Synapse and Azure Databricks to deliver clean, reliable datasets for accounting and oil sands reporting teams. I routinely create and maintain data quality dashboards and notebooks across numerous tables and schemas to safeguard data integrity from source systems through to business units. I also manage CI/CD pipelines to ensure deployments meet business requirements with traceable changes. In a DataOps consultant capacity at CGI, I ensured Apache Airflow, Azure Data Factory, and Databricks pipelines processed billions of rows daily without data loss or duplicates. I designed and maintained pipelines to ingest data from SCADA, Excel, and IoT devices, stored in Databricks Delta and Azure Synapse, and built Power BI dashboards to monitor data health and duplication across databases. I’m passionate about scalable data platforms, reliability, and clear data storytelling through dashboards and reports.

Available to hire

I am Sheldon Birch-Lucas, a data-focused Systems Analyst (Data Developer) with a track record of building and refining data pipelines in Azure Synapse and Azure Databricks to deliver clean, reliable datasets for accounting and oil sands reporting teams. I routinely create and maintain data quality dashboards and notebooks across numerous tables and schemas to safeguard data integrity from source systems through to business units. I also manage CI/CD pipelines to ensure deployments meet business requirements with traceable changes.

In a DataOps consultant capacity at CGI, I ensured Apache Airflow, Azure Data Factory, and Databricks pipelines processed billions of rows daily without data loss or duplicates. I designed and maintained pipelines to ingest data from SCADA, Excel, and IoT devices, stored in Databricks Delta and Azure Synapse, and built Power BI dashboards to monitor data health and duplication across databases. I’m passionate about scalable data platforms, reliability, and clear data storytelling through dashboards and reports.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Intermediate

Language

English

Fluent

Work Experience

Systems Analyst (Data Developer) at Canadian Natural Resources Ltd

December 1, 2024 - October 9, 2025

Designed, refactored and developed over 50 data pipelines in Azure Synapse and Azure Databricks to create quality datasets for the accounting and oil sands reporting teams. Created and maintained data quality reports in PowerBI and Databricks notebooks for over 70 database tables across multiple schemas and medallion layers to ensure data integrity from source systems. Maintained 10 CI/CD pipelines in Azure DevOps that moved Azure Data Factory pipelines and Azure Databricks notebooks between development, testing and production environments ensuring that the data meets the business requirements.

Consultant (DataOps) at CGI

February 1, 2023 - October 9, 2025

Tasked daily with ensuring that the Apache Airflow, Azure Data Factory, and Databricks data pipelines processing over 1,000,000,000+ rows of oil and gas data daily run successfully and without any data loss or duplicate records. Designed and maintained over 20 data pipelines using Azure Data Factory and Databricks notebooks to bring information from SCADA systems, excel spreadsheets, and IoT devices and store them in Databricks Delta tables and Azure Synapse. Created 6 Power BI dashboards and reports to track the health of the data platform, monitoring for duplicates or missing data across Databricks, SQL Server, and Azure Synapse.

Systems Analyst (Data Developer) at Canadian Natural Resources Ltd

December 31, 2024 - October 9, 2025

Designed, refactored and developed over 50 data pipelines in Azure Synapse and Azure Databricks to create quality datasets for the accounting and oil sands reporting teams. Created and maintained data quality reports in PowerBI and Databricks notebooks for 70+ database tables across multiple schemas and medallion layers to ensure data integrity from source systems. Maintained 10 CI/CD pipelines in Azure DevOps moving Azure Data Factory pipelines and Databricks notebooks between development, testing and production environments to ensure data meets business requirements.

Consultant (DataOps) at CGI

February 1, 2023 - October 9, 2025

Ensured Apache Airflow, Azure Data Factory, and Databricks data pipelines processing over 1,000,000,000+ rows of oil and gas data daily ran successfully with no data loss or duplicates. Designed and maintained over 20 data pipelines using Azure Data Factory and Databricks notebooks to ingest from Scada systems, Excel spreadsheets, and IoT devices into Databricks Delta tables and Azure Synapse. Created 6 Power BI dashboards and reports to monitor data health and data quality across Databricks, SQL Server, and Azure Synapse.

Systems Analyst (Data Developer) at Canadian Natural Resources Ltd

December 1, 2024 - October 9, 2025

Designed, refactored and developed over 50 data pipelines in Azure Synapse and Azure Databricks to create quality datasets for the accounting and oil sands reporting teams. Created and maintained data quality reports in PowerBI and Databricks notebooks for over 70 database tables across multiple schemas and medallion layers to ensure data integrity from the source systems and tables used by the different business units. Maintained 10 CI/CD pipelines in Azure DevOps that moved Azure Data Factory pipelines and Azure Databricks notebooks between development, testing and production environments ensuring that the data meets the business requirements.

Consultant (DataOps) at CGI

February 1, 2023 - October 9, 2025

Tasked daily with ensuring that the Apache Airflow, Azure Data Factory, and Databricks data pipelines processing over 1,000,000,000+ rows of oil and gas data daily run successfully and without any data loss or duplicate records. Also have experience with data wrangling and applied it to preprocessing (cleaning, transformations, etc) and troubleshooting oil and gas data. Designed and maintained over 20 data pipelines using Azure Data Factory and Databricks notebooks to bring information from Scada systems, excel spreadsheets, and IoT devices and store them in DataBricks delta tables and Azure Synapse. Created 6 PowerBi dashboards and reports to track the health of the data platform. These dashboards and reports keep track if there is duplicated data or missing data in database tables in Databricks, SQL server, and Azure Synapse.

Systems Analyst (Data Developer) at Canadian Natural Resources Ltd

December 31, 2024 - October 9, 2025

Designed, refactored and developed over 50 data pipelines in Azure Synapse and Azure Databricks to create quality datasets for the accounting and oil sands reporting teams. Created and maintained data quality reports in Power BI and Databricks notebooks for 70+ database tables across multiple schemas and medallion layers to ensure data integrity from the source systems and tables used by the different business units. Maintained 10 CI/CD pipelines in Azure DevOps that moved Azure Data Factory pipelines and Azure Databricks notebooks between development, testing and production environments ensuring that the data meets the business requirements.

Consultant (DataOps) at CGI

February 28, 2023 - October 9, 2025

Tasked daily with ensuring that the Apache Airflow, Azure Data Factory, and Databricks data pipelines processing over 1,000,000,000+ rows of oil and gas data daily run successfully and without any data loss or duplicate records. Designed and maintained over 20 data pipelines using Azure Data Factory and Databricks notebooks to bring information from Scada systems, excel spreadsheets, and IoT devices and store them in Databricks delta tables and Azure Synapse. Created 6 PowerBi dashboards and reports to track the health of the data platform, including monitoring for duplicated or missing data across Databricks, SQL Server, and Azure Synapse.