I’m Kenneth Chirchir, a software and data engineer based in Nairobi, where I build reliable data platforms and performance/telemetry systems that help teams ship faster and with higher confidence. At Microsoft, I’ve led the design and delivery of ETL/ELT pipelines and analytics solutions using Azure Data Factory, Microsoft Fabric, Cosmos (Scope), and Kusto—turning large-scale Insider device telemetry into well-governed warehouses, curated datasets, and release-blocking regression insights. I’m passionate about performance engineering and applied AI for triage, and I partner closely across engineering, OEMs/IHVs, and benchmark teams. I’ve also delivered multi-market data platforms and real-time processing pipelines at Ezra World, and helped stand up big-data streaming and governance foundations at Safaricom across Hadoop, Kafka, NiFi, Spark, and Flink—always focusing on data quality, operational reliability, and measurable outcomes.…

Kenneth Chirchir

I’m Kenneth Chirchir, a software and data engineer based in Nairobi, where I build reliable data platforms and performance/telemetry systems that help teams ship faster and with higher confidence. At Microsoft, I’ve led the design and delivery of ETL/ELT pipelines and analytics solutions using Azure Data Factory, Microsoft Fabric, Cosmos (Scope), and Kusto—turning large-scale Insider device telemetry into well-governed warehouses, curated datasets, and release-blocking regression insights. I’m passionate about performance engineering and applied AI for triage, and I partner closely across engineering, OEMs/IHVs, and benchmark teams. I’ve also delivered multi-market data platforms and real-time processing pipelines at Ezra World, and helped stand up big-data streaming and governance foundations at Safaricom across Hadoop, Kafka, NiFi, Spark, and Flink—always focusing on data quality, operational reliability, and measurable outcomes.…

Available to hire

I’m Kenneth Chirchir, a software and data engineer based in Nairobi, where I build reliable data platforms and performance/telemetry systems that help teams ship faster and with higher confidence. At Microsoft, I’ve led the design and delivery of ETL/ELT pipelines and analytics solutions using Azure Data Factory, Microsoft Fabric, Cosmos (Scope), and Kusto—turning large-scale Insider device telemetry into well-governed warehouses, curated datasets, and release-blocking regression insights.

I’m passionate about performance engineering and applied AI for triage, and I partner closely across engineering, OEMs/IHVs, and benchmark teams. I’ve also delivered multi-market data platforms and real-time processing pipelines at Ezra World, and helped stand up big-data streaming and governance foundations at Safaricom across Hadoop, Kafka, NiFi, Spark, and Flink—always focusing on data quality, operational reliability, and measurable outcomes.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
Intermediate
Intermediate
Intermediate
Intermediate
See more

Language

Work Experience

Software Engineer II at Microsoft
October 1, 2024 - Present
Led design and delivery of ETL/ELT pipelines using Cosmos (Scope), Azure Data Factory and Microsoft Fabric to ingest power and performance telemetry and traces from Windows Insider devices into the data lake. Designed a Microsoft Fabric and Kusto telemetry data warehouse with data models, partitioning, storage tiers, retention, and governance for multi-terabyte datasets. Built Kusto (KQL) and Fabric pipelines aggregating in-market telemetry into curated datasets for performance-critical OS component identification, improving Windows speed and reducing OS binary size at scale. Architected a benchmarking platform on Azure Synapse with data-quality checks and statistical baselines feeding release-blocking regression gates. Built pipelines for Windows crash data modeling by driver, build, and hardware to prioritize fixes. Developed a benchmarking toolkit for repeatable power/performance evaluation, served as power and performance SME using WPR/WPA traces, and built an agentic AI regression
Senior Data Engineer at Ezra World
March 1, 2023 - October 1, 2024
Designed and implemented a multi-market data platform using Azure Databricks, Data Factory, and ADLS Gen2 to serve four markets, translating market-specific requirements into reusable pipelines and reducing onboarding time. Defined data models and governance practices to reduce reporting discrepancies across markets. Automated pipeline deployments to AWS using Ansible and established Bitbucket CI/CD with a private PyPI repository to reduce deployment time and failures. Built cross-source reconciliation and validation to improve efficiency and reduce data-integrity issues. Developed Python/PostgreSQL processing applications and optimized analytics queries for faster performance. Implemented Kafka-based real-time processing and Azure-to-on-premises transfer pipelines to significantly increase throughput. Built Java/Spring Boot APIs to expose warehouse data and collaborated on dashboards. Mentored junior engineers and partnered with data scientists to deliver feature pipelines and monitor
Senior Data Engineer at Safaricom Ethiopia
March 1, 2022 - March 1, 2023
Set up Hadoop, Kafka, and Apache NiFi from scratch for a telecom network launch, ingesting and processing voice, SMS, mobile data, recharge, and billing records for company analytics from day one. Developed data models with governance using Hadoop, Hive, and Apache Iceberg to reduce duplicate datasets and speed up analytics queries. Migrated a bare-metal Hadoop cluster to Tanzu Kubernetes to reduce infrastructure costs. Built Airflow and NiFi pipelines improving workflow throughput and integration time. Implemented streaming workloads with Spark, Flink, and Kafka including multi-broker replication for fault tolerance and high availability. Built Spark applications in Scala and Python for daily call-detail record processing, reduced analysis time, and delivered near-real-time dashboards for operations and management. Built subscriber usage and segmentation datasets and implemented access controls and masking for subscriber PII to support compliance. Trained and mentored junior engineers
Data Engineer at Safaricom PLC
June 1, 2021 - March 1, 2022
Developed Apache NiFi and Spark pipelines ingesting transactional and IoT data into Hadoop (HDFS/Hive) on Cloudera Data Platform, maintaining high pipeline uptime. Built and optimized Spark batch jobs in Scala and Python for faster ETL and reduced SQL/Hive query runtime. Developed custom NiFi processors and controller services for recurring integration patterns to reduce ETL development time. Operated production Hadoop clusters (HDP/Cloudera: HDFS, YARN, Hive, Kafka, NiFi), handling incidents, monitoring cluster health, and tuning resources. Automated pipeline monitoring, alerting, and job recovery to reduce manual intervention and time to resolve failures.
Software Engineer at Adanian Labs Africa
January 1, 2021 - May 1, 2021
Led migration of legacy software to Java Spring Boot, improving application reliability and speed. Standardized MySQL databases to reduce redundancy and improve data-retrieval efficiency. Built reusable JavaScript (ES6) components and responsive web interfaces with HTML and CSS, improving code efficiency, and managed source code in GitHub.

Education

B.Sc. Computer Science - First Class Honours at Multimedia University of Kenya
January 1, 2016 - January 1, 2020
B.Sc. Computer Science - First Class Honours at Multimedia University of Kenya
January 1, 2016 - December 31, 2020
B.Sc. Computer Science - First Class Honours at Multimedia University of Kenya
January 1, 2016 - January 1, 2020

Qualifications

Add your qualifications or awards here.

Industry Experience

Software & Internet, Telecommunications, Computers & Electronics, Professional Services

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
Intermediate
Intermediate
Intermediate
Intermediate
See more

Hire a Software Engineer

We have the best software engineer experts on Twine. Hire a software engineer in Nairobi today.