Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

Hi, I’m Mustafa Ahmed. I’m a Big Data Engineer with hands-on experience designing, deploying, and managing scalable data solutions. I specialize in architecting end-to-end data pipelines and building high-availability production systems using the Hadoop ecosystem, Kafka, and IBM Watsonx.data to turn raw data into actionable business insights. Most recently at WOREX Technology, I led the development of near real-time data platforms, optimized Spark workloads, implemented containerized deployments, and advanced data governance and customer segmentation on the Cloudera platform. Previously, at the Ministry of Defense Egypt, I modernized legacy data workflows and improved SQL/data processes to boost operational efficiency. I enjoy collaborating with teams to translate business needs into robust data architectures and to enable informed decision-making through reliable data pipelines.…Hi, I’m Mustafa Ahmed. I’m a Big Data Engineer with hands-on experience designing, deploying, and managing scalable data solutions. I specialize in architecting end-to-end data pipelines and building high-availability production systems using the Hadoop ecosystem, Kafka, and IBM Watsonx.data to turn raw data into actionable business insights. Most recently at WOREX Technology, I led the development of near real-time data platforms, optimized Spark workloads, implemented containerized deployments, and advanced data governance and customer segmentation on the Cloudera platform. Previously, at the Ministry of Defense Egypt, I modernized legacy data workflows and improved SQL/data processes to boost operational efficiency. I enjoy collaborating with teams to translate business needs into robust data architectures and to enable informed decision-making through reliable data pipelines.

Mustafa Ahmed

Data Scientist, Full Stack Developer, Data Analyst, +4





Hi, I’m Mustafa Ahmed. I’m a Big Data Engineer with hands-on experience designing, deploying, and managing scalable data solutions. I specialize in architecting end-to-end data pipelines and building high-availability production systems using the Hadoop ecosystem, Kafka, and IBM Watsonx.data to turn raw data into actionable business insights. Most recently at WOREX Technology, I led the development of near real-time data platforms, optimized Spark workloads, implemented containerized deployments, and advanced data governance and customer segmentation on the Cloudera platform. Previously, at the Ministry of Defense Egypt, I modernized legacy data workflows and improved SQL/data processes to boost operational efficiency. I enjoy collaborating with teams to translate business needs into robust data architectures and to enable informed decision-making through reliable data pipelines.…Hi, I’m Mustafa Ahmed. I’m a Big Data Engineer with hands-on experience designing, deploying, and managing scalable data solutions. I specialize in architecting end-to-end data pipelines and building high-availability production systems using the Hadoop ecosystem, Kafka, and IBM Watsonx.data to turn raw data into actionable business insights. Most recently at WOREX Technology, I led the development of near real-time data platforms, optimized Spark workloads, implemented containerized deployments, and advanced data governance and customer segmentation on the Cloudera platform. Previously, at the Ministry of Defense Egypt, I modernized legacy data workflows and improved SQL/data processes to boost operational efficiency. I enjoy collaborating with teams to translate business needs into robust data architectures and to enable informed decision-making through reliable data pipelines.

Available to hire

Hi, I’m Mustafa Ahmed. I’m a Big Data Engineer with hands-on experience designing, deploying, and managing scalable data solutions. I specialize in architecting end-to-end data pipelines and building high-availability production systems using the Hadoop ecosystem, Kafka, and IBM Watsonx.data to turn raw data into actionable business insights.

Most recently at WOREX Technology, I led the development of near real-time data platforms, optimized Spark workloads, implemented containerized deployments, and advanced data governance and customer segmentation on the Cloudera platform. Previously, at the Ministry of Defense Egypt, I modernized legacy data workflows and improved SQL/data processes to boost operational efficiency. I enjoy collaborating with teams to translate business needs into robust data architectures and to enable informed decision-making through reliable data pipelines.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Intermediate

Intermediate

Language

English

Fluent

Work Experience

Big Data Engineer at WOREX Technology

November 1, 2023 - Present

Architected, deployed, and maintained scalable data platforms enabling high-volume batch and real-time analytics. Built end-to-end streaming and reporting systems using Kafka, Spark, Hadoop, Apache Iceberg, and IBM Watsonx.data to support near real-time BI in Cognos. Implemented containerized platforms with Docker Compose, deploying monitored Kafka clusters (Prometheus/Grafana) and analytical stacks (Dremio, MinIO, Project Nessie, Spark) to enhance data governance and schema evolution. Optimized Spark jobs and automated NiFi-based orchestration on Cloudera, achieving significant performance gains. Delivered a real-time CDR pipeline for Vodafone Egypt, and led data governance initiatives and segmentation projects on Cloudera.

Data Engineer at Ministry of Defense Egypt

October 1, 2021 - October 1, 2023

Developed ad-hoc SQL queries to extract actionable topics and insights, analyzed workflows to drive efficiency improvements, and modernized legacy archiving through Oracle APEX. Digitized document follow-up workflows with topic tracking and accountability, conducted gap analyses between legacy and new systems, and performed end-to-end testing to ensure data accuracy and reliability.