Darsh Premchandani
I'm a results-oriented Lead Data & Cloud Engineer with 12 years of IT experience, including 11+ years designing and deploying full-scale data pipelines and cloud-native architectures across AWS, GCP, Azure, and on-prem…
About
I’m a results-oriented Lead Data & Cloud Engineer with 12 years of IT experience, including 11+ years designing and deploying full-scale data pipelines and cloud-native architectures across AWS, GCP, Azure, and on-prem Hadoop ecosystems. I excel at building scalable, secure, and high-throughput solutions for real-time analytics and data modeling, and I lead cross-functional teams with a strong focus on governance and automated pipeline orchestration.
I’ve architected multi-cloud, AI-powered streaming platforms using Kafka, Flink, PySpark, and Beam; developed MLOps-friendly data products and LLM-powered solutions, and steered migrations from legacy on-prem systems to cloud-native platforms to optimize cost and performance.
- 13 years' experience
- Joined January 2026
Industry experience
- Energy & Utilities
- Financial Services
- Healthcare
- Manufacturing
- Retail
- Software & Internet
- Professional Services
- Life Sciences
- Media & Entertainment
- Other
More experts in Columbus, United States
- Back-End Developers for hire in Columbus, United States
- Cloud Developers for hire in Columbus, United States
- Data Analysts for hire in Columbus, United States
- Data Scientists for hire in Columbus, United States
- DevOps Developers for hire in Columbus, United States
- Developers for hire in Columbus, United States
- Full Stack Developers for hire in Columbus, United States
Work experience· 6 roles
Designed and implemented end-to-end data pipelines for ingestion of smart meter, SCADA, and outage management data into cloud analytics platforms. Built streaming pipelines with Kinesis and Spark Structured Streaming for near real-time energy consumption and grid telemetry; implemented CDC via AWS DMS and Spark jobs to sync changes to Redshift and S3-based data lakes. Implemented SCD Type 1/2, cross-region Kafka replication, and serverless components to automate workflows for fraud detection, regulatory reporting, and executive dashboards.
Migrated legacy ETL and Airflow workloads to Cloud Composer; built real-time ingestion pipelines with Kafka and Spark Streaming; leveraged GCP services (BigQuery, DataProc, Pub/Sub) and Dataprep/ADF for Bronze-Silver-Gold data pipelines, materialized views, and partitioning to support regulatory reporting and dashboards.
Designed real-time transaction and IoT-driven data platform using Kafka and Azure Event Hubs; ingested data from in-store devices via Azure IoT Hub; built metadata-driven ingestion with YAML/JSON configs; automated end-to-end ingestion with ADF and SQL Server; optimized performance in Azure Synapse Analytics and Delta Lake for retail analytics and BI dashboards.
Education· 9
Certifications and awards· 6
Hire Darsh Premchandani today
Post a job and invite Darsh, or contact them directly. No hidden commission.









