DP

Darsh Premchandani

Available to hire

I'm a results-oriented Lead Data & Cloud Engineer with 12 years of IT experience, including 11+ years designing and deploying full-scale data pipelines and cloud-native architectures across AWS, GCP, Azure, and on-prem…

About

I’m a results-oriented Lead Data & Cloud Engineer with 12 years of IT experience, including 11+ years designing and deploying full-scale data pipelines and cloud-native architectures across AWS, GCP, Azure, and on-prem Hadoop ecosystems. I excel at building scalable, secure, and high-throughput solutions for real-time analytics and data modeling, and I lead cross-functional teams with a strong focus on governance and automated pipeline orchestration.

I’ve architected multi-cloud, AI-powered streaming platforms using Kafka, Flink, PySpark, and Beam; developed MLOps-friendly data products and LLM-powered solutions, and steered migrations from legacy on-prem systems to cloud-native platforms to optimize cost and performance.

  • 13 years' experience
  • Joined January 2026

Industry experience

  • Energy & Utilities
  • Financial Services
  • Healthcare
  • Manufacturing
  • Retail
  • Software & Internet
  • Professional Services
  • Life Sciences
  • Media & Entertainment
  • Other

Work experience· 6 roles

Lead Data Engineer · American Electric PowerDec 2024 – Present · 2 yrs

Designed and implemented end-to-end data pipelines for ingestion of smart meter, SCADA, and outage management data into cloud analytics platforms. Built streaming pipelines with Kinesis and Spark Structured Streaming for near real-time energy consumption and grid telemetry; implemented CDC via AWS DMS and Spark jobs to sync changes to Redshift and S3-based data lakes. Implemented SCD Type 1/2, cross-region Kafka replication, and serverless components to automate workflows for fraud detection, regulatory reporting, and executive dashboards.

Lead Data & Cloud Engineer · CitigroupJan 2023 – Nov 2024 · 1 yr 11 mos

Migrated legacy ETL and Airflow workloads to Cloud Composer; built real-time ingestion pipelines with Kafka and Spark Streaming; leveraged GCP services (BigQuery, DataProc, Pub/Sub) and Dataprep/ADF for Bronze-Silver-Gold data pipelines, materialized views, and partitioning to support regulatory reporting and dashboards.

Senior Data & Cloud Engineer · NordstromNov 2020 – Dec 2022 · 2 yrs 2 mos

Designed real-time transaction and IoT-driven data platform using Kafka and Azure Event Hubs; ingested data from in-store devices via Azure IoT Hub; built metadata-driven ingestion with YAML/JSON configs; automated end-to-end ingestion with ADF and SQL Server; optimized performance in Azure Synapse Analytics and Delta Lake for retail analytics and BI dashboards.

Cloud Data Engineer · Gilead SciencesAug 2017 – Oct 2020 · 3 yrs 3 mos
Hadoop Developer · Lucid MotorsSep 2014 – Jul 2017 · 2 yrs 11 mos
Software Developer · OracleJan 2013 – Aug 2014 · 1 yr 8 mos

Education· 9

Master of Business Administration (Business Analytics) · Illinois Institute of Technology, Chicago2030 – 2026
Integrated Program in Business Analytics · Stern School of Business, New York University (NYU), NY2030 – 2026
Bachelor of Commerce (Finance and Accounting) · Stern School of Business, New York University (NYU), NY2030 – 2026
Master of Business Administration (Business Analytics) · Illinois Institute of Technology, Chicago2030 – 2026

Certifications and awards· 6

Microsoft Certified: Azure Fundamentals (AZ-900)2030 – 2026
Basic Hadoop Certification2030 – 2026
Microsoft Certified: Azure Fundamentals (AZ-900)2030 – 2026
Basic Hadoop Certification2030 – 2026

Hire Darsh Premchandani today

Post a job and invite Darsh, or contact them directly. No hidden commission.

Post a job