Zubair Ahmed Siddiqui

Oversee design, development, and deployment of technical solutions for Saudi-based projects. Utilize ABP Framework for modular enterprise applications; manage SQL/NoSQL data stores; implement data pipelines via Databricks and Snowflake; automate CI/CD with GitLab; develop front-end using React/Angular; apply Microservices, Event-Driven, and Domain-Driven Design (DDD) principles; configure Hangfire for background tasks.

Designed and developed data pipelines in Databricks for AI training datasets. Architected scalable cloud data platforms across Azure, AWS, and GCP; built data lakehouse architectures (Delta Lake, Snowflake, BigQuery); implemented ETL/ELT pipelines with PySpark; defined data models; established DataOps including CI/CD, monitoring, and lineage; integrated real-time ingestion using Kafka and cloud-native messaging. Designed and deployed Retrieval-Augmented Generation (RAG) pipelines with LangChain and vector databases (Pinecone, FAISS) and integrated LLM inference endpoints (OpenAI, Azure OpenAI).

Designed and implemented cloud data architecture across Azure, AWS, and GCP; established data governance frameworks; built data pipelines with Databricks, Apache Spark, and Apache Kafka; implemented real-time streaming; leveraged Snowflake and BigQuery for analytics; integrated ML pipelines and BI reporting; orchestrated DataOps with Airflow.