Principal AI/ML Engineer and Staff Software Engineer with 10 years of progressive experience architecting, building, and operationalizing production AI/ML systems, large language model applications, and generative AI platforms for regulated industries including financial services, capital markets, government, and retail. Deep hands-on expertise across the complete machine learning engineering lifecycle from dataset curation, feature engineering, and model training through evaluation, deployment, monitoring, and continuous retraining in production environments. Proven record of delivering measurable outcomes including 60 percent reduction in processing latency, 30 percent decrease in data errors, and systems sustaining 10M-plus daily event throughput. Specialized in LLM engineering, Retrieval-Augmented Generation (RAG), Agentic AI systems, LangChain, LangGraph, Knowledge Graphs, and the full LLMOps stack including prompt engineering, context window management, embedding pipelines, vector database integration, guardrail implementation, and responsible AI governance. Combines deep AI/ML engineering proficiency with strong software engineering fundamentals across Python, Java, and Scala, extensive cloud AI platform experience across AWS Bedrock, SageMaker, and Azure Machine Learning, and data engineering capability across Apache Kafka, Apache Spark, and distributed data platforms. Experienced engineering leader managing 8-plus person cross-functional teams, driving ML architecture decisions, and translating business problems into applied AI solutions delivered within Agile frameworks.

Garry Singh

Principal AI/ML Engineer and Staff Software Engineer with 10 years of progressive experience architecting, building, and operationalizing production AI/ML systems, large language model applications, and generative AI platforms for regulated industries including financial services, capital markets, government, and retail. Deep hands-on expertise across the complete machine learning engineering lifecycle from dataset curation, feature engineering, and model training through evaluation, deployment, monitoring, and continuous retraining in production environments. Proven record of delivering measurable outcomes including 60 percent reduction in processing latency, 30 percent decrease in data errors, and systems sustaining 10M-plus daily event throughput. Specialized in LLM engineering, Retrieval-Augmented Generation (RAG), Agentic AI systems, LangChain, LangGraph, Knowledge Graphs, and the full LLMOps stack including prompt engineering, context window management, embedding pipelines, vector database integration, guardrail implementation, and responsible AI governance. Combines deep AI/ML engineering proficiency with strong software engineering fundamentals across Python, Java, and Scala, extensive cloud AI platform experience across AWS Bedrock, SageMaker, and Azure Machine Learning, and data engineering capability across Apache Kafka, Apache Spark, and distributed data platforms. Experienced engineering leader managing 8-plus person cross-functional teams, driving ML architecture decisions, and translating business problems into applied AI solutions delivered within Agile frameworks.

Available to hire

Principal AI/ML Engineer and Staff Software Engineer with 10 years of progressive experience architecting, building, and
operationalizing production AI/ML systems, large language model applications, and generative AI platforms for regulated industries
including financial services, capital markets, government, and retail. Deep hands-on expertise across the complete machine learning
engineering lifecycle from dataset curation, feature engineering, and model training through evaluation, deployment, monitoring, and
continuous retraining in production environments. Proven record of delivering measurable outcomes including 60 percent reduction
in processing latency, 30 percent decrease in data errors, and systems sustaining 10M-plus daily event throughput.
Specialized in LLM engineering, Retrieval-Augmented Generation (RAG), Agentic AI systems, LangChain, LangGraph, Knowledge
Graphs, and the full LLMOps stack including prompt engineering, context window management, embedding pipelines, vector
database integration, guardrail implementation, and responsible AI governance. Combines deep AI/ML engineering proficiency with
strong software engineering fundamentals across Python, Java, and Scala, extensive cloud AI platform experience across AWS
Bedrock, SageMaker, and Azure Machine Learning, and data engineering capability across Apache Kafka, Apache Spark, and
distributed data platforms. Experienced engineering leader managing 8-plus person cross-functional teams, driving ML architecture
decisions, and translating business problems into applied AI solutions delivered within Agile frameworks.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
See more

Language

English
Fluent

Work Experience

Head of Product and Engineering, Principal AI/ML Engineer at RegCore.AI
December 1, 2024 - Present
Led design and delivery of an AI-powered regulatory intelligence SaaS platform featuring a fault-tolerant multi-model LLM gateway, dynamic multi-agent orchestration, and a production RAG stack with per-tenant governance. Built a fault-tolerant, multi-tenant LLM API routing gateway; implemented per-model policy enforcement, circuit-breaker failover, latency-aware routing, and canary deployments. Architected LangGraph-based multi-agent workflows and a knowledge graph for cross-document regulatory obligation mapping with end-to-end explainability and provenance. Established LLMOps/MLOps standards, observability dashboards, and CI/CD for AI deployments, achieving reduced deployment cycle times and high automation coverage.
Principal Software Engineer at RegCore.AI
December 1, 2024 - Present
Own the end-to-end software engineering lifecycle for an enterprise AI-powered regulatory intelligence platform; design a multi-service, cloud-native stack on AWS and Azure; implement agentic AI workflows with Retrieval-Augmented Generation, LangChain orchestration, and knowledge-graph-based obligation mapping; establish MLOps/LLMOps standards and CI/CD pipelines; lead an 8+ person cross-functional team.
Principal AI/ML Engineer and Software Engineer at IBM Canada (Client: Employment and Social Development Canada)
August 1, 2022 - April 1, 2024
Designed and deployed an AI-augmented benefits payment integrity platform. Built real-time anomaly detection with LSTM/autoencoder models, feature engineering with PySpark, and containerized inference on Azure AKS. Implemented end-to-end ML lifecycle (training, validation, registry, deployment, retraining on drift) and observability with ELK, AB testing, and model performance dashboards. Delivered low-latency feature serving and scalable microservices for enterprise-grade regulatory compliance.
Principal Software Engineer, Enterprise Systems and AI/ML Platforms at IBM Canada (Client: Employment and Social Development Canada)
August 1, 2022 - April 1, 2024
Led full SDLC for a federal benefits modernization program; designed a scalable Java/Spring Boot microservices platform with Azure ADF and APIM, Confluent Kafka, NiFi, and Databricks; built real-time ML anomaly detection; improved data quality governance and auditing; delivered architecture artifacts and runbooks for regulatory compliance.
Lead Senior AI/ML and Distributed Systems Engineer at Northern Trust Asset Management
April 1, 2021 - August 1, 2022
Implemented end-to-end ML workflow on AWS for liquidity risk and counterparty exposure forecasting, leveraging SageMaker endpoints for real-time scoring. Built a Delta Lake-based data lakehouse and Redshift data warehouse, with automated data quality validation and Spark-based feature computation. Led model governance and observability, delivering explainability and compliance within risk management frameworks.
Lead Senior Software Engineer, Distributed Systems and Data Platform at Northern Trust Asset Management
April 1, 2021 - August 1, 2022
Architected a real-time global market risk data platform; decomposed into bounded services; implemented Spark Structured Streaming with Delta Lake on AWS, and a Redshift-based data warehouse; built automated ETL with AWS Glue, data quality frameworks, and SageMaker-based risk forecasting; established CI/CD, observability, and mentoring.
Senior AI/ML Integration Engineer, Capital Markets Platform at TD Bank, Global Capital Markets
March 1, 2020 - April 1, 2021
Architected agentic AI-powered Lambda microservices for dynamic event classification and routing of trading events. Migrated legacy rule engines to Scala-based ML-informed rules and implemented real-time OLAP with Druid. Built ETL and feature pipelines for ML-driven risk scoring, designed enterprise middleware with Kafka, and delivered secure API integrations for risk and trading analytics.
Senior Software Engineer, Capital Markets Platform and Real-Time Systems at TD Bank, Global Capital Markets
March 1, 2020 - April 1, 2021
Designed a high-throughput, real-time event-driven trading platform; migrated messaging from Solace to Confluent Kafka with KStreams/KSQL; implemented FIX-based messaging for low-latency order routing; migrated Drools to Scala with Druid for real-time OLAP; built 5M+ daily trading events pipelines using Kinesis, Lambda, Spark, and Python ETL; introduced ReAct pattern for dynamic event classification and robust observability.
Senior Software Engineer and AI/ML Data Platform Lead at Albertsons Companies
January 1, 2019 - March 1, 2020
Led greenfield Kafka-based real-time data platform, built ML-driven data quality and anomaly detection pipelines, and deployed containerized microservices for data validation, enrichment, and routing. Implemented distributed feature computation with PySpark, StreamSets for ingestion, NiFi for enterprise integration, and Kubernetes-based deployment.
Senior Software Engineer, Lead Kafka Platform Architect at Albertsons Companies
January 1, 2019 - March 1, 2020
Led greenfield deployment of an enterprise Confluent Kafka platform; defined topology, topic strategy, Schema Registry, and Zookeeper; built real-time data integration microservices with Spring Boot and Kafka Streams; implemented NiFi data flow automation and Azure Data Factory pipelines; secured data through Kerberos and OAuth; containerized services on Kubernetes with CI/CD.
Software Engineer, Big Data and AI/ML Systems at Royal Bank of Canada
September 1, 2014 - January 1, 2019
Built real-time data ingestion and processing pipelines with Kafka, NiFi, Storm, and Flume; migrated Hive HQL to Spark SQL for ML feature computation and time-series liquidity risk metrics. Delivered batch and streaming data processing, OSFI-aligned regulatory reporting support, and scalable data workflows.
Software Engineer, Big Data and Enterprise Systems at Royal Bank of Canada
September 1, 2014 - January 1, 2019
Developed Basel III and OSFI regulatory reporting platforms; built Hadoop MapReduce, Hive, and Spark-based pipelines; implemented ETL via DataStage/Talend; built real-time ingestion with Kafka, NiFi, Storm, and Flume; contributed to Proton big data platform for regulatory reporting with improved performance and auditability.

Education

Master of Science in Software Engineering, Specialization in AI and Machine Learning at University of Oxford
January 11, 2030 - February 27, 2026
Bachelor of Applied Science in Software Development and Network Engineering at Sheridan Institute of Technology
January 11, 2030 - February 27, 2026
Bachelor of Business Administration at Vinayaka Missions Sikkim University
January 11, 2030 - February 27, 2026
Master of Science in Software Engineering, Specialization in AI and Machine Learning at University of Oxford
January 11, 2030 - February 27, 2026
Bachelor of Applied Science in Software Development and Network Engineering at Sheridan College
January 11, 2030 - February 27, 2026
Bachelor of Business Administration at Vinayaka Missions Sikkim University
January 11, 2030 - February 27, 2026

Qualifications

Project Management Professional (PMP)
January 11, 2030 - February 27, 2026
Certified Associate in Project Management (CAPM)
January 11, 2030 - February 27, 2026
Certified Scrum Master (CSM)
January 11, 2030 - February 27, 2026
Microsoft Certified: Azure AI Engineer Associate
January 11, 2030 - February 27, 2026
Machine Learning Specialization (Stanford University, Andrew Ng)
January 11, 2030 - February 27, 2026
Mathematics for Machine Learning and Data Science (DeepLearning.AI)
January 11, 2030 - February 27, 2026
Microsoft Certified: Azure Data Engineer Associate
January 11, 2030 - February 27, 2026
AWS Certified Solutions Architect – Associate
January 11, 2030 - February 27, 2026
Project Management Professional (PMP)
January 11, 2030 - February 27, 2026
Certified Associate in Project Management (CAPM)
January 11, 2030 - February 27, 2026
Certified Scrum Master (CSM)
January 11, 2030 - February 27, 2026
Microsoft Certified: Azure AI Engineer Associate
January 11, 2030 - February 27, 2026
Machine Learning Specialization (Stanford/Andrew Ng via Coursera)
January 11, 2030 - February 27, 2026
Mathematics for Machine Learning and Data Science (DeepLearning.AI)
January 11, 2030 - February 27, 2026
Microsoft Certified: Azure Data Engineer Associate
January 11, 2030 - February 27, 2026
AWS Certified Solutions Architect Associate (In Progress)
January 11, 2030 - February 27, 2026

Industry Experience

Financial Services, Government, Software & Internet, Professional Services, Retail