Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

I am Ashmit Kaur Bagga, a Senior Data Engineer with 12+ years of experience designing and delivering enterprise-scale data platforms, real-time streaming pipelines, and high-performance analytics solutions. I specialize in Spark, PySpark, and SQL, and have a proven track record of building scalable data workflows and reporting for financial services. I have hands-on experience deploying containerized microservices using Docker and OpenShift, optimizing complex data jobs, and collaborating with cross-functional teams to implement data governance and enable data-driven decision making. I thrive in fast-paced environments and enjoy turning complex data problems into reliable, value-driving solutions.…I am Ashmit Kaur Bagga, a Senior Data Engineer with 12+ years of experience designing and delivering enterprise-scale data platforms, real-time streaming pipelines, and high-performance analytics solutions. I specialize in Spark, PySpark, and SQL, and have a proven track record of building scalable data workflows and reporting for financial services. I have hands-on experience deploying containerized microservices using Docker and OpenShift, optimizing complex data jobs, and collaborating with cross-functional teams to implement data governance and enable data-driven decision making. I thrive in fast-paced environments and enjoy turning complex data problems into reliable, value-driving solutions.

Ashmit Kaur Bagga

Data Scientist, Full Stack Developer, Web Developer, +2





I am Ashmit Kaur Bagga, a Senior Data Engineer with 12+ years of experience designing and delivering enterprise-scale data platforms, real-time streaming pipelines, and high-performance analytics solutions. I specialize in Spark, PySpark, and SQL, and have a proven track record of building scalable data workflows and reporting for financial services. I have hands-on experience deploying containerized microservices using Docker and OpenShift, optimizing complex data jobs, and collaborating with cross-functional teams to implement data governance and enable data-driven decision making. I thrive in fast-paced environments and enjoy turning complex data problems into reliable, value-driving solutions.…I am Ashmit Kaur Bagga, a Senior Data Engineer with 12+ years of experience designing and delivering enterprise-scale data platforms, real-time streaming pipelines, and high-performance analytics solutions. I specialize in Spark, PySpark, and SQL, and have a proven track record of building scalable data workflows and reporting for financial services. I have hands-on experience deploying containerized microservices using Docker and OpenShift, optimizing complex data jobs, and collaborating with cross-functional teams to implement data governance and enable data-driven decision making. I thrive in fast-paced environments and enjoy turning complex data problems into reliable, value-driving solutions.

Available to hire

I am Ashmit Kaur Bagga, a Senior Data Engineer with 12+ years of experience designing and delivering enterprise-scale data platforms, real-time streaming pipelines, and high-performance analytics solutions. I specialize in Spark, PySpark, and SQL, and have a proven track record of building scalable data workflows and reporting for financial services.

I have hands-on experience deploying containerized microservices using Docker and OpenShift, optimizing complex data jobs, and collaborating with cross-functional teams to implement data governance and enable data-driven decision making. I thrive in fast-paced environments and enjoy turning complex data problems into reliable, value-driving solutions.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Intermediate

Language

English

Fluent

Work Experience

Data Engineer at Crédit Agricole Corporate and Investment Banking (via Recruit Express Pte Ltd)

March 1, 2021 - January 1, 2026

Built and maintained ETL pipelines using Apache Spark and Amazon S3 to process large-scale financial data with high availability. Migrated legacy systems from HDFS and DB to an AWS-based stack leveraging Amazon S3, resulting in significant cost savings and improved query performance. Designed and implemented real-time and batch data ingestion workflows using Apache Kafka, Apache Spark, and Amazon Kinesis, ensuring seamless data streaming into Amazon S3 for downstream analytics. Automated data transformation and loading processes using Amazon Glue, integrating multiple data sources for reporting and analysis. Developed scalable, containerized microservices using Java, deployed on OpenShift, for managing and processing data operations. Created transformation frameworks in PySpark and Spark SQL within Databricks Workflows for seamless data acquisition, enrichment, and distribution across business domains. Implemented serverless data validation and processing routines via AWS Lambda for li

Data Engineer at DBS Bank (via NTT Data Pte Ltd)

September 1, 2019 - February 1, 2021

Reconciliation of user data from target systems like Active Directory Server, HR Systems, AIM & UAMS. User Management: Creation, Adding/Updating resources, Lock/Unlock - Enable/Disable and deletion of user accounts. Developed advanced SQL queries to generate data reports using Report Editor in UAMS. Served as SPOC for all management reports. Configuration and managing provisioning to multiple domains in AD. Designing role/rule-based provisioning policies as per Role/Access Matrix. Worked on Identity Manager to Provision the users into IDM and assign the respective roles. Migrated all reports from AIM system to UAMS using Report Editor in One Identity Manager. Analyzed IDM logs, IDM application server logs, provisioning server logs to troubleshoot endpoint related issues. Participated in weekly IDM support meetings and reported to Ops manager.

Data Analyst at Citi Bank (via Aspire NXT Pte Ltd)

July 1, 2018 - September 1, 2019

Designed relational and analytical database schemas aligned with best practices and client requirements. Built and deployed an R + Shiny application showcasing machine learning for business forecasting. Developed ASP.Net web pages enabling machine provisioning. Troubleshot BI solutions, resolving ETL and reporting issues. Created dashboards and reports in Power BI using SQL Server, Excel, CSV, and text files as data sources. Utilized DAX for Power BI dashboards and built optimized data models. Wrote complex T-SQL queries and stored procedures for applications, ETL, and reporting.

Software Developer at ICICI Securities (via 3i Infotech Ltd)

May 1, 2016 - December 1, 2017

Gained client requirements; designed and implemented components with C#, utilizing N-tier architecture and Object-Oriented Programming techniques. Developed ASP.NET pages to retrieve data from Oracle using ADO.NET. Created and integrated web services for data transfer and external application integration.

Software Developer at Atos System Pvt Ltd

March 1, 2014 - April 1, 2016

Gained client requirements; developed ASP.NET pages to retrieve data from Oracle using ADO.NET. Applied Master Pages, Themes, and CSS for a consistent look and feel for page design. Used JavaScript for client-side validations and server-side validations. Created various ASP.NET pages using ADO.NET to retrieve data from multiple data sources.