Skills
Experience Level
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
Intermediate
Intermediate
Work Experience
Senior Data Engineer at Moneris Solutions
October 1, 2024 - October 1, 2025Design and implementation of ETL pipelines to build a Snowflake data warehouse from SQL Server. Implemented enterprise-wide Dimensional and Data Vault models (Bronze–Silver–Gold) to standardize ingestion, transformation, and consumption layers, enabling trusted data products and seamless data delivery for business users and stakeholders. Automated Azure Databricks workflows and jobs to extract data from SQL Server, apply PySpark-based transformations (joins, aggregations, schema harmonization), and load curated datasets into Delta Lake with ACID guarantees.
Senior Data Engineer at TD Bank
February 1, 2024 - October 1, 2024Implemented Azure-based data solutions using ADF, Synapse, and Databricks to build and maintain an enterprise-wide Delta Lake data hub, leveraging Data Vault 2.0 modeling for historization, auditability, and scalable ingestion. Designed Databricks ingestion pipelines for migration of HRM systems from PeopleSoft to Workday; produced Synapse SQL views, curated Delta tables, and Databricks-ready feature datasets to improve model-building efficiency.
Senior Data Engineer at TransUnion LLC
February 1, 2018 - February 1, 2024Designed and implemented data pipelines to automate acquisition and data processing of extracts with financial data from multiple vendors (Flat files/Avro/Parquet/XML/JSON), resulting in 80% reduction in processing times. Led the migration of on-prem DB2 to AWS Aurora Postgres, reducing maintenance and licensing costs. Spearheaded cloud migrations using AWS S3, Redshift, Lambda, and IAM; developed Tableau dashboards to present insights and trends to stakeholders; integrated data from third-party APIs for comprehensive analysis.
Consultant at Tata Consultancy Service, Singapore
September 1, 2016 - December 1, 2016Designed and developed a framework for automating the delivery of data extracts to business teams.
Consultant at Elait IT Technologies, India
April 1, 2013 - August 1, 2015Acted as a key business and technical SME in the project delivering end to end ETL solutions for advertising and gaming clients.
Associate Consultant at Capgemini India Pvt Ltd, India
March 1, 2012 - April 1, 2013Developed ETL jobs to address complex business logic and coordinated with business users, QA and support teams to ensure timely delivery.
Software Engineer at Virtusa Pvt Ltd, India
August 1, 2010 - February 1, 2012Handled change requests and participated in release management activities of the project.
Education
Bachelor of Engineering in Computer Science and Engineering at Anna University, Chennai, India
January 11, 2030 - January 1, 2010Bachelor’s Degree at Anna University, Chennai, India
January 11, 2030 - January 1, 2010Qualifications
AWS Certified Solutions Architect – Associate
January 11, 2030 - January 20, 2026AWS Certified Data Analytics – Specialty
January 11, 2030 - January 20, 2026Industry Experience
Telecommunications, Financial Services, Media & Entertainment, Professional Services
Skills
Experience Level
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
Intermediate
Intermediate
Hire a Data Scraping Specialist
We have the best data scraping specialist experts on Twine. Hire a data scraping specialist in Brampton today.