Azure/AWS Data Engineer with 12 years of experience

Harini

Azure/AWS Data Engineer with 12 years of experience

Available to hire

Azure/AWS Data Engineer with 12 years of experience

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
Intermediate
Intermediate
See more

Work Experience

Senior Data Engineer at Moneris Solutions
October 1, 2024 - October 1, 2025
Design and implementation of ETL pipelines to build a Snowflake data warehouse from SQL Server. Implemented enterprise-wide Dimensional and Data Vault models (Bronze–Silver–Gold) to standardize ingestion, transformation, and consumption layers, enabling trusted data products and seamless data delivery for business users and stakeholders. Automated Azure Databricks workflows and jobs to extract data from SQL Server, apply PySpark-based transformations (joins, aggregations, schema harmonization), and load curated datasets into Delta Lake with ACID guarantees.
Senior Data Engineer at TD Bank
February 1, 2024 - October 1, 2024
Implemented Azure-based data solutions using ADF, Synapse, and Databricks to build and maintain an enterprise-wide Delta Lake data hub, leveraging Data Vault 2.0 modeling for historization, auditability, and scalable ingestion. Designed Databricks ingestion pipelines for migration of HRM systems from PeopleSoft to Workday; produced Synapse SQL views, curated Delta tables, and Databricks-ready feature datasets to improve model-building efficiency.
Senior Data Engineer at TransUnion LLC
February 1, 2018 - February 1, 2024
Designed and implemented data pipelines to automate acquisition and data processing of extracts with financial data from multiple vendors (Flat files/Avro/Parquet/XML/JSON), resulting in 80% reduction in processing times. Led the migration of on-prem DB2 to AWS Aurora Postgres, reducing maintenance and licensing costs. Spearheaded cloud migrations using AWS S3, Redshift, Lambda, and IAM; developed Tableau dashboards to present insights and trends to stakeholders; integrated data from third-party APIs for comprehensive analysis.
Consultant at Tata Consultancy Service, Singapore
September 1, 2016 - December 1, 2016
Designed and developed a framework for automating the delivery of data extracts to business teams.
Consultant at Elait IT Technologies, India
April 1, 2013 - August 1, 2015
Acted as a key business and technical SME in the project delivering end to end ETL solutions for advertising and gaming clients.
Associate Consultant at Capgemini India Pvt Ltd, India
March 1, 2012 - April 1, 2013
Developed ETL jobs to address complex business logic and coordinated with business users, QA and support teams to ensure timely delivery.
Software Engineer at Virtusa Pvt Ltd, India
August 1, 2010 - February 1, 2012
Handled change requests and participated in release management activities of the project.

Education

Bachelor of Engineering in Computer Science and Engineering at Anna University, Chennai, India
January 11, 2030 - January 1, 2010
Bachelor’s Degree at Anna University, Chennai, India
January 11, 2030 - January 1, 2010

Qualifications

AWS Certified Solutions Architect – Associate
January 11, 2030 - January 20, 2026
AWS Certified Data Analytics – Specialty
January 11, 2030 - January 20, 2026

Industry Experience

Telecommunications, Financial Services, Media & Entertainment, Professional Services

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
Intermediate
Intermediate
See more

Hire a Data Scraping Specialist

We have the best data scraping specialist experts on Twine. Hire a data scraping specialist in Brampton today.