Data Platform Support Engineer at Virtusa

Responsible for SDLC-compliant data engineering tasks, including loading data into Azure Data Lake Storage and Synapse DW. Created a Data Lake Analytics account and Data Lake Analytics Jobs via the Azure Portal using SQL scripts. Built ETL/ELT processes from source systems to Azure Data Storage using a mix of T-SQL, Spark SQL, and U-SQL, with data curation in Azure Databricks. Implemented Spark-based jobs (Scala/PySpark) and Spark streaming pipelines for real-time data processing. Automated UNIX shell tasks and supported reporting with Power BI. Managed version control and collaboration through Git, Azure DevOps, Jira, and Confluence, following Agile practices.

Data Engineer at Virtusa

Followed the SDLC; loaded data into Azure Synapse Analytics (DW) and Azure Data Lake Storage; created Data Lake Analytics jobs in Azure Portal using SQL Script; ETL/ELT data from sources to Azure Data Storage using ADF, T-SQL, Spark SQL, and U-SQL; used Git for version control; collaborated with data scientists, analysts, and stakeholders; implemented CI/CD with Azure DevOps; developed ETL pipelines in/out of DW using Python and Snow SQL; implemented BigQuery data processing on GCP Pub/Sub with Python REST API to load data into BigQuery; data curation with Azure Databricks; wrote Scala for Spark applications; created Databricks Spark jobs with PySpark; UNIX scripts; Power BI reporting; managed project docs in Jira/Confluence; worked in Agile/Scrum.

Cloud Engineer (Data Engineering) at Tata Consultancy Services (TCS)

Part of the Data Engineering and Platform Support team for Fidelity National Information Services (FIS). Designed, automated, and monitored data workflows on AWS and Snowflake to ensure timely availability of accurate financial data for risk, compliance, and operations. Built automated pipelines, dashboards, and data quality metrics; performed root cause analysis to reduce data/pipeline incidents; facilitated ITIL-aligned incident/change/problem management and weekly cross-functional reviews, contributing to improved user satisfaction. Utilized Excel, SQL, and regression models for analyzing large financial datasets and deriving actionable insights.

Cloud Engineer (Data Engineering) at Tata Consultancy Services (Client: Fidelity National Information Services - FIS)

Part of the Data Engineering and Platform Support team for FIS, providing end-to-end support for financial data pipelines and reporting. Designed, automated, and monitored data workflows on AWS and Snowflake to ensure timely availability of accurate financial data for risk, compliance, and operations. Built queries and dashboards to track data quality and SLA metrics; performed root cause analysis to reduce recurring incidents; facilitated weekly cross-functional reviews; ITIL-aligned incident/change/problem workflows to improve transparency and reduce resolution time.

Data Platform Support Engineer at Skylives Info Tech Pvt Ltd

Developed a warehouse using Azure stack (Data Factory, Data Lake, Data Bricks, Synapse) for analytics. Implemented strategies for handling large datasets with partitions, Spark SQL, and performance tuning. Extracted, transformed, and loaded data from source systems to Azure Data Storage using a combination of Azure Data Factory, T-SQL, Spark SQL, and Data Lake Analytics; executed scripts in Data Bricks. Created data ingestion systems for pulling data from traditional RDBMS into NoSQL databases like MongoDB. Enhanced Snowflake tables, views, and schemas for reporting and analytics. Implemented CI/CD pipelines via Jenkins to automate Hadoop/Spark/Hive workloads. Built streaming ETL pipelines with Spark streaming to move data into Snowflake. Designed and built Spark/PySpark ETL pipelines for migrating credit card transactions, accounts, and customer data into an enterprise Hadoop Data Lake. Wrote PL/SQL, worked with Spark/Spark SQL (Scala API), and managed project issues with JIRA. Worked