Data Engineer and Data Analyst with 5+ years of experience building scalable cloud-native data platforms and delivering actionable insights in banking, insurance, and financial services. Expertise spans migrating legacy ETL (SSIS/on-prem SQL Server) to modern Azure/Databricks/Snowflake/Fabric lakehouse architectures with strong governance and compliance. I design end-to-end batch, streaming, and hybrid pipelines (including Event Hubs/Kafka, Databricks Structured Streaming, Delta Live Tables, Auto Loader) to support risk monitoring, regulatory reporting, claims analytics, and executive reporting. I also build governed curated datasets, semantic models, and Power BI dashboards, while implementing data quality, lineage, PII discovery, and access controls using Microsoft Purview and Unity Catalog.

Rama Krishna K

Data Engineer and Data Analyst with 5+ years of experience building scalable cloud-native data platforms and delivering actionable insights in banking, insurance, and financial services. Expertise spans migrating legacy ETL (SSIS/on-prem SQL Server) to modern Azure/Databricks/Snowflake/Fabric lakehouse architectures with strong governance and compliance. I design end-to-end batch, streaming, and hybrid pipelines (including Event Hubs/Kafka, Databricks Structured Streaming, Delta Live Tables, Auto Loader) to support risk monitoring, regulatory reporting, claims analytics, and executive reporting. I also build governed curated datasets, semantic models, and Power BI dashboards, while implementing data quality, lineage, PII discovery, and access controls using Microsoft Purview and Unity Catalog.

Available to hire

Data Engineer and Data Analyst with 5+ years of experience building scalable cloud-native data platforms and delivering actionable insights in banking, insurance, and financial services. Expertise spans migrating legacy ETL (SSIS/on-prem SQL Server) to modern Azure/Databricks/Snowflake/Fabric lakehouse architectures with strong governance and compliance.

I design end-to-end batch, streaming, and hybrid pipelines (including Event Hubs/Kafka, Databricks Structured Streaming, Delta Live Tables, Auto Loader) to support risk monitoring, regulatory reporting, claims analytics, and executive reporting. I also build governed curated datasets, semantic models, and Power BI dashboards, while implementing data quality, lineage, PII discovery, and access controls using Microsoft Purview and Unity Catalog.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
Beginner
Beginner
See more

Language

Work Experience

Data Engineer at Virtusa
July 1, 2025 - Present
Architected a Medallion Lakehouse using Azure Databricks, Delta Live Tables, and Unity Catalog with centralized metadata governance and fine-grained access controls. Led Microsoft Fabric integration (OneLake, Lakehouse, Dataflows Gen2, Synapse serverless, notebooks, Direct Lake Power BI) to provide real-time cross-department insights and eliminate legacy silos. Built real-time and near-real-time PySpark pipelines using Auto Loader/Delta Live Tables to transform feeds from Event Hubs, Kafka, and APIs into curated ACID-compliant silver and gold layers. Implemented enterprise governance with Microsoft Purview (sensitivity classification, automated lineage, business glossary, compliance-aligned policies) and developed custom PII scanners to label and protect sensitive data. Orchestrated incremental watermark-based ELT pipelines in Azure Data Factory and optimized Snowflake performance via clustering, materialized views, and query acceleration. Designed hybrid batch/streaming ingestion pat
Data Engineer at BMO
January 1, 2024 - June 30, 2025
Led large-scale Azure big data implementations for banking, designing end-to-end platforms using ADLS, Azure Data Factory, HDInsight, and Azure Synapse Analytics for regulatory reporting and risk analytics. Built lambda-style patterns using ADLS + ADF + HDInsight (Hive/Sqoop) + Azure SQL Server for batch processing of high-volume transactional and core banking data. Developed Snowflake models tuned with partitioning, clustering, and materialized views to support complex financial/compliance queries. Migrated legacy SSIS/on-prem ETL workloads to a hybrid Snowflake + Azure environment. Implemented incremental loading with watermarking/change tracking in ADF for efficient historical movement from Azure SQL DB to Synapse. Built Spark applications in Databricks for multi-format extraction/transform/aggregation (CSV/JSON/Parquet) and managed cluster performance and cost optimization. Designed cross-cloud ingestion from AWS S3 to Azure ADLS and Snowflake using ADF, AWS Glue, and Athena. Impl
Data Engineer / Data Analyst at Cognizant
February 1, 2021 - December 31, 2023
Designed and implemented Azure Data Factory ETL pipelines migrating data from on-prem SQL Server and flat files into Azure SQL Database to support insurance claims, policy, and underwriting analytics. Developed modular, parameterized ADF pipelines using activities such as Lookup, ForEach, Copy, Get Metadata, and stored procedures for reusability and dynamic configuration. Maintained complex SSIS packages to move data from heterogeneous sources (SQL Server, Excel, flat files, APIs) into staging and warehouse layers. Created T-SQL stored procedures, functions, and views for insurance business logic including premium calculations, loss ratio aggregations, and recurring claims reconciliation. Applied Lean Six Sigma practices to reduce cycle times for claims preparation and monthly close. Built Excel operational dashboards using VBA/Power Query/PivotTables for daily claims metrics and loss trends. Orchestrated batch workflows with Apache Airflow and computed actuarial KPIs using CTEs, win

Education

Add your educational history here.

Qualifications

Bachelor of Technology (Computer Science)
January 11, 2030 - August 19, 2026
Microsoft Certified: Azure Data Engineer Associate
January 11, 2030 - August 19, 2026
Microsoft Certified: Azure Data Fundamentals
January 11, 2030 - August 19, 2026
Microsoft Certified: Fabric Data Engineer Associate
January 11, 2030 - August 19, 2026
Databricks Certified: Data Engineer Associate
January 11, 2030 - August 19, 2026

Industry Experience

Financial Services