Senior Data Engineer with 10+ years of experience designing and delivering scalable cloud data platforms across enterprise data analytics, reporting, and compliance, with deep exposure to Banking and Financial Services. Hands-on expertise across Azure Data Factory, Azure Databricks, PySpark/Spark SQL, Delta Lake, and Snowflake—building auditable ETL/ELT pipelines with incremental processing, MERGE-based upserts, SCD Type 1 & 2, and schema evolution. Proven strength in Spark performance tuning, cost optimization, and implementing data quality/reconciliation/governance frameworks for production reporting. Experienced with CI/CD using Git and Azure DevOps, Infrastructure as Code (Terraform), and workflow orchestration via ADF triggers and Databricks Jobs, providing L3 production support with RCA and continuous improvements.

ANKITH KOONA

Senior Data Engineer with 10+ years of experience designing and delivering scalable cloud data platforms across enterprise data analytics, reporting, and compliance, with deep exposure to Banking and Financial Services. Hands-on expertise across Azure Data Factory, Azure Databricks, PySpark/Spark SQL, Delta Lake, and Snowflake—building auditable ETL/ELT pipelines with incremental processing, MERGE-based upserts, SCD Type 1 & 2, and schema evolution. Proven strength in Spark performance tuning, cost optimization, and implementing data quality/reconciliation/governance frameworks for production reporting. Experienced with CI/CD using Git and Azure DevOps, Infrastructure as Code (Terraform), and workflow orchestration via ADF triggers and Databricks Jobs, providing L3 production support with RCA and continuous improvements.

Available to hire

Senior Data Engineer with 10+ years of experience designing and delivering scalable cloud data platforms across enterprise data analytics, reporting, and compliance, with deep exposure to Banking and Financial Services. Hands-on expertise across Azure Data Factory, Azure Databricks, PySpark/Spark SQL, Delta Lake, and Snowflake—building auditable ETL/ELT pipelines with incremental processing, MERGE-based upserts, SCD Type 1 & 2, and schema evolution.

Proven strength in Spark performance tuning, cost optimization, and implementing data quality/reconciliation/governance frameworks for production reporting. Experienced with CI/CD using Git and Azure DevOps, Infrastructure as Code (Terraform), and workflow orchestration via ADF triggers and Databricks Jobs, providing L3 production support with RCA and continuous improvements.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
Beginner
Beginner
Beginner
See more

Language

Work Experience

Data Engineer at Citi Group
January 1, 2024 - Present
Built a centralized Azure Lakehouse platform for credit risk and regulatory reporting by ingesting and transforming high-volume datasets from Oracle, SQL Server, REST APIs, SFTP, and flat files. Architected a Medallion (Bronze/Silver/Gold) Delta Lake design with ACID-compliant pipelines, incremental processing, MERGE upserts, SCD Type 1 & 2, and schema evolution/time travel for auditability. Implemented ETL/ELT transformations using PySpark, Spark SQL, Python, and Delta Lake; added data quality and reconciliation checks (counts, null/duplicates, schema drift, source-to-target consistency) to ensure traceability. Optimized Spark performance (partitioning, caching, broadcast joins, Z-ordering, file compaction) to reduce runtime and Databricks compute cost. Automated deployments and workflows with ADF triggers, Databricks Jobs, Git/Bitbucket, Azure DevOps/TeamCity/uDeploy, and Terraform-managed Azure resources (Data Factory, Databricks, ADLS Gen2, Key Vault). Provided production support w
Data Engineer at Citi Group
September 1, 2023 - January 1, 2024
Built and operated an Xceptor-based regulatory reporting ETL platform that processed financial datasets from NAS-based file systems into SQL Server (MSSQL) for transformation, validation, report generation, and historical tracking, then returned outputs to NAS for downstream consumption. Designed end-to-end ETL workflows in Xceptor, including configuration-driven controls (.config) and XML-based report templates for dynamic report generation. Developed reusable/customizable Xceptor components to standardize team delivery and managed multi-environment deployments. Used Xceptor AI/ML capabilities for document classification, data extraction, and pattern recognition to reduce manual effort. Provided production support including monitoring, troubleshooting, and RCA, and authored operational documentation and runbooks.
Data Engineer at FINRA
September 1, 2022 - September 1, 2023
Designed and maintained scalable data pipelines and an enterprise regulatory data warehouse for market surveillance and broker-dealer compliance. Implemented ingestion and transformations using Azure Data Factory, Azure Databricks, and PySpark for high-volume trade/transaction/compliance data from multiple sources. Built staging/ODS/data mart layers with star schema dimensional modeling to support regulatory analytics. Developed reusable PySpark notebooks and optimized Spark jobs (partitioning, broadcast joins, adaptive query execution) to meet regulatory SLAs. Implemented incremental loading and CDC strategies for efficient daily processing and reduced batch windows. Created SQL Server stored procedures/views/functions and optimized T-SQL for compliance reporting and trade reconciliation; maintained SSIS for legacy migrations. Enforced security using Azure AD, managed identities, Key Vault, and RBAC; maintained Azure DevOps CI/CD YAML for Databricks notebooks/ADF/SQL object deployment
ETL Developer at Kroger
August 1, 2020 - September 1, 2022
Developed and supported enterprise ETL pipelines using Informatica PowerCenter for retail supply chain, inventory, merchandising, and vendor integrations. Created mappings, workflows, sessions, and worklets to extract/transform/load data from Oracle, SQL Server, flat files, and XML into Walmart’s enterprise data warehouse/reporting layers. Implemented SCD Type 1 & 2 logic for product/vendor/store dimensions using Informatica transformations (Expression, Aggregator, Joiner, Router, Lookup, Sequence Generator). Built incremental loading strategies using high-watermark logic and CDC to process large volumes with minimal load-window impact. Wrote SQL, stored procedures, and PL/SQL for pre-load validation and post-load reconciliation/source-to-target consistency checks. Monitored and troubleshot workflows via Workflow Monitor; performed performance tuning through caching/partitioning and push-down optimization. Provided production support with incident resolution and maintained ETL design
Tableau Developer at DXC Technology
May 1, 2016 - May 1, 2020
Designed and delivered Tableau dashboards for Microsoft to monitor global IT asset/device fleet across OEM partners by integrating data from Amazon S3, SQL Server (MSSQL), and NAS-based SFTP file shares. Built interactive dashboards with hierarchical rollups (office/country/region/global) and KPI definitions across device fleet, vendor SLAs, warranty/service quality, and logistics/courier costs. Developed scalable multi-level data models and optimized Tableau visualizations for procurement spend, returns, warranty performance, and freight/return trends. Authored optimized SQL/stored procedures/views/functions in SQL Server to support multi-level aggregations and reporting logic. Implemented data quality/validation rules, tuned performance, and provided production support for dashboard enhancements used by IT/procurement/logistics/finance teams worldwide.

Education

Bachelor of Technology at Jawaharlal Nehru Technological University
May 1, 2012 - April 1, 2016

Qualifications

Databricks Certified Data Engineer Professional
January 11, 2030 - August 26, 2026
Snowflake SnowPro Core
January 11, 2030 - August 26, 2026
AWS Certified Data Engineer – Associate
January 11, 2030 - August 26, 2026
Xceptor Core Configurations
January 11, 2030 - August 26, 2026

Industry Experience

Financial Services

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
Beginner
Beginner
Beginner
See more