Azure Data Engineer with experience building scalable, cloud-native data solutions on Microsoft Azure. Hands-on in end-to-end ETL/ELT using Azure Data Factory and Databricks, migrating legacy workflows, and transforming large datasets with Apache Spark (PySpark, Spark SQL, Scala). Strong focus on optimizing Spark performance and reducing compute costs. Also drives engineering acceleration by building AI-powered agents and code-generation tools to streamline pipeline development, automate repetitive tasks, and improve delivery timelines. Has supported large enterprise migration programs across SAP ECC to SAP S/4HANA, Teradata to Azure, Alteryx to Azure, and governance improvements via Unity Catalog.

Tadiboina Sumanth

Azure Data Engineer with experience building scalable, cloud-native data solutions on Microsoft Azure. Hands-on in end-to-end ETL/ELT using Azure Data Factory and Databricks, migrating legacy workflows, and transforming large datasets with Apache Spark (PySpark, Spark SQL, Scala). Strong focus on optimizing Spark performance and reducing compute costs. Also drives engineering acceleration by building AI-powered agents and code-generation tools to streamline pipeline development, automate repetitive tasks, and improve delivery timelines. Has supported large enterprise migration programs across SAP ECC to SAP S/4HANA, Teradata to Azure, Alteryx to Azure, and governance improvements via Unity Catalog.

Available to hire

Azure Data Engineer with experience building scalable, cloud-native data solutions on Microsoft Azure. Hands-on in end-to-end ETL/ELT using Azure Data Factory and Databricks, migrating legacy workflows, and transforming large datasets with Apache Spark (PySpark, Spark SQL, Scala). Strong focus on optimizing Spark performance and reducing compute costs.

Also drives engineering acceleration by building AI-powered agents and code-generation tools to streamline pipeline development, automate repetitive tasks, and improve delivery timelines. Has supported large enterprise migration programs across SAP ECC to SAP S/4HANA, Teradata to Azure, Alteryx to Azure, and governance improvements via Unity Catalog.

See more

Language

Work Experience

FMCG Client – SAP ECC to SAP S/4HANA Data Migration & Co-Existence Strategy Project at Capgemini (Offshore)
January 1, 2026 - Present
Enterprise migration initiative focusing on data sourcing, impact assessment, and analytics continuity. Performed end-to-end impact analysis for ECC to S/4HANA changes, built PoCs for post-migration dataset behavior, and implemented dual-run scenarios for phased rollout. Developed integration logic to combine ECC and S/4HANA data into unified datasets for end-user consumption. Created AI-powered agents for table/field mappings and harmonized views, and validated reconciliation across dual-source pipelines.
FMCG Client – Teradata to Azure Data Platform Migration Project at Capgemini (Offshore)
June 1, 2025 - December 31, 2025
Migrated enterprise workloads from Teradata to an Azure analytics platform by analyzing Teradata schemas and dependencies and converting logic to Databricks (Spark SQL/PySpark) with optimized transformations. Built ADF ETL pipelines for ingestion, transformation, and load into ADLS Gen2, and implemented data validation/reconciliation for parity between Teradata and Azure. Optimized Spark workloads using partitioning strategies, adaptive query execution, and optimized joins; supported performance testing and post-migration stabilization for SLA/reporting requirements.
FMCG Client – Alteryx to Azure Migration Project at Capgemini (Offshore)
November 1, 2024 - May 31, 2025
Migrated legacy Alteryx workflows to Azure by assessing workflows and mapping components to Azure Data Factory and Databricks. Rebuilt orchestration and data movement using ADF best practices and translated transformation logic to Spark on Databricks with performance and compute-cost optimization. Performed testing for functional parity and resolved technical issues via root-cause analysis to ensure a smooth transition.
FMCG Client – Unity Catalog Migration Project at Capgemini (Offshore)
June 1, 2024 - October 31, 2024
Led migration from legacy non-Unity Catalog components to Unity Catalog in Azure Databricks to enhance governance, security, and compliance. Planned and executed migration strategy including dataset selection and prerequisites, migrated metadata/data assets to Unity Catalog, and implemented fine-grained role-based access controls at database/table/column levels. Validated integrity and access policies post-migration to ensure zero data loss and uninterrupted pipeline operations, enabling centralized metadata management and data lineage for auditability.
FMCG Client – Business Data Lake at Capgemini (Offshore)
July 1, 2022 - May 31, 2024
Designed and implemented transformation logic aligned with business objectives in the silver layer of Azure Databricks using SQL and PySpark. Used Apache Spark for large-scale processing and orchestrated end-to-end workflows using Azure Data Factory from ingestion to storage in Azure Data Lake Storage. Validated transformed datasets for accuracy/completeness and optimized Spark jobs with advanced tuning techniques to reduce compute costs and improve performance.
Data Engineer at Capgemini
July 1, 2022 - Present
FMCG client programs across multiple data migration and co-existence initiatives on Azure. Supported SAP ECC to SAP S/4HANA data migration and analytics continuity by performing impact analysis on data models and reporting objects, building proof-of-concepts for selected business objects, and implementing dual-run scenarios for phased rollout. Designed integration logic to unify ECC and S/4HANA data for seamless downstream consumption. Built an AI-powered mapping agent to generate ECC-to-S/4HANA table/field mappings and an additional AI-driven agent to produce harmonized, consumer-ready views. Validated data consistency and reconciliation across dual-source pipelines. Other migration work included Teradata to Azure platform modernization using ADF + Databricks + ADLS Gen2 with schema/SQL conversion, ETL pipeline implementation, validation/reconciliation checks, and Spark tuning for SLA adherence; also migrated Alteryx workflows to Azure using ADF orchestration and Spark transformations

Education

B.Tech in Computer Science Engineering at Vellore Institute of Technology
June 1, 2018 - April 30, 2022

Qualifications

Microsoft Certified: Azure Data Fundamentals
January 11, 2030 - August 24, 2026
Microsoft Certified: Azure Fundamentals
January 11, 2030 - August 24, 2026
Microsoft Certified: Azure Data Engineer Associate
January 11, 2030 - August 24, 2026
Microsoft Certified: Azure Developer Associate
January 11, 2030 - August 24, 2026
Microsoft Certified: Fabric Data Engineer Associate
January 11, 2030 - August 24, 2026
Databricks Certified: Data Engineer Associate
January 11, 2030 - August 24, 2026
Databricks Certified: Data Engineer Professional
January 11, 2030 - August 24, 2026
Databricks Certified: Generative AI Engineer Associate
January 11, 2030 - August 24, 2026

Industry Experience

Software & Internet, Professional Services, Consumer Goods