I am a delivery-focused Data & AI Consultant with extensive experience in AI/ML engineering, ETL/ELT processes, cloud infrastructure, and automation. I specialize in building scalable big data and AI solutions across leading platforms such as Azure, AWS, GCP, and Databricks. My technical skills span programming in Python, Java, and Scala, and working with modern data architectures and CI/CD pipelines. I excel at translating business and analytical needs into high-impact cloud-native AI and data solutions. I am a strong communicator able to engage stakeholders and deliver under pressure while driving business value through data innovation. I am passionate about mentoring teams and adopting new technologies that consistently enhance client satisfaction.

Surender Kudumula

I am a delivery-focused Data & AI Consultant with extensive experience in AI/ML engineering, ETL/ELT processes, cloud infrastructure, and automation. I specialize in building scalable big data and AI solutions across leading platforms such as Azure, AWS, GCP, and Databricks. My technical skills span programming in Python, Java, and Scala, and working with modern data architectures and CI/CD pipelines. I excel at translating business and analytical needs into high-impact cloud-native AI and data solutions. I am a strong communicator able to engage stakeholders and deliver under pressure while driving business value through data innovation. I am passionate about mentoring teams and adopting new technologies that consistently enhance client satisfaction.

Available to hire

I am a delivery-focused Data & AI Consultant with extensive experience in AI/ML engineering, ETL/ELT processes, cloud infrastructure, and automation. I specialize in building scalable big data and AI solutions across leading platforms such as Azure, AWS, GCP, and Databricks. My technical skills span programming in Python, Java, and Scala, and working with modern data architectures and CI/CD pipelines.

I excel at translating business and analytical needs into high-impact cloud-native AI and data solutions. I am a strong communicator able to engage stakeholders and deliver under pressure while driving business value through data innovation. I am passionate about mentoring teams and adopting new technologies that consistently enhance client satisfaction.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
See more

Language

English
Fluent

Work Experience

Senior Big Data Consultant at Government Client (Multi-Cloud)
January 1, 2024 - Present
Architected and delivered end-to-end AI/ML solutions on Azure Machine Learning, Databricks, and Synapse for predictive analytics, optimization, and real-time decisioning. Designed streaming AI pipelines using Spark Structured Streaming and Event Hub to process IoT telemetry and passenger data in near real-time. Developed predictive maintenance, demand forecasting, and ticket pricing optimization models improving revenue and reducing downtime. Applied NLP and Generative AI tools like Azure OpenAI for customer sentiment analysis and intelligent knowledge assistants. Built computer vision and edge AI models with Azure IoT Edge for safety monitoring. Established MLOps practices with CI/CD, MLflow, Unity Catalog, and governance frameworks. Delivered Databricks Lakehouse architecture and implemented Delta medallion architecture with Unity Catalog for governance and PII controls. Led development of pipelines, model fine-tuning, feature store construction, and real-time model serving using Mos
Senior Big Data Consultant at FormulaOne Cloud Migration (Multi Cloud Platform)
January 1, 2024 - September 5, 2025
Developed architecture vision and KDD documents, consulted on business and engineering engagements, and participated in architecture governance and review board meetings. Delivered data migration projects transitioning on-premises data warehouses to multi-cloud environments (AWS and Azure). Designed and deployed end-to-end solutions across on-premises and cloud platforms. Applied agile methodologies for large-scale data management initiatives. Developed data lakes and pipelines using AWS Glue, Kinesis, Lambda, and Redshift. Created DBT models for data warehouse ETL and implemented Terraform infrastructure as code to provision cloud resources consistently. Used AWS Step Functions and Glue workflows for orchestration and automated deployment pipelines. Integrated Salesforce APIs for marketing use cases and managed data governance and compliance.
Senior Big Data Consultant at Government Client (Multi Cloud Platform)
June 1, 2023 - September 5, 2025
Implemented AWS data ingestion pipelines using Kinesis, Lambda, Glue, and S3 for streaming and batch analytics. Developed Spark-based ETL and DBT models for Redshift data warehousing and supported BI reporting using Tableau. Delivered data lineage, governance solutions, and automated workflows with Glue Workflows and Step Functions. Conducted performance tuning on Spark jobs and integrated Palantir Foundry for code repositories and data lineage. Used Terraform for infrastructure provisioning and ensured GDPR and compliance adherence. Applied multi-layer architecture including Bronze, Silver, and Gold data layers in Data Lakes and Delta Lake formats.
Senior Big Data Consultant at Specsavers
April 1, 2020 - September 5, 2025
Designed and implemented an end-to-end big data platform on Azure with Databricks and ADLS Gen2. Extracted and transformed raw JSON data to create dimensional models in Delta Lake supporting BI reporting in Tableau. Automated ETL pipelines using Azure Data Factory and Databricks notebooks with scheduled batch workflows. Developed unit and behavior-driven tests, implemented CI/CD using Azure DevOps. Collaborated with InfoSec teams on data security and governance. Mentored developers and tuned Spark applications to meet strict SLAs. Used Terraform for provisioning and infrastructure as code.
Senior Big Data Consultant at Discover Financial Services
February 1, 2019 - September 5, 2025
Led optimization of processing sales data for card transactions, rewriting Java Spark applications for 10x performance improvement. Implemented Spark SQL and broadcast variables for efficient data transformations and error detection. Developed ETL jobs to load processed data into Snowflake for analytics reporting. Delivered timely and reliable data pipelines to meet strict SLAs.
Senior Big Data Consultant at Government Client (Multi-Cloud)
January 1, 2024 - Present
Architected and delivered end-to-end AI/ML solutions using Azure Machine Learning, Databricks, and Synapse for real-time analytics and optimization. Designed streaming AI data pipelines and implemented predictive maintenance, demand forecasting, and ticket pricing optimization models. Applied NLP and Generative AI for customer insights and chatbots, and built computer vision edge AI models for safety monitoring. Established MLOps practices with automated retraining and governance. Developed Databricks Lakehouse solutions incorporating Mosaic AI, Delta medallion architecture, feature stores, and real-time serving pipelines. Mentored junior engineers and optimized data pipelines for performance and cost efficiency.
Senior Big Data Consultant at FormulaOneCloud Migration (Multi Cloud Platform)
January 1, 2024 - September 5, 2025
Developed architectural vision, business and engineering consulting artifacts for migrating on-premises data warehouse to multi-cloud environments. Delivered large-scale data management solutions on AWS and Azure with big data platforms, focusing on data lakes, ETL pipelines, and analytics. Implemented AWS Glue-based data pipelines, DBT models for data warehousing, and automated infrastructure provisioning with Terraform. Participated in ARB design reviews and collaborated with stakeholders across distributed teams to ensure compliance and security.
Senior Big Data Consultant at Government Client (Multi Cloud Platform)
June 1, 2023 - September 5, 2025
Handled batch and real-time data ingestion, ETL, and analytics on AWS and Azure. Implemented data pipelines using Apache Spark, AWS Glue, Kinesis, Lambda, and Redshift. Created data models using DBT and handled data lineage and governance. Developed CI/CD pipelines with GitHub Actions and Terraform to automate infrastructure and ETL code deployments. Supported downstream analytics and reporting using Tableau and Power BI. Engaged with business and data teams to define KPIs and enable self-service analytics while ensuring data security and compliance.
Senior Big Data Consultant at Specsavers
April 1, 2020 - September 5, 2025
Designed and implemented end-to-end big data solutions on Azure Databricks and Azure Data Factory for ingesting, transforming, and modelling sales and customer data. Developed ETL pipelines using PySpark and Scala, optimized Spark jobs for performance, and implemented dimensional modelling to support Tableau dashboards. Applied CI/CD practices with Azure DevOps and Terraform for infrastructure as code. Mentored team members on best practices and supported InfoSec and governance requirements.
Senior Big Data Consultant at Discover Financial Services
February 1, 2019 - September 5, 2025
Led development and optimization of sales data processing for EPP settlements. Rewrote fixed-width file generation functionality in Spark to improve performance tenfold. Implemented Spark SQL and broadcast variables for data lookup and duplicate detection using HBase. Delivered data ingestion into Snowflake for reporting and analytics.

Education

Masters in Software Engineering at University of Abertay Dundee, UK
January 11, 2030 - January 1, 2008
Bachelors in Computer Science at Scient Institute of Technology, India
January 11, 2030 - January 1, 2006
Masters in Software Engineering at University of Abertay Dundee, UK
January 11, 2030 - January 1, 2008
Bachelors in Computer Science at Scient Institute of Technology, India
January 11, 2030 - January 1, 2006

Qualifications

Microsoft Certified: Azure AI Engineer Associate
January 11, 2030 - September 5, 2025
Databricks Certified Generative AI Engineer Associate
January 11, 2030 - September 5, 2025
AWS Certified AI Practitioner
January 11, 2030 - September 5, 2025
Microsoft Certified: Fabric Data Engineer Associate
January 11, 2030 - September 5, 2025
Databricks Certified Data Engineer Professional
January 11, 2030 - September 5, 2025
AWS Certified Data Engineer – Associate
January 11, 2030 - September 5, 2025
Microsoft Certified Azure Solution Architect
January 11, 2030 - September 5, 2025
Togaf 9 Certified Enterprise Architect
January 11, 2030 - September 5, 2025
AWS Certified Solution Architect Professional
January 11, 2030 - September 5, 2025
Microsoft Certified Azure Data Engineer
January 11, 2030 - September 5, 2025
Google Cloud Professional Architect
January 11, 2030 - September 5, 2025
Google Cloud Professional Data Engineer
January 11, 2030 - September 5, 2025
Sun Certified Java Programmer
January 11, 2030 - September 5, 2025
Sun Certified Web Component Developer
January 11, 2030 - September 5, 2025
Microsoft Certified: Azure AI Engineer Associate
January 11, 2030 - September 5, 2025
Databricks Certified Generative AI Engineer Associate
January 11, 2030 - September 5, 2025
AWS Certified AI Practitioner
January 11, 2030 - September 5, 2025
Microsoft Certified: Fabric Data Engineer Associate
January 11, 2030 - September 5, 2025
Databricks Certified Data Engineer Professional
January 11, 2030 - September 5, 2025
AWS Certified Data Engineer – Associate
January 11, 2030 - September 5, 2025
Microsoft Certified Azure Solution Architect
January 11, 2030 - September 5, 2025
Togaf 9 Certified Enterprise Architect
January 11, 2030 - September 5, 2025
AWS Certified Solution Architect Professional
January 11, 2030 - September 5, 2025
Microsoft Certified Azure Data Engineer
January 11, 2030 - September 5, 2025
Google Cloud Professional Architect
January 11, 2030 - September 5, 2025
Google Cloud Professional Data Engineer
January 11, 2030 - September 5, 2025
Sun Certified Java Programmer
January 11, 2030 - September 5, 2025
Sun Certified Web Component Developer
January 11, 2030 - September 5, 2025

Industry Experience

Government, Financial Services, Telecommunications, Transportation & Logistics, Software & Internet, Retail