Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

I'm a Senior Data Engineer with 12+ years of experience transforming complex data ecosystems into business-ready analytics platforms. I design scalable ETL/ELT pipelines and cloud data architectures using Python, PySpark, Snowflake, Databricks, and AWS, focusing on reliability, governance, and cost efficiency. I enjoy bridging engineering and business, mentoring cross-functional teams, and enabling insight generation through Power BI, Looker, and Tableau. I’m a clear communicator and collaborative leader who helps stakeholders translate analytical needs into robust data solutions that drive growth.…I'm a Senior Data Engineer with 12+ years of experience transforming complex data ecosystems into business-ready analytics platforms. I design scalable ETL/ELT pipelines and cloud data architectures using Python, PySpark, Snowflake, Databricks, and AWS, focusing on reliability, governance, and cost efficiency. I enjoy bridging engineering and business, mentoring cross-functional teams, and enabling insight generation through Power BI, Looker, and Tableau. I’m a clear communicator and collaborative leader who helps stakeholders translate analytical needs into robust data solutions that drive growth.

Madeva Reddy Vemireddy

Data Scientist, Data Analyst, Full Stack Developer, +5





I'm a Senior Data Engineer with 12+ years of experience transforming complex data ecosystems into business-ready analytics platforms. I design scalable ETL/ELT pipelines and cloud data architectures using Python, PySpark, Snowflake, Databricks, and AWS, focusing on reliability, governance, and cost efficiency. I enjoy bridging engineering and business, mentoring cross-functional teams, and enabling insight generation through Power BI, Looker, and Tableau. I’m a clear communicator and collaborative leader who helps stakeholders translate analytical needs into robust data solutions that drive growth.…I'm a Senior Data Engineer with 12+ years of experience transforming complex data ecosystems into business-ready analytics platforms. I design scalable ETL/ELT pipelines and cloud data architectures using Python, PySpark, Snowflake, Databricks, and AWS, focusing on reliability, governance, and cost efficiency. I enjoy bridging engineering and business, mentoring cross-functional teams, and enabling insight generation through Power BI, Looker, and Tableau. I’m a clear communicator and collaborative leader who helps stakeholders translate analytical needs into robust data solutions that drive growth.

Available to hire

I’m a Senior Data Engineer with 12+ years of experience transforming complex data ecosystems into business-ready analytics platforms. I design scalable ETL/ELT pipelines and cloud data architectures using Python, PySpark, Snowflake, Databricks, and AWS, focusing on reliability, governance, and cost efficiency.

I enjoy bridging engineering and business, mentoring cross-functional teams, and enabling insight generation through Power BI, Looker, and Tableau. I’m a clear communicator and collaborative leader who helps stakeholders translate analytical needs into robust data solutions that drive growth.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Intermediate

Intermediate

Intermediate

Language

English

Fluent

Work Experience

Senior Data Engineer at Direct Line Group

June 1, 2022 - Present

Modernized DLG Insurance Home data ecosystem by designing and maintaining scalable ETL/ELT pipelines (Python, Spark, PySpark) and migrating legacy policies, quotes, and claims data to AWS S3 Data Lake and Snowflake. Automated workflows with Airflow and AWS Lambda, optimized Snowflake data marts, and implemented CI/CD pipelines for deployment. Migrated datasets/workflows from Databricks to AWS-native platforms (S3, Glue, EMR, Lake Formation) with zero data loss, improving data accessibility, processing efficiency, and governance. ETL & Data Pipelines: improved data accessibility by 40%. Workflow Automation: reduced manual intervention by 70% and cut pipeline execution time by 30%. Data Warehousing & Analytics: improved query performance by 45% and reduced analyst turnaround by 25%. Cloud & Data Processing: leveraged AWS Glue, Python, Airflow, EMR, DBT, Redshift, and PySpark to enhance data processing efficiency by 35% and ensure scalable, robust platforms. Cloud Migration & Cost Optimiz

Data Engineer at Tech Mahindra

April 1, 2022 - October 23, 2025

Built and maintained scalable ETL pipelines with Python and PySpark to process millions of credit card and financial transactions daily, migrating data into AWS S3 and Redshift for real-time analytics. Automated workflows with Step Functions; deployed infrastructure with Terraform; monitored pipelines with Datadog to enhance reliability. Designed and optimized Amazon Redshift warehouses and integrated Power BI, Looker, and Tableau for financial reporting, boosting query performance by 40% and enabling near real-time analytics. Implemented governance and compliance controls and reduced provisioning effort by 60% through infrastructure as code. ETL & Data Pipelines: 25+ pipelines, throughput improved by 30%. Data Warehousing: Redshift optimizations improved performance by 40%. Infrastructure & Automation: Terraform, Step Functions reduced provisioning and delays. Compliance & Monitoring: Datadog-based monitoring improved reliability and reporting accuracy.

Big Data Engineer at IBM

October 1, 2018 - October 23, 2025

Designed and implemented a centralized Customer Data Lake for AMEX Bank by ingesting data from mainframes, RDBMS, and JSON into HDFS, automating pipelines with NiFi and Spark, and building optimized data models and warehouses to enhance reporting and analytics. Standardized ingestion with Parquet format, cutting storage usage by 30% and improving query speed by 25%. Monitoring and reliability efforts contributed to 99.9% uptime. Data Integration: Data Lake creation across sources; Pipeline Automation: NiFi-based workflows reduced wrangling time by 40%. Data Warehousing: Optimized models and warehouses for faster reporting.

Software Engineer at Speridian Technologies

February 1, 2016 - October 23, 2025

Contributed to the development of pre-release software by designing reusable code for cloud-based distributed environments, modernizing legacy codebases, and building software for desktop and mobile platforms. Automated testing with Python Pytest, achieving high defect detection and on-time feature delivery. Coordinated with project management to ensure release schedules, and created reusable cloud code libraries to reduce development effort.

Senior Data Engineer at Direct Line Group

June 1, 2022 - Present

Data Engineer at Tech Mahindra

April 1, 2022 - October 24, 2025

Built and maintained 25+ scalable ETL pipelines using Python and PySpark to process millions of credit card and financial transactions daily, migrating data into AWS S3 and Redshift for real-time analytics. Automated workflows with Step Functions; deployed infrastructure with Terraform; monitored with Datadog to enhance pipeline reliability and reporting accuracy.

Big Data Engineer at IBM

October 1, 2018 - October 24, 2025

Designed and implemented a centralized Customer Data Lake for AMEX Bank by integrating data from mainframes, RDBMS, and JSON into HDFS, automating pipelines with NiFi and Spark, and building optimized data models and warehouses to enhance reporting, analytics, and overall process efficiency.

Software Engineer at Speridian Technologies

February 1, 2016 - October 24, 2025

Contributed to the development of pre-release software by designing reusable code for cloud-based distributed environments, modernizing legacy codebases, and building software for both desktop and mobile platforms. Collaborated with project managers on database development timelines, implemented testing with Python (Pytest), and delivered customized solutions to meet customer requirements.

Senior Data Engineer at Direct Line Group | Home Insurance

June 1, 2022 - November 19, 2025

Modernised the home insurance data ecosystem by designing, engineering, and maintaining scalable ETL/ELT pipelines (Python, Spark, PySpark) to migrate legacy policies, quotes, and claims data into AWS S3 Data Lake and Snowflake. Orchestrated workflows with Airflow and AWS Lambda, refined Snowflake data marts, and implemented CI/CD pipelines for deployment to AWS-native platforms (Glue, EMR, Lake Formation), ensuring zero data loss and improving accessibility, processing efficiency, and governance.

Data Engineer at Tech Mahindra | CRED (Finance)

April 1, 2022 - April 1, 2022

Built and maintained 25+ scalable ETL pipelines using Python and PySpark for high-volume financial transactions, migrated data into AWS S3 and Redshift for real-time analytics, and orchestrated workflows with Step Functions. Deployed infrastructure with Terraform, improved data availability and compliance, and implemented monitoring with Datadog to enhance pipeline reliability and reporting accuracy.

Big Data Engineer at IBM | AMEX (Banking)

October 1, 2018 - October 1, 2018

Architected a centralised Customer Data Lake on HDFS by integrating data from mainframes, RDBMS, and JSON sources; automated pipelines with Apache NiFi and Spark; built enhanced data models and data warehouses to strengthen reporting and analytics, improving process efficiency and data availability.

Software Engineer at Speridian Technologies

February 1, 2016 - February 1, 2016

Contributed to the development of pre-release software by designing reusable code for cloud-based distributed environments, modernising legacy codebases, and building software for desktop and mobile platforms. Collaborated with project managers on database development timelines, introduced testing with Python (Pytest), and delivered customised solutions to meet customer requirements.