Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

I’m Manish Kumar Tiwari, a Senior Data Engineer and AI Specialist with over 11 years of experience in data engineering, analytics, and AI/ML solution development. I specialize in designing and implementing scalable data pipelines, integrating diverse data sources, and enabling data-driven insights using Python, SQL, Snowflake, Airflow, Spark, and Flask/FastAPI. My work focuses on data migration, API development, AI/ML model integration, and cloud-based data architecture across industries including Banking, Retail, Telecom, and Investment Analytics. I’ve led projects involving LLM-powered data extraction, sentiment analysis, and predictive modeling to enhance decision-making efficiency. I’m passionate about combining data engineering and AI to deliver intelligent, automated solutions that drive measurable business value. Core Skills: Data Engineering (ETL/ELT, Snowflake, Spark, Airflow, DBT) AI & ML (LLMs, RAG, NLP, Deep Learning) Backend Development (Python, Flask, FastAPI, Node.js) Cloud Platforms (AWS, GCP, Azure) Data Visualization (Looker, Tableau, Power BI) CI/CD (GitLab, GitHub Actions)…I’m Manish Kumar Tiwari, a Senior Data Engineer and AI Specialist with over 11 years of experience in data engineering, analytics, and AI/ML solution development. I specialize in designing and implementing scalable data pipelines, integrating diverse data sources, and enabling data-driven insights using Python, SQL, Snowflake, Airflow, Spark, and Flask/FastAPI. My work focuses on data migration, API development, AI/ML model integration, and cloud-based data architecture across industries including Banking, Retail, Telecom, and Investment Analytics. I’ve led projects involving LLM-powered data extraction, sentiment analysis, and predictive modeling to enhance decision-making efficiency. I’m passionate about combining data engineering and AI to deliver intelligent, automated solutions that drive measurable business value. Core Skills: Data Engineering (ETL/ELT, Snowflake, Spark, Airflow, DBT) AI & ML (LLMs, RAG, NLP, Deep Learning) Backend Development (Python, Flask, FastAPI, Node.js) Cloud Platforms (AWS, GCP, Azure) Data Visualization (Looker, Tableau, Power BI) CI/CD (GitLab, GitHub Actions)

Manish Kumar Tiwari

Data Scientist, Back-End Developer, Programmer, +4





I’m Manish Kumar Tiwari, a Senior Data Engineer and AI Specialist with over 11 years of experience in data engineering, analytics, and AI/ML solution development. I specialize in designing and implementing scalable data pipelines, integrating diverse data sources, and enabling data-driven insights using Python, SQL, Snowflake, Airflow, Spark, and Flask/FastAPI. My work focuses on data migration, API development, AI/ML model integration, and cloud-based data architecture across industries including Banking, Retail, Telecom, and Investment Analytics. I’ve led projects involving LLM-powered data extraction, sentiment analysis, and predictive modeling to enhance decision-making efficiency. I’m passionate about combining data engineering and AI to deliver intelligent, automated solutions that drive measurable business value. Core Skills: Data Engineering (ETL/ELT, Snowflake, Spark, Airflow, DBT) AI & ML (LLMs, RAG, NLP, Deep Learning) Backend Development (Python, Flask, FastAPI, Node.js) Cloud Platforms (AWS, GCP, Azure) Data Visualization (Looker, Tableau, Power BI) CI/CD (GitLab, GitHub Actions)…I’m Manish Kumar Tiwari, a Senior Data Engineer and AI Specialist with over 11 years of experience in data engineering, analytics, and AI/ML solution development. I specialize in designing and implementing scalable data pipelines, integrating diverse data sources, and enabling data-driven insights using Python, SQL, Snowflake, Airflow, Spark, and Flask/FastAPI. My work focuses on data migration, API development, AI/ML model integration, and cloud-based data architecture across industries including Banking, Retail, Telecom, and Investment Analytics. I’ve led projects involving LLM-powered data extraction, sentiment analysis, and predictive modeling to enhance decision-making efficiency. I’m passionate about combining data engineering and AI to deliver intelligent, automated solutions that drive measurable business value. Core Skills: Data Engineering (ETL/ELT, Snowflake, Spark, Airflow, DBT) AI & ML (LLMs, RAG, NLP, Deep Learning) Backend Development (Python, Flask, FastAPI, Node.js) Cloud Platforms (AWS, GCP, Azure) Data Visualization (Looker, Tableau, Power BI) CI/CD (GitLab, GitHub Actions)

Available to hire

I’m Manish Kumar Tiwari, a Senior Data Engineer and AI Specialist with over 11 years of experience in data engineering, analytics, and AI/ML solution development. I specialize in designing and implementing scalable data pipelines, integrating diverse data sources, and enabling data-driven insights using Python, SQL, Snowflake, Airflow, Spark, and Flask/FastAPI.

My work focuses on data migration, API development, AI/ML model integration, and cloud-based data architecture across industries including Banking, Retail, Telecom, and Investment Analytics. I’ve led projects involving LLM-powered data extraction, sentiment analysis, and predictive modeling to enhance decision-making efficiency.

I’m passionate about combining data engineering and AI to deliver intelligent, automated solutions that drive measurable business value.

Core Skills:

Data Engineering (ETL/ELT, Snowflake, Spark, Airflow, DBT)

AI & ML (LLMs, RAG, NLP, Deep Learning)

Backend Development (Python, Flask, FastAPI, Node.js)

Cloud Platforms (AWS, GCP, Azure)

Data Visualization (Looker, Tableau, Power BI)

CI/CD (GitLab, GitHub Actions)

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Intermediate

Language

English

Advanced

Hindi

Advanced

Work Experience

Senior Data Engineer at Publicis Sapient

November 1, 2024 - November 2, 2025

Analyzed Power BI backend logic and converted to SQL tables; Owned phase 3 CNI collection incentive implementation for RM/LCM/RCM; Conducted requirements gathering, backend development, assisted report layout, and led UAT and production deployment; Supported bug fixes and deployment discussions; Used Airflow to schedule ETL jobs.

Data Engineer at U3Infotech (@GIC)

November 1, 2024 - November 1, 2024

Analyzed and modified DB views, stored procedures, and SQL queries for Rex project; Migrated backend API from Flask to FastAPI; Architected and developed an in-house data pipeline framework using Python, Airflow, SQL; automated data replication from various sources to destinations; Reduced processing time from 2 days to 2 hours; Created Airflow DAGs; Automated report generation to SharePoint; Implemented scheduled reconciliation; Researched AI model tools like GPT Engineer and Aider.

Data Engineer at Achiever Technology (Capgemini)

November 1, 2022 - November 1, 2022

Reporting for STRE MOT module @ DBS; Building reporting process; Writing SQL queries to implement business rules; Data analysis and reporting; Enhancement of Scala-based Spark code.

Data Engineer at Styleseat Analytics

October 1, 2022 - October 1, 2022

Sales & Marketing team; Dashboards & KPIs; LookML modelling; Onboarded new tables to Looker; Optimized dashboards; ETL jobs using AWS, SQL, Python, Airflow, DBT; PoC with Firebolt for faster dashboard refresh; Automated report generation and upload to SharePoint; Scheduled reconciliation; Researched AI model-based tools for project assessment.

Data Engineer at Ampcus (Nasdaq)

April 1, 2022 - April 1, 2022

Vulnerability Management (VMT) data pipelines; Python data cleaning and transformation; PySpark-based processing; Built dashboards and KPIs in Looker; Looker dimensions, measures, and actions; Node.js API for Looker input actions; Used Firebolt to optimize dashboards.

Senior Data Engineer at Happiest Mind

July 1, 2021 - July 1, 2021

WES Data Engineering; Moodle data lake implementation; Snowflake-based EDW with PostgreSQL; DBT-based ETL; AWS S3; Data validation; End-to-end ELT pipelines; CI/CD pipelines; Documentation and client interaction.

Senior Software Engineer at Oracle India

March 1, 2020 - March 1, 2020

BU–Retail Cloud project; ODI, OBIEE, Web Services; Spark for large data sets; Shell scripting for automation; SVN/JIRA; Performance tuning and enhancements; Data warehousing and ETL; Realtime data movement.

Associate Consultant at Manthan Systems

April 1, 2019 - April 1, 2019

Alshaya (Kuwait) and Yum! Brands projects; Redshift-based data lake; Parquet in S3; ETL to populate Dim/Facts; Tableau dashboards; Coordination with RA tool; AWS S3, Aginity, CloudBerry.

Application Development Analyst at Accenture Solutions

May 1, 2018 - May 1, 2018

Takeda (GenMed Mobile Reporting & QAAD), FairPoint, Liberty Global projects; Informatica ETL; SAS data analysis; Tidal scheduling; Mentored juniors; SVN, Unix, JIRA; automation and migration support.