Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

Hi, I’m Raman Singh Malhotra, a data engineer with 5 years of experience designing and scaling cloud-native data platforms across AWS, Databricks, and Snowflake. I build real-time and batch ETL pipelines, optimize query performance, and enable data-driven decision-making for Fortune 500 clients. I’m passionate about transforming raw data into high-quality analytical assets and leading end-to-end data lifecycle automation. I enjoy collaborating with cross-functional teams—ML, DevOps, and analytics—to deliver fault-tolerant pipelines and scalable solutions. In my spare time, I explore new data tools and optimize processes to extract maximum value from data.…Hi, I’m Raman Singh Malhotra, a data engineer with 5 years of experience designing and scaling cloud-native data platforms across AWS, Databricks, and Snowflake. I build real-time and batch ETL pipelines, optimize query performance, and enable data-driven decision-making for Fortune 500 clients. I’m passionate about transforming raw data into high-quality analytical assets and leading end-to-end data lifecycle automation. I enjoy collaborating with cross-functional teams—ML, DevOps, and analytics—to deliver fault-tolerant pipelines and scalable solutions. In my spare time, I explore new data tools and optimize processes to extract maximum value from data.

Raman Singh Malhotra

Data Scientist, Full Stack Developer, Web Developer, +3





Hi, I’m Raman Singh Malhotra, a data engineer with 5 years of experience designing and scaling cloud-native data platforms across AWS, Databricks, and Snowflake. I build real-time and batch ETL pipelines, optimize query performance, and enable data-driven decision-making for Fortune 500 clients. I’m passionate about transforming raw data into high-quality analytical assets and leading end-to-end data lifecycle automation. I enjoy collaborating with cross-functional teams—ML, DevOps, and analytics—to deliver fault-tolerant pipelines and scalable solutions. In my spare time, I explore new data tools and optimize processes to extract maximum value from data.…Hi, I’m Raman Singh Malhotra, a data engineer with 5 years of experience designing and scaling cloud-native data platforms across AWS, Databricks, and Snowflake. I build real-time and batch ETL pipelines, optimize query performance, and enable data-driven decision-making for Fortune 500 clients. I’m passionate about transforming raw data into high-quality analytical assets and leading end-to-end data lifecycle automation. I enjoy collaborating with cross-functional teams—ML, DevOps, and analytics—to deliver fault-tolerant pipelines and scalable solutions. In my spare time, I explore new data tools and optimize processes to extract maximum value from data.

Available to hire

Hi, I’m Raman Singh Malhotra, a data engineer with 5 years of experience designing and scaling cloud-native data platforms across AWS, Databricks, and Snowflake. I build real-time and batch ETL pipelines, optimize query performance, and enable data-driven decision-making for Fortune 500 clients. I’m passionate about transforming raw data into high-quality analytical assets and leading end-to-end data lifecycle automation.

I enjoy collaborating with cross-functional teams—ML, DevOps, and analytics—to deliver fault-tolerant pipelines and scalable solutions. In my spare time, I explore new data tools and optimize processes to extract maximum value from data.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Intermediate

Work Experience

Senior Data Engineer at Genpact

September 1, 2024 - Present

Led real-time data pipelines on Databricks and AWS S3 for Nike logistics, achieving 85% lower latency and 95% higher data accuracy. Implemented event-driven ETL using SQS, Lambda, Step Functions and Glue, cutting streaming processing time by 40%. Implemented Delta Live Tables and Kafka ingestion for high-throughput workloads (100 GB–1 TB), reducing throughput costs by 30%. Tuned PySpark jobs handling 1.5M+ records to resolve small-file issues. Optimized Redshift query plans to improve API stability and reduce timeouts.

Data Engineer at Koantek

April 1, 2024 - September 1, 2024

Orchestrated 10+ AWS Lambda and Glue ETL jobs with Step Functions to automate multi-source data ingestion. Managed daily ingestion of 5+ TB of SQL and MongoDB data via AWS DMS, ensuring consistency across S3 and DynamoDB. Migrated 200+ S3 tables to Snowflake using dbt, reducing load times by 30% and enabling incremental refreshes via Snowpipe. Built dbt models with star/snowflake schemas for scalable analytics in credit risk and customer lifecycle. Collaborated with ML and DevOps teams to ensure fault-tolerant pipelines and CI/CD-based data delivery.

DWH / BI Developer at Amdocs Development Centre

July 1, 2020 - April 1, 2024

Led three large migrations from Mainframe/Teradata to Snowflake, converting 500+ tables and automating 1,000+ batch jobs using TWS. Developed 150+ optimized Snowflake SQL and Python scripts for structured/unstructured data ingestion, improving efficiency by 30%. Converted 20+ SSIS packages to Azure Data Factory pipelines, reducing manual ETL maintenance by 40%. Designed and implemented row-level security and governance controls. Built Python automation for ETL planning and DML script analysis, integrating GPT-powered regex, saving 200+ hours per sprint.