I am a results-driven Data Engineer with 6+ years of experience building scalable data pipelines, cloud architectures, and analytics solutions. I specialize in Microsoft Fabric, Azure Data Factory, Azure Data Lake, and SQL/PySpark to design efficient ETL/ELT workflows. I have experience integrating AI/LLM models with vector databases to enable intelligent data applications. I enjoy collaborating with cross-functional teams, delivering reliable data systems, and mentoring junior engineers to adopt modern Azure data tools.

Malathi Soundarapandian

I am a results-driven Data Engineer with 6+ years of experience building scalable data pipelines, cloud architectures, and analytics solutions. I specialize in Microsoft Fabric, Azure Data Factory, Azure Data Lake, and SQL/PySpark to design efficient ETL/ELT workflows. I have experience integrating AI/LLM models with vector databases to enable intelligent data applications. I enjoy collaborating with cross-functional teams, delivering reliable data systems, and mentoring junior engineers to adopt modern Azure data tools.

Available to hire

I am a results-driven Data Engineer with 6+ years of experience building scalable data pipelines, cloud architectures, and analytics solutions. I specialize in Microsoft Fabric, Azure Data Factory, Azure Data Lake, and SQL/PySpark to design efficient ETL/ELT workflows.

I have experience integrating AI/LLM models with vector databases to enable intelligent data applications. I enjoy collaborating with cross-functional teams, delivering reliable data systems, and mentoring junior engineers to adopt modern Azure data tools.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
Intermediate
Intermediate
See more

Language

English
Fluent
Tamil
Advanced
Telugu
Advanced
Hindi
Advanced
Norwegian
Intermediate

Work Experience

Data Engineer at Kermit Tech Consulting Company
May 1, 2023 - November 1, 2025
Designed and implemented Microsoft Fabric pipelines for the Core42 project, automating data ingestion from Salesforce into the data warehouse to support UI analytics. Developed end-to-end Cosmos DB pipelines with vector embeddings, enabling semantic search and AI-based data retrieval. Built dataflows, lakehouses, and Fabric pipelines to streamline ETL and reporting for multiple clients. Integrated LLM models with Vector Databases to enhance contextual knowledge search. Delivered technical demos and mentored junior engineers on modern Azure data tools. Collaborated with cross-functional teams to optimize ETL/ELT performance and ensure data quality.
Data Engineer Intern at Kermit Tech Consulting Company
February 1, 2023 - February 1, 2023
Designed Snowflake databases for scalable storage solutions. Built StreamSets pipelines to ingest and process large datasets. Implemented Change Data Capture (CDC) for real-time updates. Transformed data using DBT for analytical reporting.
ETL Developer – Telenor at Tata Consultancy Services (TCS)
February 1, 2017 - February 1, 2017
Created ETL workflows using Pentaho, managing large-scale data migration projects. Automated ETL tasks with UNIX shell scripting, improving efficiency. Ensured data consistency and optimized transformations for high-volume datasets.
ETL Developer (Internal Projects) at Tata Consultancy Services (TCS)
February 1, 2014 - February 1, 2014
Developed ETL processes integrating data from Oracle, MySQL, PostgreSQL, XML, and Excel. Created BI dashboards using Synaptris and documented ETL workflows. Completed Informatica training for workflow and integration design.

Education

Bachelor of Engineering in Computer Science at Anna University of Technology, Tirunelveli, India
January 1, 2011 - November 1, 2025

Qualifications

Microsoft Certified: Fabric Data Engineer Associate
January 11, 2030 - November 1, 2025
SnowPro Core Certified
January 11, 2030 - November 1, 2025
AWS Solutions Architect – Associate
January 11, 2030 - November 1, 2025
AWS Cloud Practitioner
January 11, 2030 - November 1, 2025
StreamSets Yellow Belt Certified
January 11, 2030 - November 1, 2025

Industry Experience

Software & Internet, Professional Services, Media & Entertainment

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
Intermediate
Intermediate
See more

Hire a Developer

We have the best developer experts on Twine. Hire a developer in Oslo today.