Malathi Soundarapandian
I am a results-driven Data Engineer with 6+ years of experience building scalable data pipelines, cloud architectures, and analytics solutions.
About
I am a results-driven Data Engineer with 6+ years of experience building scalable data pipelines, cloud architectures, and analytics solutions. I specialize in Microsoft Fabric, Azure Data Factory, Azure Data Lake, and SQL/PySpark to design efficient ETL/ELT workflows.
I have experience integrating AI/LLM models with vector databases to enable intelligent data applications. I enjoy collaborating with cross-functional teams, delivering reliable data systems, and mentoring junior engineers to adopt modern Azure data tools.
- 2 years' experience
- Joined November 2025
Skills· 15
Languages
- EnglishFluent
- TamilAdvanced
- TeluguAdvanced
- HindiAdvanced
- NorwegianIntermediate
Industry experience
- Software & Internet
- Professional Services
- Media & Entertainment
More experts in Oslo, Norway
Work experience· 4 roles
Designed and implemented Microsoft Fabric pipelines for the Core42 project, automating data ingestion from Salesforce into the data warehouse to support UI analytics. Developed end-to-end Cosmos DB pipelines with vector embeddings, enabling semantic search and AI-based data retrieval. Built dataflows, lakehouses, and Fabric pipelines to streamline ETL and reporting for multiple clients. Integrated LLM models with Vector Databases to enhance contextual knowledge search. Delivered technical demos and mentored junior engineers on modern Azure data tools. Collaborated with cross-functional teams to optimize ETL/ELT performance and ensure data quality.
Designed Snowflake databases for scalable storage solutions. Built StreamSets pipelines to ingest and process large datasets. Implemented Change Data Capture (CDC) for real-time updates. Transformed data using DBT for analytical reporting.
Created ETL workflows using Pentaho, managing large-scale data migration projects. Automated ETL tasks with UNIX shell scripting, improving efficiency. Ensured data consistency and optimized transformations for high-volume datasets.
Education
Certifications and awards· 5
Hire Malathi Soundarapandian today
Post a job and invite Malathi, or contact them directly. No hidden commission.







