I am a Senior Software Engineer with 12+ years in the tech industry, including 5 years specializing in Data Engineering. I design and develop database applications for AML in banking and investments in financial services, with hands-on experience in big data processing and warehousing using Databricks, Azure, and relational databases like Oracle and MS SQL. I have led teams and built/maintained ETL applications on cloud platforms (Azure Databricks, ADF) and have strong skills in PySpark, Spark SQL, Python, and SQL. I enjoy solving complex data problems, optimizing performance, and collaborating with stakeholders to deliver reliable, analytics-ready data products.

MANIMARAN VARATHARAJAN

I am a Senior Software Engineer with 12+ years in the tech industry, including 5 years specializing in Data Engineering. I design and develop database applications for AML in banking and investments in financial services, with hands-on experience in big data processing and warehousing using Databricks, Azure, and relational databases like Oracle and MS SQL. I have led teams and built/maintained ETL applications on cloud platforms (Azure Databricks, ADF) and have strong skills in PySpark, Spark SQL, Python, and SQL. I enjoy solving complex data problems, optimizing performance, and collaborating with stakeholders to deliver reliable, analytics-ready data products.

Available to hire

I am a Senior Software Engineer with 12+ years in the tech industry, including 5 years specializing in Data Engineering. I design and develop database applications for AML in banking and investments in financial services, with hands-on experience in big data processing and warehousing using Databricks, Azure, and relational databases like Oracle and MS SQL.

I have led teams and built/maintained ETL applications on cloud platforms (Azure Databricks, ADF) and have strong skills in PySpark, Spark SQL, Python, and SQL. I enjoy solving complex data problems, optimizing performance, and collaborating with stakeholders to deliver reliable, analytics-ready data products.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
Intermediate
Intermediate
See more

Work Experience

Senior Data Engineer at CitiBank, Singapore
April 1, 2024 - November 7, 2025
Led AML Datamart development and designed, built, and implemented ETL pipelines. Implemented ETL pipelines in Azure Data Factory to extract, transform, and load data into Azure Data Lake Storage Gen2 (ADLS). Developed and configured Linked Services, Datasets, and Pipelines in ADF, integrating with Databricks, ADLS, Azure SQL, and Key Vault for secure data movement. Managed automated pipeline orchestration with ADF triggers. Built PySpark-based processing frameworks in Azure Databricks for large-scale transformation, cleansing, and aggregation. Processed multi-format data (Delta, CSV, Parquet, JSON) to derive insights on customer behavior. Streamlined workflows across ADF, Databricks, and ADLS with a focus on performance and data quality. Collaborated with reporting teams to deliver curated data and used GitHub for CI/CD.
Senior Data Engineer at U3 Infotech, Singapore
April 1, 2024 - April 1, 2024
Worked on Investment Applications, designing and developing end-to-end ETL pipelines in Azure Databricks following the Medallion architecture to produce clean, curated, analytics-ready data. Built refined Delta-format datasets for the gold layer and ingestion pipelines using Azure Data Factory (Spark SQL), integrating with ADLS Gen2, Azure Storage, and Azure SQL Database. Configured Linked Services, Datasets, and Triggers to automate data workflows across sources. Migrated legacy PL/SQL procedures and packages to PySpark SQL to improve performance, maintainability, and scalability in Databricks.
Data Engineer at CitiBank, Singapore
February 1, 2022 - February 1, 2022
Developed relational database designs with normalization and indexing; authored and maintained PL/SQL, stored procedures, functions, and packages. Collaborated with cross-functional teams to support application development and ensure PL/SQL integration with business requirements. Wrote Hive queries for data analysis and integrated them into Spark for batch processing. Migrated complex PL/SQL procedures to Spark SQL and created Hive-based reports for UI teams.
Consultant at Virtusa Polaris
November 1, 2018 - November 1, 2018
Developed PL/SQL queries, stored procedures, functions, triggers, and packages to ensure high performance in large-scale Oracle databases. Identified and resolved performance bottlenecks through query optimization, indexing strategies, and database tuning techniques (e.g., EXPLAIN PLAN, SQL trace, optimizer hints). Demonstrated problem-solving skills with debugging tools to stabilize Oracle-based applications.
Associate Project at Cognizant
December 1, 2017 - December 1, 2017
Migrated DATASTAGE tools to Oracle components for cost efficiency. Developed PL/SQL queries, procedures, functions, and triggers to manipulate and retrieve data. Applied database optimization techniques including index usage and understanding execution plans to improve SQL/PL-SQL performance. Worked with dynamic customer-specific rules using Oracle Collection Objects.
Software Developer at Information Dynamic India Pvt Ltd
July 1, 2016 - July 1, 2016
Developed application modules for Shipping and Logistics using Oracle objects. Created PL/SQL queries, procedures, functions, and triggers to manage data efficiently. Proficient in writing complex SQL queries with joins, subqueries, and aggregations and implementing business logic through PL/SQL blocks.

Education

Bachelor of Technology at Anna University, Chennai, TN, India
January 11, 2030 - January 1, 2012

Qualifications

Databricks Certified Data Engineer Associate
January 1, 2025 - November 7, 2025
Azure Databricks Platform Architect accreditation
January 1, 2025 - November 7, 2025
Microsoft Certified: Azure Fundamentals
January 1, 2020 - November 7, 2025

Industry Experience

Financial Services, Professional Services