Naveen Kumar

Sr.Data Engineer at UTMB Health

Designed and implemented ETL pipelines using Azure Data Factory to extract, transform, and load large datasets from on-prem Oracle and SQL Server sources into Azure Synapse Analytics. Migrated Informatica PowerCenter workflows to ADF, improving pipeline efficiency and reducing maintenance overhead by 30%. Built and maintained control tables in Azure SQL Database for pipeline auditing, metadata tracking, and error handling. Optimized Synapse Dedicated SQLPool queries with partitioning and indexing; collaborated with Power BI teams to deliver reliable data models for dashboards.

Data Engineer - Databricks at Charles Schwab

Migrated 500+ on-premises data pipelines to cloud-native Databricks on AWS, cutting manual operations by 70%. Implemented AES-256 encryption and used Snowflake Zero-Copy Cloning for streamlined development and QA. Containerized PySpark jobs with Docker and deployed on AWS EC2; designed scalable ETL/ELT workflows using Databricks (PySpark) and Apache Airflow, ingesting raw data into S3 and loading into Snowflake using JDBC connectors.

Data Engineer at Adons Softech

Developed configurable data delivery pipelines for scheduled updates to customer-facing data stores built with Python. Used big data tools such as Apache Pig, Hadoop, Hive, Spark to complete data analysis tasks. Managed the SSIS lifecycle, built/deployed ETL packages; worked with AWS components (EMR, EC2, S3) for scalable data processing. Generated ad-hoc reports and dashboards to support decision-makers.

Sr. Data Engineer at UTMB Health

Designed and implemented ETL pipelines using Azure Data Factory to extract, transform, and load large datasets from on-prem Oracle and SQL Server sources into Azure Synapse Analytics. Migrated and modernized Informatica PowerCenter workflows to Azure Data Factory, improving pipeline efficiency and reducing maintenance overhead by 30%. Led an Informatica-to-Azure migration project involving 192 source tables and multiple workflows, optimizing data ingestion and transformation logic in Synapse. Developed and maintained control tables in Azure SQL Database for pipeline auditing, metadata tracking, and error handling in ADF workflows. Built and optimized complex stored procedures, joins, and aggregations in Synapse dedicated SQL pools for reporting and analytics. Created and scheduled ADF triggers, linked services, and datasets to automate data movement between Azure Blob Storage, Synapse, and on-prem databases. Designed Informatica mappings and sessions for Oracle-to-Azure data migration,

Data Engineer - Databricks at Charles Schwab

Migrated 500+ on-premises data pipelines to a cloud-native architecture, reducing manual operations by 70%. Implemented AES-256 encryption and used Snowflake Zero-Copy Cloning for streamlined development and QA. Containerized PySpark jobs using Docker and deployed on AWS EC2 for scalable execution. Leveraged AWS Lambda for serverless data transformations, storing results in PostgreSQL, and implemented AWS CloudWatch for monitoring and logging. Designed and orchestrated scalable ETL/ELT workflows using Databricks (PySpark) and Apache Airflow, ingesting raw data into AWS S3 and loading into Snowflake using JDBC connectors. Leveraged Snowflake features (Snowpipe, Time Travel, clustering keys, materialized views, virtual warehouses, VACUUM) achieving 45% faster query execution and 30% lower compute costs. Engineered scalable PySpark/Databricks Auto Loader pipelines to ingest & transform semi-structured data (JSON, XML, CSV, Avro) into Delta Lake with schema enforcement, ACID compliance, Ti

Data Engineer at Adons Softech

Developed a configurable data delivery pipeline for scheduled updates to customer-facing data stores built with Python. Used big data tools such as Apache Pig, Hadoop, Hive, Spark to complete data analysis tasks. Participated in the SSIS lifecycle, creating packages, deployment, and execution in both environments. Worked extensively with AWS components (EMR, EC2, S3). Created ETL scripts to fulfill ad-hoc data requests and pull data from analytic sites. Leveraged libraries including NumPy, Pandas, Scikit-learn, and TensorFlow for data processing and modeling. Generated ad-hoc reports in Excel and Power Pivot; shared dashboards with Power BI. Designed reports for multiple departments, enabling strategic decision-making.

Sr.Data Engineer at UTMB Health

Designed and implemented end-to-end ETL pipelines using Azure Data Factory to extract, transform, and load large datasets from on-prem Oracle and SQL Server sources into Azure Synapse Analytics. Migrated and modernized Informatica PowerCenter workflows to Azure Data Factory, reducing maintenance overhead by 30%. Led Informatica-to-Azure migration for 192 source tables and multiple workflows, optimizing ingestion and transformation logic in Synapse. Implemented control tables in Azure SQL Database for pipeline auditing, metadata tracking, and error handling within ADF. Used dedicated SQL pools in Synapse to optimize complex stored procedures, joins, and aggregations for reporting. Created and scheduled ADF triggers, linked services, and datasets to automate movement between Azure Blob Storage, Synapse, and on-prem databases. Designed Informatica mappings for Oracle-to-Azure data migration, ensuring data quality and integrity. Performed performance tuning in SSMS and validated data post-

Senior Data Engineer at UTMB Health

Designed and implemented ETL pipelines using Azure Data Factory to extract, transform, and load large datasets from on-prem Oracle and SQL Server sources into Azure Synapse Analytics. Migrated Informatica PowerCenter workflows to Azure Data Factory, improving pipeline efficiency and reducing maintenance overhead by 30%. Led Informatica-to-Azure migration projects across 192 source tables to optimize ingestion and transformation logic in Synapse. Created control tables in Azure SQL Database for auditing, metadata tracking, and error handling in ADF workflows. Optimized queries and storage in Synapse, automated data movement between Blob Storage, Synapse, and on-prem databases, and collaborated with analysts to deliver reliable data models for dashboards.