Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

Hi, I’m an IT professional with 8+ years of experience delivering end-to-end data solutions across Banking, Finance, Healthcare, and Retail. I design, build, and deploy large-scale data applications in multi-cloud environments (AWS, Azure, GCP), leveraging Hadoop, Spark, and modern cloud data warehouses to enable insightful analytics. I thrive in Agile teams, implementing CI/CD pipelines, cloud migrations, data governance, and scalable data pipelines with Spark, Airflow, Databricks, Snowflake, and BI tools like Tableau and Power BI. I enjoy translating complex business needs into robust data platforms and delivering tangible value through data-driven decision making.…Hi, I’m an IT professional with 8+ years of experience delivering end-to-end data solutions across Banking, Finance, Healthcare, and Retail. I design, build, and deploy large-scale data applications in multi-cloud environments (AWS, Azure, GCP), leveraging Hadoop, Spark, and modern cloud data warehouses to enable insightful analytics. I thrive in Agile teams, implementing CI/CD pipelines, cloud migrations, data governance, and scalable data pipelines with Spark, Airflow, Databricks, Snowflake, and BI tools like Tableau and Power BI. I enjoy translating complex business needs into robust data platforms and delivering tangible value through data-driven decision making.

user1453543

Data Scientist, Data Analyst, Back-End Developer, +2





Hi, I’m an IT professional with 8+ years of experience delivering end-to-end data solutions across Banking, Finance, Healthcare, and Retail. I design, build, and deploy large-scale data applications in multi-cloud environments (AWS, Azure, GCP), leveraging Hadoop, Spark, and modern cloud data warehouses to enable insightful analytics. I thrive in Agile teams, implementing CI/CD pipelines, cloud migrations, data governance, and scalable data pipelines with Spark, Airflow, Databricks, Snowflake, and BI tools like Tableau and Power BI. I enjoy translating complex business needs into robust data platforms and delivering tangible value through data-driven decision making.…Hi, I’m an IT professional with 8+ years of experience delivering end-to-end data solutions across Banking, Finance, Healthcare, and Retail. I design, build, and deploy large-scale data applications in multi-cloud environments (AWS, Azure, GCP), leveraging Hadoop, Spark, and modern cloud data warehouses to enable insightful analytics. I thrive in Agile teams, implementing CI/CD pipelines, cloud migrations, data governance, and scalable data pipelines with Spark, Airflow, Databricks, Snowflake, and BI tools like Tableau and Power BI. I enjoy translating complex business needs into robust data platforms and delivering tangible value through data-driven decision making.

Available to hire

Hi, I’m an IT professional with 8+ years of experience delivering end-to-end data solutions across Banking, Finance, Healthcare, and Retail. I design, build, and deploy large-scale data applications in multi-cloud environments (AWS, Azure, GCP), leveraging Hadoop, Spark, and modern cloud data warehouses to enable insightful analytics.

I thrive in Agile teams, implementing CI/CD pipelines, cloud migrations, data governance, and scalable data pipelines with Spark, Airflow, Databricks, Snowflake, and BI tools like Tableau and Power BI. I enjoy translating complex business needs into robust data platforms and delivering tangible value through data-driven decision making.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Work Experience

Sr. Data Engineer at BNY Mellon

November 1, 2024 - Present

Responsible for Capital Markets data platforms, ensuring data accuracy, availability, and regulatory compliance. Set up multi-node Big Data clusters on AWS EC2 with CloudWatch/CloudTrail, secured S3 storage, and DynamoDB integration with Lambda. Designed enterprise data warehouses on Redshift, automated recurring tasks with Python, and engineered Airflow-based ETL/ELT pipelines. Developed PySpark/Scala data pipelines ingesting from APIs, S3, Teradata, and Redshift into curated lake layers; implemented Spark SQL transformations and Hive query tuning; built Python UDFs/MapReduce for data validation; real-time analytics with Spark Streaming; applied Spark MLlib for predictive use cases. Leveraged Palantir/IASE for governance and supported modernization including Java↔.NET migrations and JSP↔Angular front-end work. Led database migrations to PostgreSQL and supported Azure→AWS and Azure→GCP migrations. Managed Kubernetes clusters for high availability and resilience.

Sr. Data Engineer at Humana

December 1, 2022 - October 1, 2024

Contributed to Healthcare analytics by building and maintaining Azure Data Factory pipelines, processing data into ADLS Gen2 and Azure Synapse. Developed scalable ETL/ELT solutions, implemented metadata, lineage, and governance with Purview, and automated pipelines with PowerShell. Used Spark SQL/Delta Lake in Databricks, performed database tuning in Azure SQL and Synapse, and designed dimensional models for BI. Modernized legacy Hadoop/Hive transformations by migrating to Databricks and Synapse; integrated HDInsight with Databricks for advanced analytics; built predictive analytics pipelines in Python and Power BI dashboards. Led data migrations to Azure and supported cross-cloud migrations (Azure→AWS, Azure→GCP). Implemented CI/CD with Azure DevOps and real-time streaming with Kafka/Databricks.

Data Engineer at TARGET

April 1, 2021 - November 1, 2022

Built scalable data pipelines to process web server and POS logs, leveraging Flume to load into MongoDB for downstream analytics. Implemented fan-out Flume workflows, created dynamic Hive/HBase tables on EMR, and optimized Hadoop join strategies. Developed Spark/Scala pipelines on Databricks, engineered ETL pipelines with AWS Glue/Data Pipeline, and moved data across S3, Redshift, RDS (PostgreSQL), and Snowflake. Automated testing, validated data quality, and supported BI dashboards via Tableau.

AWS Developer / Data Engineer at USAA / Nike (contracted experience)

January 1, 2020 - March 1, 2021

Worked on Hadoop/Spark-based data processing, ingested data via Flume into HDFS on EMR, and built Spark/Scala pipelines with Databricks. Implemented MapReduce, Pig on EMR, and integrated Hive with Tableau for analytics. Built ETL pipelines using Sqoop, TDCH, Talend, and Python, loading data into S3, Redshift, and Snowflake. Established CI with Jenkins, and supported real-time streaming with Kafka. Contributed to cross-cloud data initiatives and data migrations, including PostgreSQL migrations.

Data Analyst at App Labs

September 1, 2017 - October 1, 2019

Involved in end-to-end data implementation with focus on writing MapReduce and Hive jobs for large-scale data processing. Utilized Hive/HQL for data querying on HDFS, monitored and managed Hadoop clusters, and accelerated processing with Spark (Python/Scala). Automated batch ETL pipelines, automated Spark scheduling, and developed large-scale data transformations with Spark/Scala. Led data warehouse migration efforts and loaded data into HDFS/Hive from SQL/DB2/Oracle, utilizing Spark Streaming for near real-time analytics and integrating with Tableau.