Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

I'm a data engineer with 8 years in software, including 4 years in Azure cloud services and big data technologies, and 4 years in data warehouse implementations. I specialize in building scalable data pipelines, data warehouses, and cloud-native data platforms, using Azure Data Factory, Databricks, Snowflake, and Spark to move and transform large volumes of data. I thrive on solving complex data problems, collaborating across teams, and delivering data-driven insights through dashboards and reports. I have hands-on experience across data ingestion, data modeling, encryption, and performance tuning, along with CI/CD for data pipelines and ERP integrations.…I'm a data engineer with 8 years in software, including 4 years in Azure cloud services and big data technologies, and 4 years in data warehouse implementations. I specialize in building scalable data pipelines, data warehouses, and cloud-native data platforms, using Azure Data Factory, Databricks, Snowflake, and Spark to move and transform large volumes of data. I thrive on solving complex data problems, collaborating across teams, and delivering data-driven insights through dashboards and reports. I have hands-on experience across data ingestion, data modeling, encryption, and performance tuning, along with CI/CD for data pipelines and ERP integrations.

Teja Ch

Data Scientist, Full Stack Developer, Cloud Developer, +3





I'm a data engineer with 8 years in software, including 4 years in Azure cloud services and big data technologies, and 4 years in data warehouse implementations. I specialize in building scalable data pipelines, data warehouses, and cloud-native data platforms, using Azure Data Factory, Databricks, Snowflake, and Spark to move and transform large volumes of data. I thrive on solving complex data problems, collaborating across teams, and delivering data-driven insights through dashboards and reports. I have hands-on experience across data ingestion, data modeling, encryption, and performance tuning, along with CI/CD for data pipelines and ERP integrations.…I'm a data engineer with 8 years in software, including 4 years in Azure cloud services and big data technologies, and 4 years in data warehouse implementations. I specialize in building scalable data pipelines, data warehouses, and cloud-native data platforms, using Azure Data Factory, Databricks, Snowflake, and Spark to move and transform large volumes of data. I thrive on solving complex data problems, collaborating across teams, and delivering data-driven insights through dashboards and reports. I have hands-on experience across data ingestion, data modeling, encryption, and performance tuning, along with CI/CD for data pipelines and ERP integrations.

Available to hire

I’m a data engineer with 8 years in software, including 4 years in Azure cloud services and big data technologies, and 4 years in data warehouse implementations. I specialize in building scalable data pipelines, data warehouses, and cloud-native data platforms, using Azure Data Factory, Databricks, Snowflake, and Spark to move and transform large volumes of data. I thrive on solving complex data problems, collaborating across teams, and delivering data-driven insights through dashboards and reports. I have hands-on experience across data ingestion, data modeling, encryption, and performance tuning, along with CI/CD for data pipelines and ERP integrations.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Language

English

Fluent

Work Experience

Azure Data Engineer at Bank Of America

March 1, 2024 - November 21, 2025

Managed end-to-end ETL data pipelines using Azure Data Factory and Databricks; integrated on-premises and cloud data sources (MySQL, Cassandra, Blob storage, Azure SQL DB) and loaded data into Snowflake. Implemented query optimization and indexing, wrote DDL/DML, and implemented data validations. Developed ELT pipelines to move data between SQL databases, Snowflake, and data lakes; collaborated with Logic Apps for process automation and monitored data processing pipelines. Designed and deployed interactive Power BI dashboards for leadership insights.

Azure Data Engineer at UnitedHealth Group

February 29, 2024 - February 29, 2024

Ingested data into Azure Data Lake, Azure Storage, Azure SQL, and Azure Synapse; performed ETL using Azure Databricks; migrated on-prem Oracle ETL processes to Synapse; migrated SQL databases to Azure Data Lake and integrated with Databricks. Implemented data partitioning and bucket-based Hive joins; built batch and streaming data pipelines with Spark Streaming and Kafka. Deployed Python-based applications to Azure DevOps CI/CD and built enterprise data models and dashboards.

Python Data Engineer at Nike

April 30, 2023 - April 30, 2023

Developed a data platform from scratch; designed Hive tables and processed data using Sqoop for HDFS; built data pipelines with Spark (PySpark/Spark SQL) and Hive. Developed REST APIs using Python (Flask/Django); created Power BI dashboards; implemented CI/CD with Docker and Jenkins; integrated AWS S3 for static data storage; handled batch and streaming data processing with Sqoop and Spark.

Big Data Developer at Truist Financial

December 31, 2021 - December 31, 2021

Imported data via Sqoop into HDFS; performed Spark-based aggregations and data landing in Hive. Built Kafka/Spark streaming pipelines; worked with Hadoop ecosystem (Hadoop, Hive, MapReduce, Zookeeper, Oozie) to manage workflows; implemented Oozie workflows and YAML-based CI/CD; migrated data from Oracle to Hadoop; collaborated with JIRA for project tracking; leveraged PySpark for data analysis.

Hadoop Developer at Neon Software Services

November 30, 2019 - November 30, 2019

Developed ETL framework using Sqoop, Pig, and Hive to regularly ingest data; built Spark-Scala jobs to migrate data from Oracle to MySQL; developed Spark Streaming apps; implemented deployment automation with YAML; created end-to-end Hadoop data pipelines with Zookeeper, Kafka, Cassandra; scheduled workflows with Oozie and managed Hadoop ecosystem components.

Azure Data Engineer at UnitedHealth Group

February 1, 2024 - February 1, 2024

Led ingestion and processing of healthcare data in Azure, moving data into Azure Data Lake, Azure Storage, Azure SQL, and Azure Synapse Analytics. Performed ETL using Azure Databricks and migrated on-prem Oracle ETL processes to Azure Synapse; migrated SQL databases to data lake storage; used PolyBase/PolyBase-like data transfer. Implemented data transfer using Synapse pipelines and Polybase; created partitions and buckets for efficient queries. Developed batch and streaming pipelines using Spark (Scala and Python) and Spark Streaming, incorporating Kafka and Azure Event Hubs for real-time data. Built Hive on Spark queries and data models to support analytics, along with Power BI dashboards for leadership. Deployed enterprise-level CI/CD pipelines using Jenkins, JIRA, and Git for data pipelines. Coordinated with Logic Apps for automation and process monitoring, ensuring data governance and security.

Python Data Engineer at Nike

April 1, 2023 - April 1, 2023

Developed a data platform from scratch, participating in requirements gathering and modeling. Designed Hive tables and used Sqoop to import/export data between MySQL and HDFS; processed large structured, semi-structured, and unstructured datasets. Built REST APIs using Python (Flask/Django) to expose data assets and integrated data sources via Java, JDBC, Shell scripting, and text/spreadsheet files. Implemented Spark/PySpark jobs for analytics, wrote Spark SQL queries, and created data pipelines moving data to Hive and data warehouses. Set up scheduling with crontab and Jenkins; built streaming pipelines using Spark Streaming and Kafka for near-real-time insights. Ingested JSON-based healthcare data from APIs for standardized analytics and delivered Power BI reports for business stakeholders.

Big Data Developer at Truist Financial

December 1, 2021 - December 1, 2021

Architected and implemented Hadoop-based data pipelines, migrating data from Oracle to Hadoop using Sqoop; loaded data into Hive and created HBASE tables integrated with Hive for analytics. Built streaming pipelines with Kafka and Spark Streaming, and developed Oozie workflows to schedule and manage batch jobs. Wrote HiveQL queries, created partitions and bucketing to optimize join performance, and implemented data encryption and governance practices. Implemented YAML-based CI/CD pipelines and automated deployments for data pipelines; performed extensive data modeling and ETL optimization. Worked with Jira for issue tracking and collaborated with the team to ensure timely delivery of data analytics workloads.

Hadoop Developer at Neon Software Services

November 1, 2019 - November 1, 2019

GIT version control; developed ETL framework with Sqoop, Pig, and Hive to bring in data from source systems; built Spark-Scala jobs for data migration from Oracle to MySQL; developed Spark Streaming applications for real-time analytics; executed Oozie workflows and managed data pipelines in Hadoop clusters. Used Zookeeper for coordination and collaborated with Jira for project tracking. Implemented automation for deployments with YAML scripts; worked with Hadoop ecosystem including Spark, Hive, HBase, Flume, and Sqoop; built dashboards using Python and Spark SQL for analytics.