Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

Data Engineer with experience building and supporting scalable cloud-based data engineering solutions using Azure Data Factory, Azure Databricks, Microsoft Fabric, Azure Synapse Analytics, and Azure Data Lake Storage Gen2. Proficient in end-to-end ETL/ELT pipelines, automating data ingestion, transforming large datasets using Python, SQL, and PySpark, and delivering curated data for analytics and business reporting. Experienced in implementing Medallion Architecture, Delta Lake, Parquet, Slowly Changing Dimensions (SCD Type 1 & Type 2), incremental data loads, and data validation techniques to improve data quality and consistency. Hands-on with Microsoft Fabric Lakehouse and related components, along with strong skills in data modeling, performance optimization, pipeline monitoring, troubleshooting, and production support. Proficient with Git, Azure DevOps, CI/CD, Jira, Confluence, Power BI, and Agile delivery practices.…Data Engineer with experience building and supporting scalable cloud-based data engineering solutions using Azure Data Factory, Azure Databricks, Microsoft Fabric, Azure Synapse Analytics, and Azure Data Lake Storage Gen2. Proficient in end-to-end ETL/ELT pipelines, automating data ingestion, transforming large datasets using Python, SQL, and PySpark, and delivering curated data for analytics and business reporting. Experienced in implementing Medallion Architecture, Delta Lake, Parquet, Slowly Changing Dimensions (SCD Type 1 & Type 2), incremental data loads, and data validation techniques to improve data quality and consistency. Hands-on with Microsoft Fabric Lakehouse and related components, along with strong skills in data modeling, performance optimization, pipeline monitoring, troubleshooting, and production support. Proficient with Git, Azure DevOps, CI/CD, Jira, Confluence, Power BI, and Agile delivery practices.

DRUSYA S URESH

Data Engineer, Software Engineer, Database Developer, +2





Data Engineer with experience building and supporting scalable cloud-based data engineering solutions using Azure Data Factory, Azure Databricks, Microsoft Fabric, Azure Synapse Analytics, and Azure Data Lake Storage Gen2. Proficient in end-to-end ETL/ELT pipelines, automating data ingestion, transforming large datasets using Python, SQL, and PySpark, and delivering curated data for analytics and business reporting. Experienced in implementing Medallion Architecture, Delta Lake, Parquet, Slowly Changing Dimensions (SCD Type 1 & Type 2), incremental data loads, and data validation techniques to improve data quality and consistency. Hands-on with Microsoft Fabric Lakehouse and related components, along with strong skills in data modeling, performance optimization, pipeline monitoring, troubleshooting, and production support. Proficient with Git, Azure DevOps, CI/CD, Jira, Confluence, Power BI, and Agile delivery practices.…Data Engineer with experience building and supporting scalable cloud-based data engineering solutions using Azure Data Factory, Azure Databricks, Microsoft Fabric, Azure Synapse Analytics, and Azure Data Lake Storage Gen2. Proficient in end-to-end ETL/ELT pipelines, automating data ingestion, transforming large datasets using Python, SQL, and PySpark, and delivering curated data for analytics and business reporting. Experienced in implementing Medallion Architecture, Delta Lake, Parquet, Slowly Changing Dimensions (SCD Type 1 & Type 2), incremental data loads, and data validation techniques to improve data quality and consistency. Hands-on with Microsoft Fabric Lakehouse and related components, along with strong skills in data modeling, performance optimization, pipeline monitoring, troubleshooting, and production support. Proficient with Git, Azure DevOps, CI/CD, Jira, Confluence, Power BI, and Agile delivery practices.

Available to hire

Data Engineer with experience building and supporting scalable cloud-based data engineering solutions using Azure Data Factory, Azure Databricks, Microsoft Fabric, Azure Synapse Analytics, and Azure Data Lake Storage Gen2. Proficient in end-to-end ETL/ELT pipelines, automating data ingestion, transforming large datasets using Python, SQL, and PySpark, and delivering curated data for analytics and business reporting.

Experienced in implementing Medallion Architecture, Delta Lake, Parquet, Slowly Changing Dimensions (SCD Type 1 & Type 2), incremental data loads, and data validation techniques to improve data quality and consistency. Hands-on with Microsoft Fabric Lakehouse and related components, along with strong skills in data modeling, performance optimization, pipeline monitoring, troubleshooting, and production support. Proficient with Git, Azure DevOps, CI/CD, Jira, Confluence, Power BI, and Agile delivery practices.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Intermediate

Intermediate

Beginner

Work Experience

Azure Data Engineer at IT Pros LLC

October 1, 2022 - Present

Designed, developed, and maintained scalable ETL/ELT pipelines using Azure Data Factory (ADF) and Microsoft Fabric to integrate data from SQL Server, REST APIs, flat files, and cloud storage into Azure Data Lake Storage Gen2 (ADLS Gen2). Developed reusable PySpark notebooks in Azure Databricks for data transformation, cleansing, enrichment, schema validation, and business rule implementation. Built and maintained Medallion Architecture (Bronze, Silver, Gold) and implemented incremental loading, parameterization, partitioning, and optimized transformation logic to reduce processing time. Developed SQL queries, views, and stored procedures for source-to-target validation, reconciliation, record count checks, and troubleshooting. Worked with Delta Lake and Parquet formats for storage efficiency, ACID transactions, and performance. Supported data modeling for analytics-ready datasets for Azure Synapse Analytics, Microsoft Fabric Warehouse, and Snowflake. Performed data profiling, quality v