Anusha

Azure Data Engineer at HireKeyz INC

Lead data engineering initiatives for IBRD project with HireKeyz INC, designing and implementing scalable ETL/ELT pipelines using Azure Data Lake Storage, Data Factory, and Databricks to process over 40 TB monthly of customer master, material master, and sales data from SAP ERP, CRM, Salesforce and other sources. I built Spark SQL aggregations, data cleansing, and transformations; handled ingestion across CSV, JSON, Parquet, and Avro; designed Delta Lake tables for versioning and time travel; deployed Airflow for workflow automation; migrated on-prem ETL from Informatica to cloud-based pipelines; integrated real-time streaming via Kafka and Azure Event Hubs; and established data governance dashboards for proactive observability.

Data Engineer at Pinnacle IT Infotech

Migrated on-premises SQL Server databases to Azure SQL Database using Azure Database Migration Service; refactored SSIS packages into ADF pipelines with complex data transformations; implemented Delta Lake for ACID-compliant storage and time travel; developed Spark-based streaming pipelines, and designed CI/CD pipelines with Terraform, GitHub Actions, Azure DevOps, and Jenkins to automate deployments across dev/test/prod.

Azure Data Engineer Associate at Merck

Implemented end-to-end ETL/ELT workflows using Azure Data Factory and Databricks; designed parallel processing, partitioning, and incremental loads to optimize performance; migrated legacy ETL from SSIS to cloud-native pipelines; implemented Snowflake/Star/Snowflake dimensional models; developed dashboards using Tableau/Power BI; leveraged Delta Lake for versioning and ACID transactions; built data governance dashboards and monitoring for data quality.

ETL Developer (Internship) at IBA Infotech PVT LTD

Developed robust data models and SSIS-based ETL workflows to integrate data from multiple sources; implemented data partitioning and incremental loading; scheduled jobs with SQL Server Agent; integrated Google Analytics to enrich web data; collaborated on data migration projects and performance tuning for ETL processes.

Azure Data Engineer Associate (Internship) at HireKeyz INC

Implemented end-to-end ETL projects with Azure Data Factory and Databricks; designed and orchestrated ETL workflows loading sources into ADLS and Azure SQL; utilized PySpark for scalable pipelines with Delta Lake; designed star and snowflake dimensional models; migrated legacy ETL from SSIS to cloud-native pipelines; created dashboards to monitor open orders, sales, and billing; leveraged Python for data manipulation and automation.

Data Engineer at Pinnacle IT Infotech

Migrated on-prem SQL Server databases to Azure SQL; refactored SSIS packages into ADF pipelines; developed pipelines, data flows, and complex transformations using ADF and PySpark in Azure Databricks; performed data cleansing in ADF with Joins, Filters, Aggregates; designed end-to-end data solutions; performed incremental loads with SCD Type 2; performance tuning via DMVs and indexing; implemented data storage and processing across storage, integration, and visualization layers; worked in Agile environment.