Azure Data Engineer at Coral

Collaborated with stakeholders to gather data requirements, define KPIs, and build scalable data solutions using Azure Data Services, accelerating reporting turnaround time by 35% and strengthening cross-departmental alignment. Architected and executed greenfield projects using Databricks, Synapse, Microsoft Fabric, and Unity Catalog to enable real-time analytics and reduce data latency and operational delays by 40%. Leveraged PySpark to optimize large-scale ETL pipelines, cutting data processing times by 50% for CRM data from Dataverse and external APIs. Implemented automated ETL pipelines with Python and ADF to validate, test, and load data, improving data accuracy by 30%. Built metadata-driven ETL pipelines with Delta Lake, Purview, ADLS, and Python for scalable data movement across Databricks and ADF (50+ TB daily). Integrated Power BI dashboards with Delta tables to deliver near real-time CRM insights, reducing refresh and reporting delays by 45%. Established a Delta Lake-based la

Senior Data Engineer at IBM Private Ltd

Directed data requirements gathering with finance and supply chain stakeholders, guiding project planning and reducing scope creep by 20% across 6+ concurrent initiatives. Led Databricks-based implementation (PySpark, Unity Catalog, Synapse) to establish an enterprise-grade data lake with 99.9% uptime and enhanced reliability. Optimized SSIS-to-ADF transformations with PySpark in Databricks, reducing daily job runtimes by 55% to accelerate downstream reporting. Generated Python-based test scripts to validate data lineage and integrity, boosting automation coverage by 60%. Automated data cataloging with Azure Purview to ensure GDPR compliance and audit readiness. Consolidated Power BI with Delta Lake and SAP BO layers, delivering interactive executive dashboards with 3-second refresh times. Implemented a Delta Lake/ADLS-based data lake to standardize ingestion from SAP BW and Azure SQL, and delivered SSAS Tabular models for OLAP queries, improving analytics performance. Governed CI/CD p

Data Engineer at Infosys Ltd

Partnered with cross-functional teams to define data strategy and reporting requirements, boosting alignment and reducing change requests. Delivered production-ready pipelines using Databricks, Azure Synapse, Unity Catalog, PySpark, and Fabric, enabling scalable analytics across the enterprise. Processed millions of PySpark records daily, cutting data ingestion time from 2 hours to 30 minutes and achieving ~85% faster processing speeds. Created Python ETL modules and test frameworks to enable test-driven development, improving code reliability across multiple environments. Planned parameterized ETL frameworks for reuse across 6+ domains, shortening development time by 40%. Linked and published Power BI dashboards to Delta tables for real-time KPIs and optimized refresh efficiency by 50%. Transferred data from Cosmos DB to Azure SQL DB and then to S3/Redshift, reducing data redundancy and cloud storage costs by ~20% while maintaining 99.9% data availability. Implemented RBAC/IAM governa