Available to hire
Hi, I’m Akhil Reddy Palla. I’m a data engineer with over four years of experience delivering end-to-end Azure-based data solutions. I design and implement ETL pipelines, Data Lake and Data Warehouse architectures, and work to improve data availability and reliability across multiple clients.
I collaborate with business stakeholders and cross-functional teams to translate complex data needs into actionable pipelines, and I build metadata-driven workflows using PySpark and Python. I create dashboards in Power BI and Tableau to enable real-time insights, and I have hands-on experience with Databricks, Synapse, Fabric, and Unity Catalog to optimize processing and accelerate analytics adoption.
Skills
Language
English
Fluent
Work Experience
Data Engineer at Agnes Food
October 1, 2024 - November 21, 2025Collaborated with finance and operations stakeholders to gather requirements and design ETL pipelines and dashboards using ADF, Databricks, Python, and Power BI, improving reporting efficiency by 30%. Implemented scalable Databricks, Fabric, Synapse, and Unity Catalog pipelines processing millions of financial records daily, reducing ETL runtimes by 32% while maintaining accuracy. Leveraged PySpark to optimize memory usage, parallelism, and partitioning, cutting pipeline execution time by 35%. Used Python for test case automation, modeling, and workflow automation, reducing manual intervention by 50% and improving reliability. Built metadata-driven pipelines with Delta Lake, ADLS, Python, and Azure Purview for dynamic ingestion and faster onboarding of new datasets. Designed centralized Data Lake and Data Warehouse architectures with Delta Lake, delivering a single source of truth and 40% query performance gains. Created interactive Power BI dashboards for real-time KPI monitoring, imp
Data Engineer at OneWest Bank
December 1, 2023 - December 1, 2023Partnered with stakeholders to gather multi-cloud data requirements and translate them into robust ETL pipelines using ADF, Databricks, Synapse, Python, and Power BI, improving reporting efficiency by 35%. Led a project integrating Databricks, Synapse, Fabric, Unity Catalog, S3, and Redshift to handle large retail datasets, reducing ETL runtime by 33% and enhancing data reliability. Used PySpark to optimize processing of structured and unstructured data, improving memory usage and parallel processing for better performance. Implemented workflow automation and testing with Python, enabling consistent, high-quality analytics-ready data. Built metadata-driven pipelines with Delta Lake, ADLS, Python, and Azure Purview to streamline onboarding of new datasets. Designed centralized Data Lake and Data Warehouse architectures with Delta Lake, providing a single source of truth and reducing cross-functional reporting time by 28%. Created Power BI and Tableau dashboards for self-service analytic
Data Analyst at Sempra Energy
September 1, 2022 - September 1, 2022Collaborated with healthcare stakeholders to transform patient and clinical data into scalable ETL pipelines using ADF, Databricks, Python, and PySpark, improving data accuracy by 30%. Executed a Databricks, Synapse, SSIS, and Unity Catalog project to process large healthcare datasets efficiently, reducing ETL runtimes by 32% while maintaining data quality. Used PySpark for big data processing to optimize transformations, memory usage, and parallelism, improving ETL speed and reliability. Applied Python scripting for modeling, automation, and test cases, reducing manual effort by 50% and ensuring robust deployment across environments. Built metadata-driven pipelines with Delta Lake, ADLS, Python, and Azure Purview to support multi-source ingestion and schema evolution. Designed Data Lake and Data Warehouse architectures to centralize healthcare data, improving query performance and reporting accuracy by 35%. Created interactive Power BI dashboards integrating SAP BW and operational dat
BI Developer at Bristol-Myers (Mphasis Contract)
October 1, 2021 - October 1, 2021Engaged with finance and risk stakeholders to gather requirements and design ETL pipelines using SSIS, Alteryx, and SAP for improved reporting accuracy and 40% reduction in manual effort. Implemented a project integrating SSIS, SSAS, and Power BI to automate workflows for financial risk data, reducing ETL runtime by 30% while preserving data integrity. Leveraged PySpark and Alteryx for processing high-volume risk datasets, optimizing transformations and memory usage. Used Python for workflow automation, testing, and modeling to ensure consistent ETL execution and data quality. Built metadata-driven pipelines with Delta Lake and SAP BW to support dynamic schema updates and reusable ETL frameworks. Designed centralized Data Lake and Data Warehouse architectures, delivering a single source of truth and improving cross-functional reporting efficiency by 35%. Created Power BI and Tableau dashboards to monitor risk metrics, KPIs, and operational insights in real-time. Implemented IAM and RBA
Education
Master of Science in Project Management at BPP University
January 11, 2030 - January 1, 2025Bachelor of Science in Computer Science at Osmania University
January 11, 2030 - January 1, 2020Qualifications
Microsoft Certified: Azure Data Engineer Associate (DP-203)
January 11, 2030 - November 21, 2025Microsoft Certified: Power BI Data Analyst Associate (PL-300)
January 11, 2030 - November 21, 2025Industry Experience
Financial Services, Healthcare, Energy & Utilities, Software & Internet, Professional Services, Other
Skills
Hire a Data Scientist
We have the best data scientist experts on Twine. Hire a data scientist in Leicester today.