Work Experience
Education
Qualifications
Azure Data Engineer
Cloud Enterprise Business Solutions (CEBS) logo
Senior Data EngineerSenior Data Engineer
Cloud Enterprise Business Solutions (CEBS) · Full-timeCloud Enterprise Business Solutions (CEBS) · Full-time
Sep 2021 - Sep 2023 · 2 yrs 1 moSep 2021 - Sep 2023 · 2 yrs 1 mo
Islāmābād, PakistanIslāmābād, Pakistan
Implemented solutions with Microsoft Azure Databricks for big data analytics, processing, and streaming data processing to handle real-time data streams efficiently. This includes working with APIs from platforms like Facebook and Adform for managing Target Groups, showcasing my ability to integrate and leverage third-party data for advanced analytics and targeted marketing strategies.
Developed and implemented Delta Lake leveraging the Medallion Architecture, with integration into Unity Catalog for centralized data governance, ensuring stringent data security and compliance. Authored and optimized Databricks notebooks using PySpark for both batch and streaming data processing, facilitating advanced data management, processing, and analysis strategies.
Utilized Microsoft Azure Data Factory for data integration and workflows automation, specializing in copying data from multiple sources, particularly from On-Premises systems to Azure Data Lake Gen 2 and Azure TableStorage, to facilitate efficient data migration and integration.
Engineered and architected sophisticated CI/CD pipelines utilizing Azure DevOps to streamline and enhance the development lifecycle and deployment methodologies, specifically by formulating pipelines tailored for Azure Data Factory and Azure Databricks. Additionally, crafted advanced shell scripts to automate Azure workflows deployment via Azure REST API within these CI/CD pipelines, significantly boosting deployment task automation and operational efficiency.
Utilized Apache Drill for data exploration and SQL query execution on large-scale datasets for data analysis.…Cloud Enterprise Business Solutions (CEBS) logo
Senior Data EngineerSenior Data Engineer
Cloud Enterprise Business Solutions (CEBS) · Full-timeCloud Enterprise Business Solutions (CEBS) · Full-time
Sep 2021 - Sep 2023 · 2 yrs 1 moSep 2021 - Sep 2023 · 2 yrs 1 mo
Islāmābād, PakistanIslāmābād, Pakistan
Implemented solutions with Microsoft Azure Databricks for big data analytics, processing, and streaming data processing to handle real-time data streams efficiently. This includes working with APIs from platforms like Facebook and Adform for managing Target Groups, showcasing my ability to integrate and leverage third-party data for advanced analytics and targeted marketing strategies.
Developed and implemented Delta Lake leveraging the Medallion Architecture, with integration into Unity Catalog for centralized data governance, ensuring stringent data security and compliance. Authored and optimized Databricks notebooks using PySpark for both batch and streaming data processing, facilitating advanced data management, processing, and analysis strategies.
Utilized Microsoft Azure Data Factory for data integration and workflows automation, specializing in copying data from multiple sources, particularly from On-Premises systems to Azure Data Lake Gen 2 and Azure TableStorage, to facilitate efficient data migration and integration.
Engineered and architected sophisticated CI/CD pipelines utilizing Azure DevOps to streamline and enhance the development lifecycle and deployment methodologies, specifically by formulating pipelines tailored for Azure Data Factory and Azure Databricks. Additionally, crafted advanced shell scripts to automate Azure workflows deployment via Azure REST API within these CI/CD pipelines, significantly boosting deployment task automation and operational efficiency.
Utilized Apache Drill for data exploration and SQL query execution on large-scale datasets for data analysis.WW…
Hire a Cloud Developer
We have the best cloud developer experts on Twine. Hire a cloud developer in Rawalpindi today.