Available to hire
Hi, I’m Shahid H. Shah, a data-centric software engineer and AI specialist with 32+ years in IT across Europe. I thrive on turning complex data into practical, scalable solutions using Python, PySpark, Databricks, and Azure ML, while leveraging DevOps practices and AI tooling to deliver measurable business value.
In my work, I’ve partnered with UBS, Novartis, and Uniper among others, building and migrating data platforms, automating critical processes, and exploring agentic AI and LLM-driven workflows. I enjoy collaborating in Agile teams, mentoring colleagues, and continuously learning new technologies to stay ahead of the curve.
Language
English
Fluent
German
Fluent
Work Experience
Data Scientist at Infosys Ltd
November 1, 2025 - November 1, 2025Developed and deployed AI/ML solutions using Azure ML, MLflow, AutoML, and MLOps; built regression, classification, and timeseries models; experimented with Generative AI using GPT-4o, GPT-3.5 Turbo, DALL-E-3, and Whisper; integrated LangChain/LangGraph; used text embeddings and vector stores; built FastAPI/Streamlit/Flask apps; conducted model fine-tuning and prompt engineering.
Senior Ansible, Python, Bash Automation Developer at Finastra Baden
June 1, 2025 - June 1, 2025Extensive Ansible automation; Oracle and PostgreSQL health checks and alert generation; backup and security automation; complete application auditing; installation/upgrade PostgreSQL in parallel; maintenance of Oracle and PostgreSQL (Patroni Cluster); archiving financial data; Gen AI/OpenAI PoC for customer support; automation using Ansible, Python, Bash, Ansible Tower, and GitLab.
Senior Data Engineer Python, PySpark, Databricks, and SQL at UBS Zurich
August 1, 2023 - August 1, 2023Python/PySpark/SQL development in DEV/QA/UAT, test management, and QA; platform Denodo and Databricks performance testing and automation; full automation of Cucumber testing in GitLab CI/CD; created pipelines and migrated Azure CI/CD pipelines to GitLab; Docker familiarity; Auto Loader; Unity Catalog, ABAC, Row-Level Filtering, and Column Masking; Delta Lake; RiskLab data sets; ETL/DLT; L3 support and UAT/Production readiness.
Senior Python and Shell Developer at UBS IB Zurich
February 1, 2022 - February 1, 2022Developing controls on data feeds; extensive Pandas/Numpy usage; PySpark in RiskLab (Domino); RWA Collateral project in Spark; Databricks ETL pipelines and DLT; data analysis and testing; Azure Databricks; partitioning, bucketing, AQE; L3/UAT/Production support; FastAPI/Streamlit applications; participation in POC and design discussions.
Principal Consultant and Architect at UNIPER Energy Trading
April 1, 2020 - April 1, 2020Architected Oracle/SQL Server database migration to Azure Public Cloud; migrated DWH 40-60 TB to Azure; built database framework on Azure from scratch (Linux/Windows); leveraged IaaS and PaaS; automated backups/recovery; archiving; mentored offshore/onsite teams.
Principal Consultant and Architect/Engineer at Novartis
June 1, 2017 - June 1, 2017Operational and project support for DWH databases; DG, RAC, and GRID Control usage; RMAN and SQL Server backup expertise; built database framework on private cloud; automation of backups/recovery; high availability and disaster recovery planning; 3rd level production support; development and automation.
Data Scientist and Data Engineer
November 30, 2025 - November 30, 2025Data science and data engineering work focusing on Azure Databricks, Unity Catalog, GDPR, ABAC, row-level filtering, and column masking; implementing Autoloader, ETL pipelines, and DLT; extensive ML and Generative AI exploration using LLMs (GPT-4o, GPT-3.5 Turbo, DALL-E-3, Whisper, LLama) and LangChain/LangGraph; developing with FastAPI and Streamlit, vector stores, and model fine-tuning; MLOps and designer workflows.
Senior Ansible, Python, Bash Automation Developer at Finastra Baden (Switzerland)
June 30, 2025 - June 30, 2025Automation of Oracle and PostgreSQL health checks, alerts, backups, security automation, and audits using Ansible. Led patching and upgrades of PostgreSQL (Patroni) across multiple servers, plus automation of app installations and upgrades. Implemented archiving automation, GitLab CI/CD pipelines, and introduced Generative AI/LLM PoCs for customer support.
Senior Data Engineer Python, PySpark, Databricks, and SQL at UBS Zurich (Switzerland)
August 31, 2023 - August 31, 2023Python/PySpark/Databricks development, DEV/QA/UAT testing, and test management. Led Denodo and Databricks performance testing and automation, automated cucumber tests in GitLab CI/CD, built pipelines, migrated Azure CI/CD to GitLab, and implemented Unity Catalog with access management and ABAC.
Senior Python and Shell Developer at UBS IB Zurich (Switzerland)
February 28, 2022 - February 28, 2022Developed data controls, extensive PySpark usage within RiskLab (Domino), Databricks ETL/DLT pipelines, and unit testing automation. Delivered L3/UAT/production support, built REST/API interactions, and used FastAPI/Streamlit for web interfaces.
Principal Consultant and Architect at UNIPER Energy Trading Dusseldorf (Germany)
April 30, 2020 - April 30, 2020Designed and architected Oracle/SQL Server migrations to Azure, DWH migration (40–60 TB), built database framework on Azure from scratch, automated backups/recovery, and managed offshore/onsite teams. Led PySpark usage for data analysis and automation scripting.
Principal Consultant and Architect/Engineer at Novartis Basel (Switzerland)
June 30, 2017 - June 30, 2017DWH/database architecture and engineering for Oracle/SQL Server; DG, RAC, GRID control; RMAN and SQL Server backups; automated backups/recovery; high availability and DR; L3 support; mentoring and offshore/on-site leadership.
Senior Data Engineer (Python, PySpark, Databricks) at UBS Zurich
August 31, 2023 - August 31, 2023Led Python, PySpark, and Databricks development within UBS RiskLab/Databricks environment. Implemented Unity Catalog with ABAC, Row Level Filtering, and Column Masking; designed and optimized ETL pipelines using Auto Loader, DLT, and Spark SQL; managed Delta Lake workflows. Built and automated CI/CD pipelines in GitLab, migrated Azure pipelines to GitLab, and automated testing with Behave across environments. Configured Docker and AKS-based deployments; automated infrastructure with Terraform; supported Denodo virtual data layer integrations.
Senior Python and Shell Developer at UBS IB Zurich
February 28, 2022 - February 28, 2022Developed controls on data feeds using Python, Shell, and PySpark within RiskLab/Domino. Automated unit testing in GitLab CI/CD, performed platform performance testing for Denodo and Databricks, and led UAT/production support. Built REST APIs (FastAPI) and web apps (Streamlit) for data validation and analysis; implemented advanced partitioning, bucketing, and AQE techniques; managed Unity Catalog access and ABAC with Row Level Filtering and Column Masking.
Principal Consultant and Architect at UNIPER Energy Trading
April 30, 2020 - April 30, 2020Designed and led Oracle/SQL Server database migrations to Azure Public Cloud and DWH modernization (40–60 TB). Built a complete database framework on Azure (Linux/Windows) leveraging IaaS and PaaS, automating backups and recovery, and implementing HA/DR. Led large teams offshore/onshore, mentored engineers, and applied PySpark for large-scale data analysis and automation.
Principal Consultant and Architect/Engineer at Novartis Basel
June 30, 2017 - June 30, 2017Oracle/SQL Server database architecture and engineering: DG, RAC, GRID Control, Golden Gate replication; RMAN and SQL Server backup technologies; built end-to-end database framework on private cloud (VBlock); automated backups/recovery; designed HA/DR solutions and produced a critical database reporting tool; provided 3rd line production support.
Data Scientist and Data Engineer
November 1, 2025 - November 1, 2025Lead Data Scientist and Data Engineer focusing on Azure Databricks, Unity Catalog, ABAC, row-level filtering, column masking, ETL pipelines, and Generative AI experiments. Worked with LangChain, LangGraph, and various LLMs, building vector stores and AI-powered search solutions. Implemented Auto Loader based ETL pipelines, Delta Lake, and medallion architecture while collaborating in Agile sprints.
Senior Ansible, Python, Bash Automation Developer at Finastra Baden (Switzerland)
August 1, 2023 - August 1, 2023Led extensive Ansible automation for Oracle and PostgreSQL health checks, backups, audits, and patching. Implemented automation for archiving financial data, integrated with Zabbix, and delivered automated application installations and upgrades across multiple servers. Explored Gen AI/LLM PoCs for customer support.
Senior Data Engineer Python, PySpark, Databricks, and SQL at UBS Zurich (Switzerland)
August 1, 2023 - August 1, 2023Served as Python/PySpark/Databricks developer and DevOps contributor. Built robust testing pipelines with Cucumber (Behave) and GitLab CI/CD, automated infrastructure via Terraform, and managed Unity Catalog with ABAC and RLS for data access. Implemented ETL pipelines, Auto Loader, DLT, Delta Lake, and performed performance tuning in Spark.
Senior Python and Shell Developer at UBS IB Zurich (Switzerland) - DCF (Digital Control Framework)
February 1, 2022 - February 1, 2022Developed various data controls on feeds, performed unit testing, automation of risk calculations, and integration with risk analysis workflows using PySpark within RiskLab on Databricks. Led UAT and production support, built FastAPI/Streamlit interfaces, and contributed to POC discussions on generative AI solutions.
Principal Consultant and Architect at UNIPER Energy Trading Dusseldorf (Germany)
April 1, 2020 - April 1, 2020Designed and steered Oracle and SQL Server database migrations to Azure Public Cloud, including DWH migration from private cloud, automation of backups and archiving, and set-up of database frameworks on Linux/Windows with DR/HA strategies; mentored offshore teams and delivered end-to-end automation.
Principal Consultant and Architect/Engineer at Novartis Basel (Switzerland)
June 1, 2017 - June 1, 2017Operational and project support for DWH databases; DG, RAC, GRID Control; Golden Gate replication; RMAN and SQL Server backups; built a complete database framework on private cloud; automation of backups and disaster recovery; led 3rd level production support.
Education
BE Electrical and Electronics Engineering at Eastern Mediterranean University, Cyprus
January 1, 1986 - January 1, 1990BE (Electrical and Electronics Engineering) at Eastern Mediterranean University
January 1, 1986 - January 1, 1990Electrical and Electronics Engineering (BE) at Eastern Mediterranean University
January 1, 1986 - January 1, 1990BE at Eastern Mediterranean University
January 1, 1986 - January 1, 1990Qualifications
PCEP - Python Certified Entry-Level Programmer
January 11, 2030 - October 29, 2025PCAP - Python Certified Associate Programmer
January 11, 2030 - October 29, 2025Scrum Master Certified
January 11, 2030 - October 29, 2025Databricks Apache Spark 3.0 Developer Certified
January 11, 2030 - October 29, 2025AZ-900 Azure Fundamentals Certified
January 11, 2030 - October 29, 2025AI-900 Azure AI Fundamentals Certified
January 11, 2030 - October 29, 2025DP-100 Azure Data Scientist Associate Certified
January 11, 2030 - October 29, 2025ITIL Certified
January 11, 2030 - October 29, 2025Shell scripting Certified
January 11, 2030 - October 29, 2025PCEP
January 11, 2030 - November 12, 2025PCAP
January 11, 2030 - November 12, 2025Scrum Master Certified
January 11, 2030 - November 12, 2025Databricks Apache Spark 3.0 Developer Certified
January 11, 2030 - November 12, 2025AZ-900 Azure Fundamentals Certified
January 11, 2030 - November 12, 2025AI-900 Azure AI Fundamentals Certified
January 11, 2030 - November 12, 2025DP-100 Azure Data Scientist Associate Certified
January 11, 2030 - November 12, 2025Shell (Unix/Linux) scripting certified
January 11, 2030 - November 12, 2025Terraform (IaC)
January 11, 2030 - November 12, 2025ITIL Certified
January 11, 2030 - November 12, 2025Python Certified Programmer (PCEP)
January 11, 2030 - November 12, 2025Python Certified Programmer (PCAP)
January 11, 2030 - November 12, 2025Scrum Master Certified
January 11, 2030 - November 12, 2025Databricks Apache Spark 3.0 Developer Certified
January 11, 2030 - November 12, 2025AZ-900 Azure Fundamentals Certified
January 11, 2030 - November 12, 2025AI-900 Azure AI Fundamentals Certified
January 11, 2030 - November 12, 2025DP-100 Azure Data Scientist Associate Certified
January 11, 2030 - November 12, 2025Shell (Unix/Linux) scripting certified
January 11, 2030 - November 12, 2025ITIL Certified
January 11, 2030 - November 12, 2025Terraform (IaC)
January 11, 2030 - November 12, 2025PCEP (Python Certified Programmer)
January 11, 2030 - November 12, 2025PCAP (Python Certified Associate)
January 11, 2030 - November 12, 2025Scrum Master Certified
January 11, 2030 - November 12, 2025Databricks Apache Spark 3.0 Developer Certified
January 11, 2030 - November 12, 2025AZ-900 Azure Fundamentals Certified
January 11, 2030 - November 12, 2025AI-900 Azure AI Fundamentals Certified
January 11, 2030 - November 12, 2025DP-100 Azure Data Scientist Associate Certified
January 11, 2030 - November 12, 2025Shell scripting certified
January 11, 2030 - November 12, 2025ITIL Certified
January 11, 2030 - November 12, 2025Industry Experience
Financial Services, Software & Internet, Professional Services, Computers & Electronics, Other, Energy & Utilities, Healthcare
Hire a Data Scientist
We have the best data scientist experts on Twine. Hire a data scientist in Zurich today.