I'm Rizwan Mohammed, a Senior Data Engineer with 8+ years of experience designing robust data platforms, metadata management, and governance. I specialize in Alation, Databricks, Spark, Python, SQL, Azure, and Starburst, and have a track record of building scalable ETL/ELT pipelines, data catalogs, and governance frameworks that enable trusted analytics. I thrive on turning complex data ecosystems into clean, reliable data assets that empower business decision-making. I excel in cloud environments (Azure, AWS) and in integrating metadata from SQL Server, Oracle, Azure Cloud, and Snowflake. I have hands-on experience with Starburst for data federation, and I collaborate with cross-functional teams to optimize data solutions, enable data-driven decision-making, and support BI tools like Power BI, Tableau, and Alteryx. I enjoy mentoring, automation with Python, Airflow, and DBT, and driving data quality and lineage across complex ecosystems.

Rizwan Mohammed

I'm Rizwan Mohammed, a Senior Data Engineer with 8+ years of experience designing robust data platforms, metadata management, and governance. I specialize in Alation, Databricks, Spark, Python, SQL, Azure, and Starburst, and have a track record of building scalable ETL/ELT pipelines, data catalogs, and governance frameworks that enable trusted analytics. I thrive on turning complex data ecosystems into clean, reliable data assets that empower business decision-making. I excel in cloud environments (Azure, AWS) and in integrating metadata from SQL Server, Oracle, Azure Cloud, and Snowflake. I have hands-on experience with Starburst for data federation, and I collaborate with cross-functional teams to optimize data solutions, enable data-driven decision-making, and support BI tools like Power BI, Tableau, and Alteryx. I enjoy mentoring, automation with Python, Airflow, and DBT, and driving data quality and lineage across complex ecosystems.

Available to hire

I’m Rizwan Mohammed, a Senior Data Engineer with 8+ years of experience designing robust data platforms, metadata management, and governance. I specialize in Alation, Databricks, Spark, Python, SQL, Azure, and Starburst, and have a track record of building scalable ETL/ELT pipelines, data catalogs, and governance frameworks that enable trusted analytics. I thrive on turning complex data ecosystems into clean, reliable data assets that empower business decision-making.

I excel in cloud environments (Azure, AWS) and in integrating metadata from SQL Server, Oracle, Azure Cloud, and Snowflake. I have hands-on experience with Starburst for data federation, and I collaborate with cross-functional teams to optimize data solutions, enable data-driven decision-making, and support BI tools like Power BI, Tableau, and Alteryx. I enjoy mentoring, automation with Python, Airflow, and DBT, and driving data quality and lineage across complex ecosystems.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
Intermediate
See more

Language

English
Fluent
Hindi
Fluent

Work Experience

Senior Data Engineer at American International Group (AIG)
January 1, 2022 - November 1, 2025
Configured and maintained Alation Data Catalog, ensuring metadata governance and compliance. Developed and optimized data ingestion pipelines using Azure Data Factory, Databricks, and Snowflake, and led metadata onboarding from SQL Server, Oracle, Azure, and Snowflake. Built and maintained PySpark jobs for real-time and batch transformations; developed Python automation scripts for metadata validation, ETL triggering, and API integration with data catalog. Designed scalable data pipelines on Azure using Databricks, ADF, and ADLS. Mentored junior engineers, implemented Azure-based data lake architecture with fine-grained access. Led Starburst data federation efforts, integrated Databricks/Snowflake with Tableau and Alteryx, and created modular notebooks to streamline processing. Automated ETL/ELT workflows with Airflow and DBT, and implemented data lineage and governance improvements.
Senior Data Engineer at GE Oil & Gas
December 31, 2021 - December 31, 2021
Led Alation implementation and configuration for enterprise metadata management. Designed custom Alation workflows for metadata validation and governance. Developed data security policies within Alation and Azure Data Lake; automated recurring data workflows and migrated on-premises/vendor sources to Azure. Built PySpark and SQL workflows in Azure Databricks; automated infrastructure with Terraform. Created Elasticsearch indexes for low-latency search; collaborated with BI teams to optimize data models for Tableau; supported Alteryx workflows and integrated Kafka with Snowflake for real-time data flow. Mentored engineers on Databricks best practices and data governance.
Data Engineer at Philips Inc.
May 31, 2020 - May 31, 2020
Designed and implemented Hadoop-based ETL pipelines for multi-terabyte datasets. Developed PySpark-based transformations and managed Hive, Spark, and MapReduce configurations for high-performance processing. Built CI/CD pipelines with GitHub and Jenkins for automated deployment of ETL code. Integrated Azure Key Vault for secrets management and utilized Azure Monitor/Log Analytics for performance and cost tracking. Collaborated on cloud-first data strategies across AWS/Azure and supported Palantir Foundry projects and BI tooling for analytics dashboards.
Data Engineer at AgFirst
December 31, 2018 - December 31, 2018
Designed and built ETL pipelines for structured and unstructured data ingestion. Created and optimized SQL queries for AWS Redshift; defined data governance frameworks leveraging Collibra and Alation. Developed data validation scripts and Python automation for metadata tagging and transformation. Integrated data lineage tooling with Alation, supported API integrations, and assisted in migrating legacy pipelines to AWS. Conducted knowledge-sharing sessions to promote governance best practices.

Education

Master of Science - Computer Information Systems at Trine University, Indiana
January 11, 2030 - January 1, 2016

Qualifications

Databricks Certified Data Engineer Professional
January 1, 2025 - November 1, 2025
Databricks Certified Machine Learning Professional
January 1, 2025 - November 1, 2025
Databricks Certified Data Engineer Associate
January 1, 2025 - November 1, 2025
Databricks Fundamentals Accreditation
January 1, 2025 - November 1, 2025
Oracle Cloud Infrastructure 2021 Certified Architect Associate
January 1, 2021 - November 1, 2025
Oracle Cloud Infrastructure Foundations 2021 Certified Associate
January 1, 2021 - November 1, 2025

Industry Experience

Financial Services, Professional Services, Software & Internet