Looks like you have JavaScript disabled. For the full Twine experience, you will need to re-enable it.

Hi, I’m Amani M. I’m a Data Engineer with 4+ years of experience designing, building, and optimizing scalable cloud data platforms across Azure and GCP. I specialize in data ingestion, transformation, orchestration, and background execution frameworks using Azure Databricks, PySpark, Spark SQL, and Azure Data Factory. I’ve helped implement event-driven architectures, automation with Terraform, and analytics enablement using Power BI and Snowflake. I’m adept at working in Agile environments and delivering reliable, production-grade data solutions and enterprise reporting.…Hi, I’m Amani M. I’m a Data Engineer with 4+ years of experience designing, building, and optimizing scalable cloud data platforms across Azure and GCP. I specialize in data ingestion, transformation, orchestration, and background execution frameworks using Azure Databricks, PySpark, Spark SQL, and Azure Data Factory. I’ve helped implement event-driven architectures, automation with Terraform, and analytics enablement using Power BI and Snowflake. I’m adept at working in Agile environments and delivering reliable, production-grade data solutions and enterprise reporting.

Amani M

Data Scientist, Full Stack Developer, Back-End Developer, +2





Hi, I’m Amani M. I’m a Data Engineer with 4+ years of experience designing, building, and optimizing scalable cloud data platforms across Azure and GCP. I specialize in data ingestion, transformation, orchestration, and background execution frameworks using Azure Databricks, PySpark, Spark SQL, and Azure Data Factory. I’ve helped implement event-driven architectures, automation with Terraform, and analytics enablement using Power BI and Snowflake. I’m adept at working in Agile environments and delivering reliable, production-grade data solutions and enterprise reporting.…Hi, I’m Amani M. I’m a Data Engineer with 4+ years of experience designing, building, and optimizing scalable cloud data platforms across Azure and GCP. I specialize in data ingestion, transformation, orchestration, and background execution frameworks using Azure Databricks, PySpark, Spark SQL, and Azure Data Factory. I’ve helped implement event-driven architectures, automation with Terraform, and analytics enablement using Power BI and Snowflake. I’m adept at working in Agile environments and delivering reliable, production-grade data solutions and enterprise reporting.

Available to hire

Hi, I’m Amani M. I’m a Data Engineer with 4+ years of experience designing, building, and optimizing scalable cloud data platforms across Azure and GCP. I specialize in data ingestion, transformation, orchestration, and background execution frameworks using Azure Databricks, PySpark, Spark SQL, and Azure Data Factory.

I’ve helped implement event-driven architectures, automation with Terraform, and analytics enablement using Power BI and Snowflake. I’m adept at working in Agile environments and delivering reliable, production-grade data solutions and enterprise reporting.

Skills

Experience Level

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Expert

Intermediate

Intermediate

Intermediate

Intermediate

Intermediate

Work Experience

Data Engineer at AMEX

May 1, 2024 - Present

Developed and maintained Azure-based data pipelines supporting enterprise analytics across multiple datasets. Implemented data transformation logic using PySpark and Spark SQL to cleanse, standardize, and enrich data for downstream consumption. Supported incremental data processing strategies using watermarking and control tables to reduce reprocessing and improve efficiency. Built batch processing jobs using Python, PySpark, and SQL. Assisted in Spark performance tuning, applying partitioning, caching, and optimized file formats. Optimized ETL and storage strategies to reduce compute costs and improve processing times. Worked with Azure Data Lake Storage (ADLS Gen2) to organize data across raw, curated, and consumption layers. Implemented logging, retries, and basic alerting mechanisms to improve pipeline reliability. Implemented automated data validation and monitoring frameworks to ensure data quality. Contributed to event-driven ingestion components using Azure Function Apps integr

Data Engineer at Versabyte Datasystems

December 1, 2020 - December 1, 2022

Began career supporting cloud-based ETL development and data migration from MySQL and on-prem systems into Azure-based data platforms. Developed basic data ingestion pipelines using Azure Data Factory and performed batch transformations with SQL and PySpark. Implemented incremental data processing logic and supported Azure Databricks notebooks for transformation, validation, and exploratory analysis. Maintained Azure Data Lake Storage (ADLS Gen2) structures and organized datasets into raw and curated layers. Assisted with data quality validation, debugging ETL pipelines, and validating data post-ingestion into Snowflake. Documented pipelines and operational procedures; collaborated with cross-functional teams and participated in Agile ceremonies.