Abdul Rafe y3 8

Senior Data Engineer at Maid en C en tu ry

Built an AI-powered reporting system using Cloud APIs to ingest data daily from 100+ heterogeneous sources (databases, APIs, and protected Keycloak-authenticated routes). Automated aggregation and context preparation for AI-driven analysis, enabling users to generate dynamic section-based reports based on selected business dimensions. Re-architected legacy Python ETL pipelines into a Snowflake-native ELT architecture, migrating transformation logic to Snowflake SQL and reducing end-to-end processing time from 1.5 hours to ~10 minutes via query optimization, micro-partition pruning, and right-sizing for cost-effective scaling. Integrated Cloud Code into engineering workflows to accelerate Snowflake procedure development and improve SQL authorization efficiency. Leveraged AI-assisted development workflows to optimize pipeline refactoring and query performance, improving development velocity by ~30–40%. Optimized Apache Airflow orchestration by redesigning DAG dependencies for parallel

Senior Data Platform Engineer at ed x/2

Led migration of legacy data analytics pipelines from R to Python, leveraging Amazon ECS for containerized deployment and Apache Airflow for orchestration and scheduling into Snowflake, reducing runtime from 41 hours to 2.5 hours to enable faster data delivery. Developed and deployed ETL pipelines using Python scripts for efficient data analytics workflows, leveraging ArgoCD and Kubernetes for continuous integration and delivery, enhancing data processing efficiency in the Snowflake environment. Upgraded dbt (data build tool) version to ensure compatibility with existing pipelines and resolve potential issues. Extended dbt models to create comprehensive data transformations for seamless integration with downstream analytics tools. Migrated data from Salesforce Marketing Cloud and Braze to the data warehouse using Fivetran and Stitch, ensuring reliable data integration via managed connectors. Developed and maintained Terraform scripts to provision and manage Snowflake infrastructure, cr

Senior Engineer at Mc in ey T X, T X

Led a small development team for a couple of full stack projects using Python, JavaScript, SQL, Django, React, and AWS. Developed custom middleware that automatically changes user agents and IPs for every request sent, resulting in in-save performance gains by reducing time spent on proxies used to bypass blocking. Created a Chrome extension from scratch to streamline processes and save approximately 60% of time. Implemented automated testing using Selenium and Cypress, reducing manual testing costs. Conducted interviews and provided mentorship and training to new team members and remote candidates.

Senior Engineer at Arb isoft L td Softwa re Engineer

Orchestrated the extraction of data from thousands of e-commerce websites using frameworks and libraries such as Scrapy, BeautifulSoup, Requests, and Selenium, demonstrating expertise in web scraping and data acquisition.

Involved in creating a custom in-house solution for recruitment that saved the company thousands of dollars previously spent on ready-made solutions. Interviewed, mentored, and trained new joiners and remote candidates.