I’m a senior Python engineer with 6+ years of experience building scalable web scraping platforms, automation systems, and data-driven applications across recruitment, logistics, and retail. I focus on turning messy, multi-source data into reliable platform catalogs—normalizing pricing, SKUs, and product information—and ensuring the pipelines stay fresh and consistent even under high volume. I’ve worked hands-on with end-to-end ingestion and orchestration (Python ETL, Airflow-style schedulers, FastAPI/Flask/Django), and I’ve engineered distributed scraping infrastructure using tools like Selenium, Playwright, Scrapy, and Requests—handling dynamic rendering, authentication flows, rate limiting, retries, and anti-bot concerns. From designing real-time observability dashboards to setting up CI/CD with Docker and Kubernetes, I enjoy building systems that are both performant and maintainable.…

Joshua Dela Curz

Pro

I’m a senior Python engineer with 6+ years of experience building scalable web scraping platforms, automation systems, and data-driven applications across recruitment, logistics, and retail. I focus on turning messy, multi-source data into reliable platform catalogs—normalizing pricing, SKUs, and product information—and ensuring the pipelines stay fresh and consistent even under high volume. I’ve worked hands-on with end-to-end ingestion and orchestration (Python ETL, Airflow-style schedulers, FastAPI/Flask/Django), and I’ve engineered distributed scraping infrastructure using tools like Selenium, Playwright, Scrapy, and Requests—handling dynamic rendering, authentication flows, rate limiting, retries, and anti-bot concerns. From designing real-time observability dashboards to setting up CI/CD with Docker and Kubernetes, I enjoy building systems that are both performant and maintainable.…

Available to hire

I’m a senior Python engineer with 6+ years of experience building scalable web scraping platforms, automation systems, and data-driven applications across recruitment, logistics, and retail. I focus on turning messy, multi-source data into reliable platform catalogs—normalizing pricing, SKUs, and product information—and ensuring the pipelines stay fresh and consistent even under high volume.

I’ve worked hands-on with end-to-end ingestion and orchestration (Python ETL, Airflow-style schedulers, FastAPI/Flask/Django), and I’ve engineered distributed scraping infrastructure using tools like Selenium, Playwright, Scrapy, and Requests—handling dynamic rendering, authentication flows, rate limiting, retries, and anti-bot concerns. From designing real-time observability dashboards to setting up CI/CD with Docker and Kubernetes, I enjoy building systems that are both performant and maintainable.

See more

Skills

Experience Level

Python
Expert
ETL
Expert
Selenium
Expert
API
Expert
Docker
Expert
SQL
Expert
MongoDB
Expert
PostgreSQL
Expert
AWS
Expert
Java
Expert
Azure
Expert
Kubernetes
Expert
Redis
Intermediate
TensorFlow
Intermediate
Web Design
Intermediate
See more

Language

English
Fluent

Work Experience

Software Engineer at Kitchify
April 1, 2026 - Present
Built and maintained backend features for order guides, restaurant–vendor associations, and admin tooling using a PHP/MySQL/MongoDB stack. Designed and implemented EDI integrations with major food service distributors (e.g., Sysco, US Foods, PFG, GFS, Shamrock, Ben E. Keith), generating X12/CSV/TXT order files and delivering them via SFTP. Developed Python ETL pipelines and parsers to ingest vendor catalogs from email, spreadsheets, and scraped feeds, normalizing pricing, SKUs, and product data into the platform catalog. Extended inbound EDI workflows for order acknowledgments and invoices to improve order visibility and reduce manual reconciliation. Collaborated with operations and vendor IT teams for onboarding new distributors, provisioning account credentials, and validating production order submissions.
Senior Python & AI Data Engineer at Senpex
September 1, 2025 - Present
Designed and maintained a full-featured internal admin platform for sourcing and retail operations using Python, FastAPI, React, and REST APIs, supporting end-to-end logistics and wholesale workflows at scale.
Python & AI Data Platform Engineer at Bloomberg
March 1, 2024 - August 1, 2025
Built and maintained large-scale Python-based data ingestion systems capable of processing high volumes of structured and unstructured financial documents, reports, and market data, improving data availability and downstream analytics reliability for internal research teams.
Senior Python Developer
January 1, 2024 - April 1, 2026
Architected a large-scale web scraping platform covering 40+ job platforms using purpose-built scrapers with Selenium, Playwright, Scrapy, and Requests. Matched scraping logic to each site structure, handling dynamic rendering, authentication flows, and anti-bot measures across diverse site types. Engineered high-performance scraping pipelines with multithreading, adaptive rate limiting, and automated retry logic to continuously process large volumes of job listings while maintaining data freshness and minimizing source-side disruption. Built real-time scraper observability dashboards tracking job coverage rates, ingestion speed, deduplication accuracy, and scraper health indicators. Integrated an error tracking and alerting layer to capture failure patterns per source and reduce mean time to resolution. Streamlined scraper deployment and operations using GitHub Actions for CI/CD, Docker for containerization, and Dozzle for centralized real-time log streaming.
Software Engineer at Microsoft
June 1, 2022 - February 1, 2024
Developed distributed backend integrations using Java (Spring Boot) and Python, synchronizing data across Microsoft ecosystems (Azure AD, MS Graph) and enterprise platforms like HubSpot and n8n. Implemented CI/CD pipelines with GitHub Actions and deployed services to AWS (EC2, Amplify) with environment isolation and Slack deployment alerts. Built event-driven order processing pipelines using Google Pub/Sub and created AI-enabled internal tools using OpenAI APIs to automate documentation, classification, and metadata extraction. Collaborated with product managers and data teams to define integration requirements and roadmaps. Refactored legacy scripts to asynchronous Python architectures to improve throughput and stability, and built an embedding-based similarity engine to identify related documents and metadata across internal datasets.
Python Developer at Optimhire
October 1, 2021 - November 1, 2023
Designed and maintained a large-scale Job Application Tracking System (ATS) handling 35M job listings and automating data collection across 40+ job platforms. Built high-performance Python crawlers and automation bots using Playwright, Selenium, and Requests with multithreading, asynchronous execution, and proxy rotation for stable, high-throughput scraping. Developed web automation scripts for autofilling and submitting job applications, handling CAPTCHAs and Cloudflare/Akamai challenges via adaptive browser behavior and smarter retries. Implemented robust data pipelines and scheduling systems for continuous scraping, data refresh, and validation. Optimized MongoDB and PostgreSQL workflows to improve query efficiency and reduce duplication and latency. Integrated backend modules to generate enriched, standardized, and AI-optimized job descriptions, improving data quality and automation coverage.
Junior Software Developer at Gleent, Inc.
August 1, 2020 - August 1, 2021
Developed and maintained software applications by writing clean, efficient code, fixing bugs, and delivering feature enhancements across development and production environments. Assisted with automation workflows by creating scripts and API integrations to streamline data processing, improve system efficiency, and reduce manual operations. Supported cloud-based applications and infrastructure by monitoring services, troubleshooting technical issues, and collaborating with senior engineers to improve reliability. Worked with databases, backend services, and application servers to optimize performance, resolve production issues, and ensure stable application operations. Participated in Agile development processes including code reviews, testing, deployments, and debugging while following software development best practices and version control workflows.
Software Developer at Fourello
June 1, 2020 - April 1, 2022
Automated repetitive data cleaning and preprocessing workflows by building reusable Python data utilities, improving processing throughput and reducing manual operational effort. Prototyped and validated ML models using scikit-learn and TensorFlow to enhance data accuracy and support analytics features.

Education

Bachelor's degree in Computer Science at University of the East
January 1, 2017 - January 1, 2020
Bachelor's degree in Computer Science at University of the East
January 1, 2017 - January 1, 2020

Qualifications

Add your qualifications or awards here.

Industry Experience

Software & Internet, Computers & Electronics, Transportation & Logistics, Retail
    AI Audio Mixing & Mastering Platform – AudioMixingMastering

    Developed an AI-powered platform designed to automate and enhance audio mixing and mastering workflows, enabling high-quality audio production without the need for traditional manual engineering.

    Built backend systems to process and analyze audio inputs, applying intelligent algorithms to optimize sound balance, clarity, and overall quality. Designed automated pipelines that handle tasks such as level balancing, equalization, compression, and mastering, delivering consistent and production-ready outputs.

    Focused on creating a scalable and efficient architecture to support real-time or batch audio processing, ensuring reliability and performance across various audio use cases. Collaborated on integrating AI-driven models to replicate and improve standard audio engineering practices.

    AI-Powered Job Data Platform – Jobbyo.ai

    Contributed to the development of a large-scale job data platform, focusing on web scraping, automation, and backend data systems to power job aggregation and analytics.

    Designed and maintained automated scraping pipelines to collect job listings from multiple sources, ensuring consistent data flow and high coverage. Built systems for data cleaning, normalization, and deduplication, improving the accuracy and usability of job data across the platform.

    Developed backend processes to handle high-volume data ingestion and updates, enabling near real-time synchronization of job postings. Implemented automation workflows for monitoring scraper performance, handling failures, and maintaining data freshness.

    Collaborated with cross-functional teams to support downstream systems, including search, filtering, and data-driven features, by delivering structured and reliable datasets.

    AI-Powered Job Portal – OptimHire

    Developed and scaled the backend infrastructure for an AI-powered job platform, focusing on data acquisition, processing, and system reliability.

    Led the design and implementation of high-performance web scraping pipelines, aggregating millions of job listings from multiple global sources. Built robust systems for data normalization, deduplication, and enrichment, ensuring high-quality and structured job data.

    Architected and maintained scalable backend services using Python (FastAPI), handling real-time data ingestion and API delivery. Designed efficient database schemas and querying strategies (MongoDB/PostgreSQL) to support large-scale job datasets and fast search operations.

    Implemented automation workflows to continuously monitor, update, and validate job postings, improving data freshness and platform accuracy. Collaborated closely with frontend and AI teams to enable intelligent job matching and recommendation features.