I am a results-oriented Web Scraping Engineer with 6+ years of experience designing enterprise-grade data extraction infrastructures, specializing in reverse engineering and bypassing complex anti-bot countermeasures. I’ve delivered critical business intelligence for pharmaceutical and luxury retail sectors at Lobstr.io, turning raw, unstructured web data into high-accuracy datasets using Python, Celery, and cloud orchestration (AWS/GCP). I excel at building scalable scraping architectures, automating data validation pipelines, and orchestrating workflows with Celery and Airflow. I am open to remote work and relocation, and I thrive in cross-functional teams delivering reliable data solutions.

Andrew Odiit

I am a results-oriented Web Scraping Engineer with 6+ years of experience designing enterprise-grade data extraction infrastructures, specializing in reverse engineering and bypassing complex anti-bot countermeasures. I’ve delivered critical business intelligence for pharmaceutical and luxury retail sectors at Lobstr.io, turning raw, unstructured web data into high-accuracy datasets using Python, Celery, and cloud orchestration (AWS/GCP). I excel at building scalable scraping architectures, automating data validation pipelines, and orchestrating workflows with Celery and Airflow. I am open to remote work and relocation, and I thrive in cross-functional teams delivering reliable data solutions.

Available to hire

I am a results-oriented Web Scraping Engineer with 6+ years of experience designing enterprise-grade data extraction infrastructures, specializing in reverse engineering and bypassing complex anti-bot countermeasures. I’ve delivered critical business intelligence for pharmaceutical and luxury retail sectors at Lobstr.io, turning raw, unstructured web data into high-accuracy datasets using Python, Celery, and cloud orchestration (AWS/GCP).

I excel at building scalable scraping architectures, automating data validation pipelines, and orchestrating workflows with Celery and Airflow. I am open to remote work and relocation, and I thrive in cross-functional teams delivering reliable data solutions.

See more

Experience Level

Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Expert
Intermediate
Intermediate
See more

Language

English
Fluent

Work Experience

Web Scraping Engineer at Lobstr.io
March 1, 2020 - Present
Engineered resilient web crawlers for a Data-as-a-Service platform, handling thousands of daily requests with 99.9% uptime for international clients. Built and maintained 10+ crawlers for high-fidelity luxury retail product data, developed automated data validation and analytics dashboards, and orchestrated delivery to AWS S3 and Google Cloud Storage. Implemented sophisticated anti-bot middleware and managed rotating proxy pools to reduce ban rates by 40%. Led distributed task management with Celery.
Systems & Backend Engineer at Freelance / Various Remote
December 31, 2019 - December 31, 2019
Developed high-performance backend services using Rust and Go for low-latency data processing. Built custom ETL dashboards to monitor scraping health and proxy bandwidth. Integrated automated captcha solving services to handle reCAPTCHA and hCaptcha challenges seamlessly.

Education

B.Sc. at USIU-AFRICA
January 1, 2016 - January 1, 2020

Qualifications

Intermediate Go Developer
January 18, 2025 - January 18, 2025

Industry Experience

Software & Internet