RP

Ravi Patel

Available to hire

Hi, I’m Ravi Patel. I am a data engineer and web scraper with a strong track record of building scalable scraping pipelines and managing thousands of crawlers.

About

Hi, I’m Ravi Patel. I am a data engineer and web scraper with a strong track record of building scalable scraping pipelines and managing thousands of crawlers. I enjoy turning messy web data into reliable, structured information and solving bot-detection challenges at scale.

I work with Python, Scrapy, Selenium, Playwright, Airflow, and cloud platforms to automate data extraction from dynamic sites and mobile sources. I also leverage AI-assisted parsing to adapt to changing layouts and protect data quality.

  • 4 years' experience
  • Joined April 2026

Industry experience

  • Software & Internet
  • Professional Services

Work experience

Software Engineer · Perfios Pvt LtdSep 2022 – Sep 2025 · 3 yrs 1 mo

Architected and maintained a custom scraping framework built on Python requests and curl_cffi; improved customization and reliability across protected and high-traffic websites. Orchestrated large-scale crawling operations using Apache Airflow with retries, dependency management, and parallel execution. Integrated CAPTCHA handling solutions (OCR-based approaches and 2Captcha). Implemented proxy rotation, session persistence, and request behavior tuning to boost crawl success rates. Built a monitoring and alerting system to track crawler health and data quality; designed rapid-fix workflows to adapt scrapers to layout or backend changes. Stored and managed data efficiently in cloud storage and SQL/NoSQL databases.

Python Developer · Xbyte TechnolabsJun 2021 – Aug 2022 · 1 yr 3 mos

Designed, developed, and maintained Scrapy-based crawlers and headless browser solutions (Selenium, Playwright) to handle JavaScript-rendered content and collect structured data from hundreds of websites. Built scalable scraping pipelines capable of handling thousands of data sources. Implemented scraping strategies for dynamic SPAs and heavily scripted sites with DOM interaction and asynchronous content handling. Cleaned, validated, and normalized raw web data before storage; wrote scripts and queries to insert, update, and validate collected data. Automated mobile apps data extraction using Appium; identified mobile API endpoints by analyzing network traffic with tools such as Fiddler and Burp Suite.

Education

SSC · I.D.Patel high school2030 – 2026
Diploma Engineering (IT) · R.C.Technical Institute2030 – 2026
Bachelor Of Engineering (IT) · KIRC2030 – 2026

Hire Ravi Patel today

Post a job and invite Ravi, or contact them directly. No hidden commission.

Post a job