Link: https://www.twine.net/signin
Designed and developed custom web scraping solutions and data extraction pipelines to collect, process, clean, and structure data from multiple websites and platforms.
Built automated scrapers and ETL workflows to extract large datasets, handle dynamic websites, transform unstructured information, and deliver structured data for analytics, research, and business applications.
Key Projects & Data Sources
Last.fm: Scraped music, artist, and platform data.
LinkedIn: Extracted publicly available professional and contact information.
SHEIN: Collected product, pricing, and catalog data.
StockX: Extracted sneaker listings, product details, and marketplace data.
RE/MAX: Collected real estate listings and property information.
Ubiquiti UniFi Dream Machine Pro: Extracted device and platform data.
Technical Work
Developed custom web scrapers for structured and dynamic websites.
Built ETL pipelines for data extraction, transformation, cleaning, and storage.
Automated data collection and processing workflows.
Handled pagination, data normalization, duplicate removal, and extraction reliability.
My Role: Software Engineer | Web Scraping & Data Engineering
Owned scraper development, extraction logic, ETL implementation, data processing, and delivery of structured datasets.
Technology: Python, Web Scraping, Web Automation, ETL Pipelines, Data Extraction, Data Cleaning, Data Transformation, API Integration, Data Processing.














