Internship Scraper 🚀

A Go-based web scraper that aggregates internship opportunities from multiple job platforms.

Features:

• Multi-platform Support: Scrape from Wellfound, Glassdoor, and LinkedIn
• Concurrent Scraping: Async processing with rate limiting
• Output Formats: JSON & CSV support
• Customizable: Easy to add new platforms
• Anti-blocking Measures: User agent rotation & request throttling

Supported Platforms:

• Wellfound
• Glassdoor
• LinkedIn

Preview:

Installation

Prerequisites

• Go 1.22+
• Git

git clone https://github.com/AdityaKrSingh26/Scrappy.git
cd Scrappy
go mod tidy