program to scrape trip advisor and oyester website
python3 main.py
A csv file containing two columns source and target
#output
The files in the output will go into their corresponding folders which are the column names
So like if the csv file is as follows:
Source,Target https://www.tripadvisor.ca/Hotel_Review-g1480252-d316623-Reviews-Kuredu_Island_Resort_Spa-Kuredu.html , https://www.oyster.com/maldives/hotels/kuredu-island-resort-and-spa/ https://www.oyster.com/maldives/hotels/kuredu-island-resort-and-spa/ , https://www.oyster.com/maldives/hotels/kuredu-island-resort-and-spa/
then there will be folders created for each file and the name of the folder would be starting from 0,1,2 as in the row numbers.
The sample output file is also included in the repo for demo: