tgju website crawler and visualizer

This project basically crawls data from tgju website by using selenium and visualizes the results with plotly.

How to run

1. Change config.py file to your local information
2. Download and setup chromedriver
3. Install postgresql on your local machine.
4. Activate virtual environment and run

pip install -r requirements.txt

5. Create a database in postgresql by running these commands in terminal(or your can just use pgadmin)

CREATE DATABASE YOURDBNAME;
CREATEUSER YOURUSERNAME;
ALTER USER YOURUSERNAME WITH ENCRYPTED PASSWORD 'YOURPASSWORD';
GRANT ALL PRIVILAGES ON DATABASE YOURDBNAME TO YOURUSERNAME;

Do steps below by the following order:

python crawler.py

Wait for it so that it crawls all data, then

python plot.py

NOTE: If there is any problem while executing(early stop, etc) check your internet connection and repeat above steps again.

Demo

Daily Close Price

Candlesticks