Skip to content
This repository has been archived by the owner on Mar 31, 2023. It is now read-only.

Happyculture/do-company-crawler

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 

Repository files navigation

INSTALLATION

You need to use Casper.js to crawl the pages. Installation steps: http://docs.casperjs.org/en/latest/installation.html

USAGE

To use the script just launch the script like that:

casperjs crawler-companies-parse.js

TODO

  • Send the companies data to a PHP for storage purpose
  • Automate the indexation every 2 weeks
  • Build a vizualisation page
  • Build monitoring to make sure that the crawling still works

About

Extract contribution stats from companies.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published