Investigate Newspaper's Article-states

[jecarr]

Newspaper has 3 internal states when it is processing a URL

• Not-started (default)
• Success
• Failure

In this line, we stop-&-error a report-URL from processing if Newspaper's ArticleDownloadState is not a success.

In a previous version, bulk URLs each threw an exception ArticleException('You must download() an article first!') (because we tried to do a.parse() where the article-state was the default of not-started). We fixed this in 75f71c2.

It would be good to:

• Test Thread with this change reverted
• Submit bulk URLs (submit CSV)
• See if we can replicate the exception
• Determine why the previous a.download() call before the if-statement on ArticleDownloadState would leave the article-object with its default state

The URLs that caused these errors are producing 404s; we cannot tell if they were 404s at the time of this error or at the time of me writing this Issue. A test could include URLs which knowingly will lead to 404s.