Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Javascript sites aren't indexed #18

Open
bmann opened this issue Jul 22, 2024 · 2 comments
Open

Javascript sites aren't indexed #18

bmann opened this issue Jul 22, 2024 · 2 comments

Comments

@bmann
Copy link
Contributor

bmann commented Jul 22, 2024

@graham-fleming added his site https://grahamfleming.com

It is included in the pre-crawl, but then doesn't appear to be in the search index.

@bmann
Copy link
Contributor Author

bmann commented Jul 22, 2024

I tried running everything locally and it also doesn't index locally

I messaged the lieu author to see if he has any tips https://toolsforthought.social/@boris/112832083740822099

@bmann bmann changed the title Trouble with indexing Graham's site Javascript sites aren't indexed Aug 6, 2024
@bmann
Copy link
Contributor Author

bmann commented Aug 6, 2024

https://merveilles.town/@cblgh/112832523291344860

look at the output from ’lieu crawl’, grepping it for the domains you think are missing. likely that they are js-generated, lieu doesn’t have a web browser embedded (like selenium does) and so can’t evaluate js statments atm

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant