Search not finding any results

[Isak-Kallini]

Description

Search gives no results found when searching for stuff that should find something. It gets fixed after syncing from the debug page, but after a while (presumably after the daily sync?) it stops working again

Steps to reproduce

Try to search for something that should exist

Further information

No response

[danieladugyan]

@alfredgrip any immediate thoughts?

[alfredgrip]

Strange... but perhaps something to do with that the current timeout of 10 seconds is too short. I'll try to look in to it, but I suppose it's hard to debug

[alfredgrip]

#653 might close this, but I guess we need to deploy it to actually test it and see if it works

[Isak-Kallini]

Still not sure if this is fixed but I monitored the server while running the sync and found that it goes above the 200 MB memory limit while syncing. It still seems to be working though? I'm not really sure how the memory limit works

[alfredgrip]

This could very well be the case. When the syncing happens A LOT of data from our database (all members, news, events, songs, positions and committees currently) gets loaded and sent to meilisearch. I guess it could be refactored to partition the data and sync some at a time.

[alfredgrip]

#662 in combination with increasing memory usage in prod in 4ea4f7d seems to have fixed it. I monitored the memory usage during sync and it reached about 230MB (while the other instances were around 180MB), so the old limit of 200MB caused the instance to restart and thus aborting the sync halfway finished. I think this made it so that only some, say, member got synced to Meili, and that could be the reason why not all members showed up in search, i.e. the issue mentioned in #676

Still unsure how sync will be handled when 4 instances are running in parallel, but with non-unique IDs and higher memory usage I think it should be fine, but we should keep an eye on this.