Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

memory consumption, performance, reliability #4

Open
kagahd opened this issue Sep 4, 2020 · 0 comments
Open

memory consumption, performance, reliability #4

kagahd opened this issue Sep 4, 2020 · 0 comments

Comments

@kagahd
Copy link

kagahd commented Sep 4, 2020

I don't know nodejs but is it true that you're loading the source collection first in an array to insert then each document one after another to the target collection? See:

const allData = await sourceCollection.find().toArray();

How about memory consumption for big collections? How about bulk inserts in batches? Is your tool able to keep the target collection in sync once cloned? If not, why not just using mongodump/mongorestore which also restores indexes automatically?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant