Slow pulling from multiple worksheets

[vietle-bh]

Hi @adecler , @IsakNaslundBh 👋 does the adapter reopen the Excel file every time it pulls data from a worksheet?

I'm pulling data from 20 sheets in a 1-MB Excel file and it takes like 10 minutes!

CellValuesRequest request = new CellValuesRequest { Worksheet = sheetName };
IEnumerable<object> data = adapter.Pull(request);
List<TableRow> rows = data.Cast<TableRow>().ToList();

The code spent most of its time on the Pull. This appeared on every loop iteration:

I would appreciate any suggestion! 😃

[adecler]

@vietle-bh , yes it reopen the file every time. This is necessary to guarantee that the adapter is grabbing the latest content of the file (say, when you're pulling from a file that is currently open in Excel).

That being said, the problem is easily solved by adding a BatchRequest object. We already implemented the PushItem that enable batch processing for the Push, we just never got to do the same for the Pull.

[vietle-bh]

Thanks @adecler ! I'll check if I can add BatchRequest for the Pull 😃