[BUG] Session reuse between download requests within the same thread

[hailiangzhang]

Is this issue already tracked somewhere, or is this a new report?

• I've reviewed existing issues and couldn't find a duplicate for this problem.

Current Behavior

There is recently a DSE issue reported by Earthdata Login (EDL) during data download requests involving large amount of granules through EarthAccess. One issue was traced to EarthAccess creating a new session for each download instead of reusing the existing session cookie, which is intended to reduce the number of requests to EDL by the DAAC data distribution endpoint (TEA).

Expected Behavior

The session cookie should be reused between download requests from the same thread.

Steps To Reproduce

By running the following scripts:

import earthaccess

# 1. Login
earthaccess.login(strategy="netrc")

# 2. Search
results = earthaccess.search_data(
    short_name='GLDAS_VIC10_M',
    bounding_box=(-180, -90, 180, 90),
    temporal=("2003-01", "2023-05"),  # ...and time period of interest.
    count=2
)

# 3. Access
files = earthaccess.download(results, "output", threads=1)

TEA was observed to make separate EDL requests for each download instead of reusing the session cookie as designated.

Environment

- OS: Mac 14.7.2 (23H311)
- Python: 3.11.3

Additional Context

No response

[hailiangzhang]

There is an open PR trying to address this issue:
#909

[betolink]

The PR was merged on Friday, if everything goes as planned we'll release 0.13.0 this week and we could tell the IBM people to try it and we'll close this issue if we see no spikes in EDL.