Caching seems to be enabled by default (?)

[George3d6]

As far as I can see the sdk doesn't indicate that cache control tags are inserted anywhere by default.

However, I've observed that using a very long prompt and then asking for a specific output at the end, the shape of that output slightly, a response with the old output keys is returned.

Might there be a bug in the sdk where caching tags are added by default ?

[RobertCraigie]

Thanks for the report @George3d6, I think it's incredibly unlikely that this is an SDK bug.

Can you reproduce this when making requests to the API without the SDK?