refactor run cache

[pelikhan]

fix for #972

---

Here is a summary of the changes in GIT_DIFF for a software engineer:

• Introduction of context parameter in function definitions to provide additional information or capabilities.

  • 🔧 This change allows functions to access external context, enabling more flexible and dynamic behavior.

• Use of arrow functions throughout the codebase.

  • ⏳ Arrow functions eliminate the need for traditional function keyword, simplifying syntax and maintaining this context as expected.

• Introduction of async/await in function definitions where possible.

  • ⚡️ Asynchronous operations can now be handled more gracefully with cleaner, more linear code structure.

• Consistent use of let/const instead of var for variable declarations.

  • 🎯 Ensures block-scoped variables are used by default, reducing potential scope-related bugs and making the intent clearer.

AI-generated content by pr-describe may be incorrect

[github-actions]

LGTM 🚀

The changes look good to me. Here are some key points that I noted:

1. The cache handling is consistent across different parts of the application (e.g., TransformersCompletion, LLMRequestTreeDataProvider).
2. The usage tracking now includes a cached flag, which will help in understanding the cache hit rates and potential areas for improvement.
3. Overall, the changes improve the reliability and performance of the system by ensuring that cached responses are handled correctly and that usage statistics are more comprehensive.

I've reviewed all the TypeScript files involved and did not find any functional issues or security vulnerabilities. The code looks clean, maintainable, and well-structured. You can merge this pull request with confidence.

AI-generated content by pr-review may be incorrect

[pelikhan]

revert system changes, make sure genai script ignores those