You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The current implementation of the ModelAPI class in Langtest lacks robust support for generating and validating JSON schema outputs. Enhancing this functionality is essential to ensure better compatibility with structured data workflows, improved validation, and seamless integration with other components that rely on JSON schemas.
Proposed Solution:
Add methods to generate JSON schemas from the model's output data structure.
Implement validation logic to ensure the model's outputs conform to the defined JSON schema.
Provide clear error reporting for mismatches between the model's outputs and the expected schema.
Include unit tests to validate the new functionality.
Update documentation to describe the usage of JSON schema support in ModelAPI.
Issue Description:
The current implementation of the
ModelAPI
class in Langtest lacks robust support for generating and validating JSON schema outputs. Enhancing this functionality is essential to ensure better compatibility with structured data workflows, improved validation, and seamless integration with other components that rely on JSON schemas.Proposed Solution:
ModelAPI
.Benefits:
Acceptance Criteria:
ModelAPI
supports generating JSON schemas for its outputs. #1167The text was updated successfully, but these errors were encountered: