Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enhance the ModelAPI Class to Support JSON Schema Outputs #1165

Open
1 of 4 tasks
chakravarthik27 opened this issue Jan 16, 2025 · 0 comments
Open
1 of 4 tasks

Enhance the ModelAPI Class to Support JSON Schema Outputs #1165

chakravarthik27 opened this issue Jan 16, 2025 · 0 comments
Assignees
Labels
⭐ Feature Indicates new feature requests

Comments

@chakravarthik27
Copy link
Collaborator

chakravarthik27 commented Jan 16, 2025

Issue Description:

The current implementation of the ModelAPI class in Langtest lacks robust support for generating and validating JSON schema outputs. Enhancing this functionality is essential to ensure better compatibility with structured data workflows, improved validation, and seamless integration with other components that rely on JSON schemas.

Proposed Solution:

  1. Add methods to generate JSON schemas from the model's output data structure.
  2. Implement validation logic to ensure the model's outputs conform to the defined JSON schema.
  3. Provide clear error reporting for mismatches between the model's outputs and the expected schema.
  4. Include unit tests to validate the new functionality.
  5. Update documentation to describe the usage of JSON schema support in ModelAPI.

Benefits:

  • Improved data integrity and compatibility.
  • Enhanced reliability for structured data tasks.
  • Easier debugging and validation of model outputs.

Acceptance Criteria:

@chakravarthik27 chakravarthik27 added the ⭐ Feature Indicates new feature requests label Jan 16, 2025
@chakravarthik27 chakravarthik27 self-assigned this Jan 16, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
⭐ Feature Indicates new feature requests
Projects
None yet
Development

No branches or pull requests

1 participant