Skip to content

bparees/wisdom

Folders and files

NameName
Last commit message
Last commit date

Latest commit

2ad70cd · Sep 6, 2023

History

40 Commits
Aug 14, 2023
Sep 6, 2023
Aug 16, 2023
Aug 14, 2023
Sep 6, 2023
Sep 6, 2023
Aug 14, 2023
Aug 14, 2023
Aug 14, 2023
Aug 9, 2023
Sep 6, 2023
Sep 6, 2023

Repository files navigation

OpenShift Wisdom Project

Overview

Experiments in creating a service layer to sit between UX clients and backend LLMs.

Intended to provide capabilities such as:

  • prompt engineering/augumentation (adding additional context to the user supplied prompt, rejecting poor quality prompts)
  • response validating/linting/filtering (stripping sensitive information, yaml validation)
  • allowing selection from multiple backend models
  • response attribution (match response to training data and cite the reference)
  • record user feedback about response quality

Building and Usage

Build the binary

$ cd cmd/wisdom $ go build .

Define a config file

See https://github.com/bparees/wisdom/blob/main/config/sample.cfg.yaml for an example.

Run a server

$ ./wisdom serve --config path/to/config.yaml

Do a single inference

$ ./wisdom infer --config path/to/config.yaml --prompt "write a deployment yaml for the registry.redhat.io/rhel9/redis-6:latest image with 3 replicas"

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages