Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add plugins architecture #2

Open
alexrozanski opened this issue Apr 17, 2023 · 0 comments
Open

Add plugins architecture #2

alexrozanski opened this issue Apr 17, 2023 · 0 comments
Assignees
Labels
enhancement New feature or request
Milestone

Comments

@alexrozanski
Copy link
Owner

GPT4All-J requires different cpp bindings than llama.cpp, and uses a specific version of ggml.

In order to support cases like this it might be useful to have a plugin architecture where llama.swift can load different generation plugins which run prediction in an isolated context (but with the support of the core functionality of llama.swift)

@alexrozanski alexrozanski added the enhancement New feature or request label Apr 17, 2023
@alexrozanski alexrozanski added this to the v2.0 milestone Apr 17, 2023
@alexrozanski alexrozanski self-assigned this Apr 17, 2023
@alexrozanski alexrozanski moved this to Todo in llama.swift Apr 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: Todo
Development

No branches or pull requests

1 participant