Skip to content

1.8.1
Compare
Choose a tag to compare
@ngxson ngxson released this 16 May 11:58
· 67 commits to master since this release
1.8.1
50aecda
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What's Changed

HeapFS allow us to save more memory while loading model. It also prevent doing memcpy, so loading model will be a bit faster.

  • Make the config parameter of the loadModelFromUrl function optional by @felladrin in #32
  • Remove prebuilt esm by @ngxson in #33
  • Improve error handling on abort() by @ngxson in #34
  • add tool for debugging memory by @ngxson in #37
  • sync to upstream llama.cpp source code by @ngxson in #46

Full Changelog: 1.8.0...1.8.1

Contributors

felladrin and ngxson
Assets 2
Loading