GeezerVison

The World Wide Web, restored to 800 pixels of glory.

GeezerVison is showing github.com — GitHub - eugenehp/bitnet-cpp-rs: Rust bindings for bitnet.cpp based on llama-cpp-4

Branches Tags

Open more actions menu

Latest commit

History

71 Commits

Folders and files

Name		Name	Last commit message	Last commit date
.vscode		.vscode
bitnet-cpp-sys		bitnet-cpp-sys
bitnet-cpp		bitnet-cpp
examples		examples
.gitignore		.gitignore
.gitmodules		.gitmodules
Cargo.lock		Cargo.lock
Cargo.toml		Cargo.toml
LICENSE		LICENSE
README.md		README.md

Repository files navigation

BitNet.cpp for Rust

Almost safe wrapper for BitNet-cpp based on llama-cpp

Development

See bitnet-cpp-sys

Roadmap

minimize crate size
rewrite sampler PR 9294
look into Metal implementation of MatMul kernerls for BitNet
add more examples
replace all remaining python from BitNet repo
add better division between arm64 and x86_64
move python code generation into patch files

Platform support

arm64	x64	OS	comments
✅	❌	MacOS	tested fully on Apple Silicon macs
⚠️	❌	Linux	should test on ARM based linux
❓	❌	Windows	should test on ARM based windows

Thanks

Heavily inspired by llama-cpp-rs

License

MIT

Copyright

About

Rust bindings for bitnet.cpp based on llama-cpp-4

Topics

bitnet ggml llama machine-learning rust

Resources

Readme

MIT license

Activity

Stars

17 stars

Watchers

1 watching

Forks

3 forks

Report repository

Releases

Used by

Contributors

Languages

You are visitor 01402503 — GeezerVison does not store the pages you look up.
Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required.