GeezerVisonThe World Wide Web, restored to 800 pixels of glory. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Home|About|Gaming cabinet|Archives|How it works|Starter sites | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
GeezerVison is showing github.com — Loading models directly into VRAM, norm calculation on GPUs, broadcasting for ggml_mul by JohannesGaessler · Pull Request #1483 · ggml-org/llama.cpp Loading models directly into VRAM, norm calculation on GPUs, broadcasting for ggml_mul #1483New issueHave a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community. By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails. Already on GitHub? Sign in to your account
Merged
Uh oh!
There was an error while loading. Please reload this page.
Merged
Changes from 1 commit
Commits
Show all changes
35 commits
Select commit
Hold shift + click to select a range
de65783
Broadcasting for ggml_mul
JohannesGaessler 2365a2a
CUDA kernel for ggml_mul, norms in VRAM
JohannesGaessler fa1a29f
GPU weights not in RAM, direct loading with cuFile
JohannesGaessler 1bfe5a9
fixup! GPU weights not in RAM, direct loading with cuFile
JohannesGaessler 24d5ddf
fixup! GPU weights not in RAM, direct loading with cuFile
JohannesGaessler 09d8251
define default model path once, sync path with readme (#1366)
ott2 230018d
~7% faster Q5_1 AVX2 code (#1477)
ilyakurdyukov 1af2844
convert.py: Support models which are stored in a single pytorch_model…
TheBloke d5207bf
benchmark-matmul: Print the average of the test results (#1490)
d916c5b
Remove unused n_parts parameter (#1509)
sw a94b334
Fixes #1511 lambda issue for w64devkit (mingw) (#1513)
DannyDaemonic e22541a
make kv_f16 the default for api users (#1517)
Green-Sky 6b5776b
minor : fix compile warnings
ggerganov 75c017f
readme : adds WizardLM to the list of supported models (#1485)
n1trane c51c64a
main : make reverse prompt option act as a stop token in non-interact…
data-angel 0226d49
examples : add persistent chat (#1495)
ejones 9fd8187
tests : add missing header
ggerganov 211aa6a
ggml : use F16 instead of F32 in Q4_0, Q4_1, Q8_0 (#1508)
ggerganov 9a7af6c
ggml : fix scalar implementation of Q4_1 dot
ggerganov f14673a
llama : fix compile warnings in llama_set_state_data()
ggerganov df512bb
llama : fix name shadowing and C4146 (#1526)
maximegmd f401d5f
Fix for mingw (#1462)
DannyDaemonic 54ec8a9
llama : add llama_init_backend() API (close #1527)
ggerganov 667c57f
feature : add blis and other BLAS implementation support (#1502)
zenixls2 977e74d
Revert "feature : add blis and other BLAS implementation support (#15…
ggerganov ffe9652
GPU weights not in RAM, direct loading with cuFile
JohannesGaessler f67bc3c
llama : code style fixes + progress print fix
ggerganov 3ec7941
ggml : ggml_mul better broadcast support
ggerganov a3586c5
cmake : workarounds for cufile when CMake version < 3.25
ggerganov 909acb3
Merge branch 'master' into gpu-norms
ggerganov fee87f6
gg rebase fixup
JohannesGaessler b81f662
Loop in llama.cpp, fixed progress callback
JohannesGaessler fadcd58
Attempt clang-tidy fix
JohannesGaessler a4da072
llama : fix vram size computation
ggerganov 37f2c6c
Add forgotten fclose()
JohannesGaessler File filterConversations
Failed to load comments.
Loading
Uh oh!
There was an error while loading. Please reload this page. Jump to
Jump to file
Failed to load files.
Loading
Uh oh!
There was an error while loading. Please reload this page. Diff viewDiff view
ggml : ggml_mul better broadcast support
Uh oh!
There was an error while loading. Please reload this page.
commit 3ec7941bad08c39bc2fc113e9ec1b27351e33f12
There are no files selected for viewing
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| You are visitor 01402605 — GeezerVison does not store the pages you look up. Best viewed with Netscape Navigator 4.7 or Internet Explorer 6 at 800×600. No cookies required. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||