GeezerVison

make : .PHONY clean (ggml-org#1553)

ggml : output 3d sizes in ggml_graph_dump_dot()

examples : add server example with REST API (ggml-org#1443)

* Added httplib support

* Added readme for server example

* fixed some bugs

* Fix the build error on Macbook

* changed json11 to nlohmann-json

* removed some whitespaces

* remove trailing whitespace

* added support custom prompts and more functions

* some corrections and added as cmake option

ggml : update WASM SIMD

llama : add llama_init_backend() API (close ggml-org#1527)

Revert "feature : add blis and other BLAS implementation support (ggm…

…l-org#1502)"

This reverts commit 07e9ace.

Fix for mingw (ggml-org#1462)

feature : support blis and other blas implementation (ggml-org#1536)

* feature: add blis support

* feature: allow all BLA_VENDOR to be assigned in cmake arguments. align with whisper.cpp pr 927

* fix: version detection for BLA_SIZEOF_INTEGER, recover min version of cmake

* Fix typo in INTEGER

Co-authored-by: Georgi Gerganov <[email protected]>

* Fix: blas changes on ci

---------

Co-authored-by: Georgi Gerganov <[email protected]>

cuda : loading models directly into VRAM, norm calculation on GPU, br…

…oadcasting for ggml_mul (ggml-org#1483)

* Broadcasting for ggml_mul

* CUDA kernel for ggml_mul, norms in VRAM

* GPU weights not in RAM, direct loading with cuFile

* fixup! GPU weights not in RAM, direct loading with cuFile

* fixup! GPU weights not in RAM, direct loading with cuFile

* define default model path once, sync path with readme (ggml-org#1366)

* ~7% faster Q5_1 AVX2 code (ggml-org#1477)

* convert.py: Support models which are stored in a single pytorch_model.bin (ggml-org#1469)

* Support models in a single pytorch_model.bin

* Remove spurious line with typo

* benchmark-matmul: Print the average of the test results (ggml-org#1490)

* Remove unused n_parts parameter (ggml-org#1509)

* Fixes ggml-org#1511 lambda issue for w64devkit (mingw) (ggml-org#1513)

* Fix for w64devkit and mingw

* make kv_f16 the default for api users (ggml-org#1517)

* minor : fix compile warnings

* readme : adds WizardLM to the list of supported models (ggml-org#1485)

* main : make reverse prompt option act as a stop token in non-interactive mode (ggml-org#1032)

* Make reverse prompt option act as a stop token in non-interactive scenarios

* Making requested review changes

* Update gpt_params_parse and fix a merge error

* Revert "Update gpt_params_parse and fix a merge error"

This reverts commit 2bb2ff1.

* Update gpt_params_parse and fix a merge error take 2

* examples : add persistent chat (ggml-org#1495)

* examples : add persistent chat

* examples : fix whitespace

---------

Co-authored-by: Georgi Gerganov <[email protected]>

* tests : add missing header

* ggml : use F16 instead of F32 in Q4_0, Q4_1, Q8_0 (ggml-org#1508)

* ggml : use F16 instead of F32 in Q4_0, Q4_1 and Q8_0

* llama : bump LLAMA_FILE_VERSION to 3

* cuda : update Q4 and Q8 dequantize kernels

* ggml : fix AVX dot products

* readme : update performance table + hot topics

* ggml : fix scalar implementation of Q4_1 dot

* llama : fix compile warnings in llama_set_state_data()

* llama : fix name shadowing and C4146 (ggml-org#1526)

* Fix name shadowing and C4146

* Fix if macros not using defined when required

* Update llama-util.h

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

* Update llama-util.h

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>

* Code style

Co-authored-by: Georgi Gerganov <[email protected]>

---------

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Georgi Gerganov <[email protected]>

* Fix for mingw (ggml-org#1462)

* llama : add llama_init_backend() API (close ggml-org#1527)

* feature : add blis and other BLAS implementation support (ggml-org#1502)

* feature: add blis support

* feature: allow all BLA_VENDOR to be assigned in cmake arguments. align with whisper.cpp pr 927

* fix: version detection for BLA_SIZEOF_INTEGER, recover min version of cmake

* Fix typo in INTEGER

Co-authored-by: Georgi Gerganov <[email protected]>

---------

Co-authored-by: Georgi Gerganov <[email protected]>

* Revert "feature : add blis and other BLAS implementation support (ggml-org#1502)"

This reverts commit 07e9ace.

* GPU weights not in RAM, direct loading with cuFile

* llama : code style fixes + progress print fix

* ggml : ggml_mul better broadcast support

* cmake : workarounds for cufile when CMake version < 3.25

* gg rebase fixup

* Loop in llama.cpp, fixed progress callback

* Attempt clang-tidy fix

* llama : fix vram size computation

* Add forgotten fclose()

---------

Co-authored-by: András Salamon <[email protected]>
Co-authored-by: Ilya Kurdyukov <[email protected]>
Co-authored-by: Tom Jobbins <[email protected]>
Co-authored-by: rankaiyx <[email protected]>
Co-authored-by: Stephan Walter <[email protected]>
Co-authored-by: DannyDaemonic <[email protected]>
Co-authored-by: Erik Scholz <[email protected]>
Co-authored-by: Georgi Gerganov <[email protected]>
Co-authored-by: David Kennedy <[email protected]>
Co-authored-by: Jason McCartney <[email protected]>
Co-authored-by: Evan Jones <[email protected]>
Co-authored-by: Maxime <[email protected]>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Zenix <[email protected]>

llama : define magic numbers as integer constants (ggml-org#1518) (gg…

…ml-org#1520)

The underlying representation of multibyte character literals is
implementation-defined. This could, at least in principle, cause
cross-build data export/import issues independent of endianness.

Define magic numbers as integer literals to be on the safe side.

Signed-off-by: Juuso Alasuutari <[email protected]>