Code

merge upstream#42

Code

Merged

l3utterfly merged 34 commits intolayla-buildl3utterfly/llama.cpp:layla-buildfrom masterl3utterfly/llama.cpp:masterCopy head branch name to clipboardOct 10, 2024

+2,031-1,246

Commits

Commits on Oct 3, 2024

• Fixed dequant precision issues in Q4_1 and Q5_1 (ggerganov#9711)

  OuadiElfarouki

  authored
  5639971

• rpc : enable vulkan (ggerganov#9714)

  Show description for 841713e
  rgerganov

  authored
  841713e

• convert : handle tokenizer merges format from transformers 4.45 (ggerganov#9696)

  compilade

  authored
  e3c355b

• ggml: unify backend logging mechanism (ggerganov#9709)

  Show description for d6fe7ab
  bandoti

  authored
  d6fe7ab

• ggml-backend : add device description to CPU backend (ggerganov#9720)

  slaren

  authored
  a7ad553

• metal : fix compute pass descriptor autorelease crash (ggerganov#9718)

  jmousseau

  authored
  5d5ab1e

• ggml: refactor cross entropy loss CPU impl. (ggml/976)

  

  JohannesGaessler

  authored and

  ggerganov

  committed
  eee39bd

• ggml/ex: calculate accuracy in graph, adapt MNIST (ggml/980)

  

  JohannesGaessler

  authored and

  ggerganov

  committed
  fabdc3b

• sync : ggml

  ggerganov

  committed
  1bb8a64

• metal : remove abort (skip) (ggml/0)

  ggerganov

  committed
  d5ed2b9

Commits on Oct 4, 2024

• Fixed RNG seed docs (ggerganov#9723)

  Show description for 133c7b4
  d-kleine

  authored
  133c7b4

• ci : fine-grant permission (ggerganov#9710)

  ngxson

  authored
  f3fdcfa

• ggml : fixes after sync (ggml/983)

  Show description for ff56576
  

  slaren

  authored and

  ggerganov

  committed
  ff56576

• ggml : fix typo in example usage ggml_gallocr_new (ggml/984)

  

  danbev

  authored and

  ggerganov

  committed
  55951c0

• sync : ggml

  ggerganov

  committed
  1788077

• Add Llama Assistant (ggerganov#9744)

  vietanhdev

  authored
  71967c2

Commits on Oct 5, 2024

• metal : zero-init buffer contexts (whisper/0)

  ggerganov

  committed
  905f548

• sync : ggml

  ggerganov

  committed
  58b1669

• rerank : use [SEP] token instead of [BOS] (ggerganov#9737)

  Show description for 8c475b9
  ggerganov

  authored
  8c475b9

Commits on Oct 6, 2024

• vulkan : retry allocation with fallback flags (whisper/2451)

  Show description for b0915d5
  

  2 peopleauthored and

  ggerganov

  committed
  b0915d5

• sync : llama.cpp

  ggerganov

  committed
  b6d6c52

• readme : fix typo [no ci]

  ggerganov

  authored
  f4b2dcd

• contrib : simplify + minor edits [no ci]

  ggerganov

  authored
  d5cb868

Commits on Oct 7, 2024

• metal : single allocation of encode_async block (ggerganov#9747)

  Show description for 96b6912
  

  ptsochantaris

  and

  ggerganov

  authored
  96b6912

• ggml : add metal backend registry / device (ggerganov#9713)

  Show description for d5ac8cf
  

  ggerganov

  and

  slaren

  authored
  d5ac8cf

• flake.lock: Update (ggerganov#9753)

  Show description for 6279dac
  

  ggerganov

  and

  github-actions[bot]

  authored
  6279dac

• Update building for Android (ggerganov#9672)

  Show description for f1af42f
  amqdn

  authored
  f1af42f

• ggml : add backend registry / device interfaces to BLAS backend (ggerganov#9752)

  Show description for 6374743
  slaren

  authored
  6374743

Commits on Oct 8, 2024

• scripts : fix spelling typo in messages and comments (ggerganov#9782)

  Show description for fa42aa6
  standby24x7

  authored
  fa42aa6

• server : better security control for public deployments (ggerganov#9776)

  Show description for 458367a
  ngxson

  authored
  458367a

• ggml : fix BLAS with unsupported types (ggerganov#9775)

  Show description for dca1d4b
  slaren

  authored
  dca1d4b

Commits on Oct 9, 2024

• examples : remove llama.vim

  Show description for 3dc48fe
  ggerganov

  committed
  3dc48fe

• perplexity : fix integer overflow (ggerganov#9783)

  Show description for e702206
  ggerganov

  authored
  e702206

• cmake : do not build common library by default when standalone (ggerganov#9804)

  slaren

  authored
  c81f3bb