Code

b2069#81

Code

Merged

Nexesenex merged 30 commits intoNexesenex:_master_upNexesenex/croco.cpp:_master_upfrom ggerganov:masterggerganov/llama.cpp:masterCopy head branch name to clipboardFeb 5, 2024

+2,850-11,424

Commits

Commits on Feb 1, 2024

• cuda : fix LLAMA_CUDA_F16 (#5262)

  slaren

  authored
  8ca511c

  Copy full SHA for 8ca511c

• Vulkan Phi Fix for AMD Proprietary Drivers (#5260)

  Show description for 4d0924a
  0cc4m

  authored
  4d0924a

  Copy full SHA for 4d0924a

• add --no-mmap in llama-bench (#5257)

  Show description for 128dcbd
  NeoZhangJianyu

  authored
  128dcbd

  Copy full SHA for 128dcbd

Commits on Feb 2, 2024

• llama : fix memory leak in llama_batch_free (#5252)

  Show description for e1e7210
  irbull

  authored
  e1e7210

  Copy full SHA for e1e7210

• [SYCL] update guide of SYCL backend (#5254)

  Show description for af3ba5d
  NeoZhangJianyu

  authored
  af3ba5d

  Copy full SHA for af3ba5d

• [SYCL] get MAX_MEM_ALLOC from device property (#5270)

  Show description for e805f0f
  airMeng

  authored
  e805f0f

  Copy full SHA for e805f0f

• docker : add build for SYCL, Vulkan + update readme (#5228)

  Show description for 6b91b1e
  ngxson

  authored
  6b91b1e

  Copy full SHA for 6b91b1e

• Tidy ggml-sycl (#5261)

  Show description for b05102f
  

  AidanBeltonS

  and

  abhilash1910

  authored
  b05102f

  Copy full SHA for b05102f

• py : add check for '.attn.masked_bias' layers to GPT2model (#5281)

  MirrorAzure

  authored
  2d40085

  Copy full SHA for 2d40085

• scripts : parse wtype in server-llm.sh (#5167)

  Show description for e437b37
  ggerganov

  authored
  e437b37

  Copy full SHA for e437b37

• perplexity : fix KL divergence calculations on Windows (#5273)

  kalomaze

  authored
  1912211

  Copy full SHA for 1912211

Commits on Feb 3, 2024

• Fix im2col with 32fp (#5286)

  AidanBeltonS

  authored
  a305dba

  Copy full SHA for a305dba

• readme : add tenere in the ui tools list (#5284)

  pythops

  authored
  6a66c50

  Copy full SHA for 6a66c50

• YaRN : store rope scaling type as int32_t in memory (#5285)

  Show description for 1ec3332
  cebtenzzre

  authored
  1ec3332

  Copy full SHA for 1ec3332

• refactor : switch to emplace_back to avoid extra object (#5291)

  MKlimenko

  authored
  52bb63c

  Copy full SHA for 52bb63c

• Vulkan Intel Fixes, Optimizations and Debugging Flags (#5301)

  Show description for e920ed3
  0cc4m

  authored
  e920ed3

  Copy full SHA for e920ed3

• add Vulkan support to Nix flake

  

  mschwaig

  authored and

  philiptaron

  committed
  60ecf09

  Copy full SHA for 60ecf09

• make: fix nvcc optimization flags for host code (#5309)

  JohannesGaessler

  authored
  3cc5ed3

  Copy full SHA for 3cc5ed3

• make: add nvcc info print (#5310)

  JohannesGaessler

  authored
  3c0d25c

  Copy full SHA for 3c0d25c

Commits on Feb 4, 2024

• cmake : use set() for LLAMA_WIN_VER (#5298)

  Show description for 277fad3
  crimsonmagick

  authored
  277fad3

  Copy full SHA for 277fad3

• Adding some imatrix tools (#5302)

  Show description for 5ed26e1
  

  ikawrakow

  and

  Kawrakow

  authored
  5ed26e1

  Copy full SHA for 5ed26e1

• flake.lock: Update

  Show description for 9392ebd
  

  github-actions[bot]

  authored and

  philiptaron

  committed
  9392ebd

  Copy full SHA for 9392ebd

Commits on Feb 5, 2024

• [SYCL] Fix cpy with dims of 3 (#5289)

  Show description for 4833ac2
  

  AidanBeltonS

  and

  abhilash1910

  authored
  4833ac2

  Copy full SHA for 4833ac2

• readme : add CodeShell models to the supported models list (#5330)

  chiranko

  authored
  5d55b0c

  Copy full SHA for 5d55b0c

• scripts : add non-interactive server-llm.sh (#5303)

  Show description for 4be04c8
  

  garrnizon

  and

  ggerganov

  authored
  4be04c8

  Copy full SHA for 4be04c8

• scripts : fix typos, cleanup (#5303)

  ggerganov

  committed
  30679d4

  Copy full SHA for 30679d4

• common : add dynamic temperature parameters to main example cli (#5295)

  Show description for e6f8177
  l3utterfly

  authored
  e6f8177

  Copy full SHA for e6f8177

• server : allow to get default generation settings for completion (#5307)

  z80maniac

  authored
  a2d60c9

  Copy full SHA for a2d60c9

• iq2_xxs: tune quantization (#5320)

  Show description for 6fdfa2e
  

  ikawrakow

  and

  Kawrakow

  authored
  6fdfa2e

  Copy full SHA for 6fdfa2e

• py : fix internlm2-hf convert to gguf (#5305)

  Show description for 7e1ae37
  SolenoidWGT

  authored
  7e1ae37

  Copy full SHA for 7e1ae37