Code

Share buffers between CPU and GPU#1696

Code

Merged

ggerganov merged 5 commits intoggml-org:masterggml-org/llama.cpp:masterfrom

kiltyj:metal-shared-memorykiltyj/llama.cpp:metal-shared-memoryCopy head branch name to clipboard

Jun 5, 2023

Commits

Commits on Jun 5, 2023

• Use MTLDevice.newBufferWithBytesNoCopy to share buffers between CPU and GPU

  kiltyj

  committed
  bc04508

  Copy full SHA for bc04508

• Page-align buffers used by Metal

  kiltyj

  committed
  a9d0bea

  Copy full SHA for a9d0bea

• Remove trailing whitespace

  kiltyj

  committed
  c1b4424

  Copy full SHA for c1b4424

• Only import unistd.h for Metal builds

  kiltyj

  committed
  c38b0bb

  Copy full SHA for c38b0bb

• metal : remove unnecessary copies

  ggerganov

  committed
  e129f0b

  Copy full SHA for e129f0b