1 Pull request opened by 1 person

• fix: rename op_offloat to op_offload in llama.py

  #2046 opened Aug 2, 2025

1 Issue opened by 1 person

• Build fails on Windows with non-CUDA backends (CLBlast, Vulkan) for versions >= 0.2.78

  #2047 opened Aug 3, 2025

8 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• LLama cpp problem ( gpu support)

  #509 commented on Jul 31, 2025 • 0 new comments

• Building and installing llama_cpp from source for RTX 50 Blackwell GPU

  #2028 commented on Aug 2, 2025 • 0 new comments

• Cannot run T5-based models

  #1587 commented on Aug 3, 2025 • 0 new comments

• Windows11：ERROR: ERROR: Failed to build installable wheels for some pyproject.toml based projects (llama-cpp-python)

  #2035 commented on Aug 3, 2025 • 0 new comments

• Can't install with GPU support with Cuda toolkit 12.9 and Cuda 12.9

  #2013 commented on Aug 3, 2025 • 0 new comments

• Regression in unified KV cache appears after `llama.cpp` release b5912 in b5913

  #2045 commented on Aug 4, 2025 • 0 new comments

• Pre-built cpu wheel does not work on Ubuntu due to libc.musl dependency

  #1628 commented on Aug 6, 2025 • 0 new comments

• feat: Add Gemma3 chat handler (#1976)

  #1989 commented on Aug 5, 2025 • 0 new comments