Skip to content

Issues: ggerganov/llama.cpp

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

335 Open 2,674 Closed
335 Open 2,674 Closed
Author
Filter by author
Label
Filter by label
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Milestones
Filter by milestone
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Track allocated buffers in rpc-server bug-unconfirmed
#7407 opened May 20, 2024 by rgerganov
@rgerganov
2
convert.py fails importing a new model architecture
#7406 opened May 20, 2024 by JohnSully
Support for Bunny VLM (SigLip + Phi-3) bug-unconfirmed
#7404 opened May 20, 2024 by criminact
ci failing on main branch bug-unconfirmed high priority Very important issue
#7403 opened May 20, 2024 by mofosyne
@ggerganov @slaren
RPC + Flash attention generation bug bug-unconfirmed
#7401 opened May 19, 2024 by steampunque
3
FA2 - P40 || Mixtral partial GPU offload Gibberish bug-unconfirmed
#7400 opened May 19, 2024 by askmyteapot
4
speedup ROCm AMD Unified Memory Architecture enhancement New feature or request
#7399 opened May 19, 2024 by Djip007
7
Llama.cpp server doesn't return grammar error messages when in streaming mode bug-unconfirmed
#7391 opened May 19, 2024 by richardanaya
Possible bug in the 'deepseek-coder' chat template's system message bug-unconfirmed
#7385 opened May 19, 2024 by jukofyork
Different result between use llama_tokenize and python original transformers tokenizer
#7384 opened May 19, 2024 by Liufeiran123
6
convert-hf-to-gguf.py fails PR #7234 bug-unconfirmed
#7380 opened May 19, 2024 by LostRuins
Funny response with LLaMa 3 8B bug-unconfirmed
#7367 opened May 18, 2024 by Sewlell
bf16 problem
#7365 opened May 18, 2024 by Zibri
Can I handle multiple images in the same context? bug-unconfirmed
#7364 opened May 18, 2024 by Eriter555
[SYCL] include shared libs in sycl release enhancement New feature or request
#7361 opened May 18, 2024 by gfody
[Android/Termux] Significantly higher RAM usage with Vulkan compared to CPU only bug-unconfirmed
#7351 opened May 17, 2024 by egeoz
2
AMD ROCm: 8x22B Model Causes 100% GPU Utilization Stall bug-unconfirmed
#7344 opened May 17, 2024 by Trat8547
Flash attention implementations do not handle case where value vectors have different dimension from query vectors bug-unconfirmed
#7343 opened May 17, 2024 by fairydreaming
1
convert.py still fails on llama3 8B-Instruct downloaded directly from Meta (Huggingface works) bug-unconfirmed
#7339 opened May 17, 2024 by aleloi
2
Segmentation Fault on GPU training Fine-tuning and training stuff
#7337 opened May 17, 2024 by djain-fujitsu
2
Issues: Unable for multiuser prompt
#7336 opened May 17, 2024 by OlivesHere
1
llava surgery script for new llava-arch model from Intel bug-unconfirmed
#7333 opened May 16, 2024 by KohakuBlueleaf
GGML_ASSERT(n_embd_gqa == n_embd_k_gqa) fails in models where key vector dimension is different from value vector dimension
#7331 opened May 16, 2024 by fairydreaming
Add support for multilingual Viking models, please. enhancement New feature or request
#7309 opened May 15, 2024 by JohnClaw
1
Possible performance boost with 2-pass online softmax bug-unconfirmed
#7306 opened May 15, 2024 by zixuanweeei
1
ProTip! Updated in the last three days: updated:>2024-05-17.