Discussions

• 0 You must be logged in to vote

  ✨

  v3.0.0-beta.22

  github-actions bot announced May 19, 2024 in Releases

  0
• 0 You must be logged in to vote

  ✨

  v3.0.0-beta.21

  github-actions bot announced May 19, 2024 in Releases

  0
• 0 You must be logged in to vote

  ✨

  v3.0.0-beta.20

  github-actions bot announced May 19, 2024 in Releases

  0
• 2 You must be logged in to vote

  💬

  Beta version feedback (3.0.0-beta)

  giladgd started Dec 6, 2023 in General

  

  

  

  

  75
• 1 You must be logged in to vote

  💬

  Is it possible to define/constrain the JSON response more specifically

  jazelly started Apr 28, 2024 in General · Closed

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to load tokenizer config?

  linonetwo asked Apr 16, 2024 in Q&A · Closed · Answered

  

  

  5
• 1 You must be logged in to vote

  🙏

  My code keeps blank it doesn't return anything please help

  juned-adenwalla asked Apr 12, 2024 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Is it possible to pass logit-bias to llama.cpp?

  Madd0g asked Apr 9, 2024 in Q&A · Closed · Answered

  

  

  10
• 1 You must be logged in to vote

  🙏

  [Error: could not find a KV slot for the batch (try reducing the size of the batch or increase the context)]

  juned-adenwalla asked Apr 10, 2024 in Q&A · Closed · Answered

  

  

  4
• 1 You must be logged in to vote

  🙏

  Is it possible to use CLIP in node-lama-cpp for embeddings, and if so, how?

  mau-io asked Apr 10, 2024 in Q&A · Closed · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Custom stop token

  fakerybakery asked Apr 10, 2024 in Q&A · Closed · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How can I achieve streaming responses with Node-llama-cpp and Langchain?

  hafsalm asked Nov 17, 2023 in Q&A · Answered

  

  

  

  

  12
• 1 You must be logged in to vote

  💬

  Advice for GPU/cuda in an electron app

  samlhuillier started Feb 25, 2024 in General

  

  

  7
• 1 You must be logged in to vote

  🙏

  Getting errors when trying to run my index.js file on a remote linux server.

  AnimeshDeb asked Apr 5, 2024 in Q&A · Closed · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to do stateless inference?

  hawkeyexl asked Mar 25, 2024 in Q&A · Closed · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Is there a way to create more than one completion per call?

  Madd0g asked Mar 29, 2024 in Q&A · Closed · Answered

  

  

  1
• 1 You must be logged in to vote

  💬

  Implementing only CPU Usage

  AnimeshDeb started Mar 22, 2024 in General · Closed

  

  

  1
• 1 You must be logged in to vote

  💬

  n_tokens <= n_batch, beta, conversation history

  scenaristeur started Mar 7, 2024 in General

  

  

  11
• 1 You must be logged in to vote

  🙏

  Run a Gemma 2B Model

  Khalilbz asked Mar 10, 2024 in Q&A · Closed · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Model training or embedding custom data

  ZGltYQ asked Mar 7, 2024 in Q&A · Closed · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Using AVX512

  physimo asked Feb 28, 2024 in Q&A · Closed · Answered

  

  

  1
• 1 You must be logged in to vote

  💬

  Slows down when executing functions (3.0.0-beta.9)

  mrddter started Feb 8, 2024 in General · Closed

  

  

  2
• 2 You must be logged in to vote

  🙏

  Use any document as context

  danielmeloalencar asked Dec 6, 2023 in Q&A · Unanswered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  Capturing Llama.cpp stderr in typescript error

  samlhuillier asked Jan 18, 2024 in Q&A · Closed · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Supported formats

  ZGltYQ asked Jan 16, 2024 in Q&A · Closed · Answered

  

  

  

  

  2