Discussions

• 1 You must be logged in to vote

  💡

  Unify Model Interfaces

  enhancement

  lapp0 started Feb 17, 2024 in Feature requests

  

  

  3
• 1 You must be logged in to vote

  🙏

  Known Compatibility with Other HF Transformers Models

  gserapio asked Feb 21, 2024 in Q&A · Closed · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Generation from partially done JSON/List

  isamu-isozaki asked Feb 20, 2024 in Q&A · Answered

  

  

  2
• 2 You must be logged in to vote

  💡

  Add msgspec support

  dhirschfeld started Feb 11, 2024 in Feature requests

  

  

  0
• 1 You must be logged in to vote

  🤖

  stop_at argument of outlines.generate.text results in incorrect output

  bug

  lapp0 started Feb 9, 2024 in Weird model output

  

  

  11
• 1 You must be logged in to vote

  🙏

  pydantic version requirement clashes with that of vLLM

  mhillebrand asked Dec 29, 2023 in Q&A · Closed · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  High Latency for a simple CFG generation

  bug

  Shivam-Srivastava asked Feb 6, 2024 in Q&A · Answered

  

  

  

  

  10
• 1 You must be logged in to vote

  🤖

  Whitespace in Regex leads to different behaviours

  structured generation Linked to structured generation JSON correctness Everything related to the generation correctness

  immortal3 started Dec 26, 2023 in Weird model output

  

  

  

  

  6
• 1 You must be logged in to vote

  💡

  Suggestion / Question for Refactoring to Enable Multiple Generation

  lapp0 started Jan 3, 2024 in Feature requests

  

  

  8
• 1 You must be logged in to vote

  🤖

  Frequent error I'm getting: "Could not format the output of the model into a dictionary or a Pydantic model"

  aalyousfi started Jan 11, 2024 in Weird model output

  

  

  5
• 1 You must be logged in to vote

  💬

  How to estimate the average branching factor for code generation with grammar guided generation?

  arunpatro started Jan 18, 2024 in General

  

  

  1
• 1 You must be logged in to vote

  💡

  Compilation to LCEL

  question

  AriMKatz started Jan 11, 2024 in Feature requests

  

  

  

  

  4
• 1 You must be logged in to vote

  💡

  High level typed interface

  question

  AriMKatz started Jan 11, 2024 in Feature requests

  

  

  0
• 2 You must be logged in to vote

  💡

  Support/Outlines in LORAX Inference Server

  AdithyanI started Jan 11, 2024 in Feature requests

  

  

  1
• 1 You must be logged in to vote

  💡

  OpenAI, Azure, function calling and Llama CPP grammar integration

  AriMKatz started Jan 9, 2024 in Feature requests

  

  

  1
• 1 You must be logged in to vote

  🙌

  Finally managed to run Qwen models successfully with Outlines

  aalyousfi started Jan 9, 2024 in Show and tell

  

  

  0
• 3 You must be logged in to vote

  🙏

  Support for GGUF models?

  aalyousfi asked Dec 11, 2023 in Q&A · Answered

  

  

  

  

  6
• 0 You must be logged in to vote

  🙏

  Getting Pydantic version conflict when installing outlines[serve]

  Quang-elec44 asked Jan 3, 2024 in Q&A · Answered

  

  

  4
• 1 You must be logged in to vote

  🙏

  Are we able now to specify model temperature for transformers and AWQ models?

  aalyousfi asked Jan 7, 2024 in Q&A · Answered

  

  

  2
• 3 You must be logged in to vote

  🙏

  Is constraining and renormalizing the output logits an unbiased way to convert a free form LLM into a classifier?

  dhuynh95 asked Nov 11, 2023 in Q&A · Unanswered

  

  

  2
• 3 You must be logged in to vote

  🙏

  vllm API- add regex support

  mjsteele12 asked Dec 22, 2023 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🤖

  First readme.md example fails

  correctness Everything related to the generation correctness

  jloganolson started Dec 16, 2023 in Weird model output

  

  

  7
• 1 You must be logged in to vote

  💡

  Consider implementing advanced prompting techniques

  rlouf started Jan 4, 2024 in Feature requests

  

  

  0
• 1 You must be logged in to vote

  🙏

  Using Outlines with vLLM/ FastChat

  question

  rounak610 asked Sep 27, 2023 in Q&A · Answered

  

  

  

  

  2
• 1 You must be logged in to vote

  🤖

  Generating str/int/float/bool values with GPT2 using generate.json leads to absurd results

  question structured generation Linked to structured generation correctness Everything related to the generation correctness

  gaspard-dv started Dec 19, 2023 in Weird model output

  

  

  

  

  3