Discussions

• 2 You must be logged in to vote

  🙏

  How to use async request in BentoML?

  nyongja asked Mar 14, 2023 in Q&A · Unanswered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  How to make batch inference in pipeline Transformers

  khongtrunght asked Feb 24, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  CatBoost Classifier with cat_features

  ageorgiu17 asked Jan 25, 2023 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Runner with Diaparser Model

  jlunder00 asked Feb 15, 2023 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  Log request without blocking api response

  thomasaarholt asked Feb 1, 2023 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  pipeline creation for onnx model

  OriAlpha asked Jan 31, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Pass tokenizer files into bentoml packed model in v1.0.13

  OriAlpha asked Jan 31, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Querying the MIME type of a file input to an API

  ryanheise asked Jan 25, 2023 in Q&A · Unanswered

  

  

  0
• 3 You must be logged in to vote

  💡

  Inference Graph supported by BentoML

  withsmilo asked Nov 19, 2020 in Ideas · Unanswered

  

  

  

  

  3
• 1 You must be logged in to vote

  💡

  Have we considered a bentoml init command?

  phitoduck asked Jan 13, 2023 in Ideas · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Set model attributes from runner?

  RobbieFernandez asked Jan 5, 2023 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙌

  batch option doesn't optimize latency , it just trade off latency to throughput isn't it?

  KimSoungRyoul asked Dec 5, 2022 in Show and tell · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  What is the role of yatai-bento-metrics-transformer

  KimSoungRyoul asked Nov 22, 2022 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  Can I use bento docker image to run on standalone server without Yatai ?

  SpeedEX asked Nov 11, 2022 in General · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Is running preprocess, inference, postprocess at each runner the right way?

  quant1216 asked Oct 30, 2022 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  #️⃣

  No better performance for concurring requests

  katerinafrid asked Oct 24, 2022 in General · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Disabling buildkit while performing bentoml containerize

  sagarjoglekar asked Sep 23, 2022 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙏

  How can I convert bentoml example v0.13.2 -> v1.0.5

  KimSoungRyoul asked Sep 1, 2022 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Problem about using vm to create bentoml service

  DanielLeung222 asked Aug 5, 2022 in Q&A · Answered

  

  

  1
• 4 You must be logged in to vote

  🙏

  What --production flag does

  Lobosque asked Jul 28, 2022 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Deploy BentoService to Kubernetes can not work

  zhuyaguang asked Jul 27, 2022 in Q&A · Unanswered

  

  

  5
• 3 You must be logged in to vote

  🙏

  an exception occurred in remote runner [429] in production mode

  litter-rabbit asked Jul 26, 2022 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  bentoml.exceptions.BentoMLRpcError: Failed to upload MyBentoService to the remote yatai server: Deadline Exceeded

  BartlomiejSkwira asked Aug 21, 2021 in General · Answered

  

  

  

  

  4
• 1 You must be logged in to vote

  🙏

  Cookie and BentoML Performance

  callmedada asked Jun 16, 2022 in Q&A · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Multi threads in multiple processes

  pre-1.0 Issues related to BentoML 0.13 or below

  lionsheep0724 asked Jun 16, 2022 in Q&A · Unanswered

  

  

  2