Discussions

• 1 You must be logged in to vote

  🙏

  Help needed:: Guidance on Deploying to Modern BentoCloud

  oluwakayodemike asked Jul 27, 2025 in Q&A · Closed · Answered

  

  

  2
• 1 You must be logged in to vote

  💡

  Provide a predictable container path for secrets

  danfairs asked May 21, 2025 in Ideas · Unanswered

  

  

  1
• 3 You must be logged in to vote

  🙏

  Is the gRPC in BentoML stable and actively maintained?

  ryan-3m asked Mar 3, 2023 in Q&A · Answered

  

  

  

  

  12
• 1 You must be logged in to vote

  🙌

  BentoML code evolution

  andrehora asked Apr 18, 2025 in Show and tell · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to depends multi services that on other nodes?

  llc-kc asked Apr 2, 2025 in Q&A · Unanswered

  

  

  

  

  4
• 1 You must be logged in to vote

  #️⃣

  Is there any way of creating a service using functions?

  mr-mapache asked Mar 31, 2025 in General · Unanswered

  

  

  0
• 2 You must be logged in to vote

  #️⃣

  Timeline for Supporting Unique Runtime Environments in Multi-Service Deployment?

  oogou11 asked Mar 11, 2025 in General · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to debug a bentoml app like fastapi flavor?

  decadance-dance asked Mar 28, 2024 in Q&A · Answered

  

  

  

  

  3
• 1 You must be logged in to vote

  🙏

  Multiple Services & Bentos in the same project

  danieltudosiu asked Feb 7, 2025 in Q&A · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Question about Python 3.10+ support in BentoML (>=1.3.10) and its dependency simple_di

  oogou11 asked Dec 19, 2024 in Q&A · Answered

  

  

  

  

  4
• 1 You must be logged in to vote

  🙏

  Question about batch request optimization in BentoML

  oogou11 asked Nov 22, 2024 in Q&A · Closed · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💡

  Integration with https://github.com/michaelfeil/infinity

  michaelfeil asked Jun 11, 2024 in Ideas · Answered

  

  

  2
• 1 You must be logged in to vote

  #️⃣

  Incorrect Link in Observability Module: Metrics Redirects to Tracing.

  oogou11 asked Nov 5, 2024 in General · Answered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to save model for ONNX and Keras after bentoml 1.4

  cceasy asked Oct 29, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to Dynamically Allocate Resources with Limited GPU Resources?

  oogou11 asked Oct 9, 2024 in Q&A · Answered

  

  

  3
• 1 You must be logged in to vote

  🙏

  How to properly retrieve models from private model store (e.g. Azure Databricks)?

  arodindev asked Oct 11, 2024 in Q&A · Closed · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  validate numpy string dtype in bentoml's NumpyNdarray

  oogou11 asked Sep 28, 2024 in Q&A · Closed · Unanswered

  

  

  2
• 2 You must be logged in to vote

  🙏

  Best practice for multiple service serving

  tguner-arteriaai asked Jun 3, 2024 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Unnecessary Error Message Prefix in API Responses

  takhyun12 asked Aug 9, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to change temporary directory while create bentoml.Model?

  cnicolumn asked Apr 9, 2024 in Q&A · Closed · Unanswered

  

  

  

  

  2
• 1 You must be logged in to vote

  💡

  Enhancing Release Note Generation through Automation

  DetectiveCode asked Aug 22, 2024 in Ideas · Closed · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to assign a separate GPU to each worker?

  Dawnfz-Lenfeng asked Jul 31, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  question: How to use replica in BentoML?

  Dawnfz-Lenfeng asked Jul 29, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  feature: CTranslated2 Framework + Adaptive-batching for custom runner

  Matthieu-Tinycoaching asked Sep 30, 2022 in General · Closed · Answered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Is there away in v1.2 to assemble docker image from a local folder (as it was in v0.13), not from a model store?

  Ziange asked Jun 14, 2024 in Q&A · Unanswered

  

  

  1