Issues

• fast_queue=True is silently ignored — the ZMQ transport is never enabled (and would be misconfigured if it were)

  Lightning-AI/LitServe#751 · Filter by author betacatsling opened on Sep 14, 2026

• OpenAISpec rejects standard required and named function tool_choice values

  Lightning-AI/LitServe#745 · Filter by author emecii opened on Sep 10, 2026

• Sync streaming loop fires AFTER_PREDICT twice and skips decode-request callback events

  Lightning-AI/LitServe#735 · Filter by author krishna3554 opened on Aug 26, 2026

• Pass binary payloads to decode_request unchanged

  enhancement
  Lightning-AI/LitServe#732 · Filter by author yukunlin-faire opened on Aug 18, 2026
  1

• Prometheus & OpenTelemetry Metrics for LitServe

  enhancement
  Lightning-AI/LitServe#724 · Filter by author hillhack opened on Aug 4, 2026
  1

• Example: Serve FunASR/SenseVoice for speech recognition

  Lightning-AI/LitServe#688 · Filter by author LauraGPT opened on Jun 2, 2026
  1

• Threads not properly killed on windows

  bughelp wanted
  Lightning-AI/LitServe#684 · Filter by author racinmat opened on Jun 1, 2026

• wrap_litserve_start() hangs on requests when worker setup() is slow

  bughelp wanted
  Lightning-AI/LitServe#681 · Filter by author Mystic98 opened on May 9, 2026
  1

• Async task processing via TaskSpec — standalone package, interested in upstreaming?

  enhancementspec
  Feature

  Lightning-AI/LitServe#668 · Filter by author dacrystal opened on Mar 16, 2026
  2

• Swagger UI does not expose request parameters for /predict, causing 500 error when invoked

  bughelp wanted
  Lightning-AI/LitServe#667 · Filter by author mageshkrishna opened on Mar 15, 2026
  2

• downloadable documentation from https://lightning.ai/docs/litserve

  documentationenhancement
  Lightning-AI/LitServe#630 · Filter by author raulcarlomagno opened on Nov 11, 2025

• health probes such as startupz, readyz

  enhancement
  Lightning-AI/LitServe#628 · Filter by author yifan opened on Oct 29, 2025
  6

• Access Health check endpoint for each LitAPI independently

  Lightning-AI/LitServe#605 · Filter by author aniketmaurya opened on Sep 9, 2025
  4

• How can I initialize multiple instances of different model classes on different GPUs?

  enhancementgood first issuehelp wanted
  Lightning-AI/LitServe#572 · Filter by author ywh-my opened on Jul 8, 2025
  14

• LitServe MCP Bug: tools/call Always Fails

  bughelp wantedmcp
  Lightning-AI/LitServe#560 · Filter by author ductai199x opened on Jun 29, 2025
  6

• Iceoryx2 queues

  enhancement
  Lightning-AI/LitServe#559 · Filter by author tchaton opened on Jun 27, 2025
  1

• Optimize Slow CI Tests to Reduce Runtime

  bughelp wanted
  Lightning-AI/LitServe#527 · Filter by author bhimrazy opened on Jun 4, 2025
  3

• start multiple types of models, with any number of instances for each

  enhancement
  Lightning-AI/LitServe#514 · Filter by author ywh-my opened on May 27, 2025
  3

• Multiple endpoints roadmap

  enhancement
  Feature

  Lightning-AI/LitServe#492 · Filter by author aniketmaurya opened on May 13, 2025
  4

  

• Run a mix of async and non-async methods in LitAPI like FastAPI

  enhancement
  Lightning-AI/LitServe#490 · Filter by author aniketmaurya opened on May 13, 2025

• Support for OpenAI's new Responses API spec

  enhancement
  Lightning-AI/LitServe#455 · Filter by author PierreMesure opened on Mar 17, 2025
  7

• Potential Memory Leak in Response Buffer

  buggood first issuehelp wanted
  Lightning-AI/LitServe#452 · Filter by author aniketmaurya opened on Mar 12, 2025
  7

• Allow to pass default_response_class e.g. ORJSONResponse to LitServe server

  enhancementwon't fix
  Lightning-AI/LitServe#436 · Filter by author AleksanderWWW opened on Feb 23, 2025
  7

• Allow resource release at the end of life of the LitAPI object

  enhancementwon't fix
  Lightning-AI/LitServe#420 · Filter by author Alexandre-SCHOEPP opened on Feb 3, 2025
  3

• Decouple API interface from batching configuration

  enhancement
  Lightning-AI/LitServe#412 · Filter by author marrrcin opened on Jan 14, 2025
  7