Go - Cancel Job by close channel


  • Close a channel to broadcast cancellation
  • No way to know a channel is closed or not, so need another channel to indicate a channel is closed
  • This example shows when "done" channel is closed, there is still some work not done, some new messages are sent to channel
    So need consume all messages from channel when a "done channel" is closed



沒有留言:

張貼留言

Lessons Learned While Benchmarking vLLM with GPU

Recently, I benchmarked vLLM on a GPU to better understand how much throughput can realistically be expected in an LLM serving setup. One ...