Go - goroutine

  • Run f() in another goroutine: go f()
  • To produce a race condition issue, can make for loop larger


沒有留言:

張貼留言

Lessons Learned While Benchmarking vLLM with GPU

Recently, I benchmarked vLLM on a GPU to better understand how much throughput can realistically be expected in an LLM serving setup. One ...