TensorRT speeds up one video by using eight GPUs
NVIDIA reports generation falling from 156.6 to 34.2 seconds on its example workload. The eight-device layout also changes how much capacity remains for other requests.
TensorRT
Guides, news and explanations about AI and reliable systems.