A case for managed and model-less inference serving
The Morning Paper
JUNE 13, 2019
As we saw with the SOAP paper last time out, even with a fixed model variant and hardware there are a lot of different ways to map a training workload over the available hardware. First off there still is a model of course (but then there are servers hiding behind a serverless abstraction too!). autoscaling). autoscaling).
Let's personalize your content