Tensorfuse helps you run serverless GPUs on private cloud. You can deploy any custom or open-source ML model and will auto-scale wrt to the number of http request your app receives. Automatically scale down to 0 and upto required number of GPU nodes.
We have achieved cold starts of 20 secs on warm nodes.