Add experimental environment: tensorflow-serving (#1212)

This commit is contained in:
Ta-Ching Chen
2019-07-02 15:43:55 +08:00
committed by GitHub
parent 2ba66afb9f
commit b229d6e1b0
13 changed files with 408 additions and 30 deletions
+29
View File
@@ -0,0 +1,29 @@
# Fission: Tensorflow Serving Environment
This is the Tensorflow Serving environment for Fission.
It's a Docker image containing a Go runtime, along with a tensorflow serving service.
## How it works
Tensorflow Serving is an serving service that supports both RESTful API and gRPC endpoints. In current implementation,
Go server launches `tensorflow_model_server` to load in model during specialization. As long as the Go server receives
requests from router it creates a reverse proxy that connects to RESTful API endpoint exposed by tensorflow_model_server
and get response from the upstream server for user.
## Build this image
```
docker build -t USER/tensorflow-serving . && docker push USER/tensorflow-serving
```
## Using the image in fission
You can add this customized image to fission with "fission env create":
```
fission env create --name tensorflow --image USER/tensorflow-serving --version 2
```
After this, fission functions that have the env parameter set to the
same environment name as this command will use this environment.