Files
fission-src/environments/tensorflow-serving
Ta-Ching ChenandGitHub c33f1e112e Fix reverse proxy shows 404 not found when Istio enabled (#1377)
Istio sidecar proxy blocks all requests sent through the reverse proxy
to the target service if the request.Host is not properly set to the
internal target service host. This PR sets the target service hosts
before establishing the proxy for the client in order to pass the
Istio sidecar proxy check.
2019-11-04 21:59:40 +08:00
..
2019-07-15 16:33:26 +08:00

Fission: Tensorflow Serving Environment

This is the Tensorflow Serving environment for Fission.

It's a Docker image containing a Go runtime, along with a tensorflow serving service.

How it works

Tensorflow Serving is an serving service that supports both RESTful API and gRPC endpoints. In current implementation, Go server launches tensorflow_model_server to load in model during specialization. As long as the Go server receives requests from router it creates a reverse proxy that connects to RESTful API endpoint exposed by tensorflow_model_server and get response from the upstream server for user.

Build this image

docker build -t USER/tensorflow-serving . && docker push USER/tensorflow-serving

Using the image in fission

You can add this customized image to fission with "fission env create":

fission env create --name tensorflow --image USER/tensorflow-serving --version 2

After this, fission functions that have the env parameter set to the same environment name as this command will use this environment.