Update for 1.1.0 / 19.04 release

Dockerfile

@@ -79,8 +79,8 @@ RUN cd pytorch && \
 ############################################################################
 FROM ${TENSORFLOW_IMAGE} AS trtserver_build
 
-ARG TRTIS_VERSION=1.1.0dev
-ARG TRTIS_CONTAINER_VERSION=19.04dev
+ARG TRTIS_VERSION=1.1.0
+ARG TRTIS_CONTAINER_VERSION=19.04
 ARG PYVER=3.5
 
 # The TFServing release branch must match the TF release used by
@@ -200,8 +200,8 @@ ENTRYPOINT ["/opt/tensorrtserver/nvidia_entrypoint.sh"]
 ############################################################################
 FROM ${BASE_IMAGE}
 
-ARG TRTIS_VERSION=1.1.0dev
-ARG TRTIS_CONTAINER_VERSION=19.04dev
+ARG TRTIS_VERSION=1.1.0
+ARG TRTIS_CONTAINER_VERSION=19.04
 ARG PYVER=3.5
 
 ENV TENSORRT_SERVER_VERSION ${TRTIS_VERSION}

README.rst

@@ -30,13 +30,192 @@
 NVIDIA TensorRT Inference Server
 ================================
 
-    **NOTE: You are currently on the r19.04 branch which tracks
-    stabilization towards the next release. This branch is not usable
-    during stabilization.**
-
 .. overview-begin-marker-do-not-remove
 
+The NVIDIA TensorRT Inference Server provides a cloud inferencing
+solution optimized for NVIDIA GPUs. The server provides an inference
+service via an HTTP or gRPC endpoint, allowing remote clients to
+request inferencing for any model being managed by the server.
+
+What's New In 1.1.0
+-------------------
+
+* Client libraries and examples now build with a separate Makefile (a
+  Dockerfile is also included for convenience).
+
+* Input or output tensors with variable-size dimensions (indicated
+  by -1 in the model configuration) can now represent tensors where
+  the variable dimension has value 0 (zero).
+
+* Zero-sized input and output tensors are now supported for batching
+  models. This enables the inference server to support models that
+  require inputs and outputs that have shape [ batch-size ].
+
+* TensorFlow custom operations (C++) can now be built into the
+  inference server. An example and documentation are included in this
+  release.
+
+Features
+--------
+
+* `Multiple framework support
+  <https://docs.nvidia.com/deeplearning/sdk/tensorrt-inference-server-guide/docs/model_repository.html#framework-model-definition>`_. The
+  server can manage any number and mix of models (limited by system
+  disk and memory resources). Supports TensorRT, TensorFlow GraphDef,
+  TensorFlow SavedModel and Caffe2 NetDef model formats. Also supports
+  TensorFlow-TensorRT integrated models. Variable-size input and
+  output tensors are allowed if supported by the framework. See
+  `Capabilities
+  <https://docs.nvidia.com/deeplearning/sdk/tensorrt-inference-server-guide/docs/capabilities.html#capabilities>`_
+  for detailed support information for each framework.
+
+* `Concurrent model execution support
+  <https://docs.nvidia.com/deeplearning/sdk/tensorrt-inference-server-guide/docs/model_configuration.html#instance-groups>`_. Multiple
+  models (or multiple instances of the same model) can run
+  simultaneously on the same GPU.
+
+* Batching support. For models that support batching, the server can
+  accept requests for a batch of inputs and respond with the
+  corresponding batch of outputs. The inference server also supports
+  multiple `scheduling and batching
+  <https://docs.nvidia.com/deeplearning/sdk/tensorrt-inference-server-guide/docs/model_configuration.html#scheduling-and-batching>`_
+  algorithms that combine individual inference requests together to
+  improve inference throughput. These scheduling and batching
+  decisions are transparent to the client requesting inference.
+
+* `Custom backend support
+  <https://docs.nvidia.com/deeplearning/sdk/tensorrt-inference-server-guide/docs/model_repository.html#custom-backends>`_. The inference server
+  allows individual models to be implemented with custom backends
+  instead of by a deep-learning framework. With a custom backend a
+  model can implement any logic desired, while still benefiting from
+  the GPU support, concurrent execution, dynamic batching and other
+  features provided by the server.
+
+* Multi-GPU support. The server can distribute inferencing across all
+  system GPUs.
+
+* The inference server `monitors the model repository
+  <https://docs.nvidia.com/deeplearning/sdk/tensorrt-inference-server-guide/docs/model_repository.html#modifying-the-model-repository>`_
+  for any change and dynamically reloads the model(s) when necessary,
+  without requiring a server restart. Models and model versions can be
+  added and removed, and model configurations can be modified while
+  the server is running.
+
+* `Model repositories
+  <https://docs.nvidia.com/deeplearning/sdk/tensorrt-inference-server-guide/docs/model_repository.html#>`_
+  may reside on a locally accessible file system (e.g. NFS) or in
+  Google Cloud Storage.
+
+* Readiness and liveness `health endpoints
+  <https://docs.nvidia.com/deeplearning/sdk/tensorrt-inference-server-guide/docs/http_grpc_api.html#health>`_
+  suitable for any orchestration or deployment framework, such as
+  Kubernetes.
+
+* `Metrics
+  <https://docs.nvidia.com/deeplearning/sdk/tensorrt-inference-server-guide/docs/metrics.html>`_
+  indicating GPU utiliization, server throughput, and server latency.
+
 .. overview-end-marker-do-not-remove
 
+The current release of the TensorRT Inference Server is 1.1.0 and
+corresponds to the 19.04 release of the tensorrtserver container on
+`NVIDIA GPU Cloud (NGC) <https://ngc.nvidia.com>`_. The branch for
+this release is `r19.04
+<https://github.com/NVIDIA/tensorrt-inference-server/tree/r19.04>`_.
+
+Backwards Compatibility
+-----------------------
+
+Continuing in version 1.1.0 the following interfaces maintain
+backwards compatibilty with the 1.0.0 release. If you have model
+configuration files, custom backends, or clients that use the
+inference server HTTP or GRPC APIs (either directly or through the
+client libraries) from releases prior to 1.0.0 (19.03) you should edit
+and rebuild those as necessary to match the version 1.0.0 APIs.
+
+These inferfaces will maintain backwards compatibility for all future
+1.x.y releases (see below for exceptions):
+
+* Model configuration as defined in `model_config.proto
+  <https://github.com/NVIDIA/tensorrt-inference-server/blob/master/src/core/model_config.proto>`_.
+
+* The inference server HTTP and GRPC APIs as defined in `api.proto
+  <https://github.com/NVIDIA/tensorrt-inference-server/blob/master/src/core/api.proto>`_
+  and `grpc_service.proto
+  <https://github.com/NVIDIA/tensorrt-inference-server/blob/master/src/core/grpc_service.proto>`_.
+
+* The custom backend interface as defined in `custom.h
+  <https://github.com/NVIDIA/tensorrt-inference-server/blob/master/src/servables/custom/custom.h>`_.
+
+As new features are introduced they may temporarily have beta status
+where they are subject to change in non-backwards-compatible
+ways. When they exit beta they will conform to the
+backwards-compatibility guarantees described above. Currently the
+following features are in beta:
+
+* In the model configuration defined in `model_config.proto
+  <https://github.com/NVIDIA/tensorrt-inference-server/blob/master/src/core/model_config.proto>`_
+  the sections related to model ensembling are currently in beta. In
+  particular, the ModelEnsembling message will potentially undergo
+  non-backwards-compatible changes.
+
+
+Documentation
+-------------
+
+The User Guide, Developer Guide, and API Reference `documentation
+<https://docs.nvidia.com/deeplearning/sdk/tensorrt-inference-server-guide/docs/index.html>`_
+provide guidance on installing, building and running the latest
+release of the TensorRT Inference Server.
+
+You can also view the documentation for the `master branch
+<https://docs.nvidia.com/deeplearning/sdk/tensorrt-inference-server-master-branch-guide/docs/index.html>`_
+and for `earlier releases
+<https://docs.nvidia.com/deeplearning/sdk/inference-server-archived/index.html>`_.
+
+The `Release Notes
+<https://docs.nvidia.com/deeplearning/sdk/inference-release-notes/index.html>`_
+and `Support Matrix
+<https://docs.nvidia.com/deeplearning/dgx/support-matrix/index.html>`_
+indicate the required versions of the NVIDIA Driver and CUDA, and also
+describe which GPUs are supported by the inference server.
+
+Blog Posts
+^^^^^^^^^^
+
+* `NVIDIA TensorRT Inference Server Boosts Deep Learning Inference
+  <https://devblogs.nvidia.com/nvidia-serves-deep-learning-inference/>`_.
+
+* `GPU-Accelerated Inference for Kubernetes with the NVIDIA TensorRT
+  Inference Server and Kubeflow
+  <https://www.kubeflow.org/blog/nvidia_tensorrt/>`_.
+
+Contributing
+------------
+
+Contributions to TensorRT Inference Server are more than welcome. To
+contribute make a pull request and follow the guidelines outlined in
+the `Contributing <CONTRIBUTING.md>`_ document.
+
+Reporting problems, asking questions
+------------------------------------
+
+We appreciate any feedback, questions or bug reporting regarding this
+project. When help with code is needed, follow the process outlined in
+the Stack Overflow (https://stackoverflow.com/help/mcve)
+document. Ensure posted examples are:
+
+* minimal – use as little code as possible that still produces the
+  same problem
+
+* complete – provide all parts needed to reproduce the problem. Check
+  if you can strip external dependency and still show the problem. The
+  less time we spend on reproducing problems the more time we have to
+  fix it
+
+* verifiable – test the code you're about to provide to make sure it
+  reproduces the problem. Remove all other problems that are not
+  related to your request/question.
+
 .. |License| image:: https://img.shields.io/badge/License-BSD3-lightgrey.svg
    :target: https://opensource.org/licenses/BSD-3-Clause

VERSION

@@ -1 +1 @@
-1.1.0dev
+1.1.0