Skip to content

Commit

Permalink
Neuron SDK Release 2.15.1
Browse files Browse the repository at this point in the history
  • Loading branch information
awsjoshir committed Nov 9, 2023
1 parent e7e2245 commit b8d6165
Show file tree
Hide file tree
Showing 7 changed files with 100 additions and 8 deletions.
3 changes: 1 addition & 2 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
![neuron](./images/Site-Merch_Neuron-ML-SDK_Editorial.png)

# AWS Neuron
# AWS Neuron

## Neuron SDK Overview

Expand All @@ -14,4 +14,3 @@ For full documentations including user guide, Howtos and Tutorials see [Neuron S

## Support
If none of the github and online resources have an answer to your question, checkout the AWS Neuron [support forum](https://forums.aws.amazon.com/forum.jspa?forumID=355).

2 changes: 1 addition & 1 deletion conf.py
Original file line number Diff line number Diff line change
Expand Up @@ -142,7 +142,7 @@
#top_banner_message="<span>&#9888;</span><a class='reference internal' style='color:white;' href='https://awsdocs-neuron.readthedocs-hosted.com/en/latest/general/setup/setup-troubleshooting.html#gpg-key-update'> Neuron repository GPG key for Ubuntu installation has expired, see instructions how to update! </a>"


top_banner_message="Neuron 2.15.0 is released! check <a class='reference internal' style='color:white;' href='https://awsdocs-neuron.readthedocs-hosted.com/en/latest/release-notes/index.html#latest-neuron-release'> What's New </a> and <a class='reference internal' style='color:white;' href='https://awsdocs-neuron.readthedocs-hosted.com/en/latest/general/announcements/index.html'> Announcements </a>"
top_banner_message="Neuron 2.15.1 is released! check <a class='reference internal' style='color:white;' href='https://awsdocs-neuron.readthedocs-hosted.com/en/latest/release-notes/index.html#latest-neuron-release'> What's New </a> and <a class='reference internal' style='color:white;' href='https://awsdocs-neuron.readthedocs-hosted.com/en/latest/general/announcements/index.html'> Announcements </a>"


html_theme = "sphinx_book_theme"
Expand Down
12 changes: 12 additions & 0 deletions neuron-runtime/nrt-troubleshoot.rst
Original file line number Diff line number Diff line change
Expand Up @@ -264,6 +264,18 @@ Report issue to Neuron by posting the relevant details on GitHub
`issues <https://github.com/aws/aws-neuron-sdk/issues>`__.




RuntimeError: module compiled against API version 0xf but this version of numpy is 0xe
--------------------------------------------------------------------------------------
This usally means that the numpy version used during compilation is different than the one used when executing the model.
As of Neuron SDK release 2.15, numpy versions supported in Neuron SDK are following: numpy<=1.25.2, >=1.22.2. Check and confirm the right
numpy version is installed and re-compile/execute the model.





Memory Errors
$$$$$$$$$$$$$

Expand Down
11 changes: 8 additions & 3 deletions release-notes/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -11,6 +11,11 @@ What's New
.. _neuron-2.15.0-whatsnew:


Neuron 2.15.1 (11/09/2023)
--------------------------
Patch release to fix execution overhead issues in Neuron Runtime that were inadvertently introduced in 2.15 release.



Neuron 2.15.0 (10/26/2023)
--------------------------
Expand Down Expand Up @@ -297,15 +302,15 @@ Release Artifacts

Trn1 packages

.. program-output:: python3 src/helperscripts/n2-helper.py --list=packages --instance=trn1 --file=src/helperscripts/n2-manifest.json --neuron-version=2.15.0
.. program-output:: python3 src/helperscripts/n2-helper.py --list=packages --instance=trn1 --file=src/helperscripts/n2-manifest.json --neuron-version=2.15.1

Inf2 packages

.. program-output:: python3 src/helperscripts/n2-helper.py --list=packages --instance=inf2 --file=src/helperscripts/n2-manifest.json --neuron-version=2.15.0
.. program-output:: python3 src/helperscripts/n2-helper.py --list=packages --instance=inf2 --file=src/helperscripts/n2-manifest.json --neuron-version=2.15.1

Inf1 packages

.. program-output:: python3 src/helperscripts/n2-helper.py --list=packages --instance=inf1 --file=src/helperscripts/n2-manifest.json --neuron-version=2.15.0
.. program-output:: python3 src/helperscripts/n2-helper.py --list=packages --instance=inf1 --file=src/helperscripts/n2-manifest.json --neuron-version=2.15.1


Previous Releases
Expand Down
17 changes: 17 additions & 0 deletions release-notes/prev/content.rst
Original file line number Diff line number Diff line change
Expand Up @@ -7,6 +7,23 @@ Previous Releases Artifacts (Neuron 2.x)
:local:
:depth: 1

Neuron 2.15.0 (10/26/2023)
--------------------------------------

Trn1 packages
^^^^^^^^^^^^^

.. program-output:: python3 src/helperscripts/n2-helper.py --list=packages --instance=trn1 --file=src/helperscripts/n2-manifest.json --neuron-version=2.15.0

Inf2 packages
^^^^^^^^^^^^^
.. program-output:: python3 src/helperscripts/n2-helper.py --list=packages --instance=inf2 --file=src/helperscripts/n2-manifest.json --neuron-version=2.15.0

Inf1 packages
^^^^^^^^^^^^^
.. program-output:: python3 src/helperscripts/n2-helper.py --list=packages --instance=inf1 --file=src/helperscripts/n2-manifest.json --neuron-version=2.15.0



Neuron 2.14.1 (09/26/2023)
--------------------------------------
Expand Down
9 changes: 9 additions & 0 deletions release-notes/runtime/aws-neuronx-runtime-lib/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -33,6 +33,15 @@ NEFF Version Runtime Version Range Notes
============ ===================== ===================================


Neuron Runtime Library [2.18.15.0]
---------------------------------
Date: 11/09/2023

Bug fixes
^^^^^^^^^
* Removed unnecessary data collection during execution logging which could impact performance.


Neuron Runtime Library [2.18.14.0]
---------------------------------
Date: 10/26/2023
Expand Down
54 changes: 52 additions & 2 deletions src/helperscripts/n2-manifest.json
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,8 @@
{"repo_type":"rpm", "repo_url":"https://yum.repos.neuron.amazonaws.com/"},
{"repo_type":"deb", "repo_url":"https://apt.repos.neuron.amazonaws.com/"}
],
"manifest_date": "2023-10-26",
"manifest_version": "2.15.0",
"manifest_date": "2023-11-08",
"manifest_version": "2.15.1",
"latest_release": [
{"instance":"inf1", "version":"2.15.0"},
{"instance":"trn1", "version":"2.15.0"},
Expand Down Expand Up @@ -86,6 +86,56 @@
{"name":"neuronx_distributed","component":"Neuron Distributed","category":"na","package_type":"os","use_cases":["inference","training"],"pin_major":"false"}
],
"neuron_releases": [
{"neuron_version":"2.15.1", "packages": [
{"name":"aws-neuronx-collectives","version":"2.18.19.0","supported_instances":["trn1","inf2"],"supported_python_versions":[]},
{"name":"aws-neuronx-dkms","version":"2.14.5.0","supported_instances":["inf1","trn1","inf2"],"supported_python_versions":[]},
{"name":"aws-neuronx-gpsimd-customop-lib","version":"0.8.1.0","supported_instances":["trn1","inf2"],"supported_python_versions":[]},
{"name":"aws-neuronx-gpsimd-tools","version":"0.8.0.0","supported_instances":["trn1","inf2"],"supported_python_versions":[]},
{"name":"aws-neuronx-k8-plugin","version":"2.18.3.0","supported_instances":["inf1","trn1","inf2"],"supported_python_versions":[]},
{"name":"aws-neuronx-k8-scheduler","version":"2.18.3.0","supported_instances":["inf1","trn1","inf2"],"supported_python_versions":[]},
{"name":"aws-neuronx-oci-hook","version":"2.2.27.0","supported_instances":["inf1","trn1","inf2"],"supported_python_versions":[]},
{"name":"aws-neuronx-runtime-discovery","version":"2.9","supported_instances":["trn1","inf2"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"aws-neuronx-runtime-lib","version":"2.18.15.0","supported_instances":["trn1","inf2"],"supported_python_versions":[]},
{"name":"aws-neuronx-tools","version":"2.15.4.0","supported_instances":["inf1","trn1","inf2"],"supported_python_versions":[]},
{"name":"dmlc_nnvm","version":"1.18.1.0","supported_instances":["inf1"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"dmlc_topi","version":"1.18.1.0","supported_instances":["inf1"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"dmlc_tvm","version":"1.18.1.0","supported_instances":["inf1"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"inferentia_hwm","version":"1.16.1.0","supported_instances":["inf1"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"libneuronxla","version":"1.0.680","supported_instances":["trn1","inf2"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"libneuronxla","version":"0.5.570","supported_instances":["trn1","inf2"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"mx_neuron","version":"1.8.0.2.4.25.0","supported_instances":["inf1"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"mxnet_neuron","version":"1.5.1.1.10.0.0","supported_instances":["inf1"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"neuron-cc","version":"1.20.3.0","supported_instances":["inf1"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"neuronperf","version":"1.8.9.0","supported_instances":["inf1"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"neuronx-cc","version":"2.11.0.34","supported_instances":["trn1","inf2"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"neuronx_distributed","version":"0.5.0","supported_instances":["trn1","inf2"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"neuronx_hwm","version":"2.11.0.2","supported_instances":["trn1","inf2"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"tensorboard-plugin-neuronx","version":"2.5.43.0","supported_instances":["trn1","inf2"],"supported_python_versions":[]},
{"name":"tensorflow-model-server-neuronx","version":"2.10.1.2.10.2.0","supported_instances":["inf1","trn1","inf2"],"supported_python_versions":[]},
{"name":"tensorflow-model-server-neuronx","version":"2.7.4.2.10.2.0","supported_instances":["inf1","trn1","inf2"],"supported_python_versions":[]},
{"name":"tensorflow-model-server-neuronx","version":"2.8.4.2.10.2.0","supported_instances":["inf1","trn1","inf2"],"supported_python_versions":[]},
{"name":"tensorflow-model-server-neuronx","version":"2.9.3.2.10.2.0","supported_instances":["inf1","trn1","inf2"],"supported_python_versions":[]},
{"name":"tensorflow-neuron","version":"2.10.1.2.10.2.0","supported_instances":["inf1"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"tensorflow-neuron","version":"2.7.4.2.10.2.0","supported_instances":["inf1"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"tensorflow-neuron","version":"2.8.4.2.10.2.0","supported_instances":["inf1"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"tensorflow-neuron","version":"2.9.3.2.10.2.0","supported_instances":["inf1"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"tensorflow-neuronx","version":"2.10.1.2.1.0","supported_instances":["trn1","inf2"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"tensorflow-neuronx","version":"2.7.4.2.1.0","supported_instances":["trn1","inf."],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"tensorflow-neuronx","version":"2.8.4.2.1.0","supported_instances":["trn1","inf2"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"tensorflow-neuronx","version":"2.9.3.2.1.0","supported_instances":["trn1","inf2"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"torch-neuron","version":"1.10.2.2.9.6.0","supported_instances":["inf1"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"torch-neuron","version":"1.11.0.2.9.6.0","supported_instances":["inf1"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"torch-neuron","version":"1.12.1.2.9.6.0","supported_instances":["inf1"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"torch-neuron","version":"1.13.1.2.9.6.0","supported_instances":["inf1"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"torch-neuron","version":"1.9.1.2.9.6.0","supported_instances":["inf1"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"torch-neuronx","version":"1.13.1.1.12.1","supported_instances":["trn1","inf2"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"torch-neuronx","version":"2.0.0.2.0.1b0","supported_instances":["trn1","inf2"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"torch_xla","version":"1.13.1+torchneuronc","supported_instances":["trn1","inf2"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"torch_xla","version":"2.0.0+torchneuron0","supported_instances":["trn1","inf2"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"transformers-neuronx","version":"0.8.268","supported_instances":["trn1","inf2"],"supported_python_versions":["3.8","3.9","3.10"]},
{"name":"efa-installer","version":"na","supported_instances":["trn1"],"supported_python_versions":[]},
{"name":"libnrt.so","version":"2.18.15","supported_instances":["inf1"],"supported_python_versions":[]}
]},
{"neuron_version":"2.15.0", "packages": [
{"name":"aws-neuronx-collectives","version":"2.18.18.0","supported_instances":["trn1","inf2"],"supported_python_versions":[]},
{"name":"aws-neuronx-dkms","version":"2.14.5.0","supported_instances":["inf1","trn1","inf2"],"supported_python_versions":[]},
Expand Down

0 comments on commit b8d6165

Please sign in to comment.