Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

v23.01 #13

Merged
merged 29 commits into from
Jan 12, 2023
Merged

v23.01 #13

merged 29 commits into from
Jan 12, 2023

Conversation

jishminor
Copy link
Member

@jishminor jishminor commented Jan 12, 2023 •
edited
Loading

The following changes have been made:

  • Bug fixes for dynamically batched inference requests
  • Improve testing of backend for verification of correct thread pool counts and model config validation
  • A quick patch attempts to address Concurrent ArmNN CpuAcc Delegate Inference #5, and prevents the backend from segfaulting, however it also means that the number of armnn threads is locked to the number set by the first model that requests it. There will have to be major implementation changes for a fully fledged solution which would likely involving forking a separate process per tflite model managed by the backend

@jishminor
Apply formatting to cmake file and fix compile def
38dfddf
@jishminor
Merge branch 'patch/compiledef' into 'dev'
7301f79 
Patch/compiledef

See merge request arm-research/smarter/armnn_tflite_backend!29
@jishminor
Update ArmNN/ACL pin to 21.11
ec60d69
@jishminor
Merge branch 'feature/armnn-version-update' into 'dev'
47bae22 
Update ArmNN/ACL pin to 21.11

See merge request arm-research/smarter/armnn_tflite_backend!30
@jishminor
Update build logic to make tflite external project. Also roll armnn/a…
4c61a7a 
…cl pin to 22.05
@jishminor
Fix static link of tflite
bfc22a9
@jishminor
Fix xnnpack linking
3d833d0
@jishminor
Fix missing tflite libs
603ce1e
@jishminor
Fix linking order of tflite static libs
d53a4a4
@jishminor
Revert to fetch content declare for tflite and add armnn delegate cma…
87bce0d 
…ke patch
@jishminor
Ensure tf root var defined
a04e391
@jishminor
Checkpoint update to 22.08
9717c71
@jishminor
Log number of nodes delegated for xnnpack and armnn
175cc0c
@jishminor
Make delegation information info log level
f576f20
@jishminor
Revert default tflite tag to v2.4.1 to avoid auto apply of xnnpack de…
14d68d6 
…legate
@jishminor
Fix inclusion of std libs
56aaefc
@jishminor
Update README triton build instructions
f1650e7 
Signed-off-by: Josh Minor <[email protected]>
@jishminor
unlfs
d021eda 
Signed-off-by: Josh Minor <[email protected]>
@jishminor
Add github ci (#1)
2abf022 
* Add initial ci pipeline

Signed-off-by: Josh Minor <[email protected]>

* Add dev to target pr branches for actions

Signed-off-by: Josh Minor <[email protected]>

* Use triton branch as workflow var

Signed-off-by: Josh Minor <[email protected]>

* Add triton build action

Signed-off-by: Josh Minor <[email protected]>

* Transfer backend to test via artifacts

Signed-off-by: Josh Minor <[email protected]>

* Add instructions for testing locally

* Add matrix for arm64 build test

Signed-off-by: Josh Minor <[email protected]>

* Update readme and rename workflow build file

Signed-off-by: Josh Minor <[email protected]>

* Remove act from ci

Signed-off-by: Josh Minor <[email protected]>

* Codeql init earlier in build job

Signed-off-by: Josh Minor <[email protected]>

* Fix warnings

Signed-off-by: Josh Minor <[email protected]>

* Set checkout fetch depth to 0

Signed-off-by: Josh Minor <[email protected]>

* Remove codeql for cppcheck as codeql doesn't support arm64

Signed-off-by: Josh Minor <[email protected]>

* Remove cpp check action

Signed-off-by: Josh Minor <[email protected]>

* Trigger triton build and push job

Signed-off-by: Josh Minor <[email protected]>

* Use container for triton builds

Signed-off-by: Josh Minor <[email protected]>

* Install docker cli in container

Signed-off-by: Josh Minor <[email protected]>

* Fix image naming for triton builds

Signed-off-by: Josh Minor <[email protected]>

* Add correct permissions to job to push

Signed-off-by: Josh Minor <[email protected]>

* Split triton build into a build matrix to improve perf

Signed-off-by: Josh Minor <[email protected]>

* Fix matrix arch in test image

Signed-off-by: Josh Minor <[email protected]>

* Add option to specify compiler launcher for backend deps

Signed-off-by: Josh Minor <[email protected]>

* Only run build ci on relevant file changes

Signed-off-by: Josh Minor <[email protected]>

* Format conftest.py

Signed-off-by: Josh Minor <[email protected]>

* Fix workflow badge

Signed-off-by: Josh Minor <[email protected]>
@jishminor
Update build ci to only run on push to main and improve pr trigger types
3c9ffc2 
Signed-off-by: Josh Minor <[email protected]>
@jishminor
Remove errant call to AllocateTensors during model init (#3)
91d86b4 
Signed-off-by: Josh Minor <[email protected]>
@jishminor
Add thread count test and improve test composability (#6)
1353ce7 
Signed-off-by: Josh Minor <[email protected]>
@jishminor
Disable fail fast in triton build job (#8)
92eed97 
Signed-off-by: Josh Minor <[email protected]>
@jishminor
Fix regex parsing of triton branch names (#9)
c3aa581 
Signed-off-by: Josh Minor <[email protected]>
@jishminor
Support parallel execution of tests (#7)
bbd3232 
Signed-off-by: Josh Minor <[email protected]>
@jishminor
Add test for successive armnn model loads with diff thread counts (#10)
7aa5140 
Signed-off-by: Josh Minor <[email protected]>
@jishminor
Improve thread count test robustness (#11)
763c764 
Signed-off-by: Josh Minor <[email protected]>
@jishminor
Improve model configuration validation (#12)
1326403 
Signed-off-by: Josh Minor <[email protected]>
@jishminor
Merge branch 'main' into dev
97f64ca
@jishminor jishminor merged commit a16af2d into main Jan 12, 2023
jishminor added a commit that referenced this pull request Jan 13, 2023
@jishminor
Revert "v23.01 (#13)"
17f1228 
This reverts commit a16af2d.
@jishminor jishminor mentioned this pull request Jan 13, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@jishminor