Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

How to use PlaidML backend? #129

Open
samhodge opened this issue Jul 4, 2019 · 21 comments
Open

How to use PlaidML backend? #129

samhodge opened this issue Jul 4, 2019 · 21 comments

Comments

@samhodge
Copy link

samhodge commented Jul 4, 2019

OK I got ngraph working with a simple model project that I am not that interested in but it is working:

see:
wide_deep.zip

tensorflow/models@b4cf230#diff-1bcc2f2c0115147dcbe54cff4c19c431

see attached zip

I see

2019-07-04 08:10:44.309831: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-04 08:10:44.355081: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-04 08:10:44.425585: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-04 08:10:44.487407: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-04 08:10:44.556728: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-04 08:10:44.958639: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-04 08:10:45.309306: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU

How do I make it say using backend PlaidML , cooking your AMD GPU to infinity and beyond?

I quickly checked the docs and couldnt see anything useful.

Sam
@samhodge
Copy link
Author

samhodge commented Jul 4, 2019

Found this:

https://ieee-region6.org/scv-cis/wp-content/uploads/sites/6/2019/03/nGraph_PlaidML.pdf

and this:

https://github.com/NervanaSystems/ngraph/tree/master/src/ngraph/runtime/plaidml

Seems like I need some glue and an instruction manual.

@samhodge
Copy link
Author

samhodge commented Jul 4, 2019

Slim pickings

https://www.google.com/search?q=use+ngraph+backend+plaidml

@samhodge
Copy link
Author

samhodge commented Jul 4, 2019 •
edited
Loading

here is the good news

With Ngraph

2019-07-04 08:45:21.758608: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
Done warm up
Step	Img/sec	total_loss
1	images/sec: 1105.2 +/- 0.0 (jitter = 0.0)	14.299
10	images/sec: 1079.6 +/- 14.7 (jitter = 19.6)	14.299
20	images/sec: 1077.9 +/- 11.9 (jitter = 24.5)	14.299
30	images/sec: 1074.5 +/- 9.6 (jitter = 37.2)	14.299
40	images/sec: 1065.9 +/- 9.4 (jitter = 41.2)	14.298
50	images/sec: 1060.1 +/- 8.9 (jitter = 39.5)	14.298
60	images/sec: 1062.3 +/- 7.8 (jitter = 35.8)	14.299
70	images/sec: 1063.5 +/- 7.5 (jitter = 35.1)	14.299
80	images/sec: 1066.0 +/- 7.0 (jitter = 38.4)	14.298
90	images/sec: 1066.2 +/- 6.8 (jitter = 38.8)	14.298
100	images/sec: 1066.4 +/- 6.4 (jitter = 41.2)	14.298
----------------------------------------------------------------
total images/sec: 1063.79
----------------------------------------------------------------

Without

Step	Img/sec	total_loss
1	images/sec: 564.1 +/- 0.0 (jitter = 0.0)	nan
10	images/sec: 559.9 +/- 4.7 (jitter = 6.6)	nan
20	images/sec: 563.1 +/- 3.2 (jitter = 7.0)	nan
30	images/sec: 565.8 +/- 2.6 (jitter = 9.1)	nan
40	images/sec: 567.0 +/- 2.3 (jitter = 10.4)	nan
50	images/sec: 569.3 +/- 2.4 (jitter = 10.2)	nan
60	images/sec: 570.1 +/- 2.1 (jitter = 10.0)	nan
70	images/sec: 570.3 +/- 1.8 (jitter = 8.8)	nan
80	images/sec: 570.9 +/- 1.7 (jitter = 8.6)	nan
90	images/sec: 570.4 +/- 1.6 (jitter = 8.5)	nan
100	images/sec: 570.7 +/- 1.5 (jitter = 8.9)	nan
----------------------------------------------------------------
total images/sec: 570.05
----------------------------------------------------------------

From
https://github.com/tensorflow/benchmarks/blob/cnn_tf_v1.13_compatible/scripts/tf_cnn_benchmarks/tf_cnn_benchmarks.py

@samhodge
Copy link
Author

samhodge commented Jul 4, 2019

2A894D21-05FB-456B-81CE-864BFFCD06F2
Seems I needed to dig into the code a little deeper

https://github.com/tensorflow/ngraph-bridge/blob/master/python/ngraph_bridge/__init__.in.py

@samhodge
Copy link
Author

samhodge commented Jul 4, 2019

First you need to build the backend as a flag tho the python script

python build_ngtf.py --use_prebuilt_tensorflow --build_plaidml_backend

@samhodge
Copy link
Author

samhodge commented Jul 4, 2019

Nearly there

python wide_deep_test.py 
['CPU', 'INTERPRETER', 'PLAIDML', 'NOP']
WARNING: Logging before flag parsing goes to stderr.
W0704 12:14:30.208918 140735662560128 deprecation_wrapper.py:119] From /Users/sam/dev/models/official/utils/logging/hooks.py:26: The name tf.train.SessionRunHook is deprecated. Please use tf.estimator.SessionRunHook instead.

W0704 12:14:30.209583 140735662560128 deprecation_wrapper.py:119] From /Users/sam/dev/models/official/utils/logging/metric_hook.py:26: The name tf.train.LoggingTensorHook is deprecated. Please use tf.estimator.LoggingTensorHook instead.

W0704 12:14:30.209776 140735662560128 deprecation_wrapper.py:119] From wide_deep_test.py:30: The name tf.logging.set_verbosity is deprecated. Please use tf.compat.v1.logging.set_verbosity instead.

W0704 12:14:30.209871 140735662560128 deprecation_wrapper.py:119] From wide_deep_test.py:30: The name tf.logging.ERROR is deprecated. Please use tf.compat.v1.logging.ERROR instead.

Running tests under Python 3.6.5: /Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/bin/python
[ RUN      ] BaseTest.test_end_to_end_deep
Parsing /var/folders/wy/wxfdgdvn23zbw8q9mmv5q0br0000gq/T/wide_deep_testr1njieie/tmpxxr6lkn0/adult.data
2019-07-04 12:14:32.016116: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2019-07-04 12:14:32.073629: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: PLAIDML
[ERR] 2019-07-04T10:14:32z src/ngraph/runtime/plaidml/plaidml_config.cpp 245	Unrecognized PlaidML backend option: 
[ERR] 2019-07-04T10:14:32z src/ngraph/runtime/plaidml/plaidml_config.cpp 257	PlaidML Backend Specification: "PlaidML[:[device_index][,debug][,help][,list_devices][,eventlog=<filename>][,graphviz=<filename>]]".  For example: "PlaidML", "PlaidML:0,list_devices"
libc++abi.dylib: terminating with uncaught exception of type std::invalid_argument: Invalid parameter supplied to PlaidML backend
Fatal Python error: Aborted

Thread 0x000070000183a000 (most recent call first):
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/threading.py", line 295 in wait
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/queue.py", line 164 in get
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/summary/writer/event_file_writer.py", line 159 in run
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/threading.py", line 916 in _bootstrap_inner
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/threading.py", line 884 in _bootstrap

Current thread 0x00007fff932c9380 (most recent call first):
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1429 in _call_tf_sessionrun
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1341 in _run_fn
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1356 in _do_call
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1350 in _do_run
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1173 in _run
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 950 in run
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/session_manager.py", line 296 in prepare_session
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 647 in create_session
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 871 in create_session
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1205 in _create_session
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1200 in __init__
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 725 in __init__
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1007 in __init__
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 584 in MonitoredTrainingSession
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 1480 in _train_with_estimator_spec
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 1192 in _train_model_default
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 1158 in _train_model
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 367 in train
  File "/Users/sam/dev/models/official/wide_deep/wide_deep.py", line 204 in main
  File "/Users/sam/dev/models/official/utils/testing/integration.py", line 58 in run_synthetic
  File "wide_deep_test.py", line 137 in test_end_to_end_deep
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/unittest/case.py", line 605 in run
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/unittest/case.py", line 653 in __call__
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/unittest/suite.py", line 122 in run
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/unittest/suite.py", line 84 in __call__
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/unittest/suite.py", line 122 in run
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/unittest/suite.py", line 84 in __call__
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/unittest/runner.py", line 176 in run
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/unittest/main.py", line 256 in runTests
  File "/usr/local/Cellar/python/3.6.5/Frameworks/Python.framework/Versions/3.6/lib/python3.6/unittest/main.py", line 95 in __init__
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/absl/testing/absltest.py", line 2200 in _run_and_get_tests_result
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/absl/testing/absltest.py", line 2230 in run_tests
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/absl/testing/absltest.py", line 1963 in _run_in_app
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/absl/testing/absltest.py", line 1855 in main
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/platform/googletest.py", line 55 in g_main
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/absl/app.py", line 251 in _run_main
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/absl/app.py", line 300 in run
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/platform/app.py", line 40 in run
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/platform/googletest.py", line 64 in main_wrapper
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/platform/benchmark.py", line 407 in benchmarks_main
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/platform/googletest.py", line 65 in main
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/platform/test.py", line 64 in main
  File "wide_deep_test.py", line 149 in <module>
*** Received signal 6 ***
*** BEGIN MANGLED STACK TRACE ***
*** END MANGLED STACK TRACE ***

*** Begin stack trace ***
*** End stack trace ***
Abort trap: 6

@samhodge
Copy link
Author

samhodge commented Jul 4, 2019

https://github.com/NervanaSystems/ngraph/blob/master/src/ngraph/runtime/plaidml/plaidml_config.cpp

@samhodge
Copy link
Author

samhodge commented Jul 4, 2019 

>>> print(plaidml.settings.user_settings)
/Users/sam/.plaidml
>>> 
(venv-tf-py3) kaos-new:wide_deep sam$ cat /Users/sam/.plaidml
{
    "PLAIDML_DEVICE_IDS":[
        "metal_amd_radeon_pro_560.0"
    ],
    "PLAIDML_EXPERIMENTAL":false
}

@samhodge
Copy link
Author

samhodge commented Jul 4, 2019

Maybe this helps

https://github.com/plaidml/plaidml/blob/e01321340e0b53568c58348051b52aaca72a7705/testing/configs_test.py

@samhodge
Copy link
Author

samhodge commented Jul 4, 2019

More ideas

https://github.com/Lokad/Adrien/blob/master/src/spikes/2/Adrien.Compiler.PlaidML/Settings.cs

@samhodge
Copy link
Author

samhodge commented Jul 8, 2019

widedeep2.zip
Adding updated script with

PLAIDML:0 as backend

error is as follows


	 [[{{node ngraph_cluster_153}}]]

======================================================================
ERROR: test_end_to_end_wide_deep (__main__.BaseTest)
test_end_to_end_wide_deep (__main__.BaseTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1356, in _do_call
    return fn(*args)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1341, in _run_fn
    options, feed_dict, fetch_list, target_list, run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1429, in _call_tf_sessionrun
    run_metadata)
tensorflow.python.framework.errors_impl.InternalError: Caught exception while executing nGraph computation: Compilation failed: 

program_source:32:7: warning: unused variable 'tid'
  int tid = _tid;
      ^
program_source:134:14: error: call to 'select' is ambiguous
    agg[0] = select((ptrdiff_t)agg[0], (ptrdiff_t)val1, (bool)o0_cond);
             ^~~~~~
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:56:21: note: candidate function
  METAL_FUNC char   select    (char a, char b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:57:21: note: candidate function
  METAL_FUNC uchar  select    (uchar a, uchar b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:58:21: note: candidate function
  METAL_FUNC short  select    (short a, short b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:59:21: note: candidate function
  METAL_FUNC ushort select    (ushort a, ushort b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:60:21: note: candidate function
  METAL_FUNC int    select    (int a, int b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:61:21: note: candidate function
  METAL_FUNC uint   select    (uint a, uint b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:62:21: note: candidate function
  METAL_FUNC half   select    (half a, half b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:63:21: note: candidate function
  METAL_FUNC float  select    (float a, float b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:151:29: note: candidate function
  METAL_FUNC vec<half,2>    select(vec<half,2> a, vec<half,2> b, vec<bool,2> c) { return vec<half,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:152:29: note: candidate function
  METAL_FUNC vec<float,2>   select(vec<float,2> a, vec<float,2> b, vec<bool,2> c) { return vec<float,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:156:29: note: candidate function
  METAL_FUNC vec<half,3>    select(vec<half,3> a, vec<half,3> b, vec<bool,3> c) { return vec<half,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:157:29: note: candidate function
  METAL_FUNC vec<float,3>   select(vec<float,3> a, vec<float,3> b, vec<bool,3> c) { return vec<float,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:161:29: note: candidate function
  METAL_FUNC vec<half,4>    select(vec<half,4> a, vec<half,4> b, vec<bool,4> c) { return vec<half,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:162:29: note: candidate function
  METAL_FUNC vec<float,4>   select(vec<float,4> a, vec<float,4> b, vec<bool,4> c) { return vec<float,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:167:29: note: candidate function
  METAL_FUNC vec<char,2>    select(vec<char,2> a, vec<char,2> b, vec<bool,2> c) { return vec<char,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:168:29: note: candidate function
  METAL_FUNC vec<uchar,2>   select(vec<uchar,2> a, vec<uchar,2> b, vec<bool,2> c) { return vec<uchar,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:169:29: note: candidate function
  METAL_FUNC vec<short,2>   select(vec<short,2> a, vec<short,2> b, vec<bool,2> c) { return vec<short,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:170:29: note: candidate function
  METAL_FUNC vec<ushort,2>  select(vec<ushort,2> a, vec<ushort,2> b, vec<bool,2> c) { return vec<ushort,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:171:29: note: candidate function
  METAL_FUNC vec<int,2>     select(vec<int,2> a, vec<int,2> b, vec<bool,2> c) { return vec<int,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:172:29: note: candidate function
  METAL_FUNC vec<uint,2>    select(vec<uint,2> a, vec<uint,2> b, vec<bool,2> c) { return vec<uint,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:173:29: note: candidate function
  METAL_FUNC vec<char,3>    select(vec<char,3> a, vec<char,3> b, vec<bool,3> c) { return vec<char,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:174:29: note: candidate function
  METAL_FUNC vec<uchar,3>   select(vec<uchar,3> a, vec<uchar,3> b, vec<bool,3> c) { return vec<uchar,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:175:29: note: candidate function
  METAL_FUNC vec<short,3>   select(vec<short,3> a, vec<short,3> b, vec<bool,3> c) { return vec<short,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:176:29: note: candidate function
  METAL_FUNC vec<ushort,3>  select(vec<ushort,3> a, vec<ushort,3> b, vec<bool,3> c) { return vec<ushort,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:177:29: note: candidate function
  METAL_FUNC vec<int,3>     select(vec<int,3> a, vec<int,3> b, vec<bool,3> c) { return vec<int,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:178:29: note: candidate function
  METAL_FUNC vec<uint,3>    select(vec<uint,3> a, vec<uint,3> b, vec<bool,3> c) { return vec<uint,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:179:29: note: candidate function
  METAL_FUNC vec<char,4>    select(vec<char,4> a, vec<char,4> b, vec<bool,4> c) { return vec<char,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:180:29: note: candidate function
  METAL_FUNC vec<uchar,4>   select(vec<uchar,4> a, vec<uchar,4> b, vec<bool,4> c) { return vec<uchar,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:181:29: note: candidate function
  METAL_FUNC vec<short,4>   select(vec<short,4> a, vec<short,4> b, vec<bool,4> c) { return vec<short,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:182:29: note: candidate function
  METAL_FUNC vec<ushort,4>  select(vec<ushort,4> a, vec<ushort,4> b, vec<bool,4> c) { return vec<ushort,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:183:29: note: candidate function
  METAL_FUNC vec<int,4>     select(vec<int,4> a, vec<int,4> b, vec<bool,4> c) { return vec<int,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:184:29: note: candidate function
  METAL_FUNC vec<uint,4>    select(vec<uint,4> a, vec<uint,4> b, vec<bool,4> c) { return vec<uint,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^


	 [[{{node ngraph_cluster_344}}]]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "wide_deep_test.py", line 145, in test_end_to_end_wide_deep
    synth=False, max_train=None)
  File "/Users/sam/dev/models/official/utils/testing/integration.py", line 58, in run_synthetic
    main(args)
  File "/Users/sam/dev/models/official/wide_deep/wide_deep.py", line 204, in main
    model.train(input_fn=train_input_fn, hooks=train_hooks)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 367, in train
    loss = self._train_model(input_fn, hooks, saving_listeners)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 1158, in _train_model
    return self._train_model_default(input_fn, hooks, saving_listeners)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 1192, in _train_model_default
    saving_listeners)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 1484, in _train_with_estimator_spec
    _, loss = mon_sess.run([estimator_spec.train_op, estimator_spec.loss])
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 754, in run
    run_metadata=run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1252, in run
    run_metadata=run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1353, in run
    raise six.reraise(*original_exc_info)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/six.py", line 693, in reraise
    raise value
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1338, in run
    return self._sess.run(*args, **kwargs)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1411, in run
    run_metadata=run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1169, in run
    return self._sess.run(*args, **kwargs)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 950, in run
    run_metadata_ptr)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1173, in _run
    feed_dict_tensor, options, run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1350, in _do_run
    run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1370, in _do_call
    raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InternalError: Caught exception while executing nGraph computation: Compilation failed: 

program_source:32:7: warning: unused variable 'tid'
  int tid = _tid;
      ^
program_source:134:14: error: call to 'select' is ambiguous
    agg[0] = select((ptrdiff_t)agg[0], (ptrdiff_t)val1, (bool)o0_cond);
             ^~~~~~
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:56:21: note: candidate function
  METAL_FUNC char   select    (char a, char b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:57:21: note: candidate function
  METAL_FUNC uchar  select    (uchar a, uchar b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:58:21: note: candidate function
  METAL_FUNC short  select    (short a, short b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:59:21: note: candidate function
  METAL_FUNC ushort select    (ushort a, ushort b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:60:21: note: candidate function
  METAL_FUNC int    select    (int a, int b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:61:21: note: candidate function
  METAL_FUNC uint   select    (uint a, uint b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:62:21: note: candidate function
  METAL_FUNC half   select    (half a, half b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:63:21: note: candidate function
  METAL_FUNC float  select    (float a, float b, bool c) { return c ? b : a; };
                    ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:151:29: note: candidate function
  METAL_FUNC vec<half,2>    select(vec<half,2> a, vec<half,2> b, vec<bool,2> c) { return vec<half,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:152:29: note: candidate function
  METAL_FUNC vec<float,2>   select(vec<float,2> a, vec<float,2> b, vec<bool,2> c) { return vec<float,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:156:29: note: candidate function
  METAL_FUNC vec<half,3>    select(vec<half,3> a, vec<half,3> b, vec<bool,3> c) { return vec<half,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:157:29: note: candidate function
  METAL_FUNC vec<float,3>   select(vec<float,3> a, vec<float,3> b, vec<bool,3> c) { return vec<float,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:161:29: note: candidate function
  METAL_FUNC vec<half,4>    select(vec<half,4> a, vec<half,4> b, vec<bool,4> c) { return vec<half,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:162:29: note: candidate function
  METAL_FUNC vec<float,4>   select(vec<float,4> a, vec<float,4> b, vec<bool,4> c) { return vec<float,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:167:29: note: candidate function
  METAL_FUNC vec<char,2>    select(vec<char,2> a, vec<char,2> b, vec<bool,2> c) { return vec<char,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:168:29: note: candidate function
  METAL_FUNC vec<uchar,2>   select(vec<uchar,2> a, vec<uchar,2> b, vec<bool,2> c) { return vec<uchar,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:169:29: note: candidate function
  METAL_FUNC vec<short,2>   select(vec<short,2> a, vec<short,2> b, vec<bool,2> c) { return vec<short,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:170:29: note: candidate function
  METAL_FUNC vec<ushort,2>  select(vec<ushort,2> a, vec<ushort,2> b, vec<bool,2> c) { return vec<ushort,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:171:29: note: candidate function
  METAL_FUNC vec<int,2>     select(vec<int,2> a, vec<int,2> b, vec<bool,2> c) { return vec<int,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:172:29: note: candidate function
  METAL_FUNC vec<uint,2>    select(vec<uint,2> a, vec<uint,2> b, vec<bool,2> c) { return vec<uint,2>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:173:29: note: candidate function
  METAL_FUNC vec<char,3>    select(vec<char,3> a, vec<char,3> b, vec<bool,3> c) { return vec<char,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:174:29: note: candidate function
  METAL_FUNC vec<uchar,3>   select(vec<uchar,3> a, vec<uchar,3> b, vec<bool,3> c) { return vec<uchar,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:175:29: note: candidate function
  METAL_FUNC vec<short,3>   select(vec<short,3> a, vec<short,3> b, vec<bool,3> c) { return vec<short,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:176:29: note: candidate function
  METAL_FUNC vec<ushort,3>  select(vec<ushort,3> a, vec<ushort,3> b, vec<bool,3> c) { return vec<ushort,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:177:29: note: candidate function
  METAL_FUNC vec<int,3>     select(vec<int,3> a, vec<int,3> b, vec<bool,3> c) { return vec<int,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:178:29: note: candidate function
  METAL_FUNC vec<uint,3>    select(vec<uint,3> a, vec<uint,3> b, vec<bool,3> c) { return vec<uint,3>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:179:29: note: candidate function
  METAL_FUNC vec<char,4>    select(vec<char,4> a, vec<char,4> b, vec<bool,4> c) { return vec<char,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:180:29: note: candidate function
  METAL_FUNC vec<uchar,4>   select(vec<uchar,4> a, vec<uchar,4> b, vec<bool,4> c) { return vec<uchar,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:181:29: note: candidate function
  METAL_FUNC vec<short,4>   select(vec<short,4> a, vec<short,4> b, vec<bool,4> c) { return vec<short,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:182:29: note: candidate function
  METAL_FUNC vec<ushort,4>  select(vec<ushort,4> a, vec<ushort,4> b, vec<bool,4> c) { return vec<ushort,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:183:29: note: candidate function
  METAL_FUNC vec<int,4>     select(vec<int,4> a, vec<int,4> b, vec<bool,4> c) { return vec<int,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^
/System/Library/PrivateFrameworks/GPUCompiler.framework/Versions/3802/Libraries/lib/clang/802.4/include/metal/metal_relational:184:29: note: candidate function
  METAL_FUNC vec<uint,4>    select(vec<uint,4> a, vec<uint,4> b, vec<bool,4> c) { return vec<uint,4>(select(a[0],b[0],c[0]),select(a[1],b[1],c[1]),select(a[2],b[2],c[2]),select(a[3],b[3],c[3]));}
                            ^


	 [[{{node ngraph_cluster_344}}]]

======================================================================
ERROR: test_wide_deep_estimator_training (__main__.BaseTest)
test_wide_deep_estimator_training (__main__.BaseTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1356, in _do_call
    return fn(*args)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1341, in _run_fn
    options, feed_dict, fetch_list, target_list, run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1429, in _call_tf_sessionrun
    run_metadata)
tensorflow.python.framework.errors_impl.InternalError: Caught exception while executing nGraph computation: SC compilation failure
Likely a problem in input program, however cannot be more specific

	 [[{{node ngraph_cluster_495}}]]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "wide_deep_test.py", line 121, in test_wide_deep_estimator_training
    self.build_and_test_estimator('wide_deep')
  File "wide_deep_test.py", line 103, in build_and_test_estimator
    model.train(input_fn=get_input_fn(1, True, 1), steps=1)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 367, in train
    loss = self._train_model(input_fn, hooks, saving_listeners)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 1158, in _train_model
    return self._train_model_default(input_fn, hooks, saving_listeners)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 1192, in _train_model_default
    saving_listeners)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow_estimator/python/estimator/estimator.py", line 1484, in _train_with_estimator_spec
    _, loss = mon_sess.run([estimator_spec.train_op, estimator_spec.loss])
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 754, in run
    run_metadata=run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1252, in run
    run_metadata=run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1353, in run
    raise six.reraise(*original_exc_info)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/six.py", line 693, in reraise
    raise value
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1338, in run
    return self._sess.run(*args, **kwargs)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1411, in run
    run_metadata=run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/training/monitored_session.py", line 1169, in run
    return self._sess.run(*args, **kwargs)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 950, in run
    run_metadata_ptr)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1173, in _run
    feed_dict_tensor, options, run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1350, in _do_run
    run_metadata)
  File "/Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1370, in _do_call
    raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InternalError: Caught exception while executing nGraph computation: SC compilation failure
Likely a problem in input program, however cannot be more specific

	 [[{{node ngraph_cluster_495}}]]

----------------------------------------------------------------------
Ran 6 tests in 17.547s

FAILED (errors=4)

@samhodge
Copy link
Author

samhodge commented Jul 9, 2019

This is what I see from the gtest

(venv-tf-py3) kaos-new:test sam$ pwd
/Users/sam/dev/ngraph-bridge/build_cmake/test
(venv-tf-py3) kaos-new:test sam$ ./gtest_ngtf 
[==========] Running 181 tests from 14 test cases.
[----------] Global test environment set-up.
[----------] 1 test from graph_exec
[ RUN      ] graph_exec.axpy
Calling nGraph function
Tensor<Result_5: 2, 3>{[[6, 6, 6], [6, 6, 6]]}
Tensor<Result_6: 2, 3>{[[5, 5, 5], [5, 5, 5]]}
[       OK ] graph_exec.axpy (48 ms)
[----------] 1 test from graph_exec (48 ms total)

[----------] 3 tests from tf_exec
[ RUN      ] tf_exec.hello_world
2019-07-09 07:35:54.857708: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2019-07-09 07:35:54.859329: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:54.860795: I /Users/sam/dev/ngraph-bridge/test/tf_exec.cpp:61] 19
-3
[       OK ] tf_exec.hello_world (3 ms)
[ RUN      ] tf_exec.axpy
2019-07-09 07:35:54.863587: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
5 5 5 5 5 5 
6 6 6 6 6 6 
[       OK ] tf_exec.axpy (9 ms)
[ RUN      ] tf_exec.BatchMatMul
2019-07-09 07:35:54.870772: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:54.874895: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:54.879077: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:54.882073: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.882893: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.883889: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.884964: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] tf_exec.BatchMatMul (16 ms)
[----------] 3 tests from tf_exec (28 ms total)

[----------] 3 tests from padding
[ RUN      ] padding.valid
[       OK ] padding.valid (0 ms)
[ RUN      ] padding.divisible
[       OK ] padding.divisible (0 ms)
[ RUN      ] padding.indivisible
[       OK ] padding.indivisible (0 ms)
[----------] 3 tests from padding (0 ms total)

[----------] 7 tests from conversions
[ RUN      ] conversions.reshape
[       OK ] conversions.reshape (0 ms)
[ RUN      ] conversions.batch_to_tensorflow_nchw
[       OK ] conversions.batch_to_tensorflow_nchw (0 ms)
[ RUN      ] conversions.batch_to_tensorflow_nhwc
[       OK ] conversions.batch_to_tensorflow_nhwc (0 ms)
[ RUN      ] conversions.batch_to_ngraph_nchw
[       OK ] conversions.batch_to_ngraph_nchw (0 ms)
[ RUN      ] conversions.param_to_ngraph_nchw
[       OK ] conversions.param_to_ngraph_nchw (0 ms)
[ RUN      ] conversions.batch_to_ngraph_nhwc
[       OK ] conversions.batch_to_ngraph_nhwc (0 ms)
[ RUN      ] conversions.param_to_ngraph_nhwc
[       OK ] conversions.param_to_ngraph_nhwc (0 ms)
[----------] 7 tests from conversions (0 ms total)

[----------] 2 tests from AssignClusters
[ RUN      ] AssignClusters.ConstToStatic
[       OK ] AssignClusters.ConstToStatic (0 ms)
[ RUN      ] AssignClusters.Cone
[       OK ] AssignClusters.Cone (0 ms)
[----------] 2 tests from AssignClusters (0 ms total)

[----------] 6 tests from DeadnessCheck
[ RUN      ] DeadnessCheck.livedead1
[       OK ] DeadnessCheck.livedead1 (1 ms)
[ RUN      ] DeadnessCheck.DTestG1
[       OK ] DeadnessCheck.DTestG1 (0 ms)
[ RUN      ] DeadnessCheck.DTestG2
[       OK ] DeadnessCheck.DTestG2 (1 ms)
[ RUN      ] DeadnessCheck.DTestG3
[       OK ] DeadnessCheck.DTestG3 (0 ms)
[ RUN      ] DeadnessCheck.DTestG4New
[       OK ] DeadnessCheck.DTestG4New (0 ms)
[ RUN      ] DeadnessCheck.DTestG5
[       OK ] DeadnessCheck.DTestG5 (1 ms)
[----------] 6 tests from DeadnessCheck (3 ms total)

[----------] 7 tests from BackendManager
[ RUN      ] BackendManager.SetBackend
[       OK ] BackendManager.SetBackend (0 ms)
[ RUN      ] BackendManager.GetSupportedBackendNames
[       OK ] BackendManager.GetSupportedBackendNames (0 ms)
[ RUN      ] BackendManager.BackendAssignment
[       OK ] BackendManager.BackendAssignment (1 ms)
[ RUN      ] BackendManager.BackendClustering
[       OK ] BackendManager.BackendClustering (0 ms)
[ RUN      ] BackendManager.GetBackendAdditionalAttributes
[       OK ] BackendManager.GetBackendAdditionalAttributes (0 ms)
[ RUN      ] BackendManager.GetBackendAttributeValues
[       OK ] BackendManager.GetBackendAttributeValues (0 ms)
[ RUN      ] BackendManager.GetBackendCreationString
[       OK ] BackendManager.GetBackendCreationString (0 ms)
[----------] 7 tests from BackendManager (1 ms total)

[----------] 1 test from EncapsulateClusters
[ RUN      ] EncapsulateClusters.PopulateLibrary
[       OK ] EncapsulateClusters.PopulateLibrary (0 ms)
[----------] 1 test from EncapsulateClusters (0 ms total)

[----------] 4 tests from DisableOps
[ RUN      ] DisableOps.SimpleSettingAndGetting1
[       OK ] DisableOps.SimpleSettingAndGetting1 (0 ms)
[ RUN      ] DisableOps.SimpleSettingAndGetting2
[       OK ] DisableOps.SimpleSettingAndGetting2 (0 ms)
[ RUN      ] DisableOps.SimpleSettingAndGetting3
[       OK ] DisableOps.SimpleSettingAndGetting3 (0 ms)
[ RUN      ] DisableOps.DisableTest
[       OK ] DisableOps.DisableTest (1 ms)
[----------] 4 tests from DisableOps (1 ms total)

[----------] 1 test from MarkForClustering
[ RUN      ] MarkForClustering.SimpleTest
[       OK ] MarkForClustering.SimpleTest (0 ms)
[----------] 1 test from MarkForClustering (0 ms total)

[----------] 61 tests from MathOps
[ RUN      ] MathOps.Abs1D
2019-07-09 07:35:54.894927: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.895095: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Abs1D (5 ms)
[ RUN      ] MathOps.Abs2D
2019-07-09 07:35:54.898804: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.898961: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Abs2D (4 ms)
[ RUN      ] MathOps.Add
2019-07-09 07:35:54.902397: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.902564: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Add (4 ms)
[ RUN      ] MathOps.AddN
2019-07-09 07:35:54.906377: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.907144: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.AddN (4 ms)
[ RUN      ] MathOps.AnyKeepDims
2019-07-09 07:35:54.912975: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.913199: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.AnyKeepDims (6 ms)
[ RUN      ] MathOps.AnyNegativeAxis
2019-07-09 07:35:54.917086: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.917277: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.AnyNegativeAxis (4 ms)
[ RUN      ] MathOps.AnyPositiveAxis
2019-07-09 07:35:54.920915: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.921106: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.AnyPositiveAxis (4 ms)
[ RUN      ] MathOps.AllKeepDims
2019-07-09 07:35:54.925571: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.925759: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.AllKeepDims (5 ms)
[ RUN      ] MathOps.AllNegativeAxis
2019-07-09 07:35:54.929625: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.929798: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.AllNegativeAxis (4 ms)
[ RUN      ] MathOps.AllPositiveAxis
2019-07-09 07:35:54.933252: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.933411: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.AllPositiveAxis (3 ms)
[ RUN      ] MathOps.Sum
2019-07-09 07:35:54.937104: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.937270: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.940693: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.940852: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.944705: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.944911: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.948501: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.948720: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.952486: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.952660: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.956285: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.956482: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Sum (24 ms)
[ RUN      ] MathOps.Mean
2019-07-09 07:35:54.961018: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.961375: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.965457: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.965685: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.969773: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.969964: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.973714: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.973971: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.977995: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.978157: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.981816: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.981976: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Mean (25 ms)
[ RUN      ] MathOps.Prod
2019-07-09 07:35:54.985591: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.985748: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.989194: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.989358: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.993042: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.993212: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:54.996924: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:54.997095: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.000735: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.000895: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.004699: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.004884: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Prod (23 ms)
[ RUN      ] MathOps.ArgMaxNeg
2019-07-09 07:35:55.008880: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.009084: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.ArgMaxNeg (4 ms)
[ RUN      ] MathOps.ArgMaxPos
2019-07-09 07:35:55.012755: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.012927: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.ArgMaxPos (4 ms)
[ RUN      ] MathOps.ArgMinNeg
2019-07-09 07:35:55.016227: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.016384: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.ArgMinNeg (3 ms)
[ RUN      ] MathOps.ArgMinPos
2019-07-09 07:35:55.019751: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.019914: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.ArgMinPos (4 ms)
[ RUN      ] MathOps.BatchMatMul2D
2019-07-09 07:35:55.024741: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.024909: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul2D (18 ms)
[ RUN      ] MathOps.BatchMatMul2DAdjX
2019-07-09 07:35:55.041942: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.042139: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul2DAdjX (4 ms)
[ RUN      ] MathOps.BatchMatMul2DAdjY
2019-07-09 07:35:55.046063: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.046247: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul2DAdjY (4 ms)
[ RUN      ] MathOps.BatchMatMul2DAdjXY
2019-07-09 07:35:55.049817: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.049979: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul2DAdjXY (4 ms)
[ RUN      ] MathOps.BatchMatMul3D
2019-07-09 07:35:55.053833: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.054053: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul3D (4 ms)
[ RUN      ] MathOps.BatchMatMul3DAdjX
2019-07-09 07:35:55.060337: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.060613: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul3DAdjX (7 ms)
[ RUN      ] MathOps.BatchMatMul3DAdjY
2019-07-09 07:35:55.064651: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.064924: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul3DAdjY (4 ms)
[ RUN      ] MathOps.BatchMatMul3DAdjXY
2019-07-09 07:35:55.068903: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.069096: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul3DAdjXY (4 ms)
[ RUN      ] MathOps.BatchMatMul4D
2019-07-09 07:35:55.072963: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.073135: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul4D (4 ms)
[ RUN      ] MathOps.BatchMatMul4DAdjX
2019-07-09 07:35:55.077310: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.077485: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul4DAdjX (4 ms)
[ RUN      ] MathOps.BatchMatMul4DAdjY
2019-07-09 07:35:55.081585: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.081753: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul4DAdjY (4 ms)
[ RUN      ] MathOps.BatchMatMul4DAdjXY
2019-07-09 07:35:55.086038: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.086245: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.BatchMatMul4DAdjXY (4 ms)
[ RUN      ] MathOps.Cast1D
2019-07-09 07:35:55.089523: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.089696: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Cast1D (4 ms)
[ RUN      ] MathOps.Cast2D
2019-07-09 07:35:55.093002: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.093188: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Cast2D (3 ms)
[ RUN      ] MathOps.Exp1D
2019-07-09 07:35:55.099885: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.100120: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Exp1D (7 ms)
[ RUN      ] MathOps.Exp2D
2019-07-09 07:35:55.104657: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.104877: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Exp2D (5 ms)
[ RUN      ] MathOps.FloorDiv
2019-07-09 07:35:55.108444: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.108615: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.FloorDiv (4 ms)
[ RUN      ] MathOps.FloorDivBroadcasting
2019-07-09 07:35:55.112586: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.112793: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.FloorDivBroadcasting (4 ms)
[ RUN      ] MathOps.FloorDivNegFloat
2019-07-09 07:35:55.118244: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.118475: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.FloorDivNegFloat (6 ms)
[ RUN      ] MathOps.FloorMod
2019-07-09 07:35:55.122862: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.123028: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.FloorMod (4 ms)
[ RUN      ] MathOps.FloorModBroadcasting
2019-07-09 07:35:55.129726: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.129948: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.FloorModBroadcasting (7 ms)
[ RUN      ] MathOps.FloorModNegFloat
2019-07-09 07:35:55.134143: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.134370: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.FloorModNegFloat (4 ms)
[ RUN      ] MathOps.Log1D
2019-07-09 07:35:55.137811: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.137960: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Log1D (4 ms)
[ RUN      ] MathOps.Log2D
2019-07-09 07:35:55.141235: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.141425: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Log2D (3 ms)
[ RUN      ] MathOps.LogicalOr
2019-07-09 07:35:55.145273: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.145495: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.LogicalOr (5 ms)
[ RUN      ] MathOps.MaxNegativeAxis
2019-07-09 07:35:55.149926: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.150145: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.MaxNegativeAxis (4 ms)
[ RUN      ] MathOps.MaxPositiveAxis
2019-07-09 07:35:55.154709: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.154920: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.MaxPositiveAxis (5 ms)
[ RUN      ] MathOps.MinNegativeAxis
2019-07-09 07:35:55.159709: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.159994: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.MinNegativeAxis (5 ms)
[ RUN      ] MathOps.MinPositiveAxis
2019-07-09 07:35:55.163787: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.163981: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.MinPositiveAxis (4 ms)
[ RUN      ] MathOps.Minimum
2019-07-09 07:35:55.167584: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.167801: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Minimum (4 ms)
[ RUN      ] MathOps.MinimumBroadcasting
2019-07-09 07:35:55.171518: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.171696: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.MinimumBroadcasting (4 ms)
[ RUN      ] MathOps.Negate
2019-07-09 07:35:55.175091: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.175283: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Negate (3 ms)
[ RUN      ] MathOps.Pow1D
2019-07-09 07:35:55.179431: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.179649: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Pow1D (5 ms)
[ RUN      ] MathOps.Pow2D
2019-07-09 07:35:55.184329: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.184508: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Pow2D (5 ms)
[ RUN      ] MathOps.RealDiv
2019-07-09 07:35:55.188479: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.188650: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.RealDiv (4 ms)
[ RUN      ] MathOps.RealDivBroadcasting
2019-07-09 07:35:55.193011: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.193230: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.RealDivBroadcasting (4 ms)
[ RUN      ] MathOps.Reciprocal
2019-07-09 07:35:55.197511: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.197741: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Reciprocal (5 ms)
[ RUN      ] MathOps.Rsqrt
2019-07-09 07:35:55.201270: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.201444: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Rsqrt (4 ms)
[ RUN      ] MathOps.Square
2019-07-09 07:35:55.204908: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.205082: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Square (3 ms)
[ RUN      ] MathOps.SqueezeNoAttributes
2019-07-09 07:35:55.208562: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.208737: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.212929: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.213155: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.217163: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.217365: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.220940: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.221097: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.SqueezeNoAttributes (16 ms)
[ RUN      ] MathOps.SqueezeWithAttributes
2019-07-09 07:35:55.224740: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.224900: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.229397: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.229633: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.233606: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.233802: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.SqueezeWithAttributes (13 ms)
[ RUN      ] MathOps.Sqrt
2019-07-09 07:35:55.237172: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.237331: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.Sqrt (3 ms)
[ RUN      ] MathOps.SquaredDifference
2019-07-09 07:35:55.240946: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.241113: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.SquaredDifference (4 ms)
[ RUN      ] MathOps.SquaredDifferenceBroadcasting
2019-07-09 07:35:55.245282: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.245479: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] MathOps.SquaredDifferenceBroadcasting (5 ms)
[----------] 61 tests from MathOps (356 ms total)

[----------] 34 tests from NNOps
[ RUN      ] NNOps.BiasAddGrad
2019-07-09 07:35:55.248884: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.249052: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.252602: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.252756: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.256257: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.256429: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.259939: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.260136: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.263573: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.263760: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.BiasAddGrad (18 ms)
[ RUN      ] NNOps.Conv2DBackpropFilterNCHWSame
2019-07-09 07:35:55.269630: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.271050: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.Conv2DBackpropFilterNCHWSame (7 ms)
[ RUN      ] NNOps.Conv2DBackpropFilterNCHWSameWithDilation
[       OK ] NNOps.Conv2DBackpropFilterNCHWSameWithDilation (5 ms)
[ RUN      ] NNOps.Conv2DBackpropFilterNCHWValid
2019-07-09 07:35:55.280330: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.281397: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.Conv2DBackpropFilterNCHWValid (5 ms)
[ RUN      ] NNOps.Conv2DBackpropFilterNCHWValidWithDilation
[       OK ] NNOps.Conv2DBackpropFilterNCHWValidWithDilation (4 ms)
[ RUN      ] NNOps.Conv2DBackpropFilterNHWCSame
2019-07-09 07:35:55.288908: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.289737: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.Conv2DBackpropFilterNHWCSame (5 ms)
[ RUN      ] NNOps.Conv2DBackpropFilterNHWCSameWithDilation
[       OK ] NNOps.Conv2DBackpropFilterNHWCSameWithDilation (3 ms)
[ RUN      ] NNOps.Conv2DBackpropFilterNHWCValid
2019-07-09 07:35:55.298199: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.299077: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.Conv2DBackpropFilterNHWCValid (6 ms)
[ RUN      ] NNOps.Conv2DBackpropFilterNHWCValidWithDilation
[       OK ] NNOps.Conv2DBackpropFilterNHWCValidWithDilation (4 ms)
[ RUN      ] NNOps.Conv2DBackpropInputNCHWSame
2019-07-09 07:35:55.307299: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.308425: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.Conv2DBackpropInputNCHWSame (5 ms)
[ RUN      ] NNOps.Conv2DBackpropInputNCHWSameWithDilation
[       OK ] NNOps.Conv2DBackpropInputNCHWSameWithDilation (4 ms)
[ RUN      ] NNOps.Conv2DBackpropInputNCHWValid
2019-07-09 07:35:55.316602: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.317637: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.Conv2DBackpropInputNCHWValid (6 ms)
[ RUN      ] NNOps.Conv2DBackpropInputNCHWValidWithDilation
[       OK ] NNOps.Conv2DBackpropInputNCHWValidWithDilation (3 ms)
[ RUN      ] NNOps.Conv2DBackpropInputNHWC
2019-07-09 07:35:55.325851: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.327073: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.331506: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.332302: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.Conv2DBackpropInputNHWC (11 ms)
[ RUN      ] NNOps.Conv2DBackpropInputNHWCWithDilation
[       OK ] NNOps.Conv2DBackpropInputNHWCWithDilation (8 ms)
[ RUN      ] NNOps.Conv3DNDHWCSame
2019-07-09 07:35:55.343704: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.343953: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.Conv3DNDHWCSame (4 ms)
[ RUN      ] NNOps.FusedBatchNormV2NHWCInference
2019-07-09 07:35:55.359465: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.395109: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.FusedBatchNormV2NHWCInference (55 ms)
[ RUN      ] NNOps.FusedBatchNormV2NHWCTraining
2019-07-09 07:35:55.411609: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.433835: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.FusedBatchNormV2NHWCTraining (49 ms)
[ RUN      ] NNOps.FusedBatchNormV3NHWCInference
2019-07-09 07:35:55.458473: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.486647: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.FusedBatchNormV3NHWCInference (43 ms)
[ RUN      ] NNOps.FusedBatchNormV3NHWCTraining
2019-07-09 07:35:55.503744: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.527779: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.FusedBatchNormV3NHWCTraining (53 ms)
[ RUN      ] NNOps.FusedBatchNormGradNHWC
2019-07-09 07:35:55.548913: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.551547: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.558007: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.559957: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.FusedBatchNormGradNHWC (17 ms)
[ RUN      ] NNOps.FusedBatchNormGradV3NHWC
2019-07-09 07:35:55.566168: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.568449: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.574767: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.576813: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.FusedBatchNormGradV3NHWC (16 ms)
[ RUN      ] NNOps.L2Loss
2019-07-09 07:35:55.581341: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.581492: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.585059: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.585332: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.L2Loss (7 ms)
[ RUN      ] NNOps.LogSoftmax
2019-07-09 07:35:55.590344: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.590515: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.595146: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.595296: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.600628: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.600829: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.606273: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.606436: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.611374: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.611573: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.LogSoftmax (27 ms)
[ RUN      ] NNOps.MaxPool3DNDHWCSame
2019-07-09 07:35:55.615544: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.615762: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.637471: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.638194: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.MaxPool3DNDHWCSame (76 ms)
[ RUN      ] NNOps.MaxPool3DNDHWCValid
2019-07-09 07:35:55.691968: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.692176: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.715140: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.716123: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.MaxPool3DNDHWCValid (74 ms)
[ RUN      ] NNOps.QuantizedAvgPoolEvenInput
2019-07-09 07:35:55.765989: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.767596: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.772177: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.773753: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.779052: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.780633: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.787462: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.789296: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.794670: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.796303: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.801869: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.803610: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.808592: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.810085: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.815855: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.817613: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.822522: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.824082: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.829226: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.830754: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.835637: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.837155: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.841788: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.843308: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.847922: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.849378: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.854481: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.856000: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.860671: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.862229: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.867180: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.868741: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.873161: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.874606: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.879423: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.880908: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.885805: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.887355: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.891891: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.893352: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.897810: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.899232: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.904022: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.905541: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.910303: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.911883: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.917050: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.918619: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.923238: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.924748: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.929717: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.931317: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.936084: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.937622: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.942212: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.943829: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.948367: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.949906: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.954740: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.956240: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.960849: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.962371: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.967270: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.968800: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.QuantizedAvgPoolEvenInput (207 ms)
[ RUN      ] NNOps.QuantizedMaxPool
2019-07-09 07:35:55.973624: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.975109: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.980011: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.981495: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.986183: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.987700: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.992366: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.993949: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:55.998361: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:55.999906: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.005248: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.007004: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.011995: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.013706: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.018632: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.020186: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.024551: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.025967: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.030748: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.032186: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.036485: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.037863: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.042222: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.043751: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.047943: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.049406: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.054187: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.055693: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.060241: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.061739: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.066982: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.068496: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.072918: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.074327: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.078915: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.080401: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.084684: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.086221: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.090655: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.092083: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.096459: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.097839: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.102546: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.103998: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.108486: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.110061: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.115112: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.116588: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.120976: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.122373: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.126713: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.128267: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.132901: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.134331: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.138785: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.140255: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.144673: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.146057: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.150487: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.152067: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.156692: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.158160: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.163245: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.164768: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.QuantizedMaxPool (196 ms)
[ RUN      ] NNOps.QuantizedMaxPoolSameMinMax
2019-07-09 07:35:56.169387: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.170348: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.QuantizedMaxPoolSameMinMax (6 ms)
[ RUN      ] NNOps.Softmax2D
2019-07-09 07:35:56.173861: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.174034: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.Softmax2D (3 ms)
[ RUN      ] NNOps.Softmax3D
2019-07-09 07:35:56.177366: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.177545: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.Softmax3D (4 ms)
[ RUN      ] NNOps.SoftmaxZeroDimTest1
2019-07-09 07:35:56.181103: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.181258: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.SoftmaxZeroDimTest1 (3 ms)
[ RUN      ] NNOps.SoftmaxZeroDimTest2
2019-07-09 07:35:56.184318: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.184460: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.SoftmaxZeroDimTest2 (4 ms)
[ RUN      ] NNOps.SparseSoftmaxCrossEntropyWithLogits
2019-07-09 07:35:56.190277: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.190457: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] NNOps.SparseSoftmaxCrossEntropyWithLogits (6 ms)
[----------] 34 tests from NNOps (945 ms total)

[----------] 45 tests from ArrayOps
[ RUN      ] ArrayOps.DepthToSpaceNHWC
2019-07-09 07:35:56.194253: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.194405: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.197784: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.198007: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.201618: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.201781: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.205348: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.205569: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.209491: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.209740: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.214172: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.214397: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.218332: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.218495: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.DepthToSpaceNHWC (28 ms)
[ RUN      ] ArrayOps.DepthToSpaceNCHW
2019-07-09 07:35:56.222441: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.223284: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.226971: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.227873: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.231762: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.232595: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.236215: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.237028: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.240726: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.241560: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.245274: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.246465: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.273148: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.322398: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.DepthToSpaceNCHW (112 ms)
[ RUN      ] ArrayOps.Dequantizei8
2019-07-09 07:35:56.335153: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.335987: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Dequantizei8 (5 ms)
[ RUN      ] ArrayOps.Dequantizei8TF1
2019-07-09 07:35:56.340097: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.340773: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Dequantizei8TF1 (5 ms)
[ RUN      ] ArrayOps.Dequantizei8TF3
2019-07-09 07:35:56.344873: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.345532: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Dequantizei8TF3 (4 ms)
[ RUN      ] ArrayOps.Dequantizeu8
2019-07-09 07:35:56.349596: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.350241: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Dequantizeu8 (5 ms)
[ RUN      ] ArrayOps.Fill
2019-07-09 07:35:56.353551: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.353710: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.357133: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.357294: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.360915: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.361096: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.364746: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.364919: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.368379: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.368580: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Fill (19 ms)
[ RUN      ] ArrayOps.ExpandDims
2019-07-09 07:35:56.372318: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.372529: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.376212: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.376442: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.ExpandDims (8 ms)
[ RUN      ] ArrayOps.GatherNd2D
2019-07-09 07:35:56.380377: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.380585: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.GatherNd2D (4 ms)
[ RUN      ] ArrayOps.GatherNd3D
2019-07-09 07:35:56.384072: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.384261: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.GatherNd3D (3 ms)
[ RUN      ] ArrayOps.OneHot1dNegAxis
2019-07-09 07:35:56.388744: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.389497: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.OneHot1dNegAxis (5 ms)
[ RUN      ] ArrayOps.OneHot1d
2019-07-09 07:35:56.393682: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.394376: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.OneHot1d (5 ms)
[ RUN      ] ArrayOps.OneHot2dNegAxis
2019-07-09 07:35:56.398694: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.399393: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.OneHot2dNegAxis (5 ms)
[ RUN      ] ArrayOps.OneHot2d
2019-07-09 07:35:56.403602: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.404301: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.OneHot2d (5 ms)
[ RUN      ] ArrayOps.OneHot3d
2019-07-09 07:35:56.408499: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.409253: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.OneHot3d (5 ms)
[ RUN      ] ArrayOps.OneHot3dNegAxis
2019-07-09 07:35:56.413751: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.414504: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.OneHot3dNegAxis (5 ms)
[ RUN      ] ArrayOps.Pad
2019-07-09 07:35:56.417951: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.418118: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Pad (4 ms)
[ RUN      ] ArrayOps.PreventGradient
2019-07-09 07:35:56.421407: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.421588: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.425106: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.425348: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.428687: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.428875: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.431874: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.432023: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.PreventGradient (14 ms)
[ RUN      ] ArrayOps.QuantizeV2i8
2019-07-09 07:35:56.437594: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.438897: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.QuantizeV2i8 (7 ms)
[ RUN      ] ArrayOps.QuantizeV2u8SameRange
2019-07-09 07:35:56.444807: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.446152: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.QuantizeV2u8SameRange (7 ms)
[ RUN      ] ArrayOps.QuantizeV2u8DiffRange
2019-07-09 07:35:56.452125: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.453398: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.QuantizeV2u8DiffRange (8 ms)
[ RUN      ] ArrayOps.QuantizeAndDequantizeV2x8xtruextrue
2019-07-09 07:35:56.457594: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.458327: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.QuantizeAndDequantizeV2x8xtruextrue (4 ms)
[ RUN      ] ArrayOps.QuantizeAndDequantizeV2x8xtruexfalse
2019-07-09 07:35:56.462698: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.463441: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.QuantizeAndDequantizeV2x8xtruexfalse (5 ms)
[ RUN      ] ArrayOps.QuantizedConcat
2019-07-09 07:35:56.475313: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.477597: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.QuantizedConcat (15 ms)
[ RUN      ] ArrayOps.Rank
2019-07-09 07:35:56.481587: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.481767: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Rank (4 ms)
[ RUN      ] ArrayOps.Shape2D
2019-07-09 07:35:56.485095: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.485268: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Shape2D (3 ms)
[ RUN      ] ArrayOps.Shape3D
2019-07-09 07:35:56.488468: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.488611: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Shape3D (4 ms)
[ RUN      ] ArrayOps.SizeOpAttrsChange
2019-07-09 07:35:56.491719: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.491862: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.494945: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.495093: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.498145: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.498291: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.501339: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.501486: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.504517: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.504665: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.507967: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.508184: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.SizeOpAttrsChange (19 ms)
[ RUN      ] ArrayOps.SizeOpDefault
2019-07-09 07:35:56.511582: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.511732: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.514892: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.515037: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.518069: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.518214: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.521965: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.522148: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.525312: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.525458: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.528878: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.529043: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.SizeOpDefault (21 ms)
[ RUN      ] ArrayOps.Slice
2019-07-09 07:35:56.532590: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.533351: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Slice (4 ms)
[ RUN      ] ArrayOps.SpaceToDepthNHWC
2019-07-09 07:35:56.537140: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.537292: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.541112: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.541265: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.545963: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.546118: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.550011: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.550158: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.568495: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.568735: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.576525: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.576769: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.581905: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.582099: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.586665: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.586862: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.SpaceToDepthNHWC (54 ms)
[ RUN      ] ArrayOps.SpaceToDepthNCHW
2019-07-09 07:35:56.591090: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.592000: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.598953: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.599833: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.604565: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.605541: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.610660: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.611524: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.616417: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.617352: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.622671: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.624107: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.663558: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.698358: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.SpaceToDepthNCHW (119 ms)
[ RUN      ] ArrayOps.StridedSliceTest1
2019-07-09 07:35:56.715743: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.721185: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.StridedSliceTest1 (16 ms)
[ RUN      ] ArrayOps.SplitNegativeAxis
2019-07-09 07:35:56.726788: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.727032: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.SplitNegativeAxis (5 ms)
[ RUN      ] ArrayOps.SplitPositiveAxis
2019-07-09 07:35:56.731622: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.731812: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.SplitPositiveAxis (4 ms)
[ RUN      ] ArrayOps.SplitVNegSizeSplit
2019-07-09 07:35:56.736415: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.737885: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.SplitVNegSizeSplit (6 ms)
[ RUN      ] ArrayOps.SplitVNegativeAxis
2019-07-09 07:35:56.742615: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.744063: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.SplitVNegativeAxis (6 ms)
[ RUN      ] ArrayOps.SplitVPositiveSizeSplits
2019-07-09 07:35:56.748792: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.750212: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.SplitVPositiveSizeSplits (7 ms)
[ RUN      ] ArrayOps.SplitVZeroSizeSplit
2019-07-09 07:35:56.754192: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.755512: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.SplitVZeroSizeSplit (5 ms)
[ RUN      ] ArrayOps.SplitVZeroSizeNegSplit
2019-07-09 07:35:56.759683: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.761094: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.SplitVZeroSizeNegSplit (5 ms)
[ RUN      ] ArrayOps.Tile
2019-07-09 07:35:56.770274: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.770571: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.806732: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.807044: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.851102: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.851326: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.854836: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.855081: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Tile (94 ms)
[ RUN      ] ArrayOps.Transpose
2019-07-09 07:35:56.859100: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.859346: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Transpose (5 ms)
[ RUN      ] ArrayOps.TransposeConstant
2019-07-09 07:35:56.862926: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.863092: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.TransposeConstant (3 ms)
[ RUN      ] ArrayOps.Unpack
2019-07-09 07:35:56.867134: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.867302: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.872276: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.872480: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.876735: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.876977: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.Unpack (14 ms)
[ RUN      ] ArrayOps.ZerosLike
2019-07-09 07:35:56.880630: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.880811: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] ArrayOps.ZerosLike (4 ms)
[----------] 45 tests from ArrayOps (690 ms total)

[----------] 6 tests from VariableTest
[ RUN      ] VariableTest.SmallGraph1
2019-07-09 07:35:56.882493: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.886707: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.892485: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.892994: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.893733: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.895133: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.897466: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] VariableTest.SmallGraph1 (16 ms)
[ RUN      ] VariableTest.SmallGraph2
2019-07-09 07:35:56.899072: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.903429: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.912027: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.912554: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.913311: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.915113: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.916428: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] VariableTest.SmallGraph2 (19 ms)
[ RUN      ] VariableTest.SmallGraph3
2019-07-09 07:35:56.918221: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.922958: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.928860: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.937613: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.938118: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.938880: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.940318: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.942798: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.945136: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] VariableTest.SmallGraph3 (29 ms)
[ RUN      ] VariableTest.SmallGraph4
2019-07-09 07:35:56.947751: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.954587: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.960731: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.967599: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.973019: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.973653: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.975151: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.976718: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.978680: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.979984: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.981358: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] VariableTest.SmallGraph4 (37 ms)
[ RUN      ] VariableTest.SmallGraph5
2019-07-09 07:35:56.983282: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.987041: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.992555: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:56.992941: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:56.993680: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.994675: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:56.996122: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] VariableTest.SmallGraph5 (14 ms)
[ RUN      ] VariableTest.SmallGraph6
2019-07-09 07:35:56.997576: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:57.001702: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:57.008172: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-09 07:35:57.008645: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:131] NGraph is available but disabled.
2019-07-09 07:35:57.009439: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:57.011189: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
2019-07-09 07:35:57.013020: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:209] NGraph is available but disabled.
[       OK ] VariableTest.SmallGraph6 (17 ms)
[----------] 6 tests from VariableTest (132 ms total)

[----------] Global test environment tear-down
[==========] 181 tests from 14 test cases ran. (2204 ms total)
[  PASSED  ] 181 tests.

  YOU HAVE 20 DISABLED TESTS

@samhodge
Copy link
Author

samhodge commented Jul 9, 2019

How do I enable NGraph for the tests?

@samhodge
Copy link
Author

samhodge commented Jul 9, 2019

Trying the model_level_tests now, also seems to be CPU only

@samhodge
Copy link
Author

samhodge commented Jul 9, 2019

Looking at this:
https://github.com/tensorflow/ngraph-bridge/blob/master/test/model_level_tests/README.md

How can PlaidML be specified?

@samhodge
Copy link
Author

OK with the CPU back end everything is OK

(venv-tf-py3) kaos-new:wide_deep sam$ python wide_deep_test.py 
['CPU', 'INTERPRETER', 'PLAIDML', 'NOP']
WARNING: Logging before flag parsing goes to stderr.
W0715 07:20:37.756990 140736213103488 deprecation_wrapper.py:119] From /Users/sam/dev/models/official/utils/logging/hooks.py:26: The name tf.train.SessionRunHook is deprecated. Please use tf.estimator.SessionRunHook instead.

W0715 07:20:37.758661 140736213103488 deprecation_wrapper.py:119] From /Users/sam/dev/models/official/utils/logging/metric_hook.py:26: The name tf.train.LoggingTensorHook is deprecated. Please use tf.estimator.LoggingTensorHook instead.

W0715 07:20:37.758934 140736213103488 deprecation_wrapper.py:119] From wide_deep_test.py:30: The name tf.logging.set_verbosity is deprecated. Please use tf.compat.v1.logging.set_verbosity instead.

W0715 07:20:37.759047 140736213103488 deprecation_wrapper.py:119] From wide_deep_test.py:30: The name tf.logging.ERROR is deprecated. Please use tf.compat.v1.logging.ERROR instead.

Running tests under Python 3.6.5: /Users/sam/dev/ngraph-bridge/build_cmake/venv-tf-py3/bin/python
[ RUN      ] BaseTest.test_end_to_end_deep
Parsing /var/folders/wy/wxfdgdvn23zbw8q9mmv5q0br0000gq/T/wide_deep_testc1y2rubm/tmpdaldf10e/adult.data
2019-07-15 07:20:39.851392: I tensorflow/core/platform/cpu_feature_guard.cc:142] Your CPU supports instructions that this TensorFlow binary was not compiled to use: AVX2 FMA
2019-07-15 07:20:39.922476: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:40.122278: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:40.156513: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:40.192457: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:40.224482: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:40.703927: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:40.838180: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:41.067843: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:41.448085: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
Parsing /var/folders/wy/wxfdgdvn23zbw8q9mmv5q0br0000gq/T/wide_deep_testc1y2rubm/tmpdaldf10e/adult.test
2019-07-15 07:20:42.873549: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:42.916773: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:42.975586: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:43.028438: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:43.089133: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:43.347070: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:43.586694: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
Results at epoch 1
------------------------------------------------------------
accuracy: 0.5
accuracy_baseline: 0.5
auc: 0.5
auc_precision_recall: 0.74999994
average_loss: 101.560555
global_step: 1
label/mean: 0.5
loss: 3046.8167
precision: 0.5
prediction/mean: 0.9999999
recall: 1.0
[       OK ] BaseTest.test_end_to_end_deep
[ RUN      ] BaseTest.test_end_to_end_wide
Parsing /var/folders/wy/wxfdgdvn23zbw8q9mmv5q0br0000gq/T/wide_deep_testc1y2rubm/tmpl54cnxel/adult.data
2019-07-15 07:20:45.746394: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:45.794006: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:45.840725: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:45.890018: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:45.937091: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:46.718895: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:46.902587: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:47.307760: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:47.907653: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
Parsing /var/folders/wy/wxfdgdvn23zbw8q9mmv5q0br0000gq/T/wide_deep_testc1y2rubm/tmpl54cnxel/adult.test
2019-07-15 07:20:49.688712: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:49.726541: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:49.789319: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:49.853821: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:49.930247: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:50.338941: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:50.701192: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
Results at epoch 1
------------------------------------------------------------
accuracy: 0.9
accuracy_baseline: 0.5
auc: 0.95777774
auc_precision_recall: 0.9399421
average_loss: 0.3969052
global_step: 1
label/mean: 0.5
loss: 11.907156
precision: 0.8333333
prediction/mean: 0.5281824
recall: 1.0
[       OK ] BaseTest.test_end_to_end_wide
[ RUN      ] BaseTest.test_end_to_end_wide_deep
Parsing /var/folders/wy/wxfdgdvn23zbw8q9mmv5q0br0000gq/T/wide_deep_testc1y2rubm/tmp3009_9xp/adult.data
2019-07-15 07:20:53.473607: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:53.571918: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:53.638035: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:53.705950: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:53.766851: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:54.874209: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:55.144226: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:55.715512: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:56.544005: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
Parsing /var/folders/wy/wxfdgdvn23zbw8q9mmv5q0br0000gq/T/wide_deep_testc1y2rubm/tmp3009_9xp/adult.test
2019-07-15 07:20:58.809262: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:58.859001: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:58.937965: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:59.007752: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:59.086718: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:59.529918: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:20:59.928616: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
Results at epoch 1
------------------------------------------------------------
accuracy: 0.53333336
accuracy_baseline: 0.5
auc: 0.39555556
auc_precision_recall: 0.5186549
average_loss: 2.0061855
global_step: 1
label/mean: 0.5
loss: 60.185566
precision: 0.6
prediction/mean: 0.40287504
recall: 0.2
[       OK ] BaseTest.test_end_to_end_wide_deep
[ RUN      ] BaseTest.test_input_fn
Parsing /var/folders/wy/wxfdgdvn23zbw8q9mmv5q0br0000gq/T/wide_deep_testc1y2rubm/tmp2z39vyv8/test.csv
2019-07-15 07:21:00.392122: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
[       OK ] BaseTest.test_input_fn
[ RUN      ] BaseTest.test_session
[       OK ] BaseTest.test_session
[ RUN      ] BaseTest.test_wide_deep_estimator_training
Parsing wide_deep_test.csv
2019-07-15 07:21:02.995744: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:03.094725: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:03.163777: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:03.234244: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:03.294491: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:04.408025: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:04.666948: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:05.231902: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
Parsing wide_deep_test.csv
2019-07-15 07:21:07.778304: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:07.833050: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:07.914027: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:07.983661: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:08.068007: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:08.505143: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:08.947185: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
Parsing wide_deep_test.csv
2019-07-15 07:21:11.502585: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:11.580673: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:11.653313: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:11.718896: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:11.783845: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:12.911954: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:13.172609: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:13.750041: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:14.580000: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
Parsing wide_deep_test.csv
2019-07-15 07:21:19.938322: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:19.990324: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:20.072449: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:20.143543: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:20.222115: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:20.680735: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
2019-07-15 07:21:21.124922: I /Users/sam/dev/ngraph-bridge/src/ngraph_rewrite_pass.cc:247] NGraph using backend: CPU
wide_deep initial results: {'accuracy': 0.46666667, 'accuracy_baseline': 0.5, 'auc': 0.7022222, 'auc_precision_recall': 0.69362104, 'average_loss': 15.969666, 'label/mean': 0.5, 'loss': 15.969666, 'precision': 0.4814815, 'prediction/mean': 0.83395505, 'recall': 0.8666667, 'global_step': 1}
wide_deep final results: {'accuracy': 0.93333334, 'accuracy_baseline': 0.5, 'auc': 0.99999994, 'auc_precision_recall': 0.99999994, 'average_loss': 0.3471694, 'label/mean': 0.5, 'loss': 0.3471694, 'precision': 0.88235295, 'prediction/mean': 0.5397825, 'recall': 1.0, 'global_step': 1001}
[       OK ] BaseTest.test_wide_deep_estimator_training
----------------------------------------------------------------------
Ran 6 tests in 43.431s

OK

see:

from here:

(venv-tf-py3) kaos-new:wide_deep sam$ cat wide_deep_test.py 
# Copyright 2017 The TensorFlow Authors. All Rights Reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
#     http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
# ==============================================================================

from __future__ import absolute_import
from __future__ import division
from __future__ import print_function

import ngraph_bridge
print(ngraph_bridge.list_backends())
ngraph_bridge.set_backend('CPU')
import os

import tensorflow as tf  # pylint: disable=g-bad-import-order

from official.utils.testing import integration
from official.wide_deep import wide_deep

tf.logging.set_verbosity(tf.logging.ERROR)

TEST_INPUT = ('18,Self-emp-not-inc,987,Bachelors,12,Married-civ-spouse,abc,'
              'Husband,zyx,wvu,34,56,78,tsr,<=50K')

TEST_INPUT_VALUES = {
    'age': 18,
    'education_num': 12,
    'capital_gain': 34,
    'capital_loss': 56,
    'hours_per_week': 78,
    'education': 'Bachelors',
    'marital_status': 'Married-civ-spouse',
    'relationship': 'Husband',
    'workclass': 'Self-emp-not-inc',
    'occupation': 'abc',
}

TEST_CSV = os.path.join(os.path.dirname(__file__), 'wide_deep_test.csv')


class BaseTest(tf.test.TestCase):
  """Tests for Wide Deep model."""

  def setUp(self):
    # Create temporary CSV file
    self.temp_dir = self.get_temp_dir()
    self.input_csv = os.path.join(self.temp_dir, 'test.csv')
    with tf.gfile.Open(self.input_csv, 'w') as temp_csv:
      temp_csv.write(TEST_INPUT)

    with tf.gfile.Open(TEST_CSV, "r") as temp_csv:
      test_csv_contents = temp_csv.read()

    # Used for end-to-end tests.
    for fname in ['adult.data', 'adult.test']:
      with tf.gfile.Open(os.path.join(self.temp_dir, fname), 'w') as test_csv:
        test_csv.write(test_csv_contents)

  def test_input_fn(self):
    dataset = wide_deep.input_fn(self.input_csv, 1, False, 1)
    features, labels = dataset.make_one_shot_iterator().get_next()
    config = tf.ConfigProto()
    config_ngraph_enabled = ngraph_bridge.update_config(config)
    with tf.Session(config=config_ngraph_enabled) as sess:
      features, labels = sess.run((features, labels))

      # Compare the two features dictionaries.
      for key in TEST_INPUT_VALUES:
        self.assertTrue(key in features)
        self.assertEqual(len(features[key]), 1)
        feature_value = features[key][0]

        # Convert from bytes to string for Python 3.
        if isinstance(feature_value, bytes):
          feature_value = feature_value.decode()

        self.assertEqual(TEST_INPUT_VALUES[key], feature_value)

      self.assertFalse(labels)

  def build_and_test_estimator(self, model_type):
    """Ensure that model trains and minimizes loss."""
    model = wide_deep.build_estimator(self.temp_dir, model_type)

    # Train for 1 step to initialize model and evaluate initial loss
    def get_input_fn(num_epochs, shuffle, batch_size):
      def input_fn():
        return wide_deep.input_fn(
            TEST_CSV, num_epochs=num_epochs, shuffle=shuffle,
            batch_size=batch_size)
      return input_fn

    model.train(input_fn=get_input_fn(1, True, 1), steps=1)
    initial_results = model.evaluate(input_fn=get_input_fn(1, False, 1))

    # Train for 100 epochs at batch size 3 and evaluate final loss
    model.train(input_fn=get_input_fn(100, True, 3))
    final_results = model.evaluate(input_fn=get_input_fn(1, False, 1))

    print('%s initial results:' % model_type, initial_results)
    print('%s final results:' % model_type, final_results)

    # Ensure loss has decreased, while accuracy and both AUCs have increased.
    self.assertLess(final_results['loss'], initial_results['loss'])
    self.assertGreater(final_results['auc'], initial_results['auc'])
    self.assertGreater(final_results['auc_precision_recall'],
                       initial_results['auc_precision_recall'])
    self.assertGreater(final_results['accuracy'], initial_results['accuracy'])

  def test_wide_deep_estimator_training(self):
    self.build_and_test_estimator('wide_deep')

  def test_end_to_end_wide(self):
    integration.run_synthetic(
        main=wide_deep.main, tmp_root=self.get_temp_dir(), extra_flags=[
            '--data_dir', self.get_temp_dir(),
            '--model_type', 'wide',
        ],
        synth=False, max_train=None)

  def test_end_to_end_deep(self):
    integration.run_synthetic(
        main=wide_deep.main, tmp_root=self.get_temp_dir(), extra_flags=[
            '--data_dir', self.get_temp_dir(),
            '--model_type', 'deep',
        ],
        synth=False, max_train=None)

  def test_end_to_end_wide_deep(self):
    integration.run_synthetic(
        main=wide_deep.main, tmp_root=self.get_temp_dir(), extra_flags=[
            '--data_dir', self.get_temp_dir(),
            '--model_type', 'wide_deep',
        ],
        synth=False, max_train=None)


if __name__ == '__main__':
  tf.test.main()

see:
https://github.com/tensorflow/models/tree/d640ab9cb1c06e7da39cca0399f14f8c6a54eb9c/official/wide_deep

But when I change a single line

ngraph_bridge.set_backend('CPU')

to

ngraph_bridge.set_backend('PLAIDML:0')

I get the following in the attached output.txt file
output.txt

How can I diagnose what the issue is?

@Gerzer
Copy link

Gerzer commented Aug 13, 2019

I'm having the same issue with the "compilation failed" error when using the PlaidML backend. Everything works fine with the CPU backend.

@samhodge: Did you ever find a solution?

@Gerzer
Copy link

Gerzer commented Aug 13, 2019 •
edited
Loading

Interestingly, I get a different error when switching from Metal to OpenCL:

2019-08-13 10:31:18.297856: W tensorflow/core/framework/op_kernel.cc:1502] OP_REQUIRES failed at sparse_to_dense_op.cc:92 : Invalid argument: Dimension -1892243770 must be >= 0
Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/client/session.py", line 1356, in _do_call
    return fn(*args)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/client/session.py", line 1341, in _run_fn
    options, feed_dict, fetch_list, target_list, run_metadata)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/client/session.py", line 1429, in _call_tf_sessionrun
    run_metadata)
tensorflow.python.framework.errors_impl.InvalidArgumentError: assertion failed: [Expected shape for Tensor english/rnn_stack/rnn/sequence_length:0 is ] [1] [ but saw shape: ] [1]
	 [[{{node english/rnn_stack/rnn/Assert/Assert}}]]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.6/bin/ludwig", line 11, in <module>
    load_entry_point('ludwig==0.2.1', 'console_scripts', 'ludwig')()
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/cli.py", line 108, in main
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/cli.py", line 64, in __init__
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/cli.py", line 69, in experiment
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/experiment.py", line 472, in cli
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/experiment.py", line 203, in experiment
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/train.py", line 311, in full_train
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/train.py", line 475, in train
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/models/model.py", line 537, in train
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/client/session.py", line 950, in run
    run_metadata_ptr)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/client/session.py", line 1173, in _run
    feed_dict_tensor, options, run_metadata)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/client/session.py", line 1350, in _do_run
    run_metadata)
  File "/Library/Frameworks/Python.framework/Versions/3.6/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/client/session.py", line 1370, in _do_call
    raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InvalidArgumentError: assertion failed: [Expected shape for Tensor english/rnn_stack/rnn/sequence_length:0 is ] [1] [ but saw shape: ] [1]
	 [[node english/rnn_stack/rnn/Assert/Assert (defined at /lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/models/modules/recurrent_modules.py:212) ]]

Original stack trace for 'english/rnn_stack/rnn/Assert/Assert':
  File "/bin/ludwig", line 11, in <module>
    load_entry_point('ludwig==0.2.1', 'console_scripts', 'ludwig')()
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/cli.py", line 108, in main
    CLI()
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/cli.py", line 64, in __init__
    getattr(self, args.command)()
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/cli.py", line 69, in experiment
    experiment.cli(sys.argv[2:])
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/experiment.py", line 472, in cli
    experiment(**vars(args))
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/experiment.py", line 203, in experiment
    **kwargs
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/train.py", line 311, in full_train
    debug=debug
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/train.py", line 456, in train
    debug=debug
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/models/model.py", line 113, in __init__
    **kwargs
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/models/model.py", line 163, in __build
    is_training=self.is_training
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/models/inputs.py", line 42, in build_inputs
    **kwargs)
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/models/inputs.py", line 69, in build_single_input
    **kwargs)
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/features/text_feature.py", line 219, in build_input
    is_training
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/features/sequence_feature.py", line 178, in build_sequence_input
    is_training=is_training
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/models/modules/sequence_encoders.py", line 1423, in __call__
    is_training=is_training
  File "/lib/python3.6/site-packages/ludwig-0.2.1-py3.6.egg/ludwig/models/modules/recurrent_modules.py", line 212, in __call__
    dtype=tf.float32)
  File "/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/util/deprecation.py", line 324, in new_func
    return func(*args, **kwargs)
  File "/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/ops/rnn.py", line 694, in dynamic_rnn
    [_assert_has_shape(sequence_length, [batch_size])]):
  File "/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/ops/rnn.py", line 688, in _assert_has_shape
    " but saw shape: ", x_shape
  File "/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/util/tf_should_use.py", line 193, in wrapped
    return _add_should_use_warning(fn(*args, **kwargs))
  File "/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/ops/control_flow_ops.py", line 163, in Assert
    return gen_logging_ops._assert(condition, data, summarize, name="Assert")
  File "/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/ops/gen_logging_ops.py", line 74, in _assert
    name=name)
  File "/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/framework/op_def_library.py", line 788, in _apply_op_helper
    op_def=op_def)
  File "/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/util/deprecation.py", line 507, in new_func
    return func(*args, **kwargs)
  File "/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/framework/ops.py", line 3616, in create_op
    op_def=op_def)
  File "/lib/python3.6/site-packages/tensorflow-1.14.0-py3.6-macosx-10.9-x86_64.egg/tensorflow/python/framework/ops.py", line 2005, in __init__
    self._traceback = tf_stack.extract_stack()

(I'm using a library called Ludwig, which I modified myself to work on top of TensorFlow with nGraph.)

@samhodge
Copy link
Author

I havent followed up for some time, I hope to put some time into this soon

Sam

@jverce
Copy link

jverce commented Aug 16, 2019

Had a similar issue to @Gerzer's:

Traceback (most recent call last):
  File "/Users/jay/.pyenv/versions/plaidenv/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1356, in _do_call
    return fn(*args)
  File "/Users/jay/.pyenv/versions/plaidenv/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1341, in _run_fn
    options, feed_dict, fetch_list, target_list, run_metadata)
  File "/Users/jay/.pyenv/versions/plaidenv/lib/python3.6/site-packages/tensorflow/python/client/session.py", line 1429, in _call_tf_sessionrun
    run_metadata)
tensorflow.python.framework.errors_impl.InvalidArgumentError: assertion failed: [Expected shape for Tensor dynamic_seq2seq/encoder/rnn/sequence_length:0 is ] [1] [ but saw shape: ] [1]
	 [[{{node dynamic_seq2seq/encoder/rnn/Assert/Assert}}]]

@letalvoj letalvoj mentioned this issue Nov 25, 2019
Open
@kenthinson
Copy link

kenthinson commented Dec 10, 2019 •
edited
Loading

To answer the original question How to use the backend.

At the top of your NoteBook or python file before importing Tensorflow.

import ngraph_bridge
ngraph_bridge.set_backend('PLAIDML')

Then find import tensorflow as tf and add this code after it.

config = tf.ConfigProto()
config_ngraph_enabled = ngraph_bridge.update_config(config)
sess = tf.Session(config=config_ngraph_enabled)

@truboxl truboxl mentioned this issue Jul 15, 2020
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@samhodge @kenthinson @jverce @Gerzer