You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I would have raised this under AutoKeras but it is in maintenance mode. Besides I think the issue is Keras/Tensorflow.
I have tried to incorporate hyperparameters tuning using Kerastuner and Autokeras for the script classification_with_grn_and_vsn.py and here is the new script with incorporated changes. Code changes are detailed in the comments sections.
The model builds, however I have been experiencing extremely slow training process due to tf.data.Dataset. The iterator is loading the data at an extremely slow rate, even crashing the program by exhausting memory. Surprisingly, this happens under the fit function and it works when being iterated from outside - on the main script. To assess whether the model does do run, I modified the backend Trainer class fit and evaluate functions - by removing the iterating line: for step, iterator in epoch_iterator. More code changes in the script.
It works after this minor modifications. But I would like to know as to why the iterator is operating at such a slow pace, exhausting memory and crashing the program, or may be its an issue of resources from my side.
I would have raised this under AutoKeras but it is in maintenance mode. Besides I think the issue is Keras/Tensorflow.
I have tried to incorporate hyperparameters tuning using Kerastuner and Autokeras for the script classification_with_grn_and_vsn.py and here is the new script with incorporated changes. Code changes are detailed in the comments sections.
The model builds, however I have been experiencing extremely slow training process due to
tf.data.Dataset
. The iterator is loading the data at an extremely slow rate, even crashing the program by exhausting memory. Surprisingly, this happens under thefit
function and it works when being iterated from outside - on the main script. To assess whether the model does do run, I modified the backendTrainer
classfit
andevaluate
functions - by removing the iterating line:for step, iterator in epoch_iterator
. More code changes in the script.It works after this minor modifications. But I would like to know as to why the iterator is operating at such a slow pace, exhausting memory and crashing the program, or may be its an issue of resources from my side.
Environment:
The text was updated successfully, but these errors were encountered: