Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve TensorFlow compatibility in BERT scripts #743

Open
wants to merge 5 commits into
base: master
Choose a base branch
from

Conversation

rapsealk
Copy link
Member

@rapsealk rapsealk commented Jun 3, 2024

Hello mlcommons team!

Trying to run training/language_model/tensorflow/bert/cleanup_scripts/create_pretraining_data.py with TensorFlow 1.15.4 and Python 3.6.9, I faced several warnings as below:

image

I'm not sure which TensorFlow version is recommended to run this script, but these changes will be helpful for future migration to TensorFlow 2.x.

Before After
tf.app.run() tf.compat.v1.app.run()
tf.logging.set_verbosity() tf.compat.v1.logging.set_verbosity()
tf.logging.INFO tf.compat.v1.logging.INFO
tf.gfile.GFile tf.io.gfile.GFile
tf.gfile.Glob tf.io.gfile.glob
tf.logging.info() tf.compat.v1.logging.info()

Refs

@rapsealk rapsealk requested a review from a team as a code owner June 3, 2024 08:47
Copy link

github-actions bot commented Jun 3, 2024

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

@rapsealk
Copy link
Member Author

rapsealk commented Jun 3, 2024

recheck

1 similar comment
@rapsealk
Copy link
Member Author

rapsealk commented Jun 4, 2024

recheck

@arjunsuresh
Copy link
Contributor

This PR was doing a similar change. For the PR to be merged I think we need to bring it up in the Training WG meeting - Thursdays 8:30AM PST.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants