Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Avoid importing apex transformer automatically #1801

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

nWEIdia
Copy link
Contributor

@nWEIdia nWEIdia commented May 8, 2024

and make error message more clear when apex.transformer is explicitly called on unsupported platform

In some configurations, pytorch may not be built with distributed support.
So we avoid the auto import of transformer, which calls torch.distributed api explicitly.

…s more clear when apex.transformer is explicitly called on unsupported platform
apex/transformer/utils.py Outdated Show resolved Hide resolved
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also, remove "transformer" from the dunder all

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sorry, "the dunder all" means? :)

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

meaning

__all__ = ["amp", "fp16_utils", "optimizers", "normalization", "transformer"]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants