Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reorganize file utils #16264

Merged
merged 11 commits into from
Mar 23, 2022
Merged

Reorganize file utils #16264

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
997ce2a
Split file_utils in several submodules
sgugger Mar 18, 2022
8890edb
Fixes
sgugger Mar 18, 2022
2362ce3
Add back more objects
sgugger Mar 18, 2022
4c8a8bf
More fixes
sgugger Mar 18, 2022
0e84328
Who exactly decided to import that from there?
sgugger Mar 18, 2022
cc1b6be
Second suggestion to code with code review
sgugger Mar 22, 2022
4d94fdb
Revert wront move
sgugger Mar 22, 2022
b366d5f
Fix imports
sgugger Mar 22, 2022
6dd7c37
Adapt all imports
sgugger Mar 23, 2022
9acca1a
Adapt all imports everywhere
sgugger Mar 23, 2022
34c6be1
Revert this import, will fix in a separate commit
sgugger Mar 23, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
More fixes
  • Loading branch information
@sgugger
sgugger committed Mar 23, 2022
commit 4c8a8bf56d225176f20025c8d3e4e6f5a6fe659b
6 changes: 5 additions & 1 deletion src/transformers/file_utils.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -58,7 +58,11 @@
from .generic_utils import is_tensor # noqa: F401
from .generic_utils import to_numpy # noqa: F401
from .generic_utils import to_py_obj # noqa: F401
from .import_utils import ENV_VARS_TRUE_AND_AUTO_VALUES # noqa: F401
from .import_utils import TORCH_FX_REQUIRED_VERSION # noqa: F401
from .import_utils import USE_JAX # noqa: F401
from .import_utils import USE_TF # noqa: F401
from .import_utils import USE_TORCH # noqa: F401
from .import_utils import DummyObject # noqa: F401
from .import_utils import _LazyModule # noqa: F401
from .import_utils import is_apex_available # noqa: F401
Expand Down Expand Up @@ -108,6 +112,7 @@
from .import_utils import torch_required # noqa: F401
from .import_utils import torch_version # noqa: F401
from .import_utils import (
ENV_VARS_TRUE_VALUES,
_tf_version,
_torch_version,
is_tf_available,
Expand All @@ -120,7 +125,6 @@
logger = logging.get_logger(__name__) # pylint: disable=invalid-name


ENV_VARS_TRUE_VALUES = {"1", "ON", "YES", "TRUE"}
_is_offline_mode = True if os.environ.get("TRANSFORMERS_OFFLINE", "0").upper() in ENV_VARS_TRUE_VALUES else False


Expand Down
1 change: 1 addition & 0 deletions src/transformers/import_utils.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -321,6 +321,7 @@ def is_torch_tf32_available():
return True


torch_version = None
_torch_fx_available = _torch_onnx_dict_inputs_support_available = False
if _torch_available:
torch_version = version.parse(importlib_metadata.version("torch"))
Expand Down