t5_demo can't retrieve CNNDM from drive.google; how to use local copy?

[rbelew]

🐛 Bug

Describe the bug A clear and concise description of what the bug is.

Following the t5_demo, but when it tries to access the CNN data at https://drive.google.com/uc?export=download&id=0BwmD_VLjROrfTHk4NFg2SndKcjQ

To Reproduce Steps to reproduce the behavior:

1. Get notebook at t5_demo,

2. Try to run it. It gets as far as batch = next(iter(cnndm_dataloader)) (https://pytorch.org/text/stable/tutorials/t5_demo.html#generate-summaries) where cnndm_datapipe = CNNDM(split="test") (https://pytorch.org/text/stable/tutorials/t5_demo.html#datasets)

3. Get error like:

RuntimeError: Google drive link

https://drive.google.com/uc?export=download&id=0BwmD_VLjROrfTHk4NFg2SndKcjQ&confirm=t
internal error: headers don't contain content-disposition. This is
usually caused by using a sharing/viewing link instead of a download
link. Click 'Download' on the Google Drive page, which should
redirect you to a download page, and use the link of that page.

This exception is thrown by iter of
GDriveReaderDataPipe(skip_on_error=False,
source_datapipe=OnDiskCacheHolderIterDataPipe, timeout=None)

Expected behavior

Looking at others with similar error messages makes it seem like there is some timeout issue retrieving from drive.google? So I went and got the cnn_stories.tgz and dailymail_stories.tgz and unpacked them:

.
├── CNNDM
│   ├── cnn
│   │   └── stories
│   └── dailymail
│   └── stories

How can I modify the calls retrieve from my local cache?

Environment

% python collect_env.py
Collecting environment information...
PyTorch version: 2.1.0.post100
Is debug build: False
CUDA used to build PyTorch: None
ROCM used to build PyTorch: N/A

OS: macOS 14.4.1 (arm64)
GCC version: Could not collect
Clang version: 15.0.0 (clang-1500.1.0.2.5)
CMake version: Could not collect
Libc version: N/A

Python version: 3.11.7 | packaged by conda-forge | (main, Dec 23 2023, 14:38:07) [Clang 16.0.6 ] (64-bit runtime)
Python platform: macOS-14.4.1-arm64-arm-64bit
Is CUDA available: False
CUDA runtime version: No CUDA
CUDA_MODULE_LOADING set to: N/A
GPU models and configuration: No CUDA
Nvidia driver version: No CUDA
cuDNN version: No CUDA
HIP runtime version: N/A
MIOpen runtime version: N/A
Is XNNPACK available: True

CPU:
Apple M1 Pro

Versions of relevant libraries:
[pip3] mypy-extensions==1.0.0
[pip3] numpy==1.26.3
[pip3] torch==2.1.0.post100
[pip3] torchaudio==2.1.2
[pip3] torchdata==0.7.1
[pip3] torchtext==0.16.1
[pip3] torchvision==0.16.2
[conda] captum 0.7.0 0 pytorch
[conda] numpy 1.26.2 pypi_0 pypi
[conda] numpy-base 1.26.3 py311hfbfe69c_0
[conda] pytorch 2.1.0 gpu_mps_py311hf322ab5_100
[conda] torch 2.1.2 pypi_0 pypi
[conda] torchaudio 2.1.2 pypi_0 pypi
[conda] torchdata 0.7.1 pypi_0 pypi
[conda] torchtext 0.16.1 pypi_0 pypi
[conda] torchvision 0.16.2 pypi_0 pypi

Additional context Add any other context about the problem here.