Better Drive files download failure

[Conchylicultor]

Download of drive urls sometimes fails with NonMatchingChecksumError: Artifact https://drive.google.com/... has wrong checksum.

Explanation: Drive sometimes reject the download attempt, and the rejection page is downloaded instead of the data:

• If the user is based in china (should use VPN)
• If there is too many downloads of the same file.

The best solution currently is to manually download the data (https://www.tensorflow.org/datasets/overview#manual_download_if_download_fails), rather than using the automated download which got rejected by drive.

Otherwise:

• Try the download latter on.
• Try on a different computer
• Rather than downloading the file in each colab connection, load the dataset from a GCS bucket. See instructions.

Not sure there can be a solution on Google Drive side, while preventing abuse.
On TFDS side, we could make the error message more explicit when we detect a drive URL.

[dhirensr]

@Conchylicultor : do we need to just change the error message in this ticket? could you guide me a little bit so that I could work on it.

[jpgard]

Is there a way for users to e.g. make a copy of the files into our own Google Drive for a dataset, manually download them to the correct location, and proceed from there? Or any other manual workaround using the publicly-available celeba data?

[ChanchalKumarMaji]

For drive links downloads can be done by extracting the id and creating the download link as -
https://drive.google.com/uc?id=0B7EVK8r0v71pZjFTYXZWM3FlRnM

For now celeb_a download link shows -

Sorry, you can't view or download this file at this time.

Too many users have viewed or downloaded this file recently. Please try accessing the file again later. If the file you are trying to access is particularly large or is shared with many people, it may take up to 24 hours to be able to view or download the file. If you still can't access a file after 24 hours, contact your domain administrator.