Skip to content

Make partial downloads resumable.#22

Closed
jsatterfield wants to merge 1 commit into
mlcommons:mainfrom
jsatterfield:main
Closed

Make partial downloads resumable.#22
jsatterfield wants to merge 1 commit into
mlcommons:mainfrom
jsatterfield:main

Conversation

@jsatterfield

Copy link
Copy Markdown

curl can resume interrupted downloads.

@jsatterfield jsatterfield requested a review from a team as a code owner October 21, 2025 19:03
@github-actions

Copy link
Copy Markdown

MLCommons CLA bot:
Thank you very much for your submission, we really appreciate it. Before we can accept your contribution, we ask that you sign the MLCommons CLA (Apache 2). Please use this [Google form] (https://forms.gle/Ew1KkBVpyeJDuRw67) to initiate authorization. If you are from an MLCommons member organization, we will request that you be added to the CLA. If you are not from a member organization, we will email you a CLA to sign. For any questions, please contact support@mlcommons.org.
0 out of 1 committers have signed the MLCommons CLA.
@jsatterfield
You can retrigger this bot by commenting recheck in this Pull Request

@nathanwasson

nathanwasson commented Oct 21, 2025

Copy link
Copy Markdown
Member

Hi @jsatterfield, thanks for your contribution. Can you explain your thinking here? The script uses curl to source a small metadata file that tells the script what to download. The metadata file should be downloaded every time the script is run in case there are changes to what should be downloaded, so it's not really a good candidate for the resume download function. The script already uses wget to download the actual dataset files and uses the resume feature for that.

@github-actions github-actions Bot locked and limited conversation to collaborators Oct 27, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants