The Human Connectome Project (HCP) includes 1200 subjects scanned on a Trio scanner.
Getting Data
After getting the appropriate permissions:
Go to https://db.humanconnectome.org/
You can see the latest datasets.
To connect, use an Amazon S3 client. I used SyncBackPro.
Note: deselect "S3 compatible service" as this is only for non-S3 services
Make sure to select the appropriate bucket and subfolder.
Restricted Data
Most detailed subject information is "Restricted Data" that needs explicit permissions
Download restricted data
From Email help:
Hi Paul,
Once you are logged into ConnectomeDB, you download the Restricted Access behavioral data as a CSV, similarly to how you can download the Open Access behavioral data as a CSV from the Subject Dashboard or the S1200 Project Page. See pages 24-26 of the S1200 Reference Manual for info on navigating ConnectomeDB. In order to have the Restricted Data displayed and download options appear, you must toggle the data access (at the top of the screen as indicated with the magenta arrow in the screenshot below) from Open Access to Restricted or Sensitive. If you are on the Subject Dashboard, then click Download CSV and select Restricted (green arrow) to download a CSV with only the Restricted data for the subjects in the currently selected group (All Subjects in this example). If you are on the S1200 Project Page (access through the Dataset Resources or Open Dataset buttons), a Restricted Data link will appear under Quick Downloads that will download the Restricted CSV for all Subjects.
Aspera plugin
The browser will need an Aspera plugin (Sophos issues); I uninstalled Sophos to get it going.
Unzipping Aspera downloads
7-Zip can do this nicely:
https://sevenzip.osdn.jp/chm/cmdline
-x: extract with directories
Over write options - https://sevenzip.osdn.jp/chm/cmdline/switches/overwrite.htm
-aos: skip existing
% Simple
"C:\Program Files\7-Zip\7z" x -oC:\temp C:\temp\t\100206_3T_Diffusion_preproc.zip
% Full
"C:\Program Files\7-Zip\7z" x -aos -o"R:\Original Data\HCPsubjects" "R:\Original Data\Aspera\*.zip" -bse1 > "D:\temp\HCP error messages.txt"
% Test, save messages in file
"C:\Program Files\7-Zip\7z" t "R:\Original Data\Aspera\*.zip" > "D:\temp\HCP test error messages.txt"
Open file in Notepad, search for "error" - get "Data error" on files with problems:
Testing 156637\unprocessed\3T\Diffusion\156637_3T_DWI_dir95_LR.nii.gz Data Error
End of file has totals:
Archives: 4307
Archive Errors: 1
Sub items Errors: 1
Can select individual subject archives from commectome.