Sync
Google Drive sync on a fast server
Moves a lot of data quickly: many files at once, in large pieces.
- Google Drive
- Servers
Type your own: the command below follows.
rclone sync /srv/data gdrive:data \ --transfers 16 \ --checkers 32 \ --drive-chunk-size 256M \ --buffer-size 256M \ --fast-list \ -PAdd to Rclone UI opens it in the app’s Templates window, ready to save. No app yet? Download Rclone UI, free.
What it does
Makes the destination match the source. Files that are only in the destination are deleted. rclone’s docs for sync
- Each of the 16 transfers keeps a 256 MB upload piece and a 256 MB buffer in memory: up to 8 GB in all.
Each flag
- --transfers 16
- How many files are copied at the same time.rclone’s default: 4
- --checkers 32
- How many files are compared at the same time, to find the ones that need copying.rclone’s default: 8
- --drive-chunk-size 256M
- On Google Drive only: the size of each piece of an upload. Larger pieces upload faster, but each file being uploaded keeps one piece in memory.rclone’s default: 8Mi
- --buffer-size 256M
- Memory set aside for each file being read or copied, so that rclone can read ahead of the app. Each open file takes this much memory.rclone’s default: 16Mi
- --fast-list
- Lists the whole remote in a few large requests instead of one for each folder. Fewer requests, but more memory. It helps most on Google Drive and S3.
- -P
- Shows the progress in the terminal while the command runs. Rclone UI shows its own, in History.