Borg Backup Backblaze B2

Backblaze B2 client for Mac, Windows and Linux. B2 is Backblaze’s bulk storage service. It is different than their primary backup business in that it is more like Backblaze B2 in that it is an API-driven cloud storage service. It is about 1/4 the cost of Amazon S3, but has a different API making the range of desktop clients much more limited. Go to Backblaze B2 Cloud Storage, enter your email address and password, and click Sign Up for B2. Select App Keys from the B2 Cloud Storage menu. Your keyID is displayed on this page. Click Create New Master Application Key to create an Application Key. Object and File Storage Backblaze B2 is enterprise-grade, S3 compatible storage that companies around the world use to store and serve data while improving their cloud OpEx vs. Amazon S3 and others. Developers use it to easily build apps and manage services. IT leaders use it to backup their organizations with management ease and reliability. B2 isn't really a solution for people that are looking for a robust computer backup service like Backblaze currently offers for Mac and Windows. I went down that road and ended up very frustrated. I ended up buying a Synology NAS (which does offer the same computer backup features + revisioning and all that), and then syncing the backup out to B2. That's one of the largest differences between 'Backblaze Personal Backup' (our original product line) and Backblaze B2. The largest parts of the redesign/refit when we originally did B2 was around the concept of what we call 'Friendly URLs' (web page names, folder names) instead of just ugly 82 character hexadecimal file names like Backblaze.

What is the problem you are having with rclone?

Maybe this is not a problem but instead a SOLUTION to a problem: I was plagued by extremely low upload speeds (around 100 KB/s) for several years when syncing borgbackup repositories to Backblaze B2. My problems were previously described in the (now locked) forum thread here. The underlying cause was found to be lots of 503 errors being throws by Backblaze while Backblaze support assured me that everything is OK at their end. None of the proposed solutions (e.g. increasing the --transfers value) worked.

Recently I have found that simply adding the '--fast-list' option to rclone command increased my upload speeds from around 100 KB/s to at least 2 MB/s (sometimes up to 5 MB/s). That's at least 20x speed increase ant it's absolutely consistent (tried 5 times without the --fast-list option and 5 times with it). I don't know if this is a bug in rclone or at Backblaze's end but this info might help other afflicted users.

N.B: My borgbackup repositories consist of multiple long files (up to 500MB) and many more short 17 bytes files (for snapshots that did not change compared to the previous snapshot). The typical file composition of my borgbackup repository can be seen here.

What is your rclone version (output from `rclone version`)

1.52.0

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Xubuntu Linux

Which cloud storage system are you using? (eg Google Drive)

Backblaze B2

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

Backblaze B2 Client