Ideas for offsite backup of tons of small files

[Tyree]

I have been moving all my backups off-site to Google Drive for the past couple weeks. I've worked out a lot of wrinkles here and there to streamline the process. One that I can't figure out a way to tackle is uploading tons of small files.

I have just 2GB of data to upload (in this particular case), but it consists of over 225k small files. As you probably know, uploading one 2GB file takes a tiny fraction of the time it takes to upload a quarter-million files totaling 2GB.

I was hoping there was some sort of way to upload a zip file to GDrive and then expand it once it uploaded. Doesn't appear to be a way to do that. There are some extensions that allow you to unzip files on GDrive, but they use local storage to do it. So, it's basically downloading and then re-uploading them to GDrive. Obviously, that defeats the whole purpose.

Does Syncback have some method of accomplishing this? Any tips for doing an operation like this?

Thanks!

[Swapna]

Hi,

SyncBackPro supports single-zip compression, where it compresses all files on Source into a big zip file (locally) and copies it to the destination. However, with cloud services, we do not recommend using single-zip compression, because the zip file uploaded to the server is recreated in each run (deleted, recreated and uploaded to the server, which is a slow process). If you wish you can test single-zip compression with Google Drive and see if it is faster than uploading multiple small files.

Thank you.

[Tyree]

Yeah, I knew I could do that. But, like you said, every time a file is changed the entire zip file has to be uploaded again. I think I'll be stuck doing it the long, slow way.

Thanks!