From: Ken M. <km...@ma...> - 2016-07-28 14:37:59
|
bac...@li... wrote on 07/28/2016 07:34 AM: > How fast? We have a 10gbit connection from the server to campus backbone which has multiple 10gbit connections to the internet. In practice 1-2 gbits of throughput to google drive. We rarely exceed that to tape. > Bacula expects its TCP connections to stay up for the entire job Again, I don't think a fuse/google-drive solution is robust enough. I also don't think keeping the connection up during collection, compression, encryption is feasible. Transfer would be done at the end. The idea would be treating the storage pool like a virtual tape drive with a limited number of slots. Unmounting a volume means copy it out to the network. Mounting a volume means copying it back. Once a volume is unmounted its marked read/only. This would be for write once read rarely for anything unmounted. Fast for recent files, painful for older files. Just wondered if anyone had tried anything like this. Maybe there is different backup software that would be a better fit. |
From: Heitor F. <he...@ba...> - 2016-07-28 14:51:31
|
> bac...@li... wrote on 07/28/2016 07:34 AM: >> How fast? > > We have a 10gbit connection from the server to campus backbone which has > multiple 10gbit connections to the internet. In practice 1-2 gbits > of throughput to google drive. We rarely exceed that to tape. > > > Bacula expects its TCP connections to stay up for the entire job > > Again, I don't think a fuse/google-drive solution is robust enough. I > also don't think keeping the connection up during collection, > compression, encryption is feasible. Transfer would be done at the > end. Hello Ken: I think Google Drive does not support S3 and that would be the more robust solution you are looking for. Regards, -- ======================================================================= Heitor Medrado de Faria | Bacula do Brasil Próximas aulas telepresencial ao-vivo: http://www.bacula.com.br/agenda/ Ministro treinamento e implementação in-company Bacula: http://www.bacula.com.br/in-company/ 61 8268-4220 Site: www.bacula.com.br ======================================================================== |
From: Dmitri M. <dm...@bm...> - 2016-07-29 07:44:13
|
On 7/28/2016 9:37 AM, Ken Mandelberg wrote: > Just wondered if anyone had tried anything like this. Maybe there > is different backup software that would be a better fit. Yes. Amazon offers it for pay. There was also this but I don't read Deutch: http://www.libe.net/index.php/MHVTL Dima |
From: Josh F. <jf...@pv...> - 2016-07-29 11:23:57
|
On 7/28/2016 10:37 AM, Ken Mandelberg wrote: > ... > The idea would be treating the storage pool like a virtual tape > drive with a limited number of slots. Unmounting a volume means > copy it out to the network. Mounting a volume means copying it back. > Once a volume is unmounted its marked read/only. That seems a reasonable approach, although I don't know of anything like that. If something like rsync is used for the unmount copy, then it would not be necessary to mark it read-only. It is possible to define mounting and unmounting commands for a Device resource. At one time this was used for writing to DVD, etc. I'm not sure of the status of these directives in 7.4.x, but they do still exist. See http://www.bacula.org/7.4.x-manuals/en/main/Storage_Daemon_Configuratio.html#SECTION001940000000000000000. It should be possible to use a bash script to rsync the volume files back and forth and use that as the "Mount Command" and "Unmount Command" for the Device resource. |