willie
willie
Comments
-
Thanks, Katie. Meanwhile, my 5TB storage box has 1.5TB of free space left and I have one more system to back up, which has 1.6TB of data... ouch ;)
-
Added to above: my Hetzner dedi to storage box transfer slowed to maybe 15MB/s(?) for part of a day but then returned to the earlier 35MB/s or so. My backup of that dedi is now finished and it feels nice to have a complete copy in one place. I'm getting around 11MB/s from my BHS Kimsufi to the storage box which is the…
-
I had sort of remembered FLK from the Hetzner console, but ok maybe it was FSN :). Meanwhile my borg backup went back to its original speed after a few hours of slowdown, but I think the program itself can be sped up somewhat.
-
Well, I got around to spinning up a 1tb storage box to try borg backup. It worked ok, I transferred around 900GB to it, took overnight at around 35-40MB/sec, not great but not terrible. Then I bumped up the size to 5TB and sent another 200GB over and this time the transfer is about 2x slower. I wonder if the size change…
-
I decided to go with borg for now since it's supported by Hetzner. It looks like they have a borg server (not just ssh) at the remote side. I have a backup running with most options left at default, getting 35-40MB/s from a local dedi, not terrible but I think I may have been getting 2x that from plain sftp a while back.…
-
Thanks, will look. I see that it wants to compress my data, which is bad because any large data collection will usually already be compressed. E.g. linux isos are gzipped or whatever. Added: at first glance Kopia looks very similar to borgbackup, in both features and style. I wonder what is going on. I do like that it…
-
Added to above (past edit window): see https://borgbackup.readthedocs.io/en/stable/internals/security.html#fingerprinting It looks (per above) like borg also leaks metadata about file sizes etc. Not good. I'm glad that they considered and documented all these issues, but the cryptography in this program seems a little bit…
-
Ok I finally got around to looking at the borgbackup docs, and it looks like borg expects the backup repository to be sshfs mounted. It is possible to mount Hetzner storage box that way, but IME transfer is a lot slower (like 2x) with sshfs than with sftp. So, that makes borg suboptimal for storagebox unless I've missed…
-
There are already two yabs for this product posted here? Both were numerically similar and both were unimpressive.
-
Ah right, Contabo was one of those LET services. But people are asking about it here. They will get about what they should expect.
-
This is LES, our production services are supposed to be down a lot ;).
-
My prince has arrived!
-
Thanks. I'd wonder what to do with a product like this. I wonder how much ram pressure there is. If the iops cap means they are really able to deliver 1k iops consistently then I guess it is better than a dedicated HDD. But there is also the cpu. Hmm.
-
That is a pretty low benchmark right? I have lost track of this stuff.
-
Being able to configure it as public access is part of its attraction though. I.e. that is a feature that people would want and be willing to pay for, thus the suggestion of offering it only on the more expensive tier. Maybe storage box could have it as auth-only and storage share could have public access as a user choice.
-
@Hetzner_OL thinking a little more, if S3 is offered it might be better to just have it for storage share and not storage box. S3 will get used as a public-facing service which is more in the spirit of storage share, which has proper backups and (as the name says) is intended for sharing. It's the cheapskate in me speaking…
-
You can upgrade and downgrade them through the web console, it's trivial.
-
The 400gb is the 200gb that's already usually part of the plan, plus another 200gb added amirite? So only the extra 200gb is "free". Anyway it still seems like a pass given the persistent crummy benches among other things. All in all I'm happy with a smaller ssd (50gb is really plenty) and a much bigger disk of spinning…
-
That sounds pretty bogus, "lifetime" lol. Nothing ever is. If it stays running for 5 years, that's €49/year for 2TB or around €2/mo per TB, which is ok but not great these days. The 500GB plan is not attractive at all. I would stay away.
-
I think strictly speaking, more locations aren't needed, just say where the existing DE locations are more precisely than "Germany". If they are in both NBG and FLK, let the user choose which they want. If they are all in (say) FLK, just specify that, so the user can get an NBG server and back it up to FLK, getting geo…
-
Storage share also looks pretty nice. It is actually backed up to another server daily, unlike storage box, besides being on a raid system (don't know if the raid settings are similar). It is around 3 euro/TB of user storage in the large plans, vs 2 euro/TB for storage box. But since storage share stores two copies of your…
-
The client generates the session key when you make a backup. Thanks for the recommendation about Borg. I'll check it out more carefully and probably give it a try.
-
@Astro you can mount the storage box by sshfs but it relies on a tcp connection staying up, and they tend to drop every so often. I guess you could have a service restart it when that happens, but you are probably better off with storage share unless it's a very large, low-traffic instance.
-
Ok I'll see if I can find Duplicati. I guess if Borg's deduping doesn't slow stuff down and isn't discernable on the remote side, it can be ok. Public key encryption for something like this shouldn't have significant cost. Basically each server object (50MB or whatever, remember) is encrypted under its own session key and…
-
Recording some thoughts in case I decide to code something. I don't know of anything like this but the following approach seems obvious: * All objects (files or whatever) on remote side are opaque (appear to be random) and of fixed size (like 50MB), for metadata obfuscation and efficient transfer. All remote filenames are…
-
So far I just use tar and gpg. I tried duplicity a while back and found it slow and cumbersome, and borg looks to be even worse. I had heard of rclone but not really looked into it. I just spent a few minutes looking at its docs. It is nice in some ways, but rclone crypt leaks too much metadata imho, it has a few design…
-
@Hetzner_OL I haven't yet figured out a good way to set up a storage box for encrypted backup, other than just saving encrypted tar files to it by sshfs or sftp, in a manual and ad-hoc way. That will be good enough for my immediate cold backups but I would like to figure out something better. There is another thread about…