One other variable to consider is the inbound throttling by your cloud storage vendor – I have a 20MBps upstream pipe, but Carbonite was only allowing me to utilize about 4MBps for my initial upload stream. If you call them and complain, they can change that (temporarily). 500GB took me almost 30 days to completely sync including the daily “immediate backups†too.
From: vantage@yahoogroups.com [mailto:vantage@yahoogroups.com]
Sent: Tuesday, April 21, 2015 12:11 PM
To: Vantage
Subject: Re: [Vantage] OT - backups network files
That is directly correlated to the location which you are backing up to and your upload bandwidth.
If you are backing up to the Cloud take your Upload Bandwidth to that location (assuming there is nothing else going on) and Divide it by 12 TB.
for instance my Up Load bandwidth to my backup location is around 20 Mbps (that's Megabits per second) so 12 TB being approximately 96000000 megabits it could take about 4800000 seconds or 1333 hours to backup that data to my backup location. (Granted you almost never get your full bandwidth worth of transfer speed because of overhead and other network traffic issues but that would be your "OPTIMAL" performance)
Now if you are backing up to a Hard Drive your "Upload" bandwith is much higher (SSD's can get up to 600 MB(that's MegaBytes per second) writes again 12 TB being approximately 12000000 MB it could take about 20000 seconds 5.5 Hours to Copy the data. Assuming that your original hard drive can read fast enough to keep the SSD busy.
If you are going to Hard Drive but that Hard Drive is somehwere in your network (internal) once again you have to go by the Network Upload speed (which internal network PC to PC you can get around 1 Gigabit/s if you have fast Switches / NICs) which is around 125 MB (Megabytes Per Second).
Anyways you get the idea, it all depends on where you are going and how much bandwidth you've go to get there. Either way backing up 12 TB is a HUGE amount of data you might be better served by using a backup company that allows you to "Mail In" in a Hard Drive to "jump start" the backup and the use Differential to keep it in Sync.
Hopefully I did all the math right hehe
On Tue, Apr 21, 2015 at 11:50 AM, Manasa Reddy manasa.reddy@... [vantage] <vantage@yahoogroups.com> wrote:
How long does it take to back up 12TB? Manasa
From: vantage@yahoogroups.com [mailto:vantage@yahoogroups.com]
Sent: Tuesday, April 21, 2015 10:42 AM
To: vantage@yahoogroups.com
Subject: Re: [Vantage] OT - backups network files
OK, I misunderstood. I thought you were just talking about Epicor backup. I backup about 40 workstations and 12 servers onto about 12TB of storage with Appassure. I can go back about a 10 days on my restores. I use to do just the data on the workstations, but now these are all complete backups which really comes in handy when I have to replace a crashed hard drive. Appassure has a bare bones restore.
I'm not trying to sell you on Appassure. There are plenty of backup solutions out there that do the same thing.
Steven G.
On Tuesday, April 21, 2015 9:18 AM, "Manasa Reddy manasa.reddy@... [vantage]" <vantage@yahoogroups.com> wrote:
I will look into that as well….thanks Todd!
Manasa
From: vantage@yahoogroups.com [mailto:vantage@yahoogroups.com]
Sent: Tuesday, April 21, 2015 9:17 AM
To: vantage@yahoogroups.com
Subject: RE: [Vantage] OT - backups network files
Interim solution. Move one whole Full backup to Glacier. Then set backup settings to not backup anything not modified in past 3 months. If something does change since the Glacier move it will start getting caught in the local backup. In the meantime local backup should reduce to ½ or even ¼ of the current time – or less.
-Todd
From: vantage@yahoogroups.com [mailto:vantage@yahoogroups.com]
Sent: Tuesday, April 21, 2015 8:12 AM
To: vantage@yahoogroups.com
Subject: RE: [Vantage] OT - backups network files
Very true comment….and I have no idea. It would be something to investigate but it would be a project I really do not have time for right now. Maybe it really is not as bad as I think it is but I have way too much on my plate as a one person IT gal over here!
Manasa
From: vantage@yahoogroups.com [mailto:vantage@yahoogroups.com]
Sent: Tuesday, April 21, 2015 9:07 AM
To: vantage@yahoogroups.com
Subject: RE: [Vantage] OT - backups network files
How volatile is any of that network storage stuff? I’ve found that most of it (CAD drawing PDFs for example) never change but are only there “just in caseâ€. At a former employer we were using Amazon Glacier storage for a lot of that. Retrieval (just in case) was slow but file assurance and integrity was high. When a file had last been accessed over 3 to 6 months ago it was moved to Glacier. Sort of a data attic.
-Todd C.
From: vantage@yahoogroups.com [mailto:vantage@yahoogroups.com]
Sent: Tuesday, April 21, 2015 7:50 AM
To: vantage@yahoogroups.com
Subject: RE: [Vantage] OT - backups network files
Actually that is the one thing I am happy about…my Epicor backups are no problems. We do have a relatively large SQL database, about 90 GB. My issue is more on the network files, all of our word docs, excel, etc.
That is where we have 2 TB and growing data….this is what takes 3 days to back up. I’ve been backing up Epicor in a different manner and I am ok with that right now until I can reduce the amount of time it takes to back up all of my other files.
Manasa
From: vantage@yahoogroups.com [mailto:vantage@yahoogroups.com]
Sent: Tuesday, April 21, 2015 8:38 AM
To: vantage@yahoogroups.com
Subject: Re: [Vantage] OT - backups network files
My first question is are you Progress or SQL? If SQL, are your transaction logs being properly cleaned up after a backup. The reason I ask is there may be ways to reduce your database size.
We use Dell Appassure backup which they have finally gotten to a point where it is a fairly good product. It speaks SQL, so backup or restore of your live database is no problem and once you have a complete backup, all you would need are incrementals (which Appassure call snapshots). Its not cheap, but I'm happy with it.
Steven G.
On Monday, April 20, 2015 5:31 PM, "Manasa Reddy manasa.reddy@... [vantage]" <vantage@yahoogroups.com> wrote:
To answer the why on the full backup…apparently my backups had been failing for the last month, so I need at least one good full back up! I have no issues with incremental or differential….
That said, what was the cost for the carbonite? Also, how are they on security?
Manasa
From: vantage@yahoogroups.com [mailto:vantage@yahoogroups.com]
Sent: Monday, April 20, 2015 4:46 PM
To: vantage@yahoogroups.com
Subject: RE: [Vantage] OT - backups network files
Why do you need to do full backups? As opposed to incremental/differential..?
We use Carbonite as one of our backup solutions. It’s constantly backing up all day, all night. Someone changes a file, boom, it’s backed up immediately. I also do a full local backup; hard drive space is cheap these days – I have a 6TB USB 3.0 external hard drive unit that I have attached to a sandbox server that I initially did a full copy-to of all my network files. Then I created a BAT file using the ForFiles command and I launch the BAT file twice daily and copy up any modified files to the 6TB drive. I also have a spare 6TB unit sitting to the side… why not, it was only $500 at the time. So I have redundancy to my redundancy and I have two complete copies of my data, one local and one in the cloud.
I will say, if you do choose a cloud backup solution (ie, Carbonite), it will take about 30 to 45 days for it to get the initial full backup established. I had about 500GB at first and it took 30 days. It’s not based on your upstream bandwidth, rather it’s throttled by Carbonite themselves.
For me, Carbonite has been fantastic with the “Ooops, I deleted a file†questions and “Ooops, I need to go back 3 versions of a saved file†problems…. Carbonite stores up to 7 historical versions of each file. Handy. But for Disaster Recovery, Carbonite isn’t the best answer due to speed at “getting the stuff local againâ€. Again, it’s throttled, and trying to download 94,563 files comprising 500GB total took almost 36 painstaking hours. They can send you media overnighted, so that could’ve been an option. – But now I know better and I also keep a full backup local.
From: vantage@yahoogroups.com [mailto:vantage@yahoogroups.com]
Sent: Monday, April 20, 2015 3:21 PM
To: vantage@yahoogroups.com
Subject: [Vantage] OT - backups network files
We are reaching over 2TB of data and to run a full back up is taking way too long (more than 3 days over a weekend). I know why in terms of how we have it set up, but I was curious to know if anyone out there has a solution for backing up this much data in a much shorter time period. And if you do, what is it?
Thanks! Manasa
IMPORTANT NOTICE FROM API: This communication, including any attachments, contains information that may be confidential or privileged and is intended solely for the entity or individual to whom it is addressed. If you are not the intended recipient, please contact the sender immediately and delete this message. Any unauthorized disclosure, copying or distribution of this message is strictly prohibited.
IMPORTANT NOTICE FROM API: This communication, including any attachments, contains information that may be confidential or privileged and is intended solely for the entity or individual to whom it is addressed. If you are not the intended recipient, please contact the sender immediately and delete this message. Any unauthorized disclosure, copying or distribution of this message is strictly prohibited.
IMPORTANT NOTICE FROM API: This communication, including any attachments, contains information that may be confidential or privileged and is intended solely for the entity or individual to whom it is addressed. If you are not the intended recipient, please contact the sender immediately and delete this message. Any unauthorized disclosure, copying or distribution of this message is strictly prohibited.
IMPORTANT NOTICE FROM API: This communication, including any attachments, contains information that may be confidential or privileged and is intended solely for the entity or individual to whom it is addressed. If you are not the intended recipient, please contact the sender immediately and delete this message. Any unauthorized disclosure, copying or distribution of this message is strictly prohibited.
IMPORTANT NOTICE FROM API: This communication, including any attachments, contains information that may be confidential or privileged and is intended solely for the entity or individual to whom it is addressed. If you are not the intended recipient, please contact the sender immediately and delete this message. Any unauthorized disclosure, copying or distribution of this message is strictly prohibited.
IMPORTANT NOTICE FROM API: This communication, including any attachments, contains information that may be confidential or privileged and is intended solely for the entity or individual to whom it is addressed. If you are not the intended recipient, please contact the sender immediately and delete this message. Any unauthorized disclosure, copying or distribution of this message is strictly prohibited.
IMPORTANT NOTICE FROM API: This communication, including any attachments, contains information that may be confidential or privileged and is intended solely for the entity or individual to whom it is addressed. If you are not the intended recipient, please contact the sender immediately and delete this message. Any unauthorized disclosure, copying or distribution of this message is strictly prohibited.
IMPORTANT NOTICE FROM API: This communication, including any attachments, contains information that may be confidential or privileged and is intended solely for the entity or individual to whom it is addressed. If you are not the intended recipient, please contact the sender immediately and delete this message. Any unauthorized disclosure, copying or distribution of this message is strictly prohibited.
IMPORTANT NOTICE FROM API: This communication, including any attachments, contains information that may be confidential or privileged and is intended solely for the entity or individual to whom it is addressed. If you are not the intended recipient, please contact the sender immediately and delete this message. Any unauthorized disclosure, copying or distribution of this message is strictly prohibited.
IMPORTANT NOTICE FROM API: This communication, including any attachments, contains information that may be confidential or privileged and is intended solely for the entity or individual to whom it is addressed. If you are not the intended recipient, please contact the sender immediately and delete this message. Any unauthorized disclosure, copying or distribution of this message is strictly prohibited.
IMPORTANT NOTICE FROM API: This communication, including any attachments, contains information that may be confidential or privileged and is intended solely for the entity or individual to whom it is addressed. If you are not the intended recipient, please contact the sender immediately and delete this message. Any unauthorized disclosure, copying or distribution of this message is strictly prohibited.