Aspies For Freedom
The importance of backups - Printable Version

+- Aspies For Freedom (http://www.aspiesforfreedom.com)
+-- Forum: Special Interest (/forumdisplay.php?fid=53)
+--- Forum: Computers / technology (/forumdisplay.php?fid=14)
+--- Thread: The importance of backups (/showthread.php?tid=21480)


The importance of backups - Gareth - 01-27-2011 12:11 AM

Posted on the OU forums, thought some here might also find it of interest:

Quote:
I thought i'd share a little tale that hilights the importance of backups (including spare hardware that's verified to work).

Like many geeks I have a cupboard full of old computers and computer parts, including one whole system that has all the same specs as my main desktop and lacks only the harddrives (for use as an emergency backup if my main system fails). I also have various online services and external USB drives for taking backups.

Problem is I don't take those backups often enough.

When my main desktop died recently (i've been having overheating issues for a long time - they finally killed my CPU) I tried to fix it, found it just wasn't booting no matter what I did and pulled the drives to use with the spare hardware - the spare hardware that hadn't been tested for months and was in the cupboard.

This spare machine did boot to the BIOS and the bootloader started fine. However as soon as the kernel loaded and went into protected mode (first thing it does after loading) the computer shutdown. I tested with a few different kernels and other operating systems and only FreeDOS would boot.

On advice of a friend I updated the BIOS from FreeDOS. I got a few shiny options in the BIOS setup utility, but it still didn't boot into protected mode no matter what I did.



Fearing the worst (since this was identical hardware apparently to the old system and so the software configuration on my old harddrives should "just work") I ordered some external drive enclosures on the theory that i'd have access to my data from my laptop (not having another desktop machine to use this was the only option). I also ordered a new motherboard, CPU and RAM thinking that in a worst-case scenario i'd reinstall the OS.

When all this stuff came, I stuck the new mobo,CPU and RAM into my original desktop and crossed my fingers. It booted fine, but there was filesystem damage from not shutting down properly.

LUCKILY I had lost no data and the drive enclosure remains in the original packaging. However the whole incident has made me learn a few lessons:


1 - If you have some spare hardware for emergency use, boot it every now and then to test it

2 - Make regular backups - don't procrastinate. I was lucky not to have lost my data, but next time I might not be. I'm now setting up a cron job to automatically backup my home directory and anything else of importance

3 - Check those backups and make sure it's easy to restore the whole lot or just a single file. I had my TMA02 open when my desktop first died and was very concerned the filesystem damage may have caused it to not be saved correctly (luckily I had in fact saved it just a minute before the shutdown so didn't lose a lot of work). If the file was corrupted I may have had to restore that single file from backup.

4 - If you're storing backups anywhere but your own property, encrypt it. Even if you think nobody's interested, if you do a full system backup and you use your computer on a regular basis there WILL be some sensitive information in there somewhere. Better to be safe than sorry. Encrypting your backups also allows you to safely pass them to random strangers for safekeeping (so long as you use strong enough crypto - be paranoid). I've long been encrypting backups of a website's database I run and then letting random users keep hold of the encrypted backup.

There you go, that's today's safety lesson.




RE: The importance of backups - skyblue1 - 01-27-2011 03:12 AM

I would never store my files on my OS drive. The only thing on my main drives are my OS loaded with all my programs. Any work done goes to my other drives, ( I also have duplicates of all my work on other drives). I re-image my main drives  every week. You cant ever tell when a drive will go bad (even tho there are frequently clues),so with my images stored elsewhere, I just slide in a new drive.

Kind of anal I guess, all the redundacy.


RE: The importance of backups - Gareth - 01-27-2011 10:59 AM

I do have 2 seperate drives (1 for the OS, 1 for /home), but both require a functional desktop to access, or an external enclosure to connect to a laptop.


RE: The importance of backups - et - 01-27-2011 11:02 AM

If you have two drives then RAID-1 is a good option.  That gives you two copies of your data so losing one drive shouldn't cause any problems.  It also means that if you are testing something you can use only one disk.  For example when your computer dies and you use another it might be a good idea to test with one drive first, it would suck if the second computer had a problem that killed hard drives...


RE: The importance of backups - Gareth - 01-27-2011 11:19 AM

I have 2 drives with different data and of different size.
When I have the cash i'll get myself 2-4 SATA drives and use the hardware RAID, i'll probably also update my linux distro to something more modern and 64-bit (it sucks having 4GB of RAM installed when there's only 3GB available for use).
Anyone know a good source of cheap but large-capacity and reliable SATA drives?


RE: The importance of backups - et - 01-27-2011 11:34 AM

Don't use hardware RAID.  Hardware RAID that is affordable isn't much good and hardware RAID that is good is really expensive while offering little benefit over software RAID for home use.

Running a 64bit OS doesn't impact whether you get 4G of RAM.  A 32bit OS with a kernel that supports PAE can use up to 64G - although one process can only use 3G.  PAE kernels tend to be default nowadays, so if you have only 3G available it probably means you have one of those crappy Intel chipsets that only have 32 addressing lines and reserve about 768M for memory mapped IO.  If that's the case then a 64bit kernel will not make more RAM available, it will however make applications use more RAM and thus give you less RAM that you can effectively use.

64bit does give you some real benefits, faster computation for things that need big numbers or more registers and better NX support.  But in your case you won't get any RAM benefit that you couldn't get from a PAE kernel.

As for cheap SATA drives, they are all cheap commodity items nowadays, so your chance of getting any significant discount over what a corner store offers is pretty small.  I'm not aware of any difference in quality between the various brands, I just buy whichever is cheaper.


RE: The importance of backups - Gareth - 01-27-2011 11:57 AM

With regards to RAID, what specifically would make the hardware raid built into my motherboard "not much good"? It would seem to have superior performance due to offloading the processing required to the hardware, or am I mistaken? Software RAID or something similar (there's RAID-like features in the linux LVM which is used by default in my distro of choice) would appear to require more processing done by the software RAID driver whenever there is disk I/O.

I'm not using a PAE kernel either and it definitely is not an intel chipset. I was using a PAE kernel at one point but found that the nvidia drivers did not like it and thus I had no 3D acceleration.

Quote:
[gareth@lovely ~]$ uname -a
Linux lovely.home.garethnelson.com 2.6.27.19-170.2.35.fc10.i686 #1 SMP Mon Feb 23 13:21:22 EST 2009 i686 athlon i386 GNU/Linux

As you can see, it's kinda ancient (fedora core 10, latest is fedora core 14) and in need of an update anyway. If i'm going to update it I might as well go 64-bit.


RE: The importance of backups - Gareth - 01-27-2011 12:02 PM

http://www.codinghorror.com/blog/2007/03/dude-wheres-my-4-gigabytes-of-ram.html


RE: The importance of backups - et - 01-27-2011 03:21 PM

In terms of RAM availability the Intel Chipsets Wikipedia page has a good summary.  If you have a chipset that only supports 4G of RAM then you are stuck with a maximum of just over 3G of usable RAM.  I've got a E2160 system with such a chipset, when I installed 4G I got 3.25G available when running a 64bit kernel.

Gareth Wrote:
With regards to RAID, what specifically would make the hardware raid built into my motherboard "not much good"? It would seem to have superior performance due to offloading the processing required to the hardware, or am I mistaken? Software RAID or something similar (there's RAID-like features in the linux LVM which is used by default in my distro of choice) would appear to require more processing done by the software RAID driver whenever there is disk I/O.


I've written a document explaining some of the issues at this URL.  It's a question that gets asked a lot.

Gareth Wrote:
I'm not using a PAE kernel either and it definitely is not an intel chipset. I was using a PAE kernel at one point but found that the nvidia drivers did not like it and thus I had no 3D acceleration.

Quote:
[gareth@lovely ~]$ uname -a
Linux lovely.home.garethnelson.com 2.6.27.19-170.2.35.fc10.i686 #1 SMP Mon Feb 23 13:21:22 EST 2009 i686 athlon i386 GNU/Linux

As you can see, it's kinda ancient (fedora core 10, latest is fedora core 14) and in need of an update anyway. If i'm going to update it I might as well go 64-bit.


64bit is the way things are going, so it's probably a good thing to do.  Incidentally you don't need to have 64bit user-space to get the benefit of 64bit kernel addressing.  You can run a 64bit kernel with 32bit user-space.  Even the 32bit modprobe works with it!  But upgrading from FC10 is a good idea.

I am not certain that Intel is the only company to produce crap chipsets that force people to upgrade machines earlier than they should.

NVidia is just bad.  I'd rather use any other video card.  Even the cheap built-in Intel ones are more generally useful.


RE: The importance of backups - Gareth - 01-27-2011 04:02 PM

This chipset supports up to 16GB of RAM, so that isn't a problem.
I've never heard of mixing 32-bit userspace (and kernel modules? or just the userland modprobe?) with a 64-bit kernel, though I can see why it would work.


RE: The importance of backups - Gareth - 01-27-2011 04:11 PM

No intel in sight:
http://www.dabs.com/products/asus-amd-value-bundle--includes-m4n68t-m-le-v2-motherboard--athlon-ii-x2-250-3-0ghz---2gb-patriot-ddr3--77WS.html


RE: The importance of backups - - 01-27-2011 07:49 PM



Viper is System, Inhert is Media, Anubis is Games, Jehuty is "other" - drivers, patches, mods and so on. Documents are stored on Jehuty.

BM-870 I've yet to make an icon for (it's a PMP), and G:, H:, I: and J: don't exist - they're virtual drives. Eddie, Juna, Laughingman and EVA are card reader.

If I need to do a nuke, I only have to drop it on Viper - the rest are bereft of system files, only need to fix permissions after reinstall.

And yes, I made the all the icons but for the system default ones. Dead easy to do, too.

I hope like hell I've got a good couple of years left in my HDDs, because I simply can't afford to backup 4TB of crap.

...Should really clear out some of my junk and legacy driver files...


RE: The importance of backups - et - 01-27-2011 10:50 PM

Gareth Wrote:
This chipset supports up to 16GB of RAM, so that isn't a problem.
I've never heard of mixing 32-bit userspace (and kernel modules? or just the userland modprobe?) with a 64-bit kernel, though I can see why it would work.


Kernel modules have to match the kernel.  32bit kernel modules wouldn't work as they couldn't address all the RAM or parse the addressing necessary for getting data from user-space.


RE: The importance of backups - Gareth - 01-27-2011 11:46 PM

Yeah, I was skeptical of the idea you can insert 32-bit modules into a 64-bit kernel, though the userland modprobe utility in theory should work.


RE: The importance of backups - Gareth - 02-08-2011 09:13 PM

well I have fedora 14 installed on 2 1TB drives now. No RAID yet, but I will at some point get another 2 1TB drives to RAID1 the lot. Right now my old data is slowly copying over to the new drives (i'm typing this on my laptop).
I went with 32-bit for compatibility reasons and will give PAE another shot with the nvidia driver.


RE: The importance of backups - Gareth - 02-09-2011 12:36 PM

PAE and nvidia together are go!