PDA

View Full Version : How often do you backup your site and or dedicated server?


Steve_S
10-24-2001, 12:57 PM
Please only vote once. This Poll is for folks with virtual sites and dedicated servers. Please share your tips and procedures on exactly how you perform backups. If you are a "host" it would also be helpfull to learn how you perform backups for your clients or if they use a control panel to perform backups. Please do not advertise :)

Additional questions that should help all of us: What media do you use? Where are the backups stored? What recovery method do you use? How do you backup mySQL data?

One method which I tell folks to run at least every week and which I also use via Telnet to backup an entire site:


tar -cvf - /home/mysite | gzip -c > /home/mysite/backup.tar.gz


Download (Binary) the backup.tar.gz archive and make at least 2 copies of this archive. One copy needs to go on removeable media and stored in a fireproof container off site. I like burning the archive to CD. WinZip does a dandy job of exstracting the contents of this archive if I need to recover data and or files.

And you?

singloon
10-24-2001, 01:17 PM
I backup all mysql databases (0.8GB in total) every 12 hrs onto my server, download a copy every 2 or 3 days to local pc :)

I probably backup my server 2 or 3 times a month

and for both i transfer a copy to a 2nd server just in case :)

i hope to have raid disks one day though for added peace of mind :D

notibrian
10-24-2001, 01:25 PM
i never backup anything, as i have all my sites in my hardisk. but just recently i have hosted some of my friends site and have been concerning about backuping, is there any script/program that can backup everything (email,mysql,all the sites on the server) and zip it in a compressed file?

i am using raq3 server ... is the two backup options Legato and Arkeia recommendable? which one is better?

Scuba
10-24-2001, 02:09 PM
I have two copys of my site at any time,
One on my computer and second on the web server. In my openion if the server will go down in a way non recoverble by the host I can always upload and if my computer will go down I can always down load.
* My site don't contain scripts or a self changing DB.
Apart from this the site is being saved on a CDR every ones and then when I backup files to clean up the HD. (you will not belive how fast a 3X 60G IBM Raid 0 can be filled). :angel:

Kathy
10-26-2001, 09:01 AM
My server has a raid built in which helps for piece of mind....but I run a cron once a week to back up the entire server on to a tape. I have 4 tapes and they are rotated so that I have my server backed up weekly...and have the past month's weekly files available. They are tar zipped in the process.

I've actually used my backup. I can't remember why...but I lost a hunk of data. It took a while to retrieve the data and lost files but it worked.

ALthough I would prefer to back up my server daily (:D), I figure if something happens, my members would have to understand that we are doing the best we can to keep all data/files/posts but this isn't possible 100% of the time.

Gracklor
10-26-2001, 03:29 PM
All of my html code for my site is on my hard drive. (I don't use online databases or anything like that.) Because I only have a virtual server, I don't really need anything fancy to do backups. However, I do backup my computer's hard drive to a tape drive weekly. I assume that I would be backing things up big time (RAID, downloading zipped files, and archiving them) if I had an actual dedicated server, but for now, my hard drive will do. :)

mjames
10-26-2001, 06:50 PM
I'm not sure how this is done exactly because my wonderful host (HostRocket) arranged it, but my MySQL database for my vBulletin is backed up every 24 hours.

All my web site files are on my hard drive, so no need to backup there.

inogenius
10-26-2001, 08:44 PM
I have all my PHP scripts and HTML files backed up, but as my database I never back that up. Not even sure how. I'm afraid that if I tried I would ***** something up.

Ted S
10-26-2001, 09:08 PM
I backup mysql all the damn time (basically whenever I feel like changing anything).... sometimes that means daily, sometimes its weekly but always receently.

As for webfiles, I have all my scripts locally, all configured, etc... most of the images and other content is around on varrious cds and every now and then, we do back it up but thats not my job :)

singloon
11-01-2001, 07:42 AM
why is this thread being updated (last post date is Nov 1) but last thread i can see is Oct 27 ?? http://geekvillage.com/forums/showthread.php?s=&postid=77605#post77605

sdarken
11-13-2001, 01:50 PM
I think threads get bumped to the top when someone answers the poll (see the top of this thread). I've seen this happen before. It's a bit annoying isn't it.

FC
11-13-2001, 04:12 PM
I backup once a day, with use of a script, and automaticly SSH them to another server. Secure and fast.

I'm also using linux software raid (mirror) on 2 IDE 7200 rpm disks which is performing VERY well.

Cheap and safe!.

There is a bit more of a hassle when one software-raid disk fales, beats the costs of a hardware RAID config anyhow.

singloon
11-13-2001, 08:06 PM
Originally posted by sdarken
I think threads get bumped to the top when someone answers the poll (see the top of this thread). I've seen this happen before. It's a bit annoying isn't it. i'm okay with that just that the last poster on this thread is never the last post creator... it doesn't hapen now.. i.e i saw FC last poster name and indeed there is a last post there

oh well 2.2.0 might have fixed it :)

singloon
11-13-2001, 08:08 PM
Originally posted by singloon
I backup all mysql databases (0.8GB in total) every 12 hrs onto my server, download a copy every 2 or 3 days to local pc :)

I probably backup my server 2 or 3 times a month

and for both i transfer a copy to a 2nd server just in case :)

i hope to have raid disks one day though for added peace of mind :D from the above polling results, am I the only one who backs up every 12 hrs ???? :)

Steve_S
12-07-2001, 03:50 PM
I certainly hope not Georgie :) Although it appears we are in the minority. I find this quite surprising and dissapointing.

"An accident waiting to happen" as Dad used to say.

This box even has a tape backup. DI uses the Tivoli Storage Management Backup and Restoration. Sweet :)

The web interface for manuall stuff is kind of ugly and clunky but the rest is dynamite :)

Steve_S
12-08-2001, 06:08 PM
AND if I could respectfully suggest based on an email I just received from a third party:

Raid/Mirror on a server/machine connected to the net can be hacked and the drive nuked. Tape in a secure location is better.

singloon
12-13-2001, 01:43 AM
Originally posted by Steve_S
AND if I could respectfully suggest based on an email I just received from a third party:

Raid/Mirror on a server/machine connected to the net can be hacked and the drive nuked. Tape in a secure location is better. you sure about that Steve ? i gotta ask around because my next planned server for web hosting will be raided

Steve_S
12-25-2001, 08:29 PM
Georgie Geek :)

Merry xmas :)

Yep, I'm very sure that this procedure should never be done.

This issue brought tears to my eyes. One of THE very very best sites in it's space. With an outstanding BB that we all loved. A name you will certainly recognize as it's our very own "Arie"

Read it here:

http://www.infinisource.com/features/hacked.html

Tape or another data center/Host is the only way to go. Preferably behind a firewall. If all else fails a regular download to your local machine which is not connected to the net or sits behind a real firewall.

Buy his stuff and help the cause at:

http://www.rosecitysoftware.com/

He may need some help bringing his BB up <wink> so your outstanding expertise in this area will certianly be helpfull.

singloon
12-25-2001, 11:34 PM
Arie told me about that unfortunate incident :(

so they got in through wu-ftp security bug and not the raid itself

Jan
01-02-2002, 05:17 PM
Yesterday,
All those backups seemed a waste of pay.
Now my database has gone away.
Oh, I believe in yesterday.

Suddenly,
There's not half the files there used to be.
There's a deadline hanging over me.
The system crashed so suddenly.

I pushed something wrong.
What it was I could not say.
Now- all my data's gone
And I long for yesterday-ay-ay-ay...

Yesterday,
The need for backups seemed so far away.
I knew my data was all here to stay.
Now I believe in yesterday...

:angel:

batcavenet
01-21-2002, 12:36 AM
Every day - all data is a good idea :) and have a lot of tapes - like one per day for 30 days - that's just me - JDT

demae
01-24-2002, 04:44 PM
Right. RAID just makes a real-time copy of the hard drive. If the files on the hard drive get deleted/corrupted, the RAID copy likewise gets deleted/corrupted.

I use a daily cron job that runs rsync (http://samba.anu.edu.au/rsync/) to synchronize the files on a remote server. This is an incremental backup, so I could recreate the state of the hard disk for any day up to 7 days ago. The backup server has access to read the main server and no more. The main server has no access to the backup server.

It actually came in handy when the disk on my RackShack AMD Duron got corrupted just last Sunday, and their techs claimed that they could do nothing except restore the hard drive. I had a 20 hour old backup and managed to get my sites up and running in a few hours using the backup (after my hardware was operational again).

It was a bit of a pain to restore things because my backup only backed up data, not software (which I had to reinstall). If I had configured the backup to also get the software that I installed, it could have been a near-instantaneous restore. (Hmm, I could have found the files for all the software by doing a "find /" based on date.)

Furton
02-10-2002, 07:08 AM
I've never backed up my server, even when upgrading stuff like forums and news system's.

I would backup my server if I could find a program that would do it all for me, say every 24 hours.

mjames
03-22-2002, 09:04 PM
Originally posted by Furton
I've never backed up my server, even when upgrading stuff like forums and news system's.

I would backup my server if I could find a program that would do it all for me, say every 24 hours.
I can understand your unwillingness to do the tedious task of backing up regularly, but before doing an upgrade that can crash your site, I think it's better to be safe than sorry.

And you can actually use crontabs to automatically backup your servers. I'm not an expert on that, but if you do a search, you'll likely find a tutorial.

insiderhosting
03-23-2002, 02:35 PM
Originally posted by Furton
I've never backed up my server, even when upgrading stuff like forums and news system's.

I would backup my server if I could find a program that would do it all for me, say every 24 hours.

Actually, it is quite an easy thing to do if you have a good control panel or SSH/telnet. Depending on what forums you use, you can setup a cronjob to automatically backup the mysql databases on your site. You should backup your site with the tar command. To find the appropriate tar command, login to your server via SSH and type man tar.

Steve_S
04-09-2002, 12:21 PM
If you need a shell script to BU your MySQL database which works very well and runs via a crontab see Tip 1 on:

http://www.geekvillage.com/vbulletin_review.htm

It has lot's of options and is rock solid. You may have to tweak the code a bit to make it work.

HTH

singloon
04-09-2002, 08:24 PM
Originally posted by Steve_S
If you need a shell script to BU your MySQL database which works very well and runs via a crontab see Tip 1 on:

http://www.geekvillage.com/vbulletin_review.htm

It has lot's of options and is rock solid. You may have to tweak the code a bit to make it work.

HTH
---> ATTENTION funky duck ONLY <--- :D

LastActionHero
05-11-2002, 10:44 AM
How about backing up the entire site and FTP'ing it. Is this possible automatically? Right now I have to do this manually everytime.

batcavenet
05-20-2002, 12:25 PM
I backup my servers onsite and offsite each day :) never can be too careful

JDT

Steve_S
05-20-2002, 12:33 PM
Amen !

"Better safe than sorry"

Unfortunetly, hard drives don't page you or send you a nice email when they are failing. :)

singloon
05-20-2002, 01:27 PM
Originally posted by Steve_S
Amen !

"Better safe than sorry"

Unfortunetly, hard drives don't page you or send you a nice email when they are failing. :) maybe one day :)

wsz
06-21-2002, 02:24 AM
Backup to hard drive of local computer:

I keep a full, current copy of each site here at all times, except for very rencent forums and very recent changes to ad-rotation script. The copy (including static HTML pages) is saved to CD every two weeks.


Backup of forums and changes to ad-rotation:

Downloaded to local machine (and added to full site copy, incluing static HTML pages) burned to CD every two weeks.


CD backups are currently kept on site, although I think that I should get a bank safe-deposit box soon (and maybe have a friend keep a copy at their house) in case of fire, etc.

petertdavis
05-05-2003, 09:40 PM
My hosting company backs up customer data on our shared servers daily to a backup hard drive. Each of our shared servers has two hard drives, and does a back up during off hours. It seems to me that most hosting customers think that their host backs up their sites, but don't really know their host's policy on the subject. I still recommend customers to keep their own backups. Our backup drive does protect them in the case of a primary drive failure, but it doesn't protect them from a catastropic event that would destroy our servers, like a fire.

Back up your sites now folks!

katcook
08-15-2003, 12:16 AM
My web host does the backups and they do a nice job.

Only when I make major updates to the database, do I manually do a dump. Thank God I do that.

Once I was testing a pretty new gadget that I thought my members would really appreciate. But it ended up deleting them and all their preferences. Yet like superhero, I was able to restore them to their former glory - from the dump.

Ted S
08-15-2003, 03:21 AM
I was sitting around today thinking about the wonderful power outages in NY (not that I was anywhere near them) when I got an email from my host talking about how their server was up but varrious peers were down, etc... Of course that got me thinking... if my site went down and the data was lost, what would it take to rebuild? Sure I've got all the files for all my sites... all the images, scripts, etc... but the database info wasn't backed up anywhere. Needless to say I'm going to be backing it up far more often now!

Steve_S
08-15-2003, 04:06 PM
funny, I was thinking the same thing last night but since my middle name is "redundancy" I had a good nights sleep.

Compliments of the vB GODS and a valuable solution for backups via crontab. Edit to suite your mood :) and good for any MySQL db.

----Begin:

#!/bin/sh

echo<<header "
################################################## ###
# ---> ATTENTION funky duck ONLY <--- #
# #
# ---> HAVE YOU DOWNLOADED YOUR BACKUPS? PLEASE! #
# #
# Makes multiple backups of my vB mysql data #
# Makes up to 7 backups and then starts over #
# test and run from root as----> sh filename #
# Archives are located in /bath/to/archives #
################################################## ###
"
header

# List all of the MySQL databases that you want to backup in here,
# each seperated by a space
databases="mydbname"

# Directory where you want the backup files to be placed
backupdir=/path/to/store/backups

# Directory where you want an extra backup placed at a specified interval
extra_backupdir=/path/to/store/backups

# MySQL dump command, use the full path name here
mysqldumpcmd=/usr/bin/mysqldump

# MySQL Username and password
userpassword="-uname -pyourpassword"

# MySQL dump options
dumpoptions=""

# Unix Commands
gzip="/bin/gzip -f"
uuencode="/usr/bin/uuencode"
mail="/usr/sbin"

# Maximum number of backups to keep around
max_backups=7

# Backup number at which an extra backup should be made (set to
# zero if you don't want extra backups)
extra_backup=0

# Send Incremental Backup? Would you like the more frequent backup emailed to you?
# Set to "y" if you do or n
sendincbackup="n"

# Send Extra Backup? Would you like the extra backup emailed to you?
# Set to "y" if you do
sendextrabackup="n"

subject="vB_Database"
mailto="webmaster@yourdomain.com"

################################################## ##############

DAY=$(/bin/date '+%Y.%m.%d-%H%M')

for database in $databases
do
sequence_file="${backupdir**/${database**.seq"
if [ -e "$sequence_file" ]
then
read backup_count < $sequence_file
else
echo 1 >> $sequence_file
backup_count=1
fi

# Dump out the database
echo "Working on ${database** database:"
echo -n "-> Dumping database............... "
$mysqldumpcmd $userpassword $dumpoptions $database >${backupdir**/${database**.sql.backup${backup_count**
echo "done."

# Compress all of our backup files
echo -n "-> Compressing database dump...... "
$gzip ${backupdir**/${database**.sql.backup${backup_count**
echo "done."

# Make the additional backup
if [ "$backup_count" = "$extra_backup" ];
then
echo -n "-> Creating additional backup..... "
cp ${backupdir**/${database**.sql.backup${backup_count**.gz ${extra_backupdir**/${database**.sql.$DAY.gz
echo "done."
if [ $sendincbackup = "y" ];
then
echo -n "-> E-mailing additional backup.... "
#$uuencode ${extra_backupdir**/${database**.sql.$DAY.gz ${database**.sql.$DAY.gz > ${extra_backupdir**/${database**.sql.$DAY.gz.uu
#$mail -s "$subject : ${database**.sql.$DAY.gz" $mailto < ${extra_backupdir**/${database**.sql.$DAY.gz.uu
#rm ${extra_backupdir**/${database**.sql.$DAY.gz.uu
echo "done."
fi
fi

# Send the incremental backups via email
if [ $sendincbackup = "y" ];
then
echo -n "-> E-mailing incremental backup... "
# $uuencode ${backupdir**/${database**.sql.backup${backup_count**.gz ${database**.sql.backup${backup_count**.gz > ${backupdir**/${database**.sql.backup${backup_count**.gz.uu
# $mail -s "$subject : ${database**.sql.backup${backup_count**.gz" $mailto < ${backupdir**/${database**.sql.backup${backup_count**.gz.uu
# rm ${backupdir**/${database**.sql.backup${backup_count**.gz.uu
echo "done."
fi

backup_count=`expr $backup_count + 1`
if [ "$backup_count" -gt "$max_backups" ];
then
backup_count=1
fi
echo $backup_count>$sequence_file
echo "Finished with ${database** database! --> funky duck, don't forget to download your archives. PLEASE!"
echo ""

done


----------------------end

swifthost
03-01-2004, 11:59 PM
We do an incremental backup of all our servers on a daily basis. The files are backed up to a remote server for redundancy. Since this backup does not include Windows permisssions, we also run a scheduled windows backup job every night.

Regards,
Vish Nathan
http://www.swifthost.com

fawh
12-09-2004, 09:02 AM
I backup my site every time I do an update.

Larwee
12-09-2004, 09:38 AM
Wow! This is really a very old thread. But, I'll also respond since it has been brought back to life.

I do back of of each update as it is made. Then the entire site is back up each day.

I don't like to take chances so I actually quadruple backup. This is in addition to the backup done by my host.

I have two copies. My other two back up copies are kept at two different locations in different parts of town.

While I might carry things to an extreme. Some people don't back up at all and find themselves in a terrible jam when something goes wrong. It pays to back up.

CPMNewbie
12-13-2004, 01:56 AM
I have an automated daily backup to backup crucial files and folders.