Personal backups are important

This forum is for all Flare related Tips and Tricks.
Have a tip or trick you use while working in Flare? Share it here.
Post Reply
sdcinvan
Propellus Maximus
Posts: 1260
Joined: Wed Aug 21, 2013 11:46 am
Location: Vancouver, Canada

Personal backups are important

Post by sdcinvan »

So many times, I have encountered 'sad' BUT PREVENTABLE stories about people who lost 'x' days of work. Please don't wait until it is too late!

This morning, a dear friend told me about how she lost two months worth of documentation after her hard drive failed. She was extremely distraught and fearful of the consequences (but she is a star employee so probably unnecessarily concerned).

She is also angry because she was told that her computer was backed up each night but it appears that the background backup tool never worked. According to her IT guy, there is nothing that can be done and will replace her hard drive on Monday. I say, nonsense to 'nothing can be done'! but... even though I believe there is probably a level of incompetence on the part of her 'IT guy', I very strongly believe that we all need to take personal responsibility for our own work.

To that end (and the real reason why I am posting this), I created a simple batch file that she can run each morning and at the end of each day. I instructed her to buy a USB stick or USB 2.5 portable hard drive. This batch file offers two options: 1) Backup assigned folders to a common folder (merge/overwrite only old files); 2) Backup to a 'permanent' dated archive folder. The reason for running it twice (start and end of day) is so that the end of day backup only takes a few second to copy over only the changed content.

It is very easy to edit and I have commented on the functions. Of course, if you need any assistance, please ask.

Code: Select all

@echo off
rem set source folders to backup
set cpy1=Image_Resources
set cpy2=Adobe_Projects
set cpy3=Doc_Projects
set cpy4=Users\SamanthaL\Documents
rem set time stamped destination folder name and create new folder
for /f "tokens=1-3 delims=:/" %%i in ("%DATE%") do set DATESTAMP=%%k%%j%%i
rem

SET /P ANSWER=Create a dated archive on backup (Y/N)?
if /i {%ANSWER%}=={y} (goto :yes)
if /i {%ANSWER%}=={Y} (goto :yes)
goto :no

:yes
echo ***** Creating Dated Archive on Backup *****
md F:\BACKUP\%DATESTAMP%
goto :start

:no
echo ***** Merging-copying new content to common backup folder *****
rem Create a text file to indicate when the last backup occurred in this folder.
echo >> F:\BACKUP\__current\%DATESTAMP%-Last_BACKUP.txt 
set DATESTAMP=__current

:start
rem
xcopy D:\%cpy1% F:\BACKUP\%DATESTAMP%\%cpy1% /Y /S /I /D
xcopy D:\%cpy2% F:\BACKUP\%DATESTAMP%\%cpy2% /Y /S /I /D
xcopy D:\%cpy3% F:\BACKUP\%DATESTAMP%\%cpy3% /Y /S /I /D
xcopy C:\%cpy4% F:\BACKUP\%DATESTAMP%\documentation /Y /S /I /D
rem
pause
exit /b 1
I hope this helps someone. :D

BTW, I used to work as a forensic data recovery specialist and I have never encountered a drive that I couldn't extract data from. I'm going to see if I can recover her data over the weekend. I just have to find a way to instruct her how to remove the hard drive without her IT person going all crazy (he sounds like a dimwitted zealot). :roll:
Shawn in Vancouver, Canada
Main tools used: Flare 11.x, InDesign, Google Docs, Lectora, Captivate.
Report bugs: https://www.madcapsoftware.com/feedback/bugs.aspx ▪ Feature requests: https://www.madcapsoftware.com/feedback ... quest.aspx[/i]
Msquared
Propellus Maximus
Posts: 848
Joined: Mon Aug 06, 2012 10:19 am
Location: Southampton, UK

Re: Personal backups are important

Post by Msquared »

After hearing several backup horror stories over the years, I always make a point of asking what the company backup strategy is, then, a few weeks later, and regularly after that, I actually ask them to try to recover something for me. If they can't do it immediately, or, if they say there is no backup strategy, I make my own arrangements, which is what I'm currently doing (my present company doesn't back up our personal PCs although servers are backed up).

I have a 250 GB external hard drive, and I use Windows backup to back up specified files regularly onto that. It does slow my elderly laptop down a bit, so I usually leave it running while I'm cooking dinner, or overnight. I don't include any operating system files in the backup (they can all be recovered from elsewhere) and I don't include anything that is under source control (I "shelve" everything I'm working on at the end of each working day - this is a Perforce feature that saves a copy of my working files on the server where they can be recovered if I need them). Even though I'm confident my strategy is good, every so often, I try to retrieve something from my backup, just to be sure I can.

It is also necessary to consider the risks you are trying to mitigate against. Backing up to an external drive will save you from a disk failure or unintentional deletion. But if you keep the external drive in a rucksack with your laptop, and both are stolen from your car, or get dropped from a height, you may lose both at the same time. So occasionally I back up to a different disk that I don't carry around with me.

The Sunday before last, I inadvertently deleted most of my data disk while trying to free up some space, so I've just had first-hand experience of testing my back-up strategy. It took me most of the day to recover over 100GB of data from various places, but it was relatively painless and I lost nothing.

Good luck with the recovery!
Marjorie

My goal in life is to be as good a person as my dogs already think I am.
sdcinvan
Propellus Maximus
Posts: 1260
Joined: Wed Aug 21, 2013 11:46 am
Location: Vancouver, Canada

Re: Personal backups are important

Post by sdcinvan »

Msquared wrote:After hearing several backup horror stories over the years, I always make a point of asking what the company backup strategy is, then, a few weeks later, and regularly after that, I actually ask them to try to recover something for me. If they can't do it immediately, or, if they say there is no backup strategy, I make my own arrangements, which is what I'm currently doing (my present company doesn't back up our personal PCs although servers are backed up).
I never concern myself with the companies backup strategy because I would rather take responsibility for my own backups... just my data, the OS and software are not an issue.
Msquared wrote:Good luck with the recovery!
Thanks... I hope I can help her... I mean, I do feel bad for her.
Shawn in Vancouver, Canada
Main tools used: Flare 11.x, InDesign, Google Docs, Lectora, Captivate.
Report bugs: https://www.madcapsoftware.com/feedback/bugs.aspx ▪ Feature requests: https://www.madcapsoftware.com/feedback ... quest.aspx[/i]
RamonS
Senior Propellus Maximus
Posts: 4293
Joined: Thu Feb 02, 2006 9:29 am
Location: The Electric City

Re: Personal backups are important

Post by RamonS »

Individual PCs are rarely backed up and if, then to an external drive sitting on the desk. So if an IT guy tells a lowly tech writer that her/his PC will get nightly backups I instantly question this.
Always make your own backups and even as the one and only writer do use source control that runs on a backed up server. And on top of all that, make backups of your backups and if it has to be, use your own money to buy an external USB drive. Sure, the company should pay for that, but I rather pay 50 bucks out of my own pocket than having to explain to my boss why x days of work are gone.
I never had work lost due to hardware failures, but work was lost due to design flaws in Windows File Explorer. In Win7 it has the tendency to allow for highlighting a folder in both the tree view on the left and in the workspace. One delete later and a good chunk of stuff was gone. Since then I not only make backups of my own stuff, but also of anything else produced by the team that is not in source control.
SteveS
Senior Propellus Maximus
Posts: 2089
Joined: Tue Mar 07, 2006 5:06 pm
Location: Adelaide, far side of the world ( 34°56'0.78\"S 138°46'44.28\"E).
Contact:

Re: Personal backups are important

Post by SteveS »

I have a portable hard drive. Every night I copy the days work onto the hard drive. Nothing flash, drag and drop from Windows Explorer...

I went down the batch file path, but the person who owns the company is notorious for changing file locations, part of the way he manages work flow.

If you have a stable file system (ie, my boss doesn't go to your workplace) Microsft's SyncToy (free download) is well worth a look. I've used it in other jobs to create daily backups (and restore deleted files) and think its another one of those gems created by Microsft devs that didn't make it as a mainstream product.
Image
Steve
Life's too short for bad coffee, bad chocolate, and bad red wine.
sdcinvan
Propellus Maximus
Posts: 1260
Joined: Wed Aug 21, 2013 11:46 am
Location: Vancouver, Canada

Re: Personal backups are important

Post by sdcinvan »

SteveS wrote:I have a portable hard drive. Every night I copy the days work onto the hard drive. Nothing flash, drag and drop from Windows Explorer...

I went down the batch file path, but the person who owns the company is notorious for changing file locations, part of the way he manages work flow.

If you have a stable file system (ie, my boss doesn't go to your workplace) Microsft's SyncToy (free download) is well worth a look. I've used it in other jobs to create daily backups (and restore deleted files) and think its another one of those gems created by Microsft devs that didn't make it as a mainstream product.
SyncToy (http://www.microsoft.com/en-us/download ... x?id=15155) is a very nice tool. I had suggested this for my friend but her IT department doesn't allow her to install software. She asked and the IT department denied her because they said, we already have a backup system (which had FAILED HER) and the software is untested (and he was unwilling to test it first). That is the reason why I built the batch file for her... and it worked so well that I thought I would share it with this group. :-)

Incidentally, I went into her office this weekend, pulled the drive, plugged it into my laptop via a USB - SATA controller. I was prepared for several hours of recovery via Stellar Phoenix but it turned out to be simple data corruption on the boot sector. I was able to recover all her documents in a short time, without any special tools. Wow, how unbelievable that her IT guy was just going to destroy her hard drive without any attempt at recovery. :evil:
Shawn in Vancouver, Canada
Main tools used: Flare 11.x, InDesign, Google Docs, Lectora, Captivate.
Report bugs: https://www.madcapsoftware.com/feedback/bugs.aspx ▪ Feature requests: https://www.madcapsoftware.com/feedback ... quest.aspx[/i]
RamonS
Senior Propellus Maximus
Posts: 4293
Joined: Thu Feb 02, 2006 9:29 am
Location: The Electric City

Re: Personal backups are important

Post by RamonS »

At home I use Macrium Reflect. They have a free version of their tool and it pulls backups on schedule. Of course, you can also use Windows Backup, but Macrium comes with a nice WinPE based recovery disk and you can mount the backups as virtual drive and grab individual files. Pretty neat for free software.
If you do not want to install yet another app then give robocopy a try. Also one of the excellent little tools that Microsoft does not make much fuss about.
sdcinvan
Propellus Maximus
Posts: 1260
Joined: Wed Aug 21, 2013 11:46 am
Location: Vancouver, Canada

Re: Personal backups are important

Post by sdcinvan »

RamonS wrote:At home I use Macrium Reflect. They have a free version of their tool and it pulls backups on schedule. Of course, you can also use Windows Backup, but Macrium comes with a nice WinPE based recovery disk and you can mount the backups as virtual drive and grab individual files. Pretty neat for free software.
If you do not want to install yet another app then give robocopy a try. Also one of the excellent little tools that Microsoft does not make much fuss about.
I have never heard of Macrium Reflect. What a great find!

It took a bit of digging but I found the free edition (with a feature comparison chart) here: http://www.macrium.com/reflectfree.aspx

Thanks so much!
Shawn in Vancouver, Canada
Main tools used: Flare 11.x, InDesign, Google Docs, Lectora, Captivate.
Report bugs: https://www.madcapsoftware.com/feedback/bugs.aspx ▪ Feature requests: https://www.madcapsoftware.com/feedback ... quest.aspx[/i]
sdcinvan
Propellus Maximus
Posts: 1260
Joined: Wed Aug 21, 2013 11:46 am
Location: Vancouver, Canada

Re: Personal backups are important

Post by sdcinvan »

Aw... the free edition seems so limited (for me)... and doesn't include "Differential and Incremental backups". :(

I'll definitely look at the pay edition.

FYI, another backup tool that I have enjoyed is called Cobian Backup: http://www.cobiansoft.com/cobianbackup.htm

Incidentally, their source code is for sale now.
Shawn in Vancouver, Canada
Main tools used: Flare 11.x, InDesign, Google Docs, Lectora, Captivate.
Report bugs: https://www.madcapsoftware.com/feedback/bugs.aspx ▪ Feature requests: https://www.madcapsoftware.com/feedback ... quest.aspx[/i]
RamonS
Senior Propellus Maximus
Posts: 4293
Joined: Thu Feb 02, 2006 9:29 am
Location: The Electric City

Re: Personal backups are important

Post by RamonS »

sdcinvan wrote:Aw... the free edition seems so limited (for me)... and doesn't include "Differential and Incremental backups". :(
That is surely a problem if you need to backup several TB of data on a regular basis. Backing up one partition with the project data on it shouldn't take longer than the night.
Msquared
Propellus Maximus
Posts: 848
Joined: Mon Aug 06, 2012 10:19 am
Location: Southampton, UK

Re: Personal backups are important

Post by Msquared »

Why not use Windows Backup and Restore? That works for me.

I have structured my data disk in such a way that I only need to back a few top level folders. I don't back up anything that is under source control (I shelve intermediate work on the server if I have any), nor do I back up photos/music as I have a separate disk for backups of those. And I don't regularly back up old content that I like to have for reference, but doesn't change as that too is backed up elsewhere.

This leaves me with around 25GB to back up out of 120GB used on my data disk. I usually leave it running overnight, as it does slow my PC down a bit, but an incremental backup takes around 15 minutes, and a full one about an hour.

I check the space on my backup disk every couple of weeks, and when it gets a bit full, I delete some of the older backups. It's 500GB and stores a couple of months worth of backups at a time.

Most importantly, when I've needed to recover a file (or lots of files, when I deleted my whole disk by mistake the other Sunday) it just works.
Marjorie

My goal in life is to be as good a person as my dogs already think I am.
RamonS
Senior Propellus Maximus
Posts: 4293
Joined: Thu Feb 02, 2006 9:29 am
Location: The Electric City

Re: Personal backups are important

Post by RamonS »

I was just mentioned other alternatives. Macrium has the advantage that it can also clone entire disks and partitions and comes with one recovery disc for any system. Windows Backup needs a specific disc for each system (why??). Macirum does use Windows Backup to create the snapshots.
Use whatever you find works the best for you.
ToddPh
Sr. Propeller Head
Posts: 140
Joined: Wed Jan 30, 2013 2:41 pm
Location: Kirkland, Washington

Re: Personal backups are important

Post by ToddPh »

I have used Windows Backup to run a schedule incremental each night just covering my data folders (for Flare that means my working folders and my publish folders) and save to my personal network share. Because the network share is on servers that receive nightly backups, I'm relatively safe except in the case of catastrophic failure of both the local building and the remote data center. Worked great, and I only had to recover a few files over the year+ that I did this. I also use Cloudforge for my SVN, thus giving me another layer of protection offsite.

But now my employer has blessed me with a really nice little Dell Ultrabook with docking station, so my single work computer now goes home with me each night. I haven't yet decided what to do about the backups, but will probably set the Windows Backup to run each day while I'm in the office (have to test this carefully so I don't throw the notebook through the window due to slow performance ;) ).

I've seen the recommendation to use Flare's export feature to save a zip of the project, and I like this idea a lot. Unfortunately for me, I have enough documents in the portfolio now that going through and zipping each project would take a day away from work.
Todd
Image
When puns are outlawed, only outlaws will have puns.
Msquared
Propellus Maximus
Posts: 848
Joined: Mon Aug 06, 2012 10:19 am
Location: Southampton, UK

Re: Personal backups are important

Post by Msquared »

I'm in the same lucky position as you. I have my backup set to run at 8pm every night, so I do it from home, onto an external USB drive (also supplied by work), usually while dinner is cooking or being eaten.

In practice, many of the files I work on are under source control, but there are lots of other things I'd be sorry to lose (work in progress that isn't part of something under source control, application local settings etc) so I configure Windows Backup to just back up those.

But note that now there is an extra risk. I have both laptop and backup of laptop in my rucksack, and it comes to and from work with me. If my rucksack were stolen from my car or I was involved in a crash, both would be lost and no backup is any good if it is stored with the thing that has been compromised. So I keep another external USB drive in my desk at work, and back up to that at lunchtime once a week. I figure that is frequently enough for a risk that is unlikely but would have significant consequences should it happen.
Marjorie

My goal in life is to be as good a person as my dogs already think I am.
nashir
Jr. Propeller Head
Posts: 5
Joined: Tue Nov 26, 2013 12:11 am
Contact:

Re: Personal backups are important

Post by nashir »

Not she. Actually many user like me benefited with this post.
Post Reply