Working off of network drives (MobileMe, thumb drives...)

User avatar
AmberV
Posts: 20613
Joined: Sun Jun 18, 2006 4:30 am
Platform: Mac + Linux
Location: Santiago de Compostela, Galiza
Contact:

Sun Jan 11, 2009 9:49 pm Post

This concerns using any sort of technology which promises to keep local copies of your work synchronised between multiple computers over the Internet, such as MobileMe (iDisk), DropBox, WebDAV based technologies, and so forth.

Due to the way Scrivener works with a project file, and the manner in which most of these technologies keep themselves up to date, it is not recommended that you use these methods to work on active projects. Unlike many file formats, Scrivener projects are actually composed of many small files (sometimes this can range in the hundreds), which depending on how you work, are updated nearly continuously as you arrange, write, edit, and sort the material in your book. This level of complexity in combination with the number of network connexions required to keep everything up to date can dramatically increase the probability of suffering lost work, and corrupted projects.

It is possible to reduce the probability of this happening by adjusting how often Scrivener automatically saves your project, and as such if you choose to use Scrivener to edit projects that are located on these network services, you can probably reduce your risk by changing that setting to something closer to a minute or greater in length.

Despite, I still recommend that you keep your working projects on local hard drives (or external drives that are plugged in via USB or FireWire), and use these network services to store your backups. Scrivener makes it very easy to make backups, and you should be doing this as you work anyway. I highly recommend using the zip archive option so as to make sure that the many small files in the project do not get lost in the flurry of network activity that would otherwise result in saving a Scrivener project to a network drive.

To summarise: Use of Scrivener with network synchronised folders and mountable drives is not recommended and you do so at your own risk. The recommended use is to use Scrivener's back-up feature (found in the File menu) to produce zipped archives which can be safely saved to these drives and available to all of your computers.

Work local; back-up often; and develop habits for backing up your last copy of the day so that you'll always have the latest version available to all of your networked computers.
.:.
Ioa Petra'ka
“Whole sight, or all the rest is desolation.” —John Fowles

so
sorrel
Posts: 69
Joined: Fri Nov 30, 2007 12:00 am
Platform: Mac
Location: North Idaho, USA

Sun Jan 11, 2009 11:06 pm Post

I keep my files on the MacBook, but I do send the backups to MobileMe. I've never had to go back to one, so I can't say how well it works, but that (in addition to Time Machine) makes me feel better. Is it still worth doing?

BTW, Amber, thanks for the info. I appreciate your willingness to investigate technical things while the rest of us are just pounding our keyboards. And you manage to write about them in a way that makes it clear to all.
sorrel

ma
mamster
Posts: 195
Joined: Fri Jan 26, 2007 6:26 pm

Mon Jan 12, 2009 5:04 am Post

Thanks for this, Amber. I stored a couple of small projects on Dropbox without any trouble, but I won't do it again.

User avatar
AmberV
Posts: 20613
Joined: Sun Jun 18, 2006 4:30 am
Platform: Mac + Linux
Location: Santiago de Compostela, Galiza
Contact:

Mon Jan 12, 2009 4:33 pm Post

sorrel wrote:I keep my files on the MacBook, but I do send the backups to MobileMe. I've never had to go back to one, so I can't say how well it works, but that (in addition to Time Machine) makes me feel better. Is it still worth doing?


You're welcome!

And yes, it is absolutely worth doing. Time Machine can help you out with some problems, but what would happen if your house burned down, or you were in a flood and you lost all of your computer equipment to water damage? The stuff you had put on your MobileMe account will be around for you to retrieve it. I try to think of Time Machine as a system level "undo". Yes, it is technically a back-up, but a back-up is there to protect your work no matter what happens, and if you have all of your back-ups hooked up to one power outlet, or even in the same building, it won't matter how many you have in the unfortunate scenarios. Since Time Machine is, by definition, something constantly plugged into your computer, it is only as safe as your computer is. But for all the little disasters that happen within the digital environment of your computer, it is an excellent technology!
.:.
Ioa Petra'ka
“Whole sight, or all the rest is desolation.” —John Fowles

User avatar
Wock
Posts: 2540
Joined: Fri Aug 24, 2007 8:09 pm
Location: Gallatin, Tennessee (USA)
Contact:

Tue Jan 13, 2009 3:17 pm Post

Adobe products are the same way to some degree. The files are not packages but the way certain Adobe Applications save can cause problems if you are not working off of the local drive. Adobe even had a tech support knowledge sheet on the subject and showed that working on files from a network drive could cause loss of work or corruption.

Plus working off of a network drive can cause excess network traffic which can cause a higher chance of packet collisions on a busy network.

As a rule of thumb I always copy the file from a server/network drive. Work on it locally. Then save a copy back to the network drive.
The wheel is turning but the hamster is still dead.

ma
mary
Posts: 106
Joined: Thu Feb 28, 2008 3:12 pm
Location: Northeastern U.S.
Contact:

Sat Jan 17, 2009 6:35 pm Post

But I love dropbox! Am I doing this wrong? Here is my procedure:

I turn on my eMac, open Scrivener, and start working on my latest chapter. When the alarm sounds, I hit "save" on the Scrivener menu and close the program. Then I open my dropbox locally and get back into the chapter I was just working on. I see the blue arrows indicating a file update is in progress. When they turn to a green checkbox, I close Scrivener again.

I know I am saving first to my hard drive - that's just common sense, after all - and I have not yet tried to work on my project(s) using dropbox on a remote machine. I've thought of it, but haven't done it yet, and, after this warning, I guess I won't. But will I get into trouble using the procedure I've described above? :?

re
rebecca
Posts: 185
Joined: Tue Jun 26, 2007 8:18 pm
Location: Oklahoma City

Sun Jan 18, 2009 3:52 am Post

I've been using Dropbox to sync for a few weeks now with no problems. I work from the dropbox file on my local hard drive and don't pay any attention to what Dropbox in the sky does with it. All I know is that when I switch computers, it's always there. I also use Time Machine and Mozy. I believe that constitutes belt, suspenders AND parachute.

I like Amber's description of TM as a drive-level undo. It fits.

I don't doubt what she's saying. It took almost all day to do the first sync of my Scrivener file (It's large.) with Dropdox. I don't know any of the tech things it was talking about. It said it was indexing ... downloading ... uploading or some such. I'm guessing this delay was due in some way to the vagaries of Scrivener's file system. Since then, it's worked without any problems. In fact, I don't pay it any mind at all. I do my do; it does its do.

Dropbox is so convenient, I'm going to keep on with it. If anything happens, I assume that TM will have a recent backup of anything I've done. If the house burns down, I have Mozy ... although I probably wouldn't have a computer to download it to. What I like about all these things is that I don't have to give them one thought. They run on automatic.

Thanks for the heads up Amber. I hope I'm not setting myself up for a fall by ignoring it.

Rebecca

User avatar
xiamenese
Posts: 3411
Joined: Mon Jan 29, 2007 1:32 am
Platform: Mac
Location: London or Exeter, UK.

Sun Jan 18, 2009 4:57 am Post

rebecca wrote:Dropbox is so convenient, I'm going to keep on with it. If anything happens, I assume that TM will have a recent backup of anything I've done. If the house burns down, I have Mozy ... although I probably wouldn't have a computer to download it to. What I like about all these things is that I don't have to give them one thought. They run on automatic.

Thanks for the heads up Amber. I hope I'm not setting myself up for a fall by ignoring it.

Rebecca

Hi Rebecca,
I too have been working like you. In my experience it works well provided: 1) you make sure Dropbox is fully synchronised with the green tick-mark and wait a minute or so before doing anything like turning off your computer; 2) you don't work with two computers synchronising with Dropbox, and do some editing on one of them when you are unable to be online.
You might like to read the discussion on this thread:
viewtopic.php?f=4&t=5234
:)
Mark
The Scrivenerato sometimes known as Mr X.
MacBook Pro Retina 10.13, 8GB RAM, 512GB SSID
MacBook Pro 17" (late 2011) 10.13, 8GB RAM, 512GB SSID
iPad Air 2, iOS 11, 64GB
Scrivener, Scapple, Nisus Writer Pro, Bookends …

re
rebecca
Posts: 185
Joined: Tue Jun 26, 2007 8:18 pm
Location: Oklahoma City

Sun Jan 18, 2009 7:51 am Post

Mark--

Backing old data over new data is an old headache. Back in the bad old days when I was using a pc with Windows 3.1 and backing things onto floppies, I did this several times. Made me want to toss the computer out the door and into the yard.

I've been careful to just open up my laptop and let it "talk" to my iMac for awhile whenever I get home from working where there isn't an internet. I think I'm blessed that I only have two computers. More than that is too much for my delicate organizational skills. I'm getting ready to start my busy time on my job. That means long hours and lots of stress; the sort of situation that manufactures dumb mistakes. My solution last year was to turn off the iMac on days when I was working such long hours and just use the laptop. Then, on my day off, I shut down the laptop and went to the iMac. I always used Chronosync to get them right with each other when I made the change-over. It worked without a single glitch.

I have an internet at work. So the two computers should sync with Dropbox. I think I'll still set the iMac to shut itself down on long days and then leave them for a while to work it out between them when I really get home (as opposed to just showing up to shower and sleep) for a day off. It's best if I do what I can to defend myself against myself when I'm distracted and tired.

Oh me. The tangled webs we weave when we try to simplify.

Thanks for the input.

Rebecca

User avatar
xiamenese
Posts: 3411
Joined: Mon Jan 29, 2007 1:32 am
Platform: Mac
Location: London or Exeter, UK.

Tue Jan 20, 2009 5:08 am Post

For the last few days I've been trying MobileMe, using the iDisk sync as a way of keeping my two laptops in sync. Found that it's even more dangerous than Dropbox. I just can't get it to upload an updated file on one computer and then download the update onto the other. So I'm abandoning it. I'm shutting down iDisk sync and will only use my iDisk as an archiving system, logging into it manually and uploading stuff manually when I need.

I'll go back to using Dropbox for the synchronising job, but will take care to only put a back up of the Scriv file on Dropbox and will keep another back-up on a portable external. It's as near as I am going to get to Jaysen level belt-and-braces ... scriv file on MBP and MBA hard disks, synchronised through back-ups on Dropbox, with a back-up of the latest version from whichever laptop on the portable and the MBP backed up fully every night to an external FireWire drive. And when I finish with a project, I'll zip it up and archive it on iDisk.

Mark
The Scrivenerato sometimes known as Mr X.
MacBook Pro Retina 10.13, 8GB RAM, 512GB SSID
MacBook Pro 17" (late 2011) 10.13, 8GB RAM, 512GB SSID
iPad Air 2, iOS 11, 64GB
Scrivener, Scapple, Nisus Writer Pro, Bookends …

re
rebecca
Posts: 185
Joined: Tue Jun 26, 2007 8:18 pm
Location: Oklahoma City

Tue Jan 20, 2009 3:24 pm Post

Hi Mark--

iDisk is hinky. Period. I put a couple of databases (big databases) on it back when I first switched to macs, and they've been there ever since, archiving away. It will sync simple little files, and it does a good job with iCal and Address Book and Mail, which makes it worth the $ for me.

They only way I try to use it with Scrivener is with a zipped file. It burps on anything else. Even then, it takes a long time to back it up. It can be a real pain in that regard. However one time a few months ago, I tripped and fell into search strings hell with my Scrivener file. It was on my laptop, and I hadn't plugged in my portable drive to let TM work its way. I would have lost quite a bit of work except hinky 'ole iDisk came to the rescue.

For my money, iDisk is mostly unrealized potential. Apple is so good with most of its products. I wonder why they can't get it right with this one.

Rebecca

User avatar
Simon T
Posts: 63
Joined: Sat Oct 25, 2008 6:04 pm
Platform: Mac + iOS
Location: UK
Contact:

Mon Jan 26, 2009 2:02 pm Post

Has anyone ever tried using 'symbolic links' to sync Scrivener via dropbox? I've just discovered this technique for syncing address book, ical, and safari and it seems to work just fine. I'm tempted to give it a try....

Info on symbolic links can be found here:
http://wiki.getdropbox.com/TipsAndTrick ... herFolders

and here:

http://dl.getdropbox.com/u/87620/Dropbo ... mlinks.pdf

Basically, you create a symbolic link (similar to an alias) of your data (eg ~/library/calendars) and put it in your dropbox folder. Then you do the same thing on your second computer (but follow the more detailed instructions on those links). Then somehow / automagically they seem to sync. You can add and delete ical entries on one computer and when you quit ical, they get synced. Then they appear / disappear in the ical app on the other computer. The trick is to be patient and let dropbox do its stuff before trying to open to synced data.

It could work for Scriv as well. I'll let you know if I have any success. Although the technical amongst you may be able to shed more light on this...

User avatar
Jaysen
Posts: 5746
Joined: Mon Dec 17, 2007 4:00 am
Platform: Mac + Windows
Location: East-Be-Jesus-Nowhere SC, USA

Mon Jan 26, 2009 2:44 pm Post

The same sync issues would still apply. All a symlink is, is a pointer to a real location. Just like an alias on the desktop. Basically drop box "follows" symlinks as if they are real files which allows this to work.

I would not recommend this technic for the same reasons that Amber points out in her original post. Basically this changes nothing, it is just a different way to do the same thing.
Jaysen

I have a wife and 2 kids that I can only attribute to a wiggle, a giggle, and the realization that she was out of my league so I might as well be happy with her as a friend. 24 years marriage later, I can't imagine life without her. -Me 10/7/09

Image

User avatar
Simon T
Posts: 63
Joined: Sat Oct 25, 2008 6:04 pm
Platform: Mac + iOS
Location: UK
Contact:

Mon Jan 26, 2009 4:49 pm Post

Thanks Jaysen, good to get the confirmation. I did a little test and there were problems immediately, so you're right, this won't work. Pity.

ma
mary
Posts: 106
Joined: Thu Feb 28, 2008 3:12 pm
Location: Northeastern U.S.
Contact:

Wed Jan 28, 2009 6:14 pm Post

I'm still worried about what problems, because I'm using dropbox as the main backup for my novel(s) in progress. I'm only using one computer for actual writing - all I have done on other computers, or on the website, is print out files for others to read. And I do save to my hard drive first. Am I going to have problems? Because so far, it's been seamless, accurate and easy.