Incremental update of databases
mattsweeneyNoSpAmPlease at earthlink.net
Mon Mar 18 10:10:58 EST 2002
Use perl with Net::FTP and write it yourself
...should be about 20..lines with no GUI.
Check the Perl Cookbook (christiansen&torkington)
then chron schedule it.
use something like
Mirror is a package written in Perl that uses the FTP protocol to duplicate
a directory hierarchy between the machine it is run on and a remote host. It
avoids copying files unnecessarily by comparing the file time-stamps and
file sizes before transferring.
The main issue will be that the incremental backups will have changing names
you'll have to deal with.
And then you have to integrate the incremental into the existent...so it is
a little bit custom for each user and need...you may not find EXACTLY the
script you want.
oh and consider netiquette!!!!
<quote>from the mirror site.
Only mirror a site well outside the working hours of both the local and
It is probably unfriendly to try to mirror a remote site more than once a
Before trying to mirror a remote site, try and find the packages you want
from local archives, as no one will be pleased if you soak up a lot of
network bandwidth needlessly.
If you have a local archive, then tell people about it so they don't have to
waste bandwidth and CPU at the remote site.
Do remember to check your package-files from time to time in case the remote
archive has changed their access restrictions.
Johanne Duhaime wrote in message <3C8CF5FD.49448F7C at ircm.qc.ca>...
>Is there any existing scripts that allow to update locally installed
>databases of sequences as Genbank and Swissprot. I would think of a
>script that would run each day to get the new sequences and intergrated
>it the flat files of sequence.
>Thank you in advance.
>110 Ave des Pins O
>987-5556 (tel) 987-5644 (fax)
>Johanne_Duhaime at ircm.qc.ca
More information about the Bio-soft