Scripted download of an entire on-line database, how?

Scripted download of an entire on-line database, how?

Post by Dr H. T. Leu » Sat, 16 May 1998 04:00:00

Essentially I would like to download an entire on-line database and mirrors
it; how can I do that? I am thinking of doing a scripted/automated
scheduled search of every item on that particular site (over a period
of severl days or even weeks, that is) and save the result and re-arrange
it; the data base is estimated to be a few hundred Meg in size - I know the
traffic involved is quite substantial. How?

I have got a linux machine permanently switched on and connected to the
internet via a T1 line; and I can install any package of scripting
langauge as long as it is available for the intel/linux platform.
"Think of somebody you care about. What is the ONE thing you can do
to make this person happy - and why wouldn't you do it?"


1. JobConnectEurope & The Contractor's Club Now On-Line, Thousands of IT Jobs On-Line..

JobConnectEurope and The Contractor's Club are now online... Thousands
of Jobs, Both Contract and Permanent for IT Professionals. Don't miss
that Job, Career Move or Contract, register with us now and receive our
latest jobs straight to your mail box.

Register with us now... Its easy, simply go to our site at
Http:// and fill out the Registration Form.
Once registered you will receive jobs which match your requirements via
email direct to your mail box.  You can amend your details at any time,
you can also mark yourself unavailable from which point you will not
receive any further email until you pop back on line and amend your
status to available.  Its Easy, its simple, its immediate.... Unlike
other job sites we do not sell CV's, you stipulate how you wish to be
contacted. Join us now...

Our Discussion Forum and Virtual Chat areas in The Contractors Club will
be available shortley, for you to discuss issues with other like minded
people. Don't miss it.

See you on-line

Thanks for your time..


2. server with wireless NIC not accessible outside of LAN

3. New kernel bug database on-line

4. Sinus Firewall

5. Kernel Bug Database documentation on-line

6. external scsi cdrom drives

7. Kernel Bug Database 3.1 On-line

8. SGI monitor on PC runnig Linux?

9. Kernel Bug Database V1.10 on-line

10. On-Line Web/Intranet Vendor Database

11. P6 documents on-line and available for download

12. Are there any on-line guides on writing shell scripts ?

13. Developing a change password On-line script/program