Very Computer

by **David Si** » Thu, 04 Oct 2001 09:10:42

Hi again,

Thanks to those that responded to my initial post. Let me try to do this
in a more intelligent way.

I have a 3.4 GB tar file on an AIX machine which consists of around 30000
individual jpeg files (most have a common creation date and similar
filenames which would make it difficult, but probably not entirely
impossible, to break this tar file into multiple tar files). I need to move
this 3.3 GB file to a linux machine where the tape drive resides in order
to write it to tape. Due to the previously mentioned filesize, neither FTP
nor wget from Slackware 8.0.0 want to do this. Any suggestions out there
how to solve this problem?? I have not tried NSF to mount the AIX disk on
the Linux box due to a reasonably high performance but wide area network
between the two machines. Other files which are smaller than 2 GB are easy
to copy across the network using FTP and write to tape on the Linux box.

TIA,

Dave Sims

by **Paul Kimot** » Thu, 04 Oct 2001 13:46:59

1. This is really off-topic for c.o.l.d.system.
2. The "Followup-To" header is supposed to indicate where you want
subsequent followups to go, so I am ignoring the value you set.

> I have a 3.4 GB tar file on an AIX machine which consists of around 30000
> individual jpeg files (most have a common creation date and similar
> filenames which would make it difficult, but probably not entirely
> impossible, to break this tar file into multiple tar files). I need to move
> this 3.3 GB file to a linux machine where the tape drive resides in order
> to write it to tape. Due to the previously mentioned filesize, neither FTP
> nor wget from Slackware 8.0.0 want to do this.

If you need to overcome _only_ the file-transfer problem, then you can use
split(1) or even dd(1) to turn the too-large file into several smaller,
easily transferable files. After transfering, you can cat(1) them together
and reconstruct the too-large file.

--
Paul Kimoto
This message was originally posted on Usenet in plain text. Any images,
hyperlinks, or the like shown here have been added without my consent,
and may be a violation of international copyright law.

by **Bob Hau** » Fri, 05 Oct 2001 01:12:27

I replied to this once, but I guess it went off into the weeds because your
followup-to header was busted.

Quote:>I need to move this 3.3 GB file to a linux machine where the tape drive
>resides in order to write it to tape.

cat big-file | ssh linux-machine 'cat - > /dev/tape'

This avoids the problem by treating it as a stream of bytes on the Linux
side instead of as a file.

--
-| Bob Hauck
-| Codem Systems, Inc.
-| http://www.codem.com/

Very Computer

More on dealing with large files

More on dealing with large files

More on dealing with large files

More on dealing with large files