Very Computer

Folks,

  I am having problem with fwrite() function. I have written a utility to
  convert file from one format to another and I use fwrite() to write to the
  file. I get EFBIG error when file reaches 2GB limit. The file system on
  which I am writing the file is large file enabled, and ulimit is set to
  unlimited.

  As further test I tried to create a large file using dd command:

  dd if=/dev/zero of=test bs=32k

  and I was able to create file larger then 2GB, so the problem is not with
  the file system.

  Is there any limitation with fwrite()?

  Here is the fragment of code:

void SeqWriteRecord(struct WriteInfo *WriteInfo, enum RecordType RecordType,
                    char *Buffer, int DataSize)
{
   int SaveErrno;

   if (WriteInfo == NULL)
   {
      return;
   }
   WriteHeader(DataSize + 4, RecordType, WriteInfo->FilePtr);

   if (fwrite(Buffer, (size_t)1, (size_t)DataSize, WriteInfo->FilePtr)
       != DataSize)
   {
      SaveErrno = errno;
      eFatal(10828, "SeqWriteRecord: Could not write full record of size %d  errno = %d", DataSize, SaveErrno);
   }

Quote:}  

  The errno is 27 which ie EFBIG.

  I need to fix is A.S.A.P.

  Thanks is advance.

--
Hemant Shah                           /"\  ASCII ribbon campaign

                                       X     against HTML mail
TO REPLY, REMOVE NoJunkMail           / \      and postings      
FROM MY E-MAIL ADDRESS.          
-----------------[DO NOT SEND UNSOLICITED BULK E-MAIL]------------------
I haven't lost my mind,                Above opinions are mine only.
it's backed up on tape somewhere.      Others can have their own.

Does write() works for you? Did you compile your program with large file
enabled?

Bye, Dragan

--
Dragan Cvetkovic,

To be or not to be is true. G. Boole      No it isn't.  L. E. J. Brouwer

Hi,
The explanation for EFBIG from the doc is,
EFBIG Indicates that an attempt was made to write a file that exceeds the
file size of the process limit or the systemwide maximum file size.
So, please check the limit for the both.

Good luck,
Ming

Quote:

> Folks,

>   I am having problem with fwrite() function. I have written a utility to
>   convert file from one format to another and I use fwrite() to write to
the
>   file. I get EFBIG error when file reaches 2GB limit. The file system on
>   which I am writing the file is large file enabled, and ulimit is set to
>   unlimited.

>   As further test I tried to create a large file using dd command:

>   dd if=/dev/zero of=test bs=32k

>   and I was able to create file larger then 2GB, so the problem is not
with
>   the file system.

>   Is there any limitation with fwrite()?

>   Here is the fragment of code:

> void SeqWriteRecord(struct WriteInfo *WriteInfo, enum RecordType
RecordType,
>                     char *Buffer, int DataSize)
> {
>    int SaveErrno;

>    if (WriteInfo == NULL)
>    {
>       return;
>    }
>    WriteHeader(DataSize + 4, RecordType, WriteInfo->FilePtr);

>    if (fwrite(Buffer, (size_t)1, (size_t)DataSize, WriteInfo->FilePtr)
>        != DataSize)
>    {
>       SaveErrno = errno;
>       eFatal(10828, "SeqWriteRecord: Could not write full record of size

%d  errno = %d", DataSize, SaveErrno);

:)
:)> Folks,
:)>
:)>   I am having problem with fwrite() function. I have written a utility to
:)>   convert file from one format to another and I use fwrite() to write to the
:)>   file. I get EFBIG error when file reaches 2GB limit. The file system on
:)>   which I am writing the file is large file enabled, and ulimit is set to
:)>   unlimited.
:)>
:)>   As further test I tried to create a large file using dd command:
:)>
:)>   dd if=/dev/zero of=test bs=32k
:)>
:)>   and I was able to create file larger then 2GB, so the problem is not with
:)>   the file system.
:)>  
:)>   Is there any limitation with fwrite()?
:)>
:)
:)Does write() works for you? Did you compile your program with large file
:)enabled?
:)
:)Bye, Dragan

  I am not sure if my first followup made it so here it is again.

  In order to change to write, will have to change several other files,
  since this is a utility function used by many other programs.

  How do I compile code as large file enabled? I could not find any option in
  man page for xlc.

  Thanks.

:)
:)
:)--
:)Dragan Cvetkovic,
:)
:)To be or not to be is true. G. Boole      No it isn't.  L. E. J. Brouwer

--
Hemant Shah                           /"\  ASCII ribbon campaign

                                       X     against HTML mail
TO REPLY, REMOVE NoJunkMail           / \      and postings      
FROM MY E-MAIL ADDRESS.          
-----------------[DO NOT SEND UNSOLICITED BULK E-MAIL]------------------
I haven't lost my mind,                Above opinions are mine only.
it's backed up on tape somewhere.      Others can have their own.

:)Hi,
:)The explanation for EFBIG from the doc is,
:)EFBIG Indicates that an attempt was made to write a file that exceeds the
:)file size of the process limit or the systemwide maximum file size.
:)So, please check the limit for the both.
:)
:)Good luck,
:)Ming
:)

  I checked the limit, it is set to unlimited for all users. I was able to
  create file larger than 2GB using GB using dd.

:)>
:)> Folks,
:)>
:)>   I am having problem with fwrite() function. I have written a utility to
:)>   convert file from one format to another and I use fwrite() to write to
:)the
:)>   file. I get EFBIG error when file reaches 2GB limit. The file system on
:)>   which I am writing the file is large file enabled, and ulimit is set to
:)>   unlimited.
:)>
:)>   As further test I tried to create a large file using dd command:
:)>
:)>   dd if=/dev/zero of=test bs=32k
:)>
:)>   and I was able to create file larger then 2GB, so the problem is not
:)with
:)>   the file system.
:)>
:)>   Is there any limitation with fwrite()?
:)>
:)>   Here is the fragment of code:
:)>
:)> void SeqWriteRecord(struct WriteInfo *WriteInfo, enum RecordType
:)RecordType,
:)>                     char *Buffer, int DataSize)
:)> {
:)>    int SaveErrno;
:)>
:)>    if (WriteInfo == NULL)
:)>    {
:)>       return;
:)>    }
:)>    WriteHeader(DataSize + 4, RecordType, WriteInfo->FilePtr);
:)>
:)>    if (fwrite(Buffer, (size_t)1, (size_t)DataSize, WriteInfo->FilePtr)
:)>        != DataSize)
:)>    {
:)>       SaveErrno = errno;
:)>       eFatal(10828, "SeqWriteRecord: Could not write full record of size
:)%d  errno = %d", DataSize, SaveErrno);
:)>    }
:)> }
:)>
:)>   The errno is 27 which ie EFBIG.
:)>
:)>
:)>   I need to fix is A.S.A.P.
:)>
:)>   Thanks is advance.
:)>
:)>
:)>
:)> --
:)> Hemant Shah                           /"\  ASCII ribbon campaign

:)>                                        X     against HTML mail
:)> TO REPLY, REMOVE NoJunkMail           / \      and postings
:)> FROM MY E-MAIL ADDRESS.
:)> -----------------[DO NOT SEND UNSOLICITED BULK E-MAIL]------------------
:)> I haven't lost my mind,                Above opinions are mine only.
:)> it's backed up on tape somewhere.      Others can have their own.
:)
:)

--
Hemant Shah                           /"\  ASCII ribbon campaign

                                       X     against HTML mail
TO REPLY, REMOVE NoJunkMail           / \      and postings      
FROM MY E-MAIL ADDRESS.          
-----------------[DO NOT SEND UNSOLICITED BULK E-MAIL]------------------
I haven't lost my mind,                Above opinions are mine only.
it's backed up on tape somewhere.      Others can have their own.

I think you need to define _LARGE_FILES. Also, in the case of open/write
usage, you have to use O_LARGEFILE flag, not sure what's the equivalent for
streams. See man page for open.

I used to have some web links pointing to AIX documentation but it seems
that IBM has reorganised it and none of my links work any more. :-(

Bye, Dragan

--
Dragan Cvetkovic,

To be or not to be is true. G. Boole      No it isn't.  L. E. J. Brouwer

OK, I have found the link. For AIX4.3, it's at

http://publib.boulder.ibm.com/doc_link/en_US/a_doc_lib/aixprggd/genpr...

Have fun. Dragan

--
Dragan Cvetkovic,

To be or not to be is true. G. Boole      No it isn't.  L. E. J. Brouwer

How about check the file /etc/security/limites. The file defines the limit
for file size of each user can create. But you said you have created a file
over 2GB. Just give a check.

I don't see any limit on the fwrite() itself. It looks like from File
System. I also check the xlc (I have C for AIX 5.0) and don't find any
options for large file.

Ming

E-MAIL]------------------

:)> I think you need to define _LARGE_FILES. Also, in the case of open/write
:)> usage, you have to use O_LARGEFILE flag, not sure what's the equivalent for
:)> streams. See man page for open.
:)>
:)> I used to have some web links pointing to AIX documentation but it seems
:)> that IBM has reorganised it and none of my links work any more. :-(
:)>
:)> Bye, Dragan
:)>
:)
:)OK, I have found the link. For AIX4.3, it's at
:)
:)http://publib.boulder.ibm.com/doc_link/en_US/a_doc_lib/aixprggd/genpr...
:)
:)Have fun. Dragan

  Thanks. This is what I was looking for.
:)
:)--
:)Dragan Cvetkovic,
:)
:)To be or not to be is true. G. Boole      No it isn't.  L. E. J. Brouwer

--
Hemant Shah                           /"\  ASCII ribbon campaign

                                       X     against HTML mail
TO REPLY, REMOVE NoJunkMail           / \      and postings      
FROM MY E-MAIL ADDRESS.          
-----------------[DO NOT SEND UNSOLICITED BULK E-MAIL]------------------
I haven't lost my mind,                Above opinions are mine only.
it's backed up on tape somewhere.      Others can have their own.