views:

393

answers:

7

My view is that a C implementation cannot satisfy the specification of certain stdio functions (particularly fputc/fgetc) if sizeof(int)==1, since the int needs to be able to hold any possible value of unsigned char or EOF (-1). Is this reasoning correct?

(Obviously sizeof(int) cannot be 1 if CHAR_BIT is 8, due to the minimum required range for int, so we're implicitly only talking about implementations with CHAR_BIT>=16, for instance DSPs, where typical implementations would be a freestanding implementation rather than a hosted implementation, and thus not required to provide stdio.)

Edit: After reading the answers and some links references, some thoughts on ways it might be valid for a hosted implementation to have sizeof(int)==1:

First, some citations:

7.19.7.1(2-3):

If the end-of-file indicator for the input stream pointed to by stream is not set and a next character is present, the fgetc function obtains that character as an unsigned char converted to an int and advances the associated file position indicator for the stream (if defined).

If the end-of-file indicator for the stream is set, or if the stream is at end-of-file, the endof-file indicator for the stream is set and the fgetc function returns EOF. Otherwise, the fgetc function returns the next character from the input stream pointed to by stream. If a read error occurs, the error indicator for the stream is set and the fgetc function returns EOF.

7.19.8.1(2):

The fread function reads, into the array pointed to by ptr, up to nmemb elements whose size is specified by size, from the stream pointed to by stream. For each object, size calls are made to the fgetc function and the results stored, in the order read, in an array of unsigned char exactly overlaying the object. The file position indicator for the stream (if defined) is advanced by the number of characters successfully read.

Thoughts:

  • Reading back unsigned char values outside the range of int could simply have undefined implementation-defined behavior in the implementation. This is particularly unsettling, as it means that using fwrite and fread to store binary structures (which while it results in nonportable files, is supposed to be an operation you can perform portably on any single implementation) could appear to work but silently fail. essentially always results in undefined behavior. I accept that an implementation might not have a usable filesystem, but it's a lot harder to accept that an implementation could have a filesystem that automatically invokes nasal demons as soon as you try to use it, and no way to determine that it's unusable. Now that I realize the behavior is implementation-defined and not undefined, it's not quite so unsettling, and I think this might be a valid (although undesirable) implementation.

  • An implementation sizeof(int)==1 could simply define the filesystem to be empty and read-only. Then there would be no way an application could read any data written by itself, only from an input device on stdin which could be implemented so as to only give positive char values which fit in int.

+3  A: 
dmckee
If a file is opened in binary mode, any value of `unsigned char` must be able to be written to and read back from the file. And `unsigned char` cannot have padding bits.
R..
Hmm... ::sits and considers various ways to try and save the idea::
dmckee
...but no. I think that's me told. I withdraw the suggestion.
dmckee
+1  A: 

I'm not so familiar with C99, but I don't see anything that says fgetc must produce the full range of values of char. The obvious way to implement stdio on such a system would be to put 8 bits in each char, regardless of its capacity. The requirement of EOF is

EOF

which expands to an integer constant expression, with type int and a negative value, that is returned by several functions to indicate end-of-file, that is, no more input from a stream

The situation is analogous to wchar_t and wint_t. In 7.24.1/2-3 defining wint_t and WEOF, footnote 278 says

wchar_t and wint_t can be the same integer type.

which would seem to guarantee that "soft" range checking is sufficient to guarantee that *EOF is not in the character set.

Edit:

This wouldn't allow binary streams, since in such a case fputc and fgetc are required to perform no transformation. (7.19.2/3) Binary streams are not optional; only their distinctness from text streams is optional. So it would appear that this renders such an implementation noncompliant. It would still be perfectly usable, though, as long as you don't attempt to write binary data outside the 8-bit range.

Potatoswatter
You mean "8 **bits** in each char", right? In C, a byte has CHAR_BIT bits. And `wchar_t` has the same requirements as `char`.
schot
@Potatoswatter: Great compression scheme ;) I'm not sure if this 'fixes' it. I haven't found anything that forbids it yet.
schot
@schot: Well… it seems necessary to interoperability with files that aren't pre-padded. The alternative isn't actually any less dense; you need to address those ASCII characters somehow.
Potatoswatter
I mean more dense. Wow, I should quit for the evening.
Potatoswatter
If you only put 8 bits in each `char`, then `CHAR_BIT==8` and we're outside the domain of the question. Now it's very possible that someone using an implementation with `CHAR_BIT==64` would still only want to store 8 bits in each `char` when dealing with text data (in ASCII or UTF-8, for example), but this does not change the fact that `char` is an integer type capable of representing its entire range, and that `fgetc` and `fputc` work on binary data.
R..
The value of `WEOF` is implementation-defined. The value of `EOF` is -1.
R..
Actually both are implementation-defined, but `EOF` is required to be negative, while `WEOF`'s sign is not specified.
R..
A: 

I think you are right. Such an implementation cannot distinguish a legitimate unsigned char value from EOF when using fgetc/fputc on binary streams.

If there are such implementations (this thread seems to suggest there are), they are not strictly conforming. It is possible to have a freestanding implementation with sizeof (int) == 1.

A freestanding implementation (C99 4) only needs to support the features from the standard library as specified in these headers: <float.h>, <iso646.h>, <limits.h>, <stdarg.h>, <stdbool.h>, <stddef.h>, and <stdint.h>. (Note no <stdio.h>). Freestanding might make more sense for a DSP or other embedded device anyway.

schot
Nit: <float.h>, <iso646.h>, etc are not libraries: they are standard headers
pmg
@pmg Thanks, I've reworded the sentence.
schot
+3  A: 

It is possible for an implementation to meet the interface requirements for fgetc and fputc even if sizeof(int) == 1.

The interface for fgetc says that it returns the character read as an unsigned char converted to an int. Nowhere does it say that this value cannot be EOF even though the expectation is clearly that valid reads "usually" return positive values. Of course, fgetc returns EOF on a read failure or end of stream but in these cases the file's error indicator or end-of-file indicator (respectively) is also set.

Similarly, nowhere does it say that you can't pass EOF to fputc so long as that happens to coincide with the value of an unsigned char converted to an int.

Obviously the programmer has to be very careful on such platforms. This is might not do a full copy:

void Copy(FILE *out, FILE *in)
{
    int c;
    while((c = fgetc(in)) != EOF)
        fputc(c, out);
}

Instead, you would have to do something like (not tested!):

void Copy(FILE *out, FILE *in)
{
    int c;
    while((c = fgetc(in)) != EOF || (!feof(in) && !ferror(in)))
        fputc(c, out);
}

Of course, platforms where you will have real problems are those where sizeof(int) == 1 and the conversion from unsigned char to int is not an injection. I believe that this would necessarily the case on platforms using sign and magnitude or ones complement for representation of signed integers.

Charles Bailey
Passing `EOF` to `fputc` is completely valid because the argument is converted to `unsigned char` before being written. Thus `fputc(EOF)` is equivalent to `fputc(UCHAR_MAX)`. The conversion in the other direction, however, is undefined behavior if `UCHAR_MAX>INT_MAX`.
R..
@R..: Yes, you're completely correct about passing `EOF` to `fputc`. Then conversion from an `unsigned char` that can't be represented as an `int` value to `int` does not cause _undefined behaviour_, though, it is _implementation defined_. This is important because it allows an implementation to support the `fputc`/`fgetc` round trip.
Charles Bailey
@Charles: You are correct. I assumed the behavior was the same as signed arithmetic overflow, but conversion to a signed type is implementation-defined (according to 6.3.1.3 paragraph 3) as you say.
R..
+5  A: 

I remember this exact same question on comp.lang.c some 10 or 15 years ago. Searching for it, I've found a more current discussion here:

http://groups.google.de/group/comp.lang.c/browse_thread/thread/9047fe9cc86e1c6a/cb362cbc90e017ac

I think there are two resulting facts:

(a) There can be implementations where strict conformance is not possible. E.g. sizeof(int)==1 with one-complement's or sign-magnitude negative values or padding bits in the int type, i.e. not all unsigned char values can be converted to a valid int value.

(b) The typical idiom ((c=fgetc(in))!=EOF) is not portable (except for CHAR_BIT==8), as EOF is not required to be a separate value.

Secure
+1 for good reference.
R..
@R..: Ah, now I see. `fputc` couldn't work in my solution without "encoding" the character. So that excludes binary streams, but that's not a huge deal.
Potatoswatter
A: 

You are assuming that the EOF cannot be an actual character in the character set. If you allow this, then sizeof(int) == 1 is OK.

Let_Me_Be
Is this allowed? I seriously doubt it. Citation either way?
R..
`EOF` cannot be a value of `unsigned char`, as its value is -1. However, what may be possible (it's unclear to me) is whether the standard allows an implementation to have some values of `unsigned char` which cannot be represented in `int` (their conversion to `int`, which it specifies happens, would then have undefined behavior).
R..
@R For citation check the C standard. `EOF` definitely isn't defined as `-1`. Signed to unsigned conversion isn't defined per standard but we are talking about specific platform here.
Let_Me_Be
Signed to unsigned conversion is defined by the C standard. It's reduction modulo 2^N. Unsigned to signed conversion is defined by the standard when the value is representable; when it's not, the result is implementation-defined. Sorry about `EOF` and -1. It's a negative constant of type `int`, not necessarily -1, but that does not change the fact that it cannot be a value of `unsigned char`.
R..
A: 

The TI C55x compiler I am using has a 16bit char and 16bit int and does include a standard library. The library merely assumes an eight bit character set, so that when interpreted as a character as char of value > 255 is not defined; and when writing to an 8-bit stream device, the most significant 8 bits are discarded: For example when written to the UART, only the lower 8 bits are transferred to the shift register and output.

Clifford
I'm pretty sure that is not a conformant hosted implementation.
R..