Parsing indeterminate amount of data into a python tuple

Question

I have a config file that contains a list of strings. I need to read these strings in order and store them in memory and I'm going to be iterating over them many times when certain events take place. Since once they're read from the file I don't need to add or modify the list, a tuple seems like the most appropriate data structure.

However, I'm a little confused on the best way to first construct the tuple since it's immutable. Should I parse them into a list then put them in a tuple? Is that wasteful? Is there a way to get them into a tuple first without the overhead of copying/destroying the tuple every time I add a new element.

Answer 1

As you said, you're going to read the data gradually - so a tuple isn't a good idea after all, as it's immutable.

Is there a reason for not using a simple list for holding the strings?

Answer 2

I wouldn't worry about the overhead of first creating a list and then a tuple from that list. My guess is that the overhead will turn out to be negligible if you measure it.

On the other hand, I would stick with the list and iterate over that instead of creating a tuple. Tuples should be used for struct like data and list for lists of data, which is what your data sounds like to me.

Answer 3

Since your data is changing, I am not sure you need a tuple. A list should do fine.

Look at the following which should provide you further information. Assigning a tuple is much faster than assigning a list. But if you are trying to modify elements every now and then then creating a tuple may not make more sense.

• http://stackoverflow.com/questions/68630/are-tuples-more-efficient-than-lists-in-python

Answer 4

with open("config") as infile:
    config = tuple(infile)