Int tokenizer

Question

I know there are string tokenizers but is there an "int tokenizer"?

For example, I want to split the string "12 34 46" and have:

list[0]=12

list[1]=34

list[2]=46

In particular, I'm wondering if Boost::Tokenizer does this. Although I couldn't find any examples that didn't use strings.

Answer 1

What you're looking for is 2 separate actions. First tokenize the string, then convert each token to an int.

Answer 2

i am not sure if you can do this without using string or char* because you have to but both numbers and spaces into same set...

Answer 3

Yes there is: use a stream, e.g. a stringstream:

stringstream sstr("12 34 46");
int i;
while (sstr >> i)
    list.push_back(i);

Alternatively, you can also use STL algorithms and/or iterator adapters combined with constructors:

vector<int> list = vector<int>(istream_iterator<int>(sstr), istream_iterator<int>());

Answer 4

You will want to split the string up at spaces, then use boost::lexical_cast to convert the text form of the number into the binary form.

#include <boost/lexical_cast.hpp>
#include <boost/tokenizer.hpp>
#include <algorithm>
#include <iostream>
#include <iterator>
#include <string>

int main(void)
{
    // the integers
    const std::string intText = "12 34 46";
    std::vector<int> intArray;

    // tokenize integers
    boost::tokenizer<> tokens(intText);

    // read integers
    for (boost::tokenizer<>::const_iterator it = tokens.begin();
     it != tokens.end(); ++it)
    {
     intArray.push_back(boost::lexical_cast<int>(*it));
    }

    // print out array
    std::copy(intArray.begin(), intArray.end(), std::ostream_iterator<int>(std::cout, "\n"));
}