[gambit-list] fast csv parser (libcsv wrapped for gambit)
pdawes at users.sf.net
Tue Feb 13 10:03:38 EST 2007
Lang Martin wrote:
> The overhead is related to multi-byte characters being recognized by
> read-char, and the buzz reports that other systems incur similar
> overhead to handle utf-8. There was a comparison to python (and maybe
> perl as well) on a blog somewhere.
I had a look at this a while back (comparing the python, my previous
Basically it appears that python stores strings as byte-array + char
encoding meta. If the output is the same char encoding as the input then
it never gets translated - hence the speed.
l = file("bib").read() # takes 9ms in python (4.3M file)
- thats basically the same speed as a C fread() on my laptop.
More information about the Gambit-list