[TxMt] TM tokenizer is taking 100% CPU for long while using 100-200KB text files with single line

Niels Kobschaetzki n.kobschaetzki at googlemail.com
Wed Feb 27 12:03:13 UTC 2008


On Wed, Feb 27, 2008 at 12:51 PM, Adam Strzelecki <ono at java.pl> wrote:
> Hello,
>
>  I've sent a mail to Allan regarding the problem, but I want to share
>  also this problem with all of you subscribed to the TM list. Maybe you
>  have also encountered this?
>
>  I'm working with few auto-generated FO (XML) files that have no line-
>  breaks.
>
>  You can reproduce such dummy file with:
>  $ cd /tmp
>  $ perl -e '{print "<html></html>" x 20000}' > test.html
>  $ mate test.html
>
>  As you see TM gonna take 100% CPU for a really long-long while until
>  you get syntax highlight.
>  Also any modification (line-break) causes TM to take again 100% CPU
>  for a while.

Interesting -- TM should get optimized for two cores…most of the
workload is done by 1 core ans from time to time one see peaks in the
other core but never anything beyond 100% (I would have expected
nearly 200% cpu-load)

Niels


More information about the textmate mailing list