I had a similar problem a while ago, and I fixed it by editing the 'TeX' language definition, changing the end delimeter of string.other.math.tex as follows:
… { name = 'string.other.math.tex'; begin = '$'; end = '}|$'; …
It has worked without trouble for me. Since other people are having similar problems, perhaps this change should be applied.
Robin