WIP code towards tokenization of comments.

It was extracted here because it's not ready for release, but we want to keep it available for the author to resume work on it.