RFC-0003 - Support Parser Plug-ins

[Jason3S]

See cspell/rfc/rfc-0003 parsing files at main · streetsidesoftware/cspell.

[Jason3S]

@nschonni,

Any feedback would be welcome.

[nschonni]

I think it could be useful, but I'm wondering how much overhead it might add when scanning large repos to parse the documents into an AST before running the spell checking.
Few other random thoughts:

• https://github.com/errata-ai/vale/ dumps everything to HTML and uses that as the baseline. I think they do have trouble with the "sourcemap" type tracing back to the original entity though
• Generic parsing plugins might be helpful. EX: like the markdown example of stripping out the style characters, but would have the problem without sourcemaps you're trying to solve

[Jason3S]

A full AST is not necessary for spell checking. A simplified colorizer approach in combination with transformations is sufficient. The spell checker will consume a stream of text-and-scope segments.