One area where language models might actually be good is emulating a type system for dynamic languages.

Given how good these things are at figuring out general shape of the code, I suspect they could fairly accurately tell you argument and return types for functions. And you could probably get away with a pretty small model if it only targets a specific language.

I'm kind of surprised nobody's tried doing this yet.

#technology #programming #machinelearning #llm