Scaling LLMs to larger codebases
How do we scale LLMs to larger codebases? Nobody knows yet. But by understanding how LLMs contribute to engineering, we realize that investments in guidance and oversight are worthwhile.
Guidance: The context, the environment.
Oversight: The skill set needed to guide, validate, and verify the implementor's1 choices.
Investing in guidance
When an LLM can generate a working high-quality implementation in a single try, that is called one-shotting. This is the most efficient form of LLM programming....
Read more at blog.kierangill.xyz