(See the full results at compilebench.com) When ChatGPT first launched in 2022, it could barely write short snippets of working code. Today, the best LLMs can generate entire applications from scratch and even win prestigious coding competitions (like IOI 2025). But can they tackle the messy reality of software development – dependency hell, legacy toolchains, and cryptic compile errors? We created CompileBench to find out. Based on XKCD 2347 ("Dependency"). We tested 19 state-of-the-art LLMs on...