GPT-4 performs significantly worse on coding problems not in its training data

GPT-4 performs significantly worse on coding problems not in its training data. 282 comments, 344 points on Hacker News.