ExoBrain
benchmarks and evalscoding agentsmodel releases

Claude codes

The release of Claude 4 has resulted in a consistent reduction in syntax error rates for code generation, marking a significant improvement in the model's coding capabilities.

ExoBrain

1 min read
Claude codes

This chart captures Claude’s improved coding capabilities. Before 23 May, syntax error rates fluctuated between 0.15% and 0.25% across different programming languages and application scenarios generated on the Loveable AI app creation platform. After the Claude 4 rollout error rates dropped and have remained consistently low. Feedback on the new Claude has ranged from disappointment to excitement, but if it’s code you’re interested in generation 4 is a step up.