GPT Astra Reached 99% in ARC-AGI-3, Actually Not Really.
GPT-6 Astra reached 99.95% on ARC-AGI-3 with OpenAI’s Provider Adapter harness. The Standard harness result was 62.71%. Here is what the difference means.
Frontier Model & Evaluation Lead at Eyestech. PhD in Machine Learning focusing on transformer post-training, reinforcement learning from reasoning traces, and synthetic benchmark verification.
GPT-6 Astra reached 99.95% on ARC-AGI-3 with OpenAI’s Provider Adapter harness. The Standard harness result was 62.71%. Here is what the difference means.