Stories about SHAPE
1 related stories
SHAPE of Chain-of-Thought in Math Reasoning
AI InsightThis paper introduces the SHAPE framework, analyzing LLM math reasoning CoT trajectories through semantic spaces and heuristics. Unlike prior result-centric evaluations, this marks a shift from outcome to process-oriented assessment, better explaining underlying math capabilities.Key TakeawayEvaluation shifts from outcome-oriented to process-oriented.Why It MattersFills the gap in assessing underlying math skills in CoT trajectories, providing new tools for diagnosing model reasoning flaws.Who's Affected- AI ResearchersProvides a new method for analyzing CoT trajectories from a math education perspective.
- DevelopersHelps diagnose model flaws in specific math heuristics for targeted optimization.
What's NextWatch whether more models expose reasoning pattern differences under SHAPE and subsequent fixes.Importance 65/100