Artificial Analysis Launches Custom Index Builder in Data Playground

Artificial Analysis introduced a custom index builder in its Data Playground, allowing users to add any Artificial Analysis benchmarks, customize their weights, and plot results against other chart axes. Models receive a score only if they have results for every evaluation in the index, consistent with the Intelligence Index methodology. The Data Playground also includes formula metrics, launch-date playback, heat maps, box plot distributions, and a workbench with sheets and a dashboard view, available with Artificial Analysis Pro.
Event version 1.
Key insights
Custom index construction
Users can add any Artificial Analysis benchmarks and customize their weights to build a custom index. Results can be plotted with other chart axes.
Complete-coverage scoring rule
Models receive a score only if they have results for every evaluation in the custom index. This is consistent with the Intelligence Index methodology.
Additional Data Playground features
The playground includes formula metrics that combine metrics with arithmetic operators and functions such as log and sqrt. It also offers playback of scatter charts by launch date with the frontier drawn at each date, heat maps across evaluations, box plot distributions by group, and a workbench with sheets, shelves and a dashboard view.
Pro availability
The Data Playground is available with Artificial Analysis Pro.