XNews

Artificial Analysis Launches Custom Index Builder in Data Playground

Artificial Analysis Launches Custom Index Builder in Data Playground

Artificial Analysis introduced a custom index builder in its Data Playground, allowing users to add any Artificial Analysis benchmarks, customize their weights, and plot results against other chart axes. Models receive a score only if they have results for every evaluation in the index, consistent with the Intelligence Index methodology. The Data Playground also includes formula metrics, launch-date playback, heat maps, box plot distributions, and a workbench with sheets and a dashboard view, available with Artificial Analysis Pro.

Event version 1.

Key insights

Custom index construction

Users can add any Artificial Analysis benchmarks and customize their weights to build a custom index. Results can be plotted with other chart axes.

Complete-coverage scoring rule

Models receive a score only if they have results for every evaluation in the custom index. This is consistent with the Intelligence Index methodology.

Additional Data Playground features

The playground includes formula metrics that combine metrics with arithmetic operators and functions such as log and sqrt. It also offers playback of scatter charts by launch date with the frontier drawn at each date, heat maps across evaluations, box plot distributions by group, and a workbench with sheets, shelves and a dashboard view.

Pro availability

The Data Playground is available with Artificial Analysis Pro.

Source posts