XNews

Perplexity Publishes Red-Teaming Findings on SPACE VM Sandbox for Computer Agents

Perplexity Publishes Red-Teaming Findings on SPACE VM Sandbox for Computer Agents

Perplexity published new research on red-teaming SPACE, its VM sandbox for Computer agents, testing 12 models on escaping the VM to take a host credential and bypassing the network policy to reach a blocked URL. The findings show that the standard Capture the Flag setup can steer agents away from the security boundary being tested, and that security-specialized models do not guarantee better results.

Event version 1.

Key insights

Two red-teaming tasks

Twelve models were given two tasks: escape the VM to take a credential from the host, and bypass SPACE's network policy to reach a blocked URL.

Capture the Flag setup can misdirect agents

The standard Capture the Flag setup used in red-teaming can steer agents away from the security boundary being tested.

Security-specialized models not guaranteed better

Security-specialized models do not guarantee better results in the red-teaming of SPACE.

Source posts