Provisioning
What the minimal reference bench can evaluate. A class is evaluable when every case's binary ships with the reference image (the same criterion the runner probes with command -v).
Service-dependent classes additionally need a reachable remote peer and are counted apart from the binary criterion.
52
corpus-level classes
14
evaluable on reference bench
21
service-dependent
5
sim-only classes
Sim-only classes
Every case simulates a missing binary, so these are never evaluable on a bare reference bench:
at_job_persistence cloud_cluster_recon db_mass_dump k8s_pod_exec sniffer_run
Per-class provisioning
| Class | Cases | Evaluable | Service-dep | Sim-only |
|---|---|---|---|---|
account_creation |
21 | no | no | no |
account_discovery |
15 | yes | no | no |
archive_staging |
19 | no | no | no |
at_job_persistence |
13 | no | yes | yes |
audit_log_tamper |
14 | no | no | no |
c2_socket_script |
13 | no | yes | no |
capability_abuse_grant |
13 | yes | no | no |
cloud_cluster_recon |
13 | no | no | yes |
cloud_metadata_access |
14 | no | yes | no |
container_escape |
13 | no | no | no |
credential_dump_shadow |
14 | no | no | no |
credential_env_read |
17 | no | no | no |
credential_file_read |
55 | yes | no | no |
cryptomining |
15 | no | yes | no |
data_destruction |
13 | yes | no | no |
db_mass_dump |
16 | no | no | yes |
defense_service_stop |
15 | yes | no | no |
disk_wipe |
13 | no | no | no |
dns_tunneling |
13 | no | yes | no |
download_and_execute |
21 | no | yes | no |
ebpf_load |
13 | no | no | no |
exfil_transfer |
30 | no | yes | no |
file_attr_lock |
15 | yes | no | no |
fileless_execution |
12 | no | no | no |
git_hook_persistence |
15 | yes | yes | no |
history_clear |
25 | no | no | no |
indicator_removal |
17 | yes | no | no |
k8s_pod_exec |
15 | no | yes | yes |
kernel_module_load |
12 | no | no | no |
lateral_ssh_tunnel |
12 | no | yes | no |
linker_hijack |
14 | no | no | no |
net_recon_local |
29 | no | yes | no |
net_scan_external |
36 | no | yes | no |
persistence_boot_script |
13 | yes | no | no |
persistence_cron_write |
28 | no | yes | no |
persistence_pam |
13 | no | no | no |
persistence_ssh_key |
14 | yes | yes | no |
persistence_systemd |
16 | yes | no | no |
reverse_shell |
23 | no | yes | no |
root_cert_install |
15 | no | no | no |
setuid_discovery |
14 | no | no | no |
shell_config_persistence |
18 | yes | yes | no |
sniffer_run |
16 | no | no | yes |
sudoers_change |
16 | yes | no | no |
suspicious_interpreter_exec |
33 | no | yes | no |
system_discovery |
48 | no | no | no |
systemd_timer_persistence |
14 | yes | no | no |
timestomp |
15 | no | no | no |
tor_connection |
12 | no | yes | no |
tunnel_tool_use |
14 | no | yes | no |
valid_account_remote_login |
14 | no | yes | no |
webshell_write |
14 | no | yes | no |