PickPlaceCan stress

Place/release under stress — same gate, harder transport.

Three severity tiers of mass/friction stress on the can in robosuite PickPlaceCan, paired seeds, Wilson confidence intervals. Mild gate PASSes; severe stress collapses success as the can slips after grasp during lift/transport. The curve — not the mild badge — is the diligence artifact.

What we tested

Where does a PickPlaceCan policy break as can mass and friction move further from nominal?

1.00 → 0.24

success rate, nominal → severe

76%

severe episodes: grasp acquired, then lost

PASS

gate tier (mild) at defined thresholds

Charts

Success vs grasp-failure across severity

rate

Mean peak end-effector force

N (contact proxy)

Metrics

PASS · gate tiersevere score 0.24·50 episodes × 4 conditions, paired seeds

gate: stress success ≥ 80% of nominal
grasp-fail Δ ≤ 15 pp
Wilson 95% CIs on all rates

Metric	nominal	mild	moderate	severe
Success rate	1.00	1.00	0.88	0.24
Success 95% CI	[0.93, 1.00]	[0.93, 1.00]	[0.76, 0.94]	[0.14, 0.37]
Grasp-failure rate	0.00	0.00	0.12	0.76
Mean peak EE force (contact proxy)	165.86	214.54	160.43	46.87
Score (tier / nominal)	—	1.00	0.88	0.24
Verdict at gate thresholds	—	PASS	PASS	FAIL

Methodology

Nominal baseline. Run PickPlaceCan with default can mass/friction; record success, grasp-fail, and peak EE force over paired seeds.
Tiered stress. Resample can mass and sliding friction into mild → moderate → severe ranges while holding seeds paired with the baseline.
Gate + degradation. Score gate tier against success-ratio and grasp-fail Δ thresholds; report severe/nominal as the degradation headline.
Failure logging. Log each failed episode with sampled physics; classify grasp loss with a 5-step debounce after acquisition.

Seeds: 0..49 paired across conditions (50 episodes × 4 conditions)

gate: stress success ≥ 80% of nominal
grasp-fail Δ ≤ 15 pp
Wilson 95% CIs on all rates

Public methodology

Failure case · Grasp slip

The can is gripped — then slips in transport. That is the finding.

A PickPlaceCan policy that scores 1.00 at nominal looks fine until can mass rises and sliding friction falls. Without severity tiers and an honest grasp-loss metric, this would have stayed a silent green PASS.

How: Paired seeds across mild → moderate → severe mass/friction ranges. Grasp failure = never held, or grasp lost before place credit (5-step debounce). Each failed episode is logged with the exact sampled physics.

76%

of severe episodes: grasp acquired, then lost (slip)

Seed	Mass (kg)	Sliding μ	Mode
0	2.37	0.082	grasp lost (slip)
1	1.13	0.168	grasp lost (slip)
2	0.90	0.086	grasp lost (slip)
3	2.47	0.282	grasp lost (slip)

Same grasp-slip taxonomy as Lift/Stack. Mild gate PASS is the entry bar; severe degradation is the story.

Notes

Sim-only PickPlaceCan stress. Grasp/place failure under mass/friction tiers — not a substitute for real-hardware validation.

Sim-only — validated concept evidence, not a substitute for real-hardware validation or the full platform vision.