How can different VLA models be compared fairly?

Different repository structures make the same experiment hard to run across models.

What I’m testing

A shared run structure with small, model-specific adapters.

What remains

The shared structure still needs to preserve details that affect correctness.

Generated illustration of a robot arm using a camera and a visual instruction to reach for a red block among several objects.
After zooming, drag or use the arrow keys to inspect the image. Plus and minus change zoom. Escape restores the full image.
Generated concept scene · not experiment evidence

How can different VLA models be compared fairly?

Generated illustration of a robot arm using a camera and a visual instruction to reach for a red block among several objects.

Can less computation preserve model behavior?

State reuse and approximations need checks for changed behavior.

What I’m testing

Measure explicit reuse and update paths across experiments.

What remains

The useful boundary may change with the model, observation history, and action decoder.

Diagram comparing full recomputation with a smaller update path that reuses cached model state.
After zooming, drag or use the arrow keys to inspect the image. Plus and minus change zoom. Escape restores the full image.
Technical diagram

Can less computation preserve model behavior?

Diagram comparing full recomputation with a smaller update path that reuses cached model state.

Where should AI help and human judgment remain?

Generated summaries can hide uncertainty as easily as they save time.

What I’m testing

Tools for organizing notes, finding questions, and revisiting—not deciding what is true.

What remains

The right amount of structure will only become clear through repeated use.

Diagram of a research loop: read, explain from memory, check what was missed, revisit, then implement or write.
After zooming, drag or use the arrow keys to inspect the image. Plus and minus change zoom. Escape restores the full image.
Technical diagram

Where should AI help and human judgment remain?

Diagram of a research loop: read, explain from memory, check what was missed, revisit, then implement or write.