Built and tested at the CSI workcell

Three tools.
Choose where to start.

Teach an assembly from video, select a suitable robot finger, or set a placement target in the digital twin. Each tool opens in its own workspace.

How they work together

From a demonstration to a robot plan

The video workspace records the assembly sequence. Tool selection matches the part and operation to a tested finger design. The cell planner records the desired placement while leaving calibration and final approval to the operator.

6
reviewed demonstrations
24
grounded placements
90.8%
weighted hand coverage
6 / 6
final recovery runs
CSI FANUC ER-4iAPhysical runs · RGB-D · calibrated UF0
01

Demonstrate

Phone or cell video with real hands and parts.

02

Review

Hand, motion, labels and editable instructions.

03

Configure

Tested tooling and calibrated grasp profiles.

04

Validate

Reach, collision, insertion and calibration checks.

05

Run

Only through the authenticated operator client.

Measured results

Built from the physical workcell

Successful footage is paired with explicit limits. Video can teach sequence and contact; calibrated RGB-D and the current workcell transform are still required for robot coordinates.

Video instructions24 / 24

reviewed target placements grounded across six demonstrations

Automatic cycle count was exact in 2/6 clips; reviewed timing is retained.
Hand tracking90.8%

weighted hand-frame coverage across the reviewed set

Occluded contacts remain manual review points rather than invented poses.
Simulation6 / 6

final recovery-controller runs completed in the truck benchmark

Simulation validates logic; it does not replace real calibration.
Physical runs3 mm

observed waypoint completion tolerance used by the physical bridge

The public pages show high-level steps, not private controller interpolation.

Designed for

  • Top-down assembly and pick-place
  • Known or operator-reviewed part identities
  • Versioned gripper and grasp geometry

Still requires care

  • Reflective or deeply occluded parts
  • Force-controlled or blind insertions
  • Changed camera or tool transforms

Safety boundary

  • No public hardware dispatch
  • Safety gates fail closed
  • Operator approval remains external

System connection

A clear handoff at every stage

The public tools prepare files for review. The private workcell service adds the current calibration, checks reach and collision, and sends motion only after operator approval.

  1. 1Review the jobvideo, labels and target
  2. 2Prepare the filesinstructions, CAD and plan
  3. 3Run safety checksreach, collision and calibration
  4. 4Approve at the cellprivate controller and run log

The A-Team

Built at the CSI workcell

MSOE AI Club × UWM Connected Systems Institute × Rockwell Automation × NVIDIA