Sim-to-real training is an important part of the future of robot skill learning. But a lot of sim-to-real work focuses on navigation, grasping, or, more recently, non-interactive robot behaviors like dancing. Training dexterous policies for humanoids is very different, because