It turns out that the motors and IMU were actually not flipped around, I had a naming bug in the block design that made a bunch of things look wrong, and the direction plate was flipped (velcro got removed and re-attached).