The outer race **not moving** is actually the whole point —…

The outer race **not moving** is actually the whole point — that's called an **interference fit** (press fit). The bearing is *designed* to be slightly larger than the housing bore, so it grips tight.