I've done it many times. Use a small floor jack to hold the assembly. Once the nuts are off you'll need a drift or something similar to drive the shaft out. Grease it up. The re-assembly is more difficult in getting things lined up. Holding those dust caps in place is challenging.
I don't recall removing anything to do it. The brake lines are the thing to watch most.