If they are turning easily in their bores, then they are either too small of an outside diameter or the lifter bores were cut too large.
These bushings properly installed using the Wydendorf kit are "press fits". There is a Loctite adhesive that is supplied with the kit as well as an installation tool that you drive (tap in) the bushing.
It is also imperative that the oil holes in the sleeve inserts align with the oil passages in the block.
Take your pick of why the sleeves are loose from the above? I didn't think anyone following instructions could possibly screw the installation up?
If using the lifter bore restriction sleeves, you don't use the Moroso oil passage restrictions any more.
As far as refinishing the crankshaft journals, most racers feel uncomfortable at using more then a .010" undersized journal.
The reason being that they feel that there is a point at which the bearing itself becomes to malleable and will compress too much encouraging bearing failure under racing conditions.
This could be a good time to consider putting a stroker kit in?