You will never get them all aligned and bolted up by fighting the sway bar.
Put the brackets on the a arms and bolt them up to the a arms. Then use a clamp to pull the sway bars back into the body of the car with the sway arm bushings in place. Then slide on the metal U brackets and bolt them up to the fixed studs . Then release the clamp.
There is a post on how best to do this with photos- I will find the reference.