Remove the two single bolts.
this is a very good time for you to consider a proper aftermarket baffled oil pan. I believe the CJ oil pan is better than standard stock but not nearly as efficient as the aftermarket “10” quart pans offered by several builders
A quick search of this forum should steer you to more information
Larry