I pulled the suspect lifter and it is damaged. Something galled the roller as you can see in the photos below. I put a camera down the lifter bore and it looks like the cam lobe is also damaged. It looks like a new cam is needed.
The lifter next to it is also damaged on the side of the roller (its surface is OK).
The lifters on cylinder #3 look perfect.