No, I'm not worried about damages to the lobe, first because the lobe push a roller and not directly the tappet, second because the noise ends when the engine warms, third because the first thing to be damaged is the valve seat.
In user manual of our cars sold in USA, (1.5 16v), you can read "Adjust the valves during services A, B, 1, 2, or 3 if
they are noisy."