don't know why the old on was left on because with the tyre off ( if you had new tyres that needed balancing ) the weight should literally fall off.
Knock on weights have clips that pinch them tightly onto the rim - and that makes it almost impossible to keep swapping them about without damaging the paint on the rim edges. Tyre on or off, you have to remove them with a pair of weight pliers.
It sounds like the zinc part of the weight has fallen off to me, probably corroded - if the paint .gets damaged on these new zinc weights, they corrode like hell.
No lead weights now Jocko, banned since 2005!