The noise may be annoying, but my wifes Jazz made the noise for almost 12 months, gradually getting worse. When I had the gearbox fixed the garage showed me the bearing and to be honest there was no roughness there, just a very slight noise if you spun it fast.
One thing is for sure, bearing won't fail even though it sounds terrible in lower gears, just get noisier until you get fed up with it and have it fixed. And there should be no noise in 4th and 5th gear when you are cruising.