Thanks everyone. You all just confirmed what I had thought.
I gave no-one permission, they just get a local company to tow my car. For those in the UK, I got hit in Surrey, they took it to Kent

??, and I live in Leicestershire. They would not tow me home with the car, they sent an Uber which was a 4hr drive home.
I seriously have concerns at buying a similar age Jazz now. Nothing major had gone wrong with mine, accept the air con, which didn't stop the car working. But it was only time before it was going to need major works. I wouldn't want to risk getting a car that may pack up in 5 months.
So angry because him, with his flash Audi and personalised number plate could afford this accident, I come off worse and can't afford to do anything about it.