It's the twitch on the steering wheel that is unacceptable. For me it's like your passenger leaning across and grabbing the wheel.
It's only LIKE your passenger is leaning across and grabbing the wheel. In my opinion that passenger is not extremely strong, so far I beat him/her easily...
By the way... driving on (sometimes very) narrow country roads, encountering an oncoming vehicle, I slow down. Often below 30 km/h (18 mph) and then RDMS is not activated.
If the circumstances are such that a higher speed is not dangerous, I tap the indicator and see: then no RDMS tries to intervene.
I have (very quickly) learned to live with RDMS and I also regularly use the Lane Keeping Assist System that you can switch off with 1 push of a button, if desired.