It's a problem that can occur on any car where rain washes pollen onto an area that can become warm. Typical areas are shut lines, window seals and panel gaps.
Detailers often use a detailing brush with an All Purpose Cleaner (APC) to access those hard to reach areas and gently clean away any deposits.
You didn't say, but I suspect you're using Auto Glym Super Resin Polish? Most 'polishes' contain some abrasives which is why they claim to clean and protect.
Once clean, try using a sealant on those areas as this help prevent build up. It won't eradicate the issue but should cut down the frequency of cleaning.