To fuck or not to fuck

Its fair to say ive been very lucky in my sex life over the years. Im a fairly average guy, average height, not stunning looks wise but Ive somehow managed to have a lot of sex over the years. I've swung, dated, cockolded, been to swinging clubs both alone (hard work!) and with ladies (much easier!). I estimate Ive slept with between 150 and 200 women over the years- I stopped keeping count after 100. I'm in my forties now and still manage to get interest. If Tinder had been available when I was younger i would have basically been in seventh heaven as in the past finding a FWB as a man took a lot of effort, chat and balls to approach people plus the inevitable rejection from a significant proportion. Ive misbehaved with workmates (wouldn't do that these days- probably) and random women Ive met in life.

My issue is that these days the majority of woman who make it clear they want to have fun with me are either married or part of a couple. Occasionally it'll be made clear that the guy is ok with it but most of the time they are looking for an affair. I've done it many times in the past and felt a bit guilty although i seem to get over it once im having fun (funnily enough...). That said I dont really want to be part of destroying someones relationship. I always make it clear Im just there for fun but inevitably sometimes emotions get involved from the ladies side usually. It feels like im tempting fate.

If I could put on a full body VR suit and fulfil my fantasies without potentially hurting anyone, getting a STD or damaging a relationship id do it.

What do you think?