We're not talking about attraction, we're talking about sexual behavior. Two different things. "Attraction" is entirely in the mind of the beholder, whereas sexual activity can be objectively measured.
I know people who confess attraction to both men and women, but engage in sexual behavior with only one gender and never the other. Attraction is not the issue, it's not even close to the issue. Hell, I'm attracted to all sorts of women but would only consider sexual behavior with a subset of them that meets additional qualifications (e.g. not married, and of legal age).
Attraction is not compulsion, and equating the two is a canard that serves only to confuse the issue, at the service of those who wish to see the issue confused.