Don't use the default button. That's bad UI anyway. Add your own favorite button for each answer.
And, since you will be using your own classes, like:
<a class="myStarOff" href="#" data-ansID="1234" title="Click to add as favorite answer (click again to undo)">
favorite</a>
<a class="myStarOn" href="#" data-ansID="56789" title="Click to remove from favorite answers (click again to redo)">
favorite</a>
...and your own event handlers; there will be no conflict.