These things aren't one sided. When the playerA decides to against playerB, A says what they do, and B says how they try to respond. Both roll and the fiction is determined pretty straight forwardly. If for whatever reason the other player wasnt attempting to prevent this from happening (rolling interfere) then I'm not sure why the roll occurred at all, since A would just touch B.
Dismissing your example, and going into the heart of the matter though. Why not? If one character tries to do something to another and fails miserably, it should be rather clear what the implications of that are. If they try to punch someone else in the face, and that person was actively fighting back (the only reason seize by force is appropriate.) The person that tried and failed, Lost. Describe to them how and turn the situation so they cannot just "try again". In this case, they might be pinned on the ground with their gloved hand hard into the dirt.
Again though, the key here is to find out what both parties are doing before Any rolls are made. What this does is declare what's happening. If they both fail miserably, then you are free to make a hard move against them both, or have both of their moves backfire in a way where neither of the aims are successful.