Has your character told the other one that they should stop acting that way?

Just because you as a player don't ship it doesn't mean the other character stops having those feelings. It would probably be OOC for them to stop pursuing that relationship.

The annoyance for the behavior should come from your character's mouth which in turn gives you a better chance to avoid them if they continue to do it.