noun
An opponent in a contest, conflict, or dispute; an enemy.
Think of the word "adverse" (unfavorable). Your adversary is the person who makes things adverse for you.