Wearing your team's colors at away games?

I'm going to a giants game where they are playing the mets. I'm from cali but took a trip to the amazing city of nyc a couple weeks back and saw a mets game. I absolutely fell in love with the met's fans and there heart for there underdog team. I got all my mets gear but am kind of worried about the drunk *** giants fan going crazy (i know i know). I have giants gear so i could wear either...