"We" know you wear your jersey to the game ...
...... but you don't get paid by the team and you don't make tackles. And there's not a little person in your pocket either, which would make your "we" correct. You've probably heard it from a few random people before when you're cheering for your team at a bar, or at a visiting stadium, but it's a good debate. Are you allowed to use the term "we" when referring to your favorite team? "We" didnt run the ball well, "we" couldnt get anyone out in the 8th, or "we" couldn't stop Lebron James.
Check out this piece on Grantland that suggests that "YOU" should change the way you talk about "YOUR" team, and so do we.