He talks about the way he was treated by other fans (especially Liverpool fans) like they never stopped insulting him and calling him gay and even worse. Why gay? Because he was different from other players. However he is not gay so it was depressing for him. Also, even players were rude to him, especially Ince or Fowler. So he talks about the way he wanted to defend himself, even if it meant insulting or punching them.