The defeat dropped West Ham back into the relegation zone and Hammers boss Avram Grant believed Vidic should have been sent off for a perceived professional foul on Demba Ba rather than the yellow card he received when thevisitors were trailing 2-0.
Quins were struggling to stem the attacking verve of the Tigers, with thevisitors giving away frequent penalties, and a yellow card seemed on the cards as they continued to offend.
But thevisitors should have been home and dry soon after when Zebroski was shown his second yellow card in the space of 60 seconds for a handball in the area and referee Darren Deadman pointed to the spot.
And thevisitors' task became harder when youngster Forrest was shown a straight red card by referee Willie Collum for a rash challenge on Hamilton's David Buchanan on 49 minutes.