if a player doesn't do well or has a bad game causing them to die a lot and never keep up with the team. that person doesn't get a vote for surrender. boom problem solved. the people doing super well are going to control the game in team fights and in surrender votes.
if you can't get it together and at least break even then you don't get the option to affect peoples time because clearly that persons time/opinion, the person who can't keep up, isn't valuable enough to the team to make proper decisions.