Every now and then I see someone tackle the discussion about voting and results, after thinking for a while here are my thoughts.
One of the main problem (right next to small number of votes == possible better scores) is that some voters like to give good ratings, while some doesn’t. You can imagine someone being a jerk and giving bad ratings to good games, and the opposite, someone who is way too nice and gives good rating even to bad games. I noticed this on my last entry (LD#22), where I quit halfway through and still some people gave medium ratings to my game.
To remedy this, maybe we could give ratings based on other rating by the voter. If someone gives a lot of games 2-3 stars, but gives a game 5 stars, it must mean that that game is somewhat better than the rest. On the other hand, if someone goes around giving 5 stars to a bunch of games, it’s possible that those games are not really worth 5 stars.
Two possible workaround would be: calculating the rating based on the position of the game in relation to other games the voter voted (if he votes for 3 games, giving 2, 3 and 4 stars, their real rating would be 1, 3 and 5 stars, or something like that) or letting the voter order his voted games from best to worst. I’m not sure if this would work out, and I know you guys will be able to find a lot of flaws in it
Another possible solution to the voting problem, and this would mean an overhaul of the voting system, would be to separate voting in phases. Every phase would last for a week, and during that week the voter would have to vote on 10 games for his votes to be considered. The first phase would have all games, randomly given to the voters. The next phase would have just a fraction of the games (something like the 500 best voted games), the third phase even less games (for example, 100) and the last phase would have the top 10 games to be voted. I believe this would make voting something a lot more exciting than just picking random games and hoping they don’t suck, and would also make people vote more, especially on the last phase where almost everyone would come to vote, since the games are somewhat guaranteed to be good.