I was speaking with my own father about this issue before the 2008 elections and he indicated that the system of voting over the years has become rigged and flawed. His thoughts on the matter were about "hunting animals in the zoo" - its just not as much fun or as exciting when its so easy.
Perhaps male voters are leaving because they are not being challenged enough and because the "game" of politics is just not as fun. If you think about it though, white men still have an upper hand in the "game" - maybe that's why many of the players are able to take a short time out. I am really curious to see what is going to happen in 2012, and I guess only time will tell.