Lots of people view him as a wimp. A whipping boy, just there to get bossed around by Snoke (and now Kylo).
If watching lots of TV has taught me anything, it's don't underestimate the supposed weak ones. They're the ones who tend to fight back harder.