I need to test it more to know what's wrong with it
I can tell you what's wrong with it. Berserkers aren't the best choice for a deck.
Heroes do what Berserker does, but it also does so much more. It's an all round better deck.
If you want to intentionally get away from the hero build, Scouts have more potential than Berserkers right now. They've got some cool tricks up their sleeves.