Since we're talking about ballance, you removed vital units and left them with a infantry, ranged, general and cavalry. Yea that seems great, and might seem more balanced to you, but for more points it is not.
First, certain races bring powerful units in game. These units have splash and good combat (see T. Rex, Knight Champion), the slaughter any 40 hp 10 damage units, those guys stand no chance. Have you tried playing Orc vs Knight? Seriously! It's painful! Your guys deal nothing to those powerful Knights. Ogres were vital units for Orcs, core units, nothing replaces them, without those, Orcs are useless. Wolf Riders and Trolls are trash. Also untouched Siege. 3 player bases were razed by battering rams, who provide a good meat wall, catapults, who crush anything around the rams and ballistae, that manage to kill anything that tries getting past rams. Seriously, all you need is these three guys. Make siege have 40 health and give rams 2 damage and a *100 damage versus buildings like in AoE2.
Secondly, it gives poor unit variety. Everything is boring. All you have to do is set your units on infinite production and set them to attack-move at a location. It doesn't even require resource management or a certain strategy. No, all units do the same thing, all races do the same thing. You might set the Ai manage your base. All he has to do is level Keep, build enough buildings so that your mines can sustain your troops and attack move. You removed special strategy units, like Spores. Or you removed core units, that leaves races nothing to do but mass all random units. You need to give units more archetypes. There are too many infantry, shadowed by advanced infantry, for instance Swarm, why build Husk if you have Scorpions, Plague, why build Ghouls when you can mass Slimes, why Swordsmen when you can mass Knights. In my opinion this has to be hit first. Too many units can be just skipped or ignored because theya re useless. This is important since you narrowed down the units.
Third, races are too simple. Take swarm, for instance, they have 5 units, 2 strategies: either mas randomly and take over the map, or mass fire ellies. Ssrathi can do nothing, now that the Snakepriests and T Rex are useless (yes, useless, not balanced, priests can be 2-shot), undead have nothing left but the Liche Mass, those Doomknighs weren't worth the price. And it's not just the strategies. Most races have up to 5 units, 3 generic melee one caster and one ranged. Empire falls here too. Pikemen do nothing compared to Halberdiers. Also how Harshit said, you removed crucial units from races ad exposed retarded vulnerabilities, like no real anti-air unit (Orcs and Undead),