There is a summoning spell, Corruption methinks or some-such, that while active, has 30% +10% per level chance convert any newly summoned unit to the caster's side.
Said that, your enemy probably has exactly this spell active.
You can check the list of active spells on the left side of the screen (with running time countdown)