Are you sure that you didn't kill off the rest of their colonies? A civ in a real-world situation would live on if their main base operations was destroyed. They wouldn't just vanish, but I honestly cant say because I haven't gotten that far into the game yet, just a little logic thrown in there for thought.
To help your logic, he blew up the planet where they live on