I think the angry/bitter/sarcastic 'Well thats alright then" the Toymaker keeps repeating is mirroring how The Doctor really feels. They all still died under his care and he can't get them back. So the little mercies of them still carrying on after the point of his loss is of no consolation to The Doctor. Neil Patrick Harris is so good in this scene.
The Toymaker’s recap of Eleven and Twelve’s companions.