These TV shows experienced significant setbacks after the departure of key characters, causing them to struggle with their storylines and audience reception