The former CDC director was ousted late Wednesday after refusing to resign under pressure from Secretary Robert F. Kennedy Jr.