One Harry Potter team member is uninterested in returning for the Max reboot, believing their time at Hogwarts has come to an end