Can I delete the name of a reference I no longer need?

Yes, simply remove the reference information from the application page if you would like to identify more current or relevant references. Note that if a reference survey was sent to a reference you have since deleted, s/he can still fill out the survey.