Memories unlike toys can't be erased. Your poem explores that possibility. It certainly be helpful to pick and choose which ones were useful and just keep them. No wonder the haunting ones make you tired. You may want to amend your typo from 'tried' to 'tired'
All the best.