I had the same issue and found the answer here: remove custom icons from network atlas
Just be sure to delete files from all local folders where they may be, in my case I had used Atlas on the server as well as my local PC. and close NA.
Hope that helps.