What's the benefit of organize and removing using statements?

Question

If a reference is removed from your code via a using statement, does it help performance at all if it's already being used in another part of the application?  I would think not -- however, I can see that it might help if the library is not in memory.  Anyone have any info on this?