Creating library for dll files

Question

I have 2 Visual Studio 2010 pojects, one is a Windows Appliation and the other is a class library which creates one .dll file, which I reference in the Windows app project.
There are also 3 third party dll files which the application uses.
When I am releasing an update to the software I need to copy the .exe file and all 4 .dll files into the same diectory.
What I would like is to somehow have the .dll files in a folde called library or similar. This means the directory containing the .exe file will be 'tidier'
How do I do this?
 
Thanks,
Andrew