C# Project runs fine until publishing

Question

I'm using Visual Studio 2005 and programming in C#

I have a project that uses OleDb to connect to a mySQL db.  I use a third party dll called DotNetOpenMail to email people and I am displaying a jpg in the program. 

It compiles and works perfectly on my developer machine but when I goto Build->Publish and publish the project it crashes on other desktops. 

When I publish do I have to do something to include the jpeg and the dll file?  How do you make a project available to other desktops?

I hope that I have provided enough information please ask if you require more.