In 'LocalSettings.php':
$wgLogo = '/wiki/skins/common/images/logo.png';
The path is interpreted relative to the wiki install base. The example is, I believe, a decent place to put the logo since it is an image that should, indeed, be common to all skins.
