Inside the .app's Info.plist set:
<KEY>NSUIElement</KEY>
<STRING>0</STRING>