Yes, make sure that the hack you are attempting to install was actually written for your version of the UBB.
Also keep in mind that if you have installed another hack that has modified code this hack needs, it will fail as well. This doesn't happen all that often actually though.
Please post your UBB version and the exact version/location of the MultiHack file you are using.