There would be NO difference in a mudularized UBB vs the current format in terms of loading as NOTHING will have changed in terms of resources required by the base UBB system. There is NO coralation between the two. Your hypothisis has no merrit.
The only time you change this is when you ADD code/functionality to your existing system. And even then much of that is negligable as the current development team of UBBDev is fully aware of this exact issue and code accordingly.
If anything you will only get a tremendous amount of flexability which in turn will allow you to better manage your UBB and resources used. The exact opposite of your claim.