I am running with a couple IIPs:
Short Stats
Status Login
Whos Online
Top Posters
Hot Topic
ShoutBox
New User
In running through the list turning one off at a time, I didnt not much of a time difference EXCEPT for New User.
By turning off New User, my times dropped .6 seconds to a full 2 seconds over the averages with New User included.
Dont mind me - just talking through this as I go. But the "problem child" appears to be New User.