UBB.Developers Forums UBB.threads 7 Development How Do I? googlebot, webcrawler etc... How do I get some?

Looking at the Who's online for threadsdev late at night and there's dozens of googlebots indexing the site.

Then I do a search for my website at google and the first couple links that come up are threadsdev posts where I have the URL in my sig.

Damn Josh, a) How come your site is such a hot search and b) How do I find out why my site wont get indexed even with the $50 UBB Spider Modification

I've tested that mod and haven't yet had results... although the logic behind it seems to work. And I know Allen and a few others have has positive results. So it simply takes time.

Here I am using something different, which is not something I'm releasing, but is a service that I make available to my clients.

But I've tested it at a good number of sites - and it's proved very effective.

We went from 300 and something pages to about 40,000 pages in google here. I put at a new site of mine the other day and it went from 1 page in google to ~45 in just a few days and the google botand it's a fairly new site with very few posts and very few link backs.

I instealled this for shortbus at www.ultimatenurse.com and he went from having 380 pages in google to now having 3200+.

The mod-rewrite method may be just as effective, but all methods can simply take time. Also google seems to move "faster" to index you and get you listed the more link backs you have to your site.

If anyone is interested in me adding this modification to your site Visit My Site for more information.

Check out our Retrostats referrals from Search Engines:

http://www.retrostats.com/user.php?action=search_engine&a=threadsdev

Look at the number of referrals from Google. We've had retrostats since they first became availabel... and when I applied my modification here in early September, we only had ~1000 referrals from Google ever. Now we have 7829+ referrals from google. I didn't really note the others, but you see we get a fair amount of new visitors from yahoo as well.

You can also see that our traffic pretty much doubled since my install early September.

http://www.retrostats.com/user.php?action=visitors_of_the_month&a=threadsdev

I just reached over 500 in Google (most of the links picked up are from this mod which is only about a week old) and the spiders are all over my site!

Yay!

Glad it's working so well for you.

Right now ThreadsDev is showing over 75,000

Well over 3000 in google with Josh's mod and started with 700

However I have like 35000 in alltheweb.com which is weird so that engine seems to be going crazy on my site and google as well but I am a small dedicated site.

I just jumped to 815 This mod combined with the [6.4] Online User Info for 6.4 mod allows you to see every detail of where you are listed and where people are coming from.