over at google they have this thing going called 'sitemaps'
If i understand correctly you make an xml file, that lists files you wish googlebot to crawl.
i have decided to submit my ubb classic today's active topics, have had some success, as can now log in to google, which is showing status OK for my file.
i do not wish to create this by hand each day, and have found a little php to format my content island for google, i have taken code from
http://www.webmasterbase.com/article/560 and changed to
for ($j=1; $j<=count($link); $j++) {
print "<url>
<loc>$link[$j]</loc>
<lastmod>$today</lastmod>
</url>
";
} then i am including this is an xml file
<?xml version='1.0' encoding='UTF-8'?>
<urlset xmlns="http://www.google.com/schemas/sitemap/0.84" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.google.com/schemas/sitemap/0.84 http://www.google.com/schemas/sitemap/0.84/sitemap.xsd">
<!--#include virtual="site-map.php" -->
</urlset>
