On Fri, 14 Dec 2007 17:18:38 -0500, Gary King gwking@metabang.com wrote:

IIRC, there is some way to ping Google and get them to spider your page more quickly...

The text is /not/ a result of spidering - it never appeared on my webpage in this form. Google spiders weitz.de pretty often anyway. For example, Googlebot looks at the Hunchentoot page about once per day:

edi@nanook:/var/log/apache$ nslookup 66.249.67.206 Server: 81.169.163.104 Address: 81.169.163.104#53

Non-authoritative answer: 206.67.249.66.in-addr.arpa name = crawl-66-249-67-206.googlebot.com.

Authoritative answers can be found from:

edi@nanook:/var/log/apache$ cat weitz_access.log.1 weitz_access.log | grep -i 66.249.67.206 | grep "GET /hunchentoot/ " 66.249.67.206 - - [02/Dec/2007:12:10:00 +0100] "GET /hunchentoot/ HTTP/1.1" 200 133631 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" 66.249.67.206 - - [03/Dec/2007:12:05:52 +0100] "GET /hunchentoot/ HTTP/1.1" 200 133631 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" 66.249.67.206 - - [03/Dec/2007:16:40:12 +0100] "GET /hunchentoot/ HTTP/1.1" 200 133631 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" 66.249.67.206 - - [04/Dec/2007:18:51:13 +0100] "GET /hunchentoot/ HTTP/1.1" 200 133631 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" 66.249.67.206 - - [05/Dec/2007:16:16:03 +0100] "GET /hunchentoot/ HTTP/1.1" 200 133631 "-" "DoCoMo/1.0/N505i/c20/TB/W20H10 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)" 66.249.67.206 - - [05/Dec/2007:22:05:52 +0100] "GET /hunchentoot/ HTTP/1.1" 200 133631 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" 66.249.67.206 - - [05/Dec/2007:22:30:16 +0100] "GET /hunchentoot/ HTTP/1.1" 200 133631 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" 66.249.67.206 - - [07/Dec/2007:05:49:10 +0100] "GET /hunchentoot/ HTTP/1.1" 200 133631 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" 66.249.67.206 - - [07/Dec/2007:08:09:28 +0100] "GET /hunchentoot/ HTTP/1.1" 200 133631 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" 66.249.67.206 - - [08/Dec/2007:08:41:29 +0100] "GET /hunchentoot/ HTTP/1.1" 200 133631 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" 66.249.67.206 - - [09/Dec/2007:17:13:07 +0100] "GET /hunchentoot/ HTTP/1.1" 200 133631 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" 66.249.67.206 - - [11/Dec/2007:14:32:29 +0100] "GET /hunchentoot/ HTTP/1.1" 200 133631 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" 66.249.67.206 - - [12/Dec/2007:15:36:36 +0100] "GET /hunchentoot/ HTTP/1.1" 200 133631 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" 66.249.67.206 - - [13/Dec/2007:16:05:52 +0100] "GET /hunchentoot/ HTTP/1.1" 200 133631 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)" 66.249.67.206 - - [14/Dec/2007:15:32:27 +0100] "GET /hunchentoot/ HTTP/1.1" 200 133631 "-" "DoCoMo/1.0/N505i/c20/TB/W20H10 (compatible; Googlebot-Mobile/2.1; +http://www.google.com/bot.html)" 66.249.67.206 - - [14/Dec/2007:19:47:44 +0100] "GET /hunchentoot/ HTTP/1.1" 200 133631 "-" "Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)"

On Fri, 14 Dec 2007 17:33:15 -0500, Bob Hutchison hutch@recursive.ca wrote:

Edi, if you did that a while ago that might be where the description is coming from.

No, I didn't.

However, it is pretty easy to see where their information is coming from. Copy the "Web server ... only with LispWorks" text and paste /that/ into Google's search box. The first thing Google will find is the "Google Directory" entry for Hunchentoot. So, someone (not me) added this entry more than a year ago and never bothered to update it.

On 14-Dec-07, at 5:22 PM, Edi Weitz wrote:

On Fri, 14 Dec 2007 17:03:55 -0500, Bob Hutchison hutch@recursive.ca wrote:

...

Debating whether to mention this or not...

Have you noticed the text that shows up when you search for Hunchentoot in google:

"HUNCHENTOOT - The Common Lisp web server formerly known as TBNL Web server coded in Common Lisp; supports HTTP/1.1 chunking, persistent connections (keep-alive), and SSL; works only with LispWorks."

The 'works only with LispWorks' bit is maybe something you don't want there?

Didn't see that before. Of course, the information that Hunchentoot only works with LispWorks is more than a year old. Says something about Google...

Now, if I only knew where Google gets these tidbits from.

I think if you put a <meta name="description" content="... something descriptive ..." /> in the header you'll get what you want. The Hunchentoot page was cached by Google on Dec 8, 2007 which is pretty recent.

Cheers, Bob

---

tbnl-devel site list tbnl-devel@common-lisp.net http://common-lisp.net/mailman/listinfo/tbnl-devel

---- Bob Hutchison -- tumblelog at http://www.recursive.ca/so/ Recursive Design Inc. -- weblog at http://www.recursive.ca/hutch http://www.recursive.ca/ -- works on http://www.raconteur.info/cms-for-static-content/home/

It seems that dmoz uses that particular phrase.

http://www.dmoz.org/Computers/Programming/Languages/Lisp/Software/