Stupider Crawler fragt nichtexistente Seiten ab
Wat soll ick denn damit?
Code:
[...]
12.148.209.198 - - [17/Aug/2003:16:35:59 +0200] "GET /music.php?lang=lv HTTP/1.1
" 404 287 "-" "NPBot (http://www.nameprotect.com/botinfo.html)"
12.148.209.198 - - [17/Aug/2003:17:47:53 +0200] "GET /productdetail.asp?pfid=W02
A0004622&sortid=N00&iscatalog=1&isshow=0 HTTP/1.1" 404 295 "-" "NPBot (http://ww
w.nameprotect.com/botinfo.html)"
12.148.209.198 - - [17/Aug/2003:19:20:18 +0200] "GET /job.html HTTP/1.1" 404 286
"-" "NPBot (http://www.nameprotect.com/botinfo.html)"
12.148.209.198 - - [17/Aug/2003:23:33:44 +0200] "GET /directive-dict.html HTTP/1
.1" 404 297 "-" "NPBot (http://www.nameprotect.com/botinfo.html)"
12.148.209.198 - - [17/Aug/2003:17:47:53 +0200] "GET /productdetail.asp?pfid=W02
A0004622&sortid=N00&iscatalog=1&isshow=0 HTTP/1.1" 404 295 "-" "NPBot (http://ww
w.nameprotect.com/botinfo.html)"
[...]
12.148.209.198 - - [19/Aug/2003:11:10:34 +0200] "GET /latest.htm HTTP/1.1" 404 2
88 "-" "NPBot (http://www.nameprotect.com/botinfo.html)"
12.148.209.198 - - [19/Aug/2003:12:24:05 +0200] "GET /modules.php?op=modload&nam
e=My_eGallery&file=index&do=upload HTTP/1.1" 404 289 "-" "NPBot (http://www.name
protect.com/botinfo.html)"
12.148.209.198 - - [19/Aug/2003:13:34:04 +0200] "GET /bulkfoods.htm HTTP/1.1" 40
4 291 "-" "NPBot (http://www.nameprotect.com/botinfo.html)"
List beliebig fortsetzbar. Wenn schon, dann würde ich meine Seiten gerne sinnvoll crawlen lassen. What he doing??
lg paux |
