BlackHatCrew - Elite Blackhat SEO Webmaster Forum
 

Go Back   BlackHatCrew - Elite Blackhat SEO Webmaster Forum > Free 4 All > Webmaster Talk
Register FAQ Members List Calendar Search Today's Posts Mark Forums Read

Reply
 
LinkBack Thread Tools Display Modes
Old 02-17-2008, 03:17 PM   #1 (permalink)
poto
splogtastic
 
poto's Avatar
 
Join Date: Oct 2007
Posts: 1,296
Send a message via ICQ to poto
Default MSNbot Updated

Recently Microsoft announced an update to MSNbot to reduce bandwidth resources during a site crawl. MSNbot v1.1 is now able to use HTTP compression and conditional get.

HTTP Compression: HTTP compression allows faster transmission time by compressing static files and application responses, reducing network load between your servers and our crawler.

Conditional Get: We support conditional get as defined by RFC 2616 (Section 14.25), generally we will not download the page unless it has changed since the last time we crawled it. As per the standard, our crawler will include the "If-Modified-Since" header & time of last download in the GET request and when available, our crawler will include the "If-None-Match" header and the ETag value in the GET request. If the content hasn't changed the web server will respond with a 304 HTTP response.

source: Live Search Webmaster Center Blog : Announcing Crawler Improvements for Live Search
__________________
My Ratios :: My Blacklist
poto is offline   Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT. The time now is 10:18 AM.


Powered by vBulletin® Version 3.6.8
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Search Engine Optimization by vBSEO 3.0.0