Editing /robots.txt

Last saved: 2008-10-23 23:55:48

# Allow the adsense robot to read content
User-agent: Mediapartners-Google* 
Disallow:
User-agent: *
# Logs must not be indexed
Disallow: /logs/
Disallow: /page/management/LogViewer.class
# Never ending response (server push)
Disallow: /page/example/PushUpdate.class
Disallow: /page/tools/stats/LiveLog.class
Disallow: /page/tools/stats/Status.class?live=push
Disallow: /status/?live=push
# Waste of bandwidth, don't index
Disallow: /page/tools/stats/BrowserInfo.class
Disallow: /page/tools/stats/NodeInfo.class
#Disallow: /page/tools/stats/UserInfo.class
# Don't allow the whole Internet to be pulled through the mobiliser!
Disallow: /page/example/Mobiliser.class
Disallow: /mobilise/
# User content should not be indexed
Disallow: /user/
Disallow: /nodes/

Only registered users can modify WikiWebServer.

Syntax highlighting [on/off]. Powered by CodePress.

Class Details 0 Comments

WikiWebServer.org

The dynamic, rewritable Java web server ^BETA

Editing /robots.txt

WikiWebServer.org

The dynamic, rewritable Java web server BETA

Editing /robots.txt

The dynamic, rewritable Java web server ^BETA