robots.txt for Dolphin 7.x
As you know in BoonEx Dolphin 7.x absent robots.txt file by default.
I would like to present you my version of robots.txt file for BoonEx Dolphin 7.x
User-Agent: *# DirectoriesDisallow: /administration/Disallow: /backup/Disallow: /cache/Disallow: /cache_public/Disallow: /doc/Disallow: /flash/Disallow: /inc/Disallow: /langs/Disallow: /periodic/
Disallow: /plugins/Disallow: /simg/Disallow: /templates/Disallow: /tmp/Disallow: /xmlrpc/Disallow: /m/google_search/# FilesDisallow: /forgot.phpDisallow: /join.phpDisallow: /logout.phpDisallow: /get_rss_feed.phpDisallow: /searchKeyword.phpDisallow: /search_home.phpDisallow: /search.phpDisallow: /install.txtDisallow: /last_icon.txtDisallow: /license.txtDisallow: /readme.txtDisallow: /crossdomain.xml
See All ›
About BoonEx•Terms•Privacy•Contacts•© BoonEx (ACN 127966581)
Disallow: /modules/
Because when modules permalinks are off, then all module content begins with http://your.site.com/modules/index.php?r=/abc/de/, as the result most of your site content will not be indexed.
So, please remove this line or make a notice regarding modules permalinks setting.
I have just edited and deleted Disallow: /modules/ line from blog post.
Thank you, so mutch
robots.txt file - is used for allow or deny indexing content by search engine boots.
meta tag - are used for some information about page as keywords, description, author.
I suppose Dolphin script should use robots.txt file and meta tag together