mirror of
https://github.com/joomla/joomla-cms.git
synced 2024-06-26 07:13:21 +00:00
5272105be8
SEO improvement to robot.txt allowing .css and .js file to be accessed by bots in their crawlings. See https://github.com/joomla/joomla-cms/issues/3937
39 lines
1.1 KiB
Plaintext
39 lines
1.1 KiB
Plaintext
# If the Joomla site is installed within a folder such as at
|
|
# e.g. www.example.com/joomla/ the robots.txt file MUST be
|
|
# moved to the site root at e.g. www.example.com/robots.txt
|
|
# AND the joomla folder name MUST be prefixed to the disallowed
|
|
# path, e.g. the Disallow rule for the /administrator/ folder
|
|
# MUST be changed to read Disallow: /joomla/administrator/
|
|
#
|
|
# For more information about the robots.txt standard, see:
|
|
# http://www.robotstxt.org/orig.html
|
|
#
|
|
# For syntax checking, see:
|
|
# http://tool.motoricerca.info/robots-checker.phtml
|
|
|
|
User-agent: *
|
|
Disallow: /administrator/
|
|
Disallow: /bin/
|
|
Disallow: /cache/
|
|
Disallow: /cli/
|
|
Disallow: /components/
|
|
Disallow: /includes/
|
|
Disallow: /installation/
|
|
Disallow: /language/
|
|
Disallow: /layouts/
|
|
Disallow: /libraries/
|
|
Disallow: /logs/
|
|
Disallow: /media/
|
|
Disallow: /modules/
|
|
Disallow: /plugins/
|
|
Disallow: /templates/
|
|
Disallow: /tmp/
|
|
|
|
# Filter exception to allow bots (in particular Google) to read .css and .js files for a better SEO
|
|
# see https://github.com/joomla/joomla-cms/issues/3937
|
|
|
|
Allowed: /templates/*.css$
|
|
Allowed: /templates/*.js$
|
|
Allowed: /media/*.css$
|
|
Allowed: /media/*.js$
|