Missing robots buitenhouden
How can I for it see to that missing machines as Google a number of parts of my site find not and reproduce” I made namely a site for my school. Thereupon the uurroosters of all classes stand and teachers. The teachers can consult via the site uurroosters with a password. Only as you the name of a colleague by Google intikt, combined with the name of the school, finds Google the uurrrooster, and must your no password inspire. That way passwordbeveiligde pages have little use. How can I it thus for see to that Google that uurroosters finds not”
Roeland Van Rooy
The missing robots way to love particular parts of your site, you must place a resistant with the name robots. txt in the rootfolder of your site (www.mijndomain.be/robots.txt thus).
What must there now precisely in that truce stand” Quite simple! You can take up two different commandos: 'User-agent' and 'disallow'. With the first you fixed which robots are shut out must.
We let us assume that your no exceptions want to make, thus set you here an asterisk (*). The disallow-command definieert which the missing robots keep off must with their fikken. That can be a truce, or a whole file. Move source each file and each truce on a separate rule in the text truce.
It becomes simpler with a simple example. Let us assume that your all robots from the file 'uurroosters' will hold, and that they also the truce 'personal. htm' do not may indices. Open KLADBLOK (START, ALL PROGRAMS, DESK-ACCESSOIRES), and tap the next rules in:
User-agent: *
Disallow: /uurroosters/
Disallow: /personal. htm
Forgets thus not that you in the case of a complete file, you the task rule also must close with a simple slash (/). Keep the resistant as robots. txt and place it as said in the rootfolder of your website.
The results will not yet at the same time noticeable be, but the next time that it a missing robot on your website a look comes take, goes he the protected files normally past.