domainyourlinkingto.com/dir/web-design.html"
Then you would want to be sure that in the robots.txt file you should NOT see :
Disallow: /dir
Disallow: /dir/web-design.html
This is telling the search engine robot not to index or follow the links in the link directory called dir and to ignore the links page
web-design.html.
And you should not see :
User-agent: =
Disallow: /
If you see :
User-agent: =
Disallow:
Then that's OK.
All sounds a bi.complicated I know, but there is no easier way to explain this sort of thing. Some reciprocal link manager checking software will also detect the incorrect use of the meta robots tag and also check the robots text file.
However some link manager software I have experienced, incorrectly reported a link page as blocked by the robots text file because it read "Disallow:" as prohibiting the search engine when in fact it means allow (see above). It is
"Disallow: /" that would tell the search engine not to index the site.
7. Once you'v.completed your link exchange and done the checks to ensure you're not being cheated you must then check your links at regular intervals. Once you have more than about 50 links you will soon find link checking becomes a time consuming process. It's far better to build your link directory using some form of link manager software that will automatically check your links at intervals you specify.
Of course not all link theft is intentional, sometimes it's just the webmaster not knowing that the way he has set up his link directory will not provide search engine link benefit to anyone that links to them.
However some link theft is intentional, the webmaster knows exactly what they are doing and by following this advice you can avoid being their next victim.
About The Author: Tony Simpson, has been into Website Design, Promotion & Optimization for 5 years. He provides advice, product reviews & products at
webpageaddons.com/ to Make Automation of Your Web Site Work for You.A related article is "10 Mistakes to Avoid When Setting Up a Link Directory" at
webpageaddons.com/link-manager-mistakes.htmThis article is free for republishing
Tony Simpson, has 5 years in the trench experience of Website Design, Promotion and Optimization. He provides advice & product reviews at
webpageaddons.com Web Page Add Ons to Make Automation of Your Website Work for You.
Contact him at
webpageaddons.com"
