A robot is a program that searches the web for information to categorize. It is also called a "spider".
Search engines will look in your root domain for a special file named "robots.txt" (see http://jerseywebhosting.com/robots.txt ). The file tells the robot (spider) which files it may spider (download).
- 0 Users Found This Useful
Related Articles
Word Processing.
Instead of paying high licensing fees for word processing programs. Go to download and use...
Bandwidth
The word bandwidth is used to mean the amount of data that can be transferred through a digital...
What are META tags?
This information comes from many online resources. Quote:...
How long until my website is visible?
It will take between 24-48 hours for DNS propagation. DNS Propagation is the process by which...
Email help
In your Cpanel you have the option to create as many email addresses @ yourdomain.com as you...
Powered by WHMCompleteSolution
