Atom FeedsRobots.txt Howto, Tutorial And Reference
1.1 Robot.txt File
A robots.txt is the first file a crawler will grab from a site, and this file will indicate where ona site the crawler is not allowed to go.
Directories To Submit To
Directories are the backbone of the Internet; they categorise and interlink all the sites on the Internet, and are an important part of how the Search Engines index the web. It stands to reason that seeking out links from directories is a good idea.
Some good resources include:
- http://www.avivadirectory.com/strongest-directories/ - a great list of relevant international directories that is updated fairly recently.
- http://www.aussieweb.com.au/ - Aussieweb provides free listings for Aussie businesses, and is worth the punt for the price.
- http://www.HotFrog.com.au/ - Hotfrog provides free listings for Aussie businesses, and is worth the punt for the price.
- True Local - Whilst not an SEO link (it is tracked) it is still useful, as TrueLocal is a part of the News Interactive stable, and is linked in via their header on all their sites (Foxsports, news.com.au etc). Some useful TrueLocal pages include:
- Yellow Pages - Not a great SEO link, but still well worth a listing, especially as an add on to a real world, book listing. Just be sure to provide as many details as possible.