Specific to Google and "site links", that feature is automated and beyond your direct control other than to block or unblock them. That's what overanalyzer's link was all about.
So I, like you, began to speculate exactly how one optimizes their site so Google creates those site links. As it turns out a lot of other people noticed that web page wasn't much help, so I looked around and
found this excellent site which highlights suggestions and criteria that triggers Google to create site links for your site (excerpt):
- The number of links pointing to your website’s index page, using the several main keywords of your website as anchor. For example, for my blog, the two main keywords are “Cristian Mezei”, my name, and “SeoPedia” the name of my blog. Sitelinks appear only for a few main keywords, not for every keyword your website ranks for.
- The number of searches and SERP clicks for the main keywords I described above. you have to have a certain number of clicks for that keyword, to be able to reach a minimum requirement for the appearance of Sitelinks. This makes keywords which are not searched enough, to never have Sitelinks. Although some of my coleagues have mentioned that traffic has nothing to do or has everything to do with Sitelinks, I firmly believe that traffic for a particular keyword or keyphrase is very important.
- The number of indexed pages for the keyword you are targeting is also important. Please keep in mind that I am not discussing about the number of indexed pages for your website, but for the number of results shown in Google for that particular keyword.
- The age of the website is definitely an aspect when deciding how and when Sitelinks appear. As far as my tests go, and using a naturally and organically built website (no extensive or forced SEO), you can NOT have Sitelinks if the website is younger than 18-24 months, varying from case to case.
- You have to rank #1 for that particular keyword (and the ranking has to be stable) to be able to have any Sitelinks at all. This is very important and it has been proven true in 100% of times.
More details on that page - for better or worse.
Now the advice I gave does explain methods that do pretty much the same thing in terms of the search results page and within the developers control. So if you follow the advice above and find your site still doesn't index with site links, or your site is too young or ranked low/stable, you've got an alternative approach.
For example, follow my method and create categories based on your menu navigation (hint: if you use friendly URL's, that helps alot, i.e. lots of links with yoursite.com/products which contain products, yoursite.com/iphone which contains only content about iphone, etc. and use Google custom search to add keywords such as "products" and "google" and weigh them higher. Or consider using their "Promotions" feature to customize the result page, which allows you to create a simple XML file that controls how keywords and queries are optimized to show nice little headings at the top of the result page.
Details on customizing the result page and promotions are here.
Easier than designing your own spider and indexer, which I did mention as a possibility. For that, look into
FastFind which is open source PHP/MySQL and highly customizable.
So now you've got help on Google site links, Google Custom Search (alternative approach using Google) and a third party product you can customize for your own site as you see fit.
-jim