Syrinx on SharePoint

MOSS Enterprise Search. Addition to Part 1

In the first part of the series we've looked at how to create content sources to be crawled. In addition to that, you can control the behavior of the crawler on the content sources by setting exclusion and inclusion rules on the content. Those rules apply to all and any content matched by specified URL patterns. Let's take an example: you don't want the indexer to index anything under  http://yourserver.com/sites/ with one exception: you want to index one particular subsite: http://yourserver.com/sites/yourblogs.

First, you need to set an exclusion rule:

1. Open Shared Services web site:
   • Open Sharepoint 3.0 Central Administration web site
   • Under Shared Services Administration section on the left side navigation, click on the Shared Services link to load Shared Services web site
2. In the Search section click on Search Settings link:
   
3. In Crawl Settings section click on Crawl Rules link
4. Now we will create an exclusion rule to exclude all sites and content under http://yourserver.com/sites/ from being indexed:
   1. Click the New Crawl Rule button
      
      to enter the Add crawl Rule wizard:
   2. In the Path box enter the URL filter: http://yourserver.com/sites/*, then click Ok button to save the rule.
5. Next we create an inclusion rule that will allow content of some sites excluded in the previous step to be indexed: as in the previous step, click the New Crawl Rule button, the in the Path text box enter the URL pattern to be included: http://yourserver.com/sites/yourblogs/*, and select Include all items in this path option in the Crawl Configuration section, then click Ok to apply the rule.