Home > Fluid Dynamics Search Engine > Help > 1146

Filter Rules: Bypassing all directory listings

FDSE can be made to not index directory listings themselves, while still indexing the files and folders that the listing points to. This behavior is controlled using a custom Filter Rule with the "follow,noindex" action.

Use this solution if you do not want directory listings to be indexed as documents, or if you feel your visitors will be confused by them.

Note: most installs of FDSE will already contain a disabled copy of this Filter Rule, named "Bypass directory listings". If this rule is already present, you can just check the "Enabled" property and you will be set. Otherwise, go to "Admin Page" => "Filter Rules" => "Create New Rule" and create a new rule with the following parameters:

Parameter Value
Name: "Bypass directory listings"
Enabled: [x]
Action: (*) Follow links, but do not index document
Analyze: (*) Document Text
Occurrences: 1
Logic: (*) Apply rule only if...
( ) Always apply rule, unless...
Strings: (empty)
Patterns:

After creating and/or enabling this filter rule, you will need to rebuild your search index to have the changes take effect.

The filter patterns above apply to Microsoft IIS 5.0, Apache 1.3, NCSA 2.5, and CERN 3 web servers. Different web servers, different versions, and different configuration options may prevent these patterns from matching directory listings on your system. If this happens, please cut-and-paste the HTML source code of your directory listing and send it to Fluid Dynamics. I may by able to help in devising a pattern that will recognize your listings. You may also post to the Discussion Forum on this site for assistance.

See also Filter Rules: Creating a new Filter Rule and Directory listings in the search results.


    "Filter Rules: Bypassing all directory listings"
    http://www.xav.com/scripts/search/help/1146.html