Crawler does not find links within client-side content (such as Javascript menus)
The FDSE web crawler only recognizes <a href=...> links in HTML pages. It also will find FRAME, IFRAME and AREA links.
Links or navigation will not be found within:
Javascript links, menus or auto-redirects
HTML forms, including drop-down select controls
Flash movies
Navigation within Java applets or Active-X controls
If your site uses these technologies, you should use one of the following work-arounds:
-
Provide alternative HTML-based navigation for your site.
Examples would be adding a "skip intro" link below a Flash presentation, or a "site map" link below a Javascript menu.
The advantages of this approach are:
visitors that disable Javascript will still be able to use your site (12% of users*)
all search crawlers, including FDSE, will be able to index your site properly
-
Or, use the FDSE file system crawler instead of the web crawler. The file system crawler walks all files and folders on your web server to find content, rather than extracting links from HTML pages.
Instructions for setting this up can be found at Administration: Creating a "file system" realm.
Note that the file system crawler cannot be used to index dynamic content, such as database-driven sites.
Advanced
Note that all text within script tags is stripped immediately by the crawler. Therefore, normal <A HREF=...> links within Javascript will not be seen:
<script type="text/javascript">
<!--
document.write( '<a href="foo.html">bar</a>' );
//-->
</script>To allow FDSE to see these links, use the noscript tag.
* According to statistics maintained by thecounter.com/stats, approximately 12% of users have Javascript disabled. Among experienced web users, the ratio is probably higher.
"Crawler does not find links within client-side content (such as Javascript menus)"
http://www.xav.com/scripts/search/help/1149.html