Re: Directory Crawler that looks like a user-agent

And you have to take into account travel via javascript, where links
could be inside included .js files. An intelligent cfhttp based bot
can do it all but you need to code it.
There is probably anon CF based software solution already out there to
do just this.

On Tue, Jul 7, 2009 at 7:04 PM, Dave Watts<dwatts@...> wrote:
> Of course, crawlers typically only follow plain ol' HTML links, so if
> you have forms-driven navigation or JavaScript-driven navigation
> you'll have to figure out how to get to everything.

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~|
Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists
Archive: http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:324334
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=17837.14401.4