At my job we have a secure website. Every hit to the site is captured by the tracking system to the SQL Server database.
We need to create an inventory system that can look at the data and tell us about the assets on the site.
To get the appropriate data into the database, we need to use a directory crawler that can hit every asset and every item that it finds in the directory structure.
Is there such a crawler, that can appear to be a user-agent, that can crawl a secure website? Is there such a crawler in ColdFusion?
Any ideas or pointers to such a crawler would be very much appreciated.
Thanks in advance,
Jo-Anne Head
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~|
Want to reach the ColdFusion community with something they want? Let them know on the House of Fusion mailing lists
Archive:
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:324327Subscription:
http://www.houseoffusion.com/groups/cf-talk/subscribe.cfmUnsubscribe:
http://www.houseoffusion.com/cf_lists/unsubscribe.cfm?user=17837.14401.4
