Skip to Content.
Sympa Menu

internetworkers - [internetworkers] Intranet web spider

internetworkers AT lists.ibiblio.org

Subject: Internetworkers: http://www.ibiblio.org/internetworkers/

List archive

Chronological Thread  
  • From: "K. Jo Garner" <kelly AT metalab.unc.edu>
  • To: Internetworkers <internetworkers AT lists.ibiblio.org>
  • Subject: [internetworkers] Intranet web spider
  • Date: Wed, 29 Mar 2006 12:34:43 -0500 (EST)

It's been a long time since I have had to deal with a sprawling, mostly manually-maintained intranet. I have been tasked with indexing all the pages for their eventual inclusion in a database (not yet built). Before going off an checking everything by hand (ugh), I was hoping to find some suggestions for free- or shareware spiders. I just need to be able to install on my local machine, point to the server and let it rip.

Ideally the results would be csv or able to be imported into Excel (for now.) Even better, if it were able to work over a network with just the folder structure that'd be great too. (lots of javascript pop-up links, which I don't know if a spider would accurately follow).

And no, they're not interested now in putting anything into a CMS of any sort. *sigh*

Thanks,
Cheers
KJ

--
---
"A photograph is neither taken nor seized by force. It offers itself up.
It is
the photo that takes you. One must not take photos." Henri
Cartier-Bresson
www.hungryphotographer.org || www.ibiblio.org/kelly || kelly<*>unc.edu



  • [internetworkers] Intranet web spider, K. Jo Garner, 03/29/2006

Archive powered by MHonArc 2.6.24.

Top of Page