Weighting different html text nodes - h1,h2 etc..

View: New views
2 Messages — Rating Filter:   Alert me  

Weighting different html text nodes - h1,h2 etc..

by Joel Halbert-2 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi, Would I be correct in thinking that Nutch, when indexing an html
document, does not weight the different text nodes (h1, h2, anchor etc)
differently - instead it just lumps together all text as one? (this is
the impression I get from looking at
org.apache.nutch.parse.html.HtmlParser)

Rgs,
Joel



Re: Weighting different html text nodes - h1,h2 etc..

by Ken Krugler :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

>Hi, Would I be correct in thinking that Nutch, when indexing an html
>document, does not weight the different text nodes (h1, h2, anchor etc)
>differently - instead it just lumps together all text as one? (this is
>the impression I get from looking at
>org.apache.nutch.parse.html.HtmlParser)

Yes, AFAIK there's no special weighting given to text pulled from the
body of the HTML.

I believe Nutch does give higher weight to the anchor text found for
links that point to the page, which is a key factor in generating
better search results.

-- Ken
--
Ken Krugler
+1 530-210-6378