Firefox indexer not working: files in ToIndex never removed

View: New views
5 Messages — Rating Filter:   Alert me  

Firefox indexer not working: files in ToIndex never removed

by Frederik Himpe :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi, I'm using Mandriva 2009.1 with Beagle 0.3.9 running on mono 2.2. I
have enabled the Beagle Indexer 1.1 add-on in Firefox 3.0.8, but it does
not seem to be working: I had a huge amount of unindexed web pages which
were never removed from ~/.beagle/ToIndex.

The only error I could find in the logs is this backtrace:

20090420 22:18:48.7264 12883 Beagle ERROR EX: Caught exception while instantiating IndexingService backend
20090420 22:18:48.7264 12883 Beagle ERROR EX: System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.UnauthorizedAccessException: Access to the path "/home/frederik/.beagle/Indexes/IndexingServiceIndex/Locks/lucene-87e2d2d7eab46d37e08cb23db1c76b0c-write.lock" is denied.
20090420 22:18:48.7264 12883 Beagle ERROR EX:   at System.IO.File.Delete (System.String path) [0x00000]
20090420 22:18:48.7264 12883 Beagle ERROR EX:   at System.IO.Directory.RecursiveDelete (System.String path) [0x00000]
20090420 22:18:48.7264 12883 Beagle ERROR EX:   at System.IO.Directory.RecursiveDelete (System.String path) [0x00000]
20090420 22:18:48.7264 12883 Beagle ERROR EX:   at System.IO.Directory.Delete (System.String path, Boolean recursive) [0x00000]
20090420 22:18:48.7264 12883 Beagle ERROR EX:   at Beagle.Daemon.LuceneCommon.Create () [0x00000]
20090420 22:18:48.7264 12883 Beagle ERROR EX:   at Beagle.Daemon.LuceneQueryingDriver..ctor (System.String index_name, Int32 minor_version, Boolean read_only) [0x00000]
20090420 22:18:48.7264 12883 Beagle ERROR EX:   at Beagle.Daemon.LuceneQueryable.BuildLuceneQueryingDriver (System.String index_name, Int32 minor_version, Boolean read_only_mode) [0x00000]
20090420 22:18:48.7264 12883 Beagle ERROR EX:   at Beagle.Daemon.LuceneQueryable..ctor (System.String index_name, Int32 minor_version, Boolean read_only_mode) [0x00000]
20090420 22:18:48.7264 12883 Beagle ERROR EX:   at Beagle.Daemon.LuceneQueryable..ctor (System.String index_name) [0x00000]
20090420 22:18:48.7264 12883 Beagle ERROR EX:   at Beagle.Daemon.IndexingServiceQueryable.IndexingServiceQueryable..ctor () [0x00000]
20090420 22:18:48.7264 12883 Beagle ERROR EX:   at (wrapper managed-to-native) System.Reflection.MonoCMethod:InternalInvoke (object,object[],System.Exception&)
20090420 22:18:48.7264 12883 Beagle ERROR EX:   at System.Reflection.MonoCMethod.Invoke (System.Object obj, BindingFlags invokeAttr, System.Reflection.Binder binder, System.Object[] parameters, System.Globalization.CultureInfo culture) [0x00000]
20090420 22:18:48.7264 12883 Beagle ERROR EX:   --- End of inner exception stack trace ---
20090420 22:18:48.7264 12883 Beagle ERROR EX:   at System.Reflection.MonoCMethod.Invoke (System.Object obj, BindingFlags invokeAttr, System.Reflection.Binder binder, System.Object[] parameters, System.Globalization.CultureInfo culture) [0x00000]
20090420 22:18:48.7264 12883 Beagle ERROR EX:   at System.Reflection.MonoCMethod.Invoke (BindingFlags invokeAttr, System.Reflection.Binder binder, System.Object[] parameters, System.Globalization.CultureInfo culture) [0x00000]
20090420 22:18:48.7264 12883 Beagle ERROR EX:   at System.Reflection.ConstructorInfo.Invoke (System.Object[] parameters) [0x00000]
20090420 22:18:48.7264 12883 Beagle ERROR EX:   at System.Activator.CreateInstance (System.Type type, Boolean nonPublic) [0x00000]
20090420 22:18:48.7264 12883 Beagle ERROR EX:   at System.Activator.CreateInstance (System.Type type) [0x00000]
20090420 22:18:48.7264 12883 Beagle ERROR EX:   at Beagle.Daemon.QueryDriver.ScanAssemblyForQueryables (System.Reflection.Assembly assembly) [0x00000]

Does anybody have an idea about why the Firefox indexer does not work?

--
Frederik Himpe

_______________________________________________
Dashboard-hackers mailing list
Dashboard-hackers@...
http://mail.gnome.org/mailman/listinfo/dashboard-hackers

Re: Firefox indexer not working: files in ToIndex never removed

by Joe Shaw-4 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi,

On Tue, Apr 21, 2009 at 3:24 AM, Frederik Himpe <fhimpe@...> wrote:
> Hi, I'm using Mandriva 2009.1 with Beagle 0.3.9 running on mono 2.2. I
> have enabled the Beagle Indexer 1.1 add-on in Firefox 3.0.8, but it does
> not seem to be working: I had a huge amount of unindexed web pages which
> were never removed from ~/.beagle/ToIndex.
>
> The only error I could find in the logs is this backtrace:
>
> 20090420 22:18:48.7264 12883 Beagle ERROR EX: Caught exception while instantiating IndexingService backend
> 20090420 22:18:48.7264 12883 Beagle ERROR EX: System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.UnauthorizedAccessException: Access to the path "/home/frederik/.beagle/Indexes/IndexingServiceIndex/Locks/lucene-87e2d2d7eab46d37e08cb23db1c76b0c-write.lock" is denied.

This definitely looks like the problem.  Can you take a look at those
files and directories and see if there are any ownership or modal
problems that could prevent your user from being able to write or
delete files from there?  Something owned as root, perhaps?

Worst case, you could delete the
~/.beagle/Indexes/IndexingServiceIndex directory entirely.  That would
fix the permissions problem, but you would lose any previously-indexed
web pages.  (And unlike other backends which could just recrawl the
data, these will be permanently lost unless you navigate back to that
web page.)

Thanks,
Joe
_______________________________________________
Dashboard-hackers mailing list
Dashboard-hackers@...
http://mail.gnome.org/mailman/listinfo/dashboard-hackers

Re: Firefox indexer not working: files in ToIndex never removed

by Frederik Himpe :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

On Tue, 21 Apr 2009 10:22:31 -0400, Joe Shaw wrote:

>> The only error I could find in the logs is this backtrace:
>>
>> 20090420 22:18:48.7264 12883 Beagle ERROR EX: Caught exception while
>> instantiating IndexingService backend 20090420 22:18:48.7264 12883
>> Beagle ERROR EX: System.Reflection.TargetInvocationException: Exception
>> has been thrown by the target of an invocation. --->
>> System.UnauthorizedAccessException: Access to the path
>> "/home/frederik/.beagle/Indexes/IndexingServiceIndex/Locks/lucene-87e2d2d7eab46d37e08cb23db1c76b0c-write.lock"
>> is denied.
>
> This definitely looks like the problem.  Can you take a look at those
> files and directories and see if there are any ownership or modal
> problems that could prevent your user from being able to write or delete
> files from there?  Something owned as root, perhaps?

Ouch, I should have thought of this myself.

-r-------- 1 frederik frederik 6 2009-01-11 17:23 /home/frederik/.beagle/Indexes/IndexingServiceIndex/Locks/lucene-87e2d2d7eab46d37e08cb23db1c76b0c-write.lock

Making the file writeable again, fixed the problem. I have no idea
how these permissions got screwed up.

Thanks for your help!
--
Frederik Himpe

_______________________________________________
Dashboard-hackers mailing list
Dashboard-hackers@...
http://mail.gnome.org/mailman/listinfo/dashboard-hackers

Re: Firefox indexer not working: files in ToIndex never removed

by Arun Raghavan-2 :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

2009/4/22 Frederik Himpe <fhimpe@...>:
[...]
> -r-------- 1 frederik frederik 6 2009-01-11 17:23 /home/frederik/.beagle/Indexes/IndexingServiceIndex/Locks/lucene-87e2d2d7eab46d37e08cb23db1c76b0c-write.lock
>
> Making the file writeable again, fixed the problem. I have no idea
> how these permissions got screwed up.

Was looking and my logs last night and this had happened on my setup
too. Not sure why.
--
Arun Raghavan
(http://nemesis.accosted.net)
v2sw5Chw4+5ln4pr6$OFck2ma4+9u8w3+1!m?l7+9GSCKi056
e6+9i4b8/9HTAen4+5g4/8APa2Xs8r1/2p5-8 hackerkey.com
_______________________________________________
Dashboard-hackers mailing list
Dashboard-hackers@...
http://mail.gnome.org/mailman/listinfo/dashboard-hackers

Re: Firefox indexer not working: files in ToIndex never removed

by D Bera :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

>> -r-------- 1 frederik frederik 6 2009-01-11 17:23 /home/frederik/.beagle/Indexes/IndexingServiceIndex/Locks/lucene-87e2d2d7eab46d37e08cb23db1c76b0c-write.lock
>>
>> Making the file writeable again, fixed the problem. I have no idea
>> how these permissions got screwed up.
>
> Was looking and my logs last night and this had happened on my setup
> too. Not sure why.

Probably related to this:
http://svn.gnome.org/viewvc/beagle?view=revision&revision=4897

"File.Delete requires write permission on the file! This is different
than the POSIX behaviour and this bug was fixed in mono recently. As a
result, with mono-2, beagle tmpfiles could not be deleted.
Workaround this problem by using the Mono.Unix Unlink syscall."

Lockfiles are created readonly (not sure what goes wrong if we create
them read-write). r4897 fixed the most common branch when a lockfile
could be deleted but we missed the directory delete possibility:
  System.IO.File.Delete
  System.IO.Directory.RecursiveDelete
  System.IO.Directory.Delete
  Beagle.Daemon.LuceneCommon.Create

I will try to look into this when I get some time.

- dBera

--
-----------------------------------------------------
Debajyoti Bera @ http://dtecht.blogspot.com
beagle / KDE fan
Mandriva / Inspiron-1100 user
_______________________________________________
Dashboard-hackers mailing list
Dashboard-hackers@...
http://mail.gnome.org/mailman/listinfo/dashboard-hackers