beagle-query and uri's with spaces

View: New views
9 Messages — Rating Filter:   Alert me  

beagle-query and uri's with spaces

by Roger Lainson :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi,

Can someone tell me how to use beagle-query with the search-term being a uri: with spaces (or other funny characters) in it? For example, beagle-query actually returns a hit like "file:///var/SDRFiles/COMMON/Suppliers/MCS/Price List.xls" - and I want pass this back again to beagle-query as a uri: query. Tried many combinations of " and \ and %20 but not getting anywhere!

(If you want to know why, it's because I'm using PHP on a web server to exec beagle-query and display simple results, and I'd like a more detailed look at the results in some cases. I get the feeling this approach is deprecated, but it's starting to work well for indexing the server. Beagle is great!)

Cheers, Roger


_______________________________________________
Dashboard-hackers mailing list
Dashboard-hackers@...
http://mail.gnome.org/mailman/listinfo/dashboard-hackers

Re: beagle-query and uri's with spaces

by D Bera :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

> Can someone tell me how to use beagle-query with the search-term being a
> uri: with spaces (or other funny characters) in it? For example,
> beagle-query actually returns a hit like
> "file:///var/SDRFiles/COMMON/Suppliers/MCS/Price List.xls" - and I want pass
> this back again to beagle-query as a uri: query. Tried many combinations of
> " and \ and %20 but not getting anywhere!
>
> (If you want to know why, it's because I'm using PHP on a web server to exec
> beagle-query and display simple results, and I'd like a more detailed look
> at the results in some cases. I get the feeling this approach is deprecated,
> but it's starting to work well for indexing the server. Beagle is great!)

Escaping as %20 (and similar hex encoding for other characters) should work.
For the web-server you can try the web-interface approach. Some people
with similar requirements found the web-interface useful.

--
-----------------------------------------------------
Debajyoti Bera @ http://dtecht.blogspot.com
beagle / KDE fan
Mandriva / Inspiron-1100 user
_______________________________________________
Dashboard-hackers mailing list
Dashboard-hackers@...
http://mail.gnome.org/mailman/listinfo/dashboard-hackers

Re: beagle-query and uri's with spaces

by Roger Lainson :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Thanks for your advice, but regrettably it just doesn't work: Total hits: 0. So is this a bug? (I haven't actually found any documentation on what should work).

Cheers, Roger


D Bera wrote:
Can someone tell me how to use beagle-query with the search-term being a
uri: with spaces (or other funny characters) in it? For example,
beagle-query actually returns a hit like
"file:///var/SDRFiles/COMMON/Suppliers/MCS/Price List.xls" - and I want pass
this back again to beagle-query as a uri: query. Tried many combinations of
" and \ and %20 but not getting anywhere!

(If you want to know why, it's because I'm using PHP on a web server to exec
beagle-query and display simple results, and I'd like a more detailed look
at the results in some cases. I get the feeling this approach is deprecated,
but it's starting to work well for indexing the server. Beagle is great!)
    

Escaping as %20 (and similar hex encoding for other characters) should work.
For the web-server you can try the web-interface approach. Some people
with similar requirements found the web-interface useful.

  

_______________________________________________
Dashboard-hackers mailing list
Dashboard-hackers@...
http://mail.gnome.org/mailman/listinfo/dashboard-hackers

Re: beagle-query and uri's with spaces

by D Bera :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

> Thanks for your advice, but regrettably it just doesn't work: Total hits: 0.
> So is this a bug? (I haven't actually found any documentation on what should
> work).
>
> Can someone tell me how to use beagle-query with the search-term being a
> uri: with spaces (or other funny characters) in it? For example,
> beagle-query actually returns a hit like
> "file:///var/SDRFiles/COMMON/Suppliers/MCS/Price List.xls" - and I want pass
> this back again to beagle-query as a uri: query. Tried many combinations of
> " and \ and %20 but not getting anywhere!
>
> (If you want to know why, it's because I'm using PHP on a web server to exec
> beagle-query and display simple results, and I'd like a more detailed look
> at the results in some cases. I get the feeling this approach is deprecated,
> but it's starting to work well for indexing the server. Beagle is great!)
>
>
> Escaping as %20 (and similar hex encoding for other characters) should work.
> For the web-server you can try the web-interface approach. Some people
> with similar requirements found the web-interface useful.

Double fault!
I was wrong about escaping and there is an extra bug.

I will try to get a patch ready in a few days.

- dBera

--
-----------------------------------------------------
Debajyoti Bera @ http://dtecht.blogspot.com
beagle / KDE fan
Mandriva / Inspiron-1100 user
_______________________________________________
Dashboard-hackers mailing list
Dashboard-hackers@...
http://mail.gnome.org/mailman/listinfo/dashboard-hackers

Null snippets

by Roger Lainson :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

Hi dBera & list,

Many thanks for your attention to my problem of uri's with spaces. On another little matter ...

I notice that the snippet feature seems a bit fragile - that is, it returns null under various circumstances, even though the content is correctly found. The circumstances include (as far as I can see) any child indexable such as a mail attachment, some mail (but not all), and also any phrase search. Snippets for mail attachments would be particularly useful! Is this a known problem?

Cheers, Roger

D Bera wrote:
Thanks for your advice, but regrettably it just doesn't work: Total hits: 0.
So is this a bug? (I haven't actually found any documentation on what should
work).

Can someone tell me how to use beagle-query with the search-term being a
uri: with spaces (or other funny characters) in it? For example,
beagle-query actually returns a hit like
"file:///var/SDRFiles/COMMON/Suppliers/MCS/Price List.xls" - and I want pass
this back again to beagle-query as a uri: query. Tried many combinations of
" and \ and %20 but not getting anywhere!

(If you want to know why, it's because I'm using PHP on a web server to exec
beagle-query and display simple results, and I'd like a more detailed look
at the results in some cases. I get the feeling this approach is deprecated,
but it's starting to work well for indexing the server. Beagle is great!)


Escaping as %20 (and similar hex encoding for other characters) should work.
For the web-server you can try the web-interface approach. Some people
with similar requirements found the web-interface useful.
    

Double fault!
I was wrong about escaping and there is an extra bug.

I will try to get a patch ready in a few days.

- dBera

  

_______________________________________________
Dashboard-hackers mailing list
Dashboard-hackers@...
http://mail.gnome.org/mailman/listinfo/dashboard-hackers

Re: Null snippets

by D Bera :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

> I notice that the snippet feature seems a bit fragile - that is, it returns
> null under various circumstances, even though the content is correctly
> found. The circumstances include (as far as I can see) any child indexable
> such as a mail attachment, some mail (but not all), and also any phrase
> search. Snippets for mail attachments would be particularly useful! Is this
> a known problem?

When you say content correctly found, I think you mean the search
returns results but snippet is empty - right ? I don't remember this
off the top of my head, but it could be that snippets for child
indexables (email attachments) are turned off.  The magic is in
FilterMail.cs - see if there is a simple Snippet=false or
CacheContent=false and set it to true if it exists. Might just work. I
can check and come back later but I have to fix the URI problem first.

- dBera

--
-----------------------------------------------------
Debajyoti Bera @ http://dtecht.blogspot.com
beagle / KDE fan
Mandriva / Inspiron-1100 user
_______________________________________________
Dashboard-hackers mailing list
Dashboard-hackers@...
http://mail.gnome.org/mailman/listinfo/dashboard-hackers

Re: Null snippets

by Roger Lainson :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

There is a SnippetMode, but alas it's already set to true. However, in FilterMail.cs I found

                            // If this is the richest part we found for multipart emails, add its content to textcache
                            if (this.depth == 1 && this.count == 0)
                                child.CacheContent = true;
                            else
                                child.CacheContent = false;

If I make
child.CacheContent unconditionally true (and then re-index of course) the results are just what I want for attachments. Snippet is still null for phrase searches but perhaps that's inevitable? I'm ok with my hacked solution, but a command-line option to turn this on would be really nice! Or does the logic need re-visiting?

Thanks for your help. Cheers, Roger

D Bera wrote:
I notice that the snippet feature seems a bit fragile - that is, it returns
null under various circumstances, even though the content is correctly
found. The circumstances include (as far as I can see) any child indexable
such as a mail attachment, some mail (but not all), and also any phrase
search. Snippets for mail attachments would be particularly useful! Is this
a known problem?
    

When you say content correctly found, I think you mean the search
returns results but snippet is empty - right ? I don't remember this
off the top of my head, but it could be that snippets for child
indexables (email attachments) are turned off.  The magic is in
FilterMail.cs - see if there is a simple Snippet=false or
CacheContent=false and set it to true if it exists. Might just work. I
can check and come back later but I have to fix the URI problem first.

- dBera

  

_______________________________________________
Dashboard-hackers mailing list
Dashboard-hackers@...
http://mail.gnome.org/mailman/listinfo/dashboard-hackers

Re: beagle-query and uri's with spaces

by D Bera :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

> > Thanks for your advice, but regrettably it just doesn't work: Total hits: 0.
> > So is this a bug? (I haven't actually found any documentation on what should
> > work).
> >
> > Can someone tell me how to use beagle-query with the search-term being a
> > uri: with spaces (or other funny characters) in it? For example,
> > beagle-query actually returns a hit like
> > "file:///var/SDRFiles/COMMON/Suppliers/MCS/Price List.xls" - and I want pass
> > this back again to beagle-query as a uri: query. Tried many combinations of
> > " and \ and %20 but not getting anywhere!
>
> Double fault!
> I was wrong about escaping and there is an extra bug.
>
> I will try to get a patch ready in a few days.

I feel like an aged person - a few days became a few weeks. :)
Nevertheless, the patch is now in git head. This problem should should
be fixed now.

- dBera

--
-----------------------------------------------------
Debajyoti Bera @ http://dtecht.blogspot.com
beagle / KDE fan
Mandriva / Inspiron-1100 user
_______________________________________________
Dashboard-hackers mailing list
Dashboard-hackers@...
http://mail.gnome.org/mailman/listinfo/dashboard-hackers

Re: Null snippets

by D Bera :: Rate this Message:

Reply to Author | View Threaded | Show Only this Message

> There is a SnippetMode, but alas it's already set to true. However, in
> FilterMail.cs I found
>
>                             // If this is the richest part we found for
> multipart emails, add its content to textcache
>                             if (this.depth == 1 && this.count == 0)
>                                 child.CacheContent = true;
>                             else
>                                 child.CacheContent = false;
>
> If I make child.CacheContent unconditionally true (and then re-index of
> course) the results are just what I want for attachments. Snippet is still
> null for phrase searches but perhaps that's inevitable? I'm ok with my
> hacked solution, but a command-line option to turn this on would be really
> nice! Or does the logic need re-visiting?

Some of the beagle hackers has HUGE volumes of emails which was the
main motivation behind disabling snippets for emails :-). Snippets
requires caching the data which basically means a lot of storage.
Later the main email body was cached but attachments were left out ...
again fearing space problem.
So setting  "child.CacheContent = true" is ok.

I propose a Config option to enable snippets for emails (and warn
about the storage in the settings GUI) and turn on/off snippets for
emails (attachment included). Hopefully not too late on this one ....
:-)

- dBera
_______________________________________________
Dashboard-hackers mailing list
Dashboard-hackers@...
http://mail.gnome.org/mailman/listinfo/dashboard-hackers