Can't search without crashing

[Steve Goldman-3]

Wow, I guess I haven't tried to search in a while... I can't search
for *anything* without it crashing hard.  Every time.  I'm on master.

Anyone??


--- RuntimeError from thread: load threads for thread-index-mode
invalid source 4
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/ferret_index.rb:260:in `build_message'
/apps/home/sgoldman/lib/ruby/1.8/monitor.rb:242:in `synchronize'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/ferret_index.rb:256:in `build_message'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/ferret_index.rb:163:in `each_id_by_date'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/thread.rb:332:in `call'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/thread.rb:332:in `load_n_threads'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/ferret_index.rb:163:in `each_id_by_date'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/ferret_index.rb:162:in `each'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/ferret_index.rb:162:in `each_id_by_date'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/thread.rb:328:in `load_n_threads'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/thread-index-mode.rb:625:in `__unprotected_load_n_threads'
(eval):12:in `load_n_threads'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/thread-index-mode.rb:609:in `load_n_threads_background'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup.rb:77:in `reporting_thread'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup.rb:75:in `initialize'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup.rb:75:in `new'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup.rb:75:in `reporting_thread'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/thread-index-mode.rb:608:in `load_n_threads_background'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/thread-index-mode.rb:679:in `__unprotected_load_threads'
(eval):12:in `load_threads'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/thread-index-mode.rb:81:in `initialize'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/line-cursor-mode.rb:22:in `call'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/line-cursor-mode.rb:22:in `initialize'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/line-cursor-mode.rb:22:in `each'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/line-cursor-mode.rb:22:in `initialize'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/line-cursor-mode.rb:19:in `new'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/line-cursor-mode.rb:19:in `initialize'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/thread-index-mode.rb:54:in `initialize'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/search-results-mode.rb:6:in `initialize'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/search-results-mode.rb:30:in `new'
/apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/search-results-mode.rb:30:in `spawn_from_query'
bin/sup:275
--

Steve Goldman
sgoldman@...

T: 212.219.6014
F: 212.219.6007

Tower Research Capital, LLC
377 Broadway, 11th Fl.
New York, NY 10013
_______________________________________________
sup-talk mailing list
sup-talk@...
http://rubyforge.org/mailman/listinfo/sup-talk

[Steve Goldman-3]

It's not every time.

Here's my theory: my mail sits on a server across a network.  When I
can access that data *quickly*, sup doesn't crash.  When the network
(or file system or whatever) takes longer, sup crashes.

Can anyone back that up?

Thanks.


Excerpts from Steve Goldman's message of Mon Oct 26 16:15:04 -0400 2009:

>
> Wow, I guess I haven't tried to search in a while... I can't search
> for *anything* without it crashing hard.  Every time.  I'm on master.
>
> Anyone??
>
>
> --- RuntimeError from thread: load threads for thread-index-mode
> invalid source 4
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/ferret_index.rb:260:in
> `build_message'
> /apps/home/sgoldman/lib/ruby/1.8/monitor.rb:242:in `synchronize'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/ferret_index.rb:256:in
> `build_message'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/ferret_index.rb:163:in
> `each_id_by_date'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/thread.rb:332:in `call'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/thread.rb:332:in
> `load_n_threads'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/ferret_index.rb:163:in
> `each_id_by_date'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/ferret_index.rb:162:in `each'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/ferret_index.rb:162:in
> `each_id_by_date'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/thread.rb:328:in
> `load_n_threads'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/thread-index-mode.rb:625:
> in `__unprotected_load_n_threads'
> (eval):12:in `load_n_threads'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/thread-index-mode.rb:609:
> in `load_n_threads_background'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup.rb:77:in `reporting_thread'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup.rb:75:in `initialize'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup.rb:75:in `new'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup.rb:75:in `reporting_thread'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/thread-index-mode.rb:608:
> in `load_n_threads_background'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/thread-index-mode.rb:679:
> in `__unprotected_load_threads'
> (eval):12:in `load_threads'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/thread-index-mode.rb:81:i
> n `initialize'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/line-cursor-mode.rb:22:in
>  `call'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/line-cursor-mode.rb:22:in
>  `initialize'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/line-cursor-mode.rb:22:in
>  `each'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/line-cursor-mode.rb:22:in
>  `initialize'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/line-cursor-mode.rb:19:in
>  `new'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/line-cursor-mode.rb:19:in
>  `initialize'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/thread-index-mode.rb:54:i
> n `initialize'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/search-results-mode.rb:6:
> in `initialize'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/search-results-mode.rb:30
> :in `new'
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/modes/search-results-mode.rb:30
> :in `spawn_from_query'
> bin/sup:275
> --
>
> Steve Goldman
> sgoldman@...
>
> T: 212.219.6014
> F: 212.219.6007
>
> Tower Research Capital, LLC
> 377 Broadway, 11th Fl.
> New York, NY 10013

--

Steve Goldman
sgoldman@...

T: 212.219.6014
F: 212.219.6007

Tower Research Capital, LLC
377 Broadway, 11th Fl.
New York, NY 10013
_______________________________________________
sup-talk mailing list
sup-talk@...
http://rubyforge.org/mailman/listinfo/sup-talk

[Tero Tilus-2]

Steve Goldman, 2009-10-26 22:15:
> Wow, I guess I haven't tried to search in a while... I can't search
> for *anything* without it crashing hard.  Every time.  I'm on master.
>
> Anyone??
>
> --- RuntimeError from thread: load threads for thread-index-mode
> invalid source 4
> /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/ferret_index.rb:260:in
> `build_message'

http://gitorious.org/sup/mainline/blobs/master/lib/sup/ferret_index.rb#line260

Looks like Sup cant find the source for a message (appearing in
results?).  Have you altered your sources lately?  Afaik you might
need to rebuild your index.

--
Tero Tilus ## 050 3635 235 ## http://tero.tilus.net/
_______________________________________________
sup-talk mailing list
sup-talk@...
http://rubyforge.org/mailman/listinfo/sup-talk

[Steve Goldman-3]

Excerpts from Tero Tilus's message of Tue Oct 27 05:58:47 -0400 2009:

> Steve Goldman, 2009-10-26 22:15:
> > Wow, I guess I haven't tried to search in a while... I can't search
> > for *anything* without it crashing hard.  Every time.  I'm on master.
> >
> > Anyone??
> >
> > --- RuntimeError from thread: load threads for thread-index-mode
> > invalid source 4
> > /apps/infrafs1/sgoldman/sup-src/mainline/lib/sup/ferret_index.rb:260:in
> > `build_message'
>
> http://gitorious.org/sup/mainline/blobs/master/lib/sup/ferret_index.rb#line260
>
> Looks like Sup cant find the source for a message (appearing in
> results?).  Have you altered your sources lately?  Afaik you might
> need to rebuild your index.
>

No, it can find it.  But sometimes it takes a long time.

Is there some sort of timeout built into the polling process that
could cause a crash?
--

Steve Goldman
sgoldman@...

T: 212.219.6014
F: 212.219.6007

Tower Research Capital, LLC
377 Broadway, 11th Fl.
New York, NY 10013
_______________________________________________
sup-talk mailing list
sup-talk@...
http://rubyforge.org/mailman/listinfo/sup-talk

[William Morgan-4]

Reformatted excerpts from Steve Goldman's message of 2009-10-26:
> Wow, I guess I haven't tried to search in a while... I can't search
> for *anything* without it crashing hard.  Every time.  I'm on master.

In ~/.sup/sources.yaml, do you have a source with "id: 4"?
--
William <wmorgan-sup@...>
_______________________________________________
sup-talk mailing list
sup-talk@...
http://rubyforge.org/mailman/listinfo/sup-talk

[Steve Goldman-3]

Excerpts from William Morgan's message of Sun Nov 01 11:32:35 -0500 2009:
> Reformatted excerpts from Steve Goldman's message of 2009-10-26:
> > Wow, I guess I haven't tried to search in a while... I can't search
> > for *anything* without it crashing hard.  Every time.  I'm on master.
>
> In ~/.sup/sources.yaml, do you have a source with "id: 4"?

No.

Although a few weeks ago I cleared out a bunch of sources that I
thought were defunct from that file.

I'm replacing those sources (at least I backed up the sources.yaml
file) and will see how that goes.

And now I'm feeling stupid...
--

Steve Goldman
sgoldman@...

T: 212.219.6014
F: 212.219.6007

Tower Research Capital, LLC
377 Broadway, 11th Fl.
New York, NY 10013
_______________________________________________
sup-talk mailing list
sup-talk@...
http://rubyforge.org/mailman/listinfo/sup-talk

[William Morgan-4]

Reformatted excerpts from Steve Goldman's message of 2009-11-01:
> I'm replacing those sources (at least I backed up the sources.yaml
> file) and will see how that goes.

If you're really done with a source, you can remove it from
sources.yaml, but you also need to remove all messages from the index.
You should be able do something like:

  $ sh devel/console.sh
  >> q = Index.parse_query "source_id:4"
  => # ...
  >> Index.each_id(q) { |id| Index.delete id }
  => nil
  >> Index.save

--
William <wmorgan-sup@...>
_______________________________________________
sup-talk mailing list
sup-talk@...
http://rubyforge.org/mailman/listinfo/sup-talk