Weird process hangs on r5k-ip22

[Siggy Brentrup-4]

Hi list,

during the last days I was trying to build openssh from source on my
Indy r5k-ip22.  For my reason to rebuild see Bug#537972.  After more
than 5 attempts I'm giving up now.

There is no reproducible spot during build where processes hang, with
top I only see 2 cc1 processes competing for CPU, both use almost 50%
of CPU and collect TIME+.  Nothing more seems to happen, but the
machine is almost unusable.

The box has 64M of memory, swap space is ~200M.

I'm out of ideas how to investigate this problem further.

In case it matters:
% uname -a
Linux peachum 2.6.30-1-r4k-ip22 #1 Sun Jul 19 01:33:38 UTC 2009 mips64 GNU/Linux

Current sid except for openssh and postfix which are pinned to stable.

Ah, and apperently the same problem occurs when trying to install latex but
then obviously programs differ.

Any suggestions? Against which package should I report this as a bug?
Which further information should I provide?

Thank for responding
  Siggy
--
Please don't Cc: me when replying, I might not see either copy.
               bsb-at-psycho-dot-informationsanarchistik-dot-de
               or:                bsb-at-psycho-dot-i21k-dot-de
O< ascii ribbon campaign - stop html mail - www.asciiribbon.org

[Martin Michlmayr]

Copying Thomas Bogendoerfer.

* Siggy Brentrup <debian@...> [2009-08-03 14:10]:

> Hi list,
>
> during the last days I was trying to build openssh from source on my
> Indy r5k-ip22.  For my reason to rebuild see Bug#537972.  After more
> than 5 attempts I'm giving up now.
>
> There is no reproducible spot during build where processes hang, with
> top I only see 2 cc1 processes competing for CPU, both use almost 50%
> of CPU and collect TIME+.  Nothing more seems to happen, but the
> machine is almost unusable.
>
> The box has 64M of memory, swap space is ~200M.
>
> I'm out of ideas how to investigate this problem further.
>
> In case it matters:
> % uname -a
> Linux peachum 2.6.30-1-r4k-ip22 #1 Sun Jul 19 01:33:38 UTC 2009 mips64 GNU/Linux
>
> Current sid except for openssh and postfix which are pinned to stable.
>
> Ah, and apperently the same problem occurs when trying to install latex but
> then obviously programs differ.
>
> Any suggestions? Against which package should I report this as a bug?
> Which further information should I provide?
>
> Thank for responding
>   Siggy
> --
> Please don't Cc: me when replying, I might not see either copy.
>                bsb-at-psycho-dot-informationsanarchistik-dot-de
>                or:                bsb-at-psycho-dot-i21k-dot-de
> O< ascii ribbon campaign - stop html mail - www.asciiribbon.org

--
Martin Michlmayr
http://www.cyrius.com/


--
To UNSUBSCRIBE, email to debian-mips-REQUEST@...
with a subject of "unsubscribe". Trouble? Contact listmaster@...

[Thomas Bogendoerfer]

On Mon, Aug 03, 2009 at 07:57:15AM -0700, Martin Michlmayr wrote:
> * Siggy Brentrup <debian@...> [2009-08-03 14:10]:
> > The box has 64M of memory, swap space is ~200M.

how much swap is used during compiling ? Does adding more swap help ?

Thomas.

--
Crap can work. Given enough thrust pigs will fly, but it's not necessary a
good idea.                                                [ RFC1925, 2.3 ]


--
To UNSUBSCRIBE, email to debian-mips-REQUEST@...
with a subject of "unsubscribe". Trouble? Contact listmaster@...

[Siggy Brentrup-4]

On Mon, Aug 03, 2009 at 21:56 +0200, Thomas Bogendoerfer wrote:
> On Mon, Aug 03, 2009 at 07:57:15AM -0700, Martin Michlmayr wrote:
> > * Siggy Brentrup <debian@...> [2009-08-03 14:10]:
> > > The box has 64M of memory, swap space is ~200M.
>
> how much swap is used during compiling ? Does adding more swap help ?

I don't recall exact numbers, both cc1 used approx the same amount
of virtual memory, together <160M.  Other processes might use the
rest; didn't check :(.

Another thing I should try is telling make to run only a single
gcc at a time, make -j 1 ? I'm unsure, have to look it up.

But for now I make too many errors, need some sleep.  I'll
continue to look at it tomorrow morning.

Thanks for answering
  Siggy
--
Please don't Cc: me when replying, I might not see either copy.
               bsb-at-psycho-dot-informationsanarchistik-dot-de
               or:                bsb-at-psycho-dot-i21k-dot-de
O< ascii ribbon campaign - stop html mail - www.asciiribbon.org

[Siggy Brentrup-4]

On Mon, Aug 03, 2009 at 21:56 +0200, Thomas Bogendoerfer wrote:
> On Mon, Aug 03, 2009 at 07:57:15AM -0700, Martin Michlmayr wrote:
> > * Siggy Brentrup <debian@...> [2009-08-03 14:10]:
> > > The box has 64M of memory, swap space is ~200M.
>
> how much swap is used during compiling ? Does adding more swap help ?

Ample swap left, I overestimated numbers in my previous mail.

If you want to, you may look at

  http://winnegan.doesntexist.com/mips/

to find the build log generated by
  2>&1 sudo ./debian/rules build | tee ../build.log
as well as a screen shot showing top moments before I interrupted
the build.

@Thomas: please drop me a note to the 2nd address in my .signature
         when done with above URL, I don't want to see traffic on that
         site.

Thanks
  Siggy
--
Please don't Cc: me when replying, I might not see either copy.
               bsb-at-psycho-dot-informationsanarchistik-dot-de
               or:                bsb-at-psycho-dot-i21k-dot-de
O< ascii ribbon campaign - stop html mail - www.asciiribbon.org

[David Daney-4]

Siggy Brentrup wrote:
> On Mon, Aug 03, 2009 at 21:56 +0200, Thomas Bogendoerfer wrote:
>> On Mon, Aug 03, 2009 at 07:57:15AM -0700, Martin Michlmayr wrote:
>>> * Siggy Brentrup <debian@...> [2009-08-03 14:10]:
>>>> The box has 64M of memory, swap space is ~200M.
>> how much swap is used during compiling ? Does adding more swap help ?
>
> Ample swap left, I overestimated numbers in my previous mail.
>

The question is not if there is available swap space, it is if the build
is thrashing swap.

Does your ip22 have more than a single CPU core?  Mine doesn't.  Try
removing the '-j2' from the build in order to reduce memory pressure.

If I had only 64MB of RAM I wouldn't try to do too much at the same time.

David Daney

> If you want to, you may look at
>
>   http://winnegan.doesntexist.com/mips/
>
> to find the build log generated by
>   2>&1 sudo ./debian/rules build | tee ../build.log
> as well as a screen shot showing top moments before I interrupted
> the build.
>
> @Thomas: please drop me a note to the 2nd address in my .signature
>          when done with above URL, I don't want to see traffic on that
>          site.
>
> Thanks
>   Siggy

--
To UNSUBSCRIBE, email to debian-mips-REQUEST@...
with a subject of "unsubscribe". Trouble? Contact listmaster@...

[Siggy Brentrup-4]

On Tue, Aug 04, 2009 at 11:20 -0700, David Daney wrote:

> Siggy Brentrup wrote:
> >On Mon, Aug 03, 2009 at 21:56 +0200, Thomas Bogendoerfer wrote:
> >>On Mon, Aug 03, 2009 at 07:57:15AM -0700, Martin Michlmayr wrote:
> >>>* Siggy Brentrup <debian@...> [2009-08-03 14:10]:
> >>>>The box has 64M of memory, swap space is ~200M.
> >>how much swap is used during compiling ? Does adding more swap help ?
> >
> >Ample swap left, I overestimated numbers in my previous mail.
> >
>
> The question is not if there is available swap space, it is if the
> build is thrashing swap.
>
> Does your ip22 have more than a single CPU core?  Mine doesn't.  Try
> removing the '-j2' from the build in order to reduce memory
> pressure.

I forgot to mention, I already tried to by placing MAKE_FLAGS="-j 1"
after sudo in the command line below, but to no avail.

> If I had only 64MB of RAM I wouldn't try to do too much at the same time.

Neither do I, -j 2 was hardcoded in 2 places in debian/rules.
ATM the next build is running.  With debian/rules configure not
configuring I'm still waiting for configure to finish (as on every run :()
before I can see if removing -j 2 helps.

> >If you want to, you may look at
> >
> >  http://winnegan.doesntexist.com/mips/
> >
> >to find the build log generated by
> >  2>&1 sudo ./debian/rules build | tee ../build.log
> >as well as a screen shot showing top moments before I interrupted
> >the build.

I'm stopping boa now, no more access to that URL.

Thanks for responding
  Siggy
--
Please don't Cc: me when replying, I might not see either copy.
               bsb-at-psycho-dot-informationsanarchistik-dot-de
               or:                bsb-at-psycho-dot-i21k-dot-de
O< ascii ribbon campaign - stop html mail - www.asciiribbon.org

[Siggy Brentrup-4]

On Tue, Aug 04, 2009 at 22:25 +0200, Siggy Brentrup wrote:

> ATM the next build is running.  With debian/rules configure not
> configuring I'm still waiting for configure to finish (as on every run :()
> before I can see if removing -j 2 helps.

Current situation:
  ./debian/rules build         completes successfully
  ./debian/rules binary-arch   afterwards successfully builds .debs

  ./debian/rules binary-arch   in a fresh tree hangs, most interestingly
                               again running some cc1 going wild.

More disappointing: recompiling w/o -fPIC didn't help; ssh and friends
still segfault early w/o any useful info from gdb.

puzzled even more
  Siggy
--
Please don't Cc: me when replying, I might not see either copy.
               bsb-at-psycho-dot-informationsanarchistik-dot-de
               or:                bsb-at-psycho-dot-i21k-dot-de
O< ascii ribbon campaign - stop html mail - www.asciiribbon.org