Crosstool-NG: error retrieving sstrip.c

[Michael Abbott-4]

Using crosstool-ng 1.3.2 there seems to be a bit of a snag when retrieving
sstrip.c.  The first problem is that it looks for the local copy under the
wrong name, as sstrip.c?view=co, rather than plain old sstrip.c

[EXTRA]    Retrieving 'sstrip'
[DEBUG]    Trying to retrieve an already downloaded copy of 'sstrip'
[DEBUG]    Trying '/dls_sw/prod/common/sources/sstrip.c?view=co'
[DEBUG]    Trying '/dls_sw/prod/common/sources/sstrip.tar.bz2'
[DEBUG]    Trying '/dls_sw/prod/common/sources/sstrip.tar.gz'
[DEBUG]    Trying '/dls_sw/prod/common/sources/sstrip.tgz'
[DEBUG]    Trying '/dls_sw/prod/common/sources/sstrip.tar'
[DEBUG]    Trying '/dls_sw/prod/common/sources/sstrip'
[DEBUG]    Trying 'http://sources.busybox.net/index.py/trunk/buildroot/toolchain/sstrip//sstrip.c?view=co'
[DEBUG]    ==> Executing: 'CT_DoGetFileWget http://sources.busybox.net/index.py/trunk/buildroot/toolchain/sstrip//sstrip.c?view=co'
[ALL  ]    --12:12:09--  http://sources.busybox.net/index.py/trunk/buildroot/toolchain/sstrip//sstrip.c?view=co
[ALL  ]               => `sstrip.c?view=co'
[ALL  ]    Resolving wwwcache.rl.ac.uk... 130.246.135.176, 130.246.132.26
[ALL  ]    Connecting to wwwcache.rl.ac.uk|130.246.135.176|:8080... connected.
[ALL  ]    Proxy request sent, awaiting response... 200 OK
[ALL  ]    Length: unspecified [text/x-csrc]
[ALL  ]
[ALL  ]        0K .                                                     3.75 MB/s
[ALL  ]
[ALL  ]    12:12:10 (3.75 MB/s) - `sstrip.c?view=co' saved [14020]
[ALL  ]
[DEBUG]    Got 'sstrip' from the Internet

This is definitely a change from earlier versions of crosstool-ng (not
sure when, though, I'm afraid).

Unfortunately, having retrieved it as a busybox.net checkout, it leaves
the file saved as sstrip.c?view=co ... which means that the later attempt
to build fails:

[INFO ]  Installing sstrip
[EXTRA]    Building sstrip
[DEBUG]    ==> Executing: 'i386-build_redhat-linux-gnu-gcc -Wall -o sstrip /scratch/tmp/crosstool-ng/src/sstrip/sstrip.c'
[ALL  ]    i386-redhat-linux-gcc: /scratch/tmp/crosstool-ng/src/sstrip/sstrip.c: No such file or directory
[ALL  ]    i386-redhat-linux-gcc: no input files
[ERROR]    Build failed in step 'Installing sstrip'

Indeed: when I look inside the src/sstrip directory ... the file is called
sstrip.c?view=co again.

I can see where the problem is happening: scripts/build/tools/200-sstrip.h
- but the answer isn't very clear yet.

--
For unsubscribe information see http://sourceware.org/lists.html#faq

[Michael Abbott-4]

On Mon, 2 Feb 2009, michael wrote:
> Using crosstool-ng 1.3.2 there seems to be a bit of a snag when retrieving
> sstrip.c.  The first problem is that it looks for the local copy under the
> wrong name, as sstrip.c?view=co, rather than plain old sstrip.c

Ah.  I see that the code in svn is rather different...

I'm confused, though: according to svn there was a fix committed on 11th
Jan, but 1.3.2 was released on 28th Jan.  In fact, I can't find any trace
of the ultimately offending line (in scripts/build/tools/200-sstrip.sh):

            CT_GetFile sstrip '.c?view=co'  \

in the svn history.

Looks like this was a 1.3.1 => 1.3.2 fix outside the main branch which
unfortunately is broken.  I'll revert to 1.3.1 and download manually
first.


--
For unsubscribe information see http://sourceware.org/lists.html#faq

[Yann E. MORIN]

Michael,
All,

On Monday 02 February 2009 14:27:08 michael wrote:
> Using crosstool-ng 1.3.2 there seems to be a bit of a snag when retrieving
> sstrip.c.  The first problem is that it looks for the local copy under the
> wrong name, as sstrip.c?view=co, rather than plain old sstrip.c
[--SNIP--]
> This is definitely a change from earlier versions of crosstool-ng (not
> sure when, though, I'm afraid).

We use sstrip from the buildroot tree, and the buildroot servers have
been migrated recently, so the sstrip URL has changed.

There is a complete fix in trunk, but it was not straight forward to
backport to the 1.3 series (as there have been quite some internal
changes). So I added a quick fix that should have allowed people to
quickly get running, but that was not quite enough.

> Indeed: when I look inside the src/sstrip directory ... the file is called
> sstrip.c?view=co again.
> I can see where the problem is happening: scripts/build/tools/200-sstrip.h
> - but the answer isn't very clear yet.

Change line 43 to (on a single line!), and see if it helps...
  CT_DoExecLog ALL cp -v "${CT_TARBALLS_DIR}/sstrip.c?view=co"
  "${CT_SRC_DIR}/sstrip/sstrip.c"

Regards,
Yann E. MORIN.

--
.-----------------.--------------------.------------------.--------------------.
|  Yann E. MORIN  | Real-Time Embedded | /"\ ASCII RIBBON | Erics' conspiracy: |
| +0/33 662376056 | Software  Designer | \ / CAMPAIGN     |  ___               |
| --==< ^_^ >==-- `------------.-------:  X  AGAINST      |  \e/  There is no  |
| http://ymorin.is-a-geek.org/ | _/*\_ | / \ HTML MAIL    |   v   conspiracy.  |
`------------------------------^-------^------------------^--------------------'


--
For unsubscribe information see http://sourceware.org/lists.html#faq

[Yann E. MORIN]

Michael,
All,

On Monday 02 February 2009 15:11:43 michael wrote:
> Ah.  I see that the code in svn is rather different...
> I'm confused, though: according to svn there was a fix committed on 11th
> Jan, but 1.3.2 was released on 28th Jan.  In fact, I can't find any trace
> of the ultimately offending line (in scripts/build/tools/200-sstrip.sh):

crosstool-NG 1.3.2 is not based off trunk, but off the maintenance branch,
in branches/1.3

The hot fixes in trunk get backported to the maintenance branch to roll
a bug-fix-only release from time to time. But no featrue gets added to
the maintenance branch.

> I'll revert to 1.3.1 and download manually first.

Can you firt try the fix I sent a bit earlier, please?

Regards,
Yann E. MORIN.

--
.-----------------.--------------------.------------------.--------------------.
|  Yann E. MORIN  | Real-Time Embedded | /"\ ASCII RIBBON | Erics' conspiracy: |
| +0/33 662376056 | Software  Designer | \ / CAMPAIGN     |  ___               |
| --==< ^_^ >==-- `------------.-------:  X  AGAINST      |  \e/  There is no  |
| http://ymorin.is-a-geek.org/ | _/*\_ | / \ HTML MAIL    |   v   conspiracy.  |
`------------------------------^-------^------------------^--------------------'


--
For unsubscribe information see http://sourceware.org/lists.html#faq

[Michael Abbott-4]

On Mon, 2 Feb 2009, Yann E. MORIN wrote:

> Change line 43 to (on a single line!), and see if it helps...
>   CT_DoExecLog ALL cp -v "${CT_TARBALLS_DIR}/sstrip.c?view=co"
>   "${CT_SRC_DIR}/sstrip/sstrip.c"

Yes, that looks like it will work.  Thanks.

(Should have spotted that as an easy workaround, but I got distracted by
the download shenanigans and trying to hunt down the history!)

--
For unsubscribe information see http://sourceware.org/lists.html#faq

[Michael Abbott-4]

On Mon, 2 Feb 2009, Yann E. MORIN wrote:
> Can you first try the fix I sent a bit earlier, please?

Yes, that worked just fine.  Of course, it redundantly downloads the file,
but that doesn't particularly matter.

--
For unsubscribe information see http://sourceware.org/lists.html#faq

[Yann E. MORIN]

Michael,
All,

On Monday 02 February 2009 18:25:37 michael wrote:
> Yes, that worked just fine.

OK, committed in svn, and available in the fixes directory.
Thank you for testing! :-)

> Of course, it redundantly downloads the file,
> but that doesn't particularly matter.

That's unavoidable in the 1.3 series. svn /trunk fixes that.

Regards,
Yann E. MORIN.

--
.-----------------.--------------------.------------------.--------------------.
|  Yann E. MORIN  | Real-Time Embedded | /"\ ASCII RIBBON | Erics' conspiracy: |
| +0/33 662376056 | Software  Designer | \ / CAMPAIGN     |  ___               |
| --==< ^_^ >==-- `------------.-------:  X  AGAINST      |  \e/  There is no  |
| http://ymorin.is-a-geek.org/ | _/*\_ | / \ HTML MAIL    |   v   conspiracy.  |
`------------------------------^-------^------------------^--------------------'


--
For unsubscribe information see http://sourceware.org/lists.html#faq

[Powermos]

Dear all,
I'm a new user of this great tool and also a new into the Linux world.

Actually I'm try to compile a toolchain under Ubuntu 9.04 using the crosstool-ng release 1.4.0.

I've successfully passed the first step but when I'm running the ct-ng build command I've got the error below:

Dumping internal crosstool-NG configuration
[EXTRA]    Building a toolchain for:
[EXTRA]      build  = i486-linux-gnu
[EXTRA]      host   = i486-linux-gnu
[EXTRA]      target = arm-unknown-linux-gnu
[EXTRA]  Dumping internal crosstool-NG configuration: done in 0.21s (at 00:02)
[INFO ]  =================================================================
[INFO ]  Retrieving needed toolchain components' tarballs
[EXTRA]    Retrieving 'linux-2.6.29'
[EXTRA]    Retrieving 'gmp-4.2.4'
[EXTRA]    Retrieving 'mpfr-2.4.1'
[EXTRA]    Retrieving 'binutils-2.19.1'
[EXTRA]    Retrieving 'gcc-4.3.2'
[EXTRA]    Retrieving 'glibc-2.9'
[EXTRA]    Retrieving 'glibc-ports-2.9'
[EXTRA]    Retrieving 'libelf-0.8.10'
[EXTRA]    Retrieving 'sstrip'
[ERROR]    Build failed in step 'Retrieving needed toolchain components' tarballs'
[ERROR]    Error happened in '/home/dev/Tecnico/crng/lib/ct-ng-1.4.0/scripts/functions' in function 'CT_DoExecLog' (line unknown, sorry)
[ERROR]          called from '/home/dev/Tecnico/crng/lib/ct-ng-1.4.0/scripts/functions' at line # 503 in function 'CT_GetSVN'
[ERROR]          called from '/home/dev/Tecnico/crng/lib/ct-ng-1.4.0/scripts/build/tools/200-sstrip.sh' at line # 31 in function 'do_tools_sstrip_get'
[ERROR]          called from '/home/dev/Tecnico/crng/lib/ct-ng-1.4.0/scripts/build/tools.sh' at line # 21 in function 'do_tools_get'
...

I've read from similar message that can be due to the sstrip package, I've also read the 200sstrip-sh file and I've found this row:

CT_GetSVN sstrip svn://uclibc.org/trunk/buildroot/toolchain/sstrip

may be tha path is not the right one, could you please give me some advice how to solve the trouble, please be patient I'm just starting into this new world :)

Hope someone can help me.

Regards
Pow

[Yann E. MORIN]

Hello Pow!
Helo All!

On Thursday 14 May 2009 17:11:08 Powermos wrote:
> Actually I'm try to compile a toolchain under Ubuntu 9.04 using the
> crosstool-ng release 1.4.0.
[--SNIP--]
> I've read from similar message that can be due to the sstrip package, I've
> also read the 200sstrip-sh file and I've found this row:
> CT_GetSVN sstrip svn://uclibc.org/trunk/buildroot/toolchain/sstrip
> may be tha path is not the right one,

Yes, the buildroot repository has migrated to git from svn after the 1.4.0
release was out, so 1.4.0 still uses the old URL.

Please try:
http://ymorin.is-a-geek.org/download/crosstool-ng/01-fixes/1.4.0/002-sstrip-URL.patch

And while you're at it, you should also apply both of:
http://ymorin.is-a-geek.org/download/crosstool-ng/01-fixes/1.4.0/000-glibc-2.8+_from_cvs_if_addon.patch
http://ymorin.is-a-geek.org/download/crosstool-ng/01-fixes/1.4.0/001-glibc_force_ports_ARM_MIPS.patch

Regards,
Yann E. MORIN.

--
.-----------------.--------------------.------------------.--------------------.
|  Yann E. MORIN  | Real-Time Embedded | /"\ ASCII RIBBON | Erics' conspiracy: |
| +0/33 662376056 | Software  Designer | \ / CAMPAIGN     |  ___               |
| --==< ^_^ >==-- `------------.-------:  X  AGAINST      |  \e/  There is no  |
| http://ymorin.is-a-geek.org/ | _/*\_ | / \ HTML MAIL    |   v   conspiracy.  |
`------------------------------^-------^------------------^--------------------'


--
For unsubscribe information see http://sourceware.org/lists.html#faq

[Powermos]

Dear all,
thank you for your fast reply, I've just another little question, I know that I've to apply the patches but what is the right command to use, I can simply write:

patch ORIGFILE PATCHFILE

without need to specify some options or I've to set some option?

Thanks again.

Pow

[Yann E. MORIN]

Hello!

On Friday 15 May 2009 08:45:00 Powermos wrote:
> thank you for your fast reply, I've just another little question, I know
> that I've to apply the patches but what is the right command to use,

OK, I've updated:
http://ymorin.is-a-geek.org/download/crosstool-ng/01-fixes/00-README

And there's always: man patch

Regards,
Yann E. MORIN.

--
.-----------------.--------------------.------------------.--------------------.
|  Yann E. MORIN  | Real-Time Embedded | /"\ ASCII RIBBON | Erics' conspiracy: |
| +0/33 662376056 | Software  Designer | \ / CAMPAIGN     |  ___               |
| --==< ^_^ >==-- `------------.-------:  X  AGAINST      |  \e/  There is no  |
| http://ymorin.is-a-geek.org/ | _/*\_ | / \ HTML MAIL    |   v   conspiracy.  |
`------------------------------^-------^------------------^--------------------'


--
For unsubscribe information see http://sourceware.org/lists.html#faq

[Powermos ()]

Yann E. MORIN wrote:

Hello!

On Friday 15 May 2009 08:45:00 Powermos wrote:
> thank you for your fast reply, I've just another little question, I know
> that I've to apply the patches but what is the right command to use,

OK, I've updated:
http://ymorin.is-a-geek.org/download/crosstool-ng/01-fixes/00-README

And there's always: man patch

Regards,
Yann E. MORIN.

Dear Morin,
dear All,

I've applied manually the patches, now the sstrip build work fine but I've another stop into the building process, here the point:

[EXTRA]    Patching 'duma-2_5_14'
[EXTRA]    Extracting 'gdb-6.8'
[ERROR]    Build failed in step 'Extracting and patching toolchain components'
[ERROR]    Error happened in '/home/dev/Tecnico/crng/lib/ct-ng-1.4.0/scripts/functions' in function 'CT_DoExecLog' (line unknown, sorry)
[ERROR]          called from '/home/dev/Tecnico/crng/lib/ct-ng-1.4.0/scripts/functions' at line # 535 in function 'CT_Extract'
[ERROR]          called from '/home/dev/Tecnico/crng/lib/ct-ng-1.4.0/scripts/build/debug/300-gdb.sh' at line # 60 in function 'do_debug_gdb_extract'
[ERROR]          called from '/home/dev/Tecnico/crng/lib/ct-ng-1.4.0/scripts/build/debug.sh' at line # 28 in function 'do_debug_extract'
[ERROR]          called from '/home/dev/Tecnico/crng/lib/ct-ng-1.4.0/scripts/crosstool-NG.sh' at line # 467 in function 'main'
[ERROR]    Look at '/home/dev/x-tools/arm-unknown-linux-gnu/build.log' for more info on this error.
[ERROR]  (elapsed: 6:08.10)
[06:08] / make: *** [build] Errore 2
dev@dev-laptop:~/Tecnico/crng-work$

---------------------------------

Here also some other details from the build log:

EXTRA]    Retrieving 'glibc-cvs-2.9'
[DEBUG]    Made temporary directory '/home/dev/Tecnico/crng-work/targets/arm-unknown-linux-gnu/build/tmp.VxcWoX'
[DEBUG]    ==> Executing: 'cvs -z 9 -d :pserver:[e-mail]:/cvs/glibc co -P -r glibc-2_9-branch libc'
[ALL  ]    /home/dev/Tecnico/crng/lib/ct-ng-1.4.0/scripts/functions: line 120: cvs: command not found
[ERROR]    Build failed in step 'Retrieving needed toolchain components' tarballs'
[ERROR]    Error happened in '/home/dev/Tecnico/crng/lib/ct-ng-1.4.0/scripts/functions' in function 'CT_DoExecLog' (line unknown, sorry)
[ERROR]          called from '/home/dev/Tecnico/crng/lib/ct-ng-1.4.0/scripts/functions' at line # 471 in function 'CT_GetCVS'
[ERROR]          called from '/home/dev/Tecnico/crng/lib/ct-ng-1.4.0/scripts/build/libc/glibc.sh' at line # 31 in function 'do_libc_get'
[ERROR]          called from '/home/dev/Tecnico/crng/lib/ct-ng-1.4.0/scripts/crosstool-NG.sh' at line # 449 in function 'main'
[ERROR]    Look at '/home/dev/x-tools/arm-unknown-linux-gnu/build.log' for more info on this error.
[ERROR]  (elapsed: 0:03.37)

------------------------------------

I've a new, I've downloaded the cvs package from with the UBUNTU Synaptic package installer utility, after that the building process run fine until a new stop, here the error details (from the log file) posted below:

-------------------------------------

[DEBUG]    ==> Executing: 'rm -f /home/dev/Tecnico/crng-work/targets/tarballs/showfiles.php*'
[INFO ]  Retrieving needed toolchain components' tarballs: done in 0.22s (at 00:02)
[INFO ]  =================================================================
[INFO ]  Extracting and patching toolchain components
[DEBUG]    Already extracted 'linux-2.6.29'
[DEBUG]    Already patched 'linux-2.6.29'
[DEBUG]    Already extracted 'gmp-4.2.4'
[DEBUG]    Already patched 'gmp-4.2.4'
[DEBUG]    Already extracted 'mpfr-2.4.1'
[DEBUG]    Already patched 'mpfr-2.4.1'
[DEBUG]    Already extracted 'binutils-2.19.1'
[DEBUG]    Already patched 'binutils-2.19.1'
[DEBUG]    Already extracted 'gcc-4.3.2'
[DEBUG]    Already patched 'gcc-4.3.2'
[DEBUG]    Already extracted 'glibc-cvs-2.9'
[DEBUG]    Already patched 'glibc-2.9'
[DEBUG]    Already extracted 'glibc-ports-cvs-2.9'
[DEBUG]    Already patched 'glibc-ports-2.9'
[DEBUG]    Already extracted 'libelf-0.8.10'
[DEBUG]    Already patched 'libelf-0.8.10'
[DEBUG]    ==> Executing: 'mkdir -p /home/dev/Tecnico/crng-work/targets/src/sstrip'
[DEBUG]    ==> Executing: 'cp -v /home/dev/Tecnico/crng-work/targets/tarballs/sstrip.c /home/dev/Tecnico/crng-work/targets/src/sstrip'
[DEBUG]    `/home/dev/Tecnico/crng-work/targets/tarballs/sstrip.c' -> `/home/dev/Tecnico/crng-work/targets/src/sstrip/sstrip.c'
[DEBUG]    Already extracted 'dmalloc-5.5.2'
[DEBUG]    Already patched 'dmalloc-5.5.2'
[DEBUG]    Already extracted 'duma_2_5_14'
[DEBUG]    ==> Executing: 'touch /home/dev/Tecnico/crng-work/targets/src/.duma-2_5_14.extracted'
[DEBUG]    Already patched 'duma-2_5_14'
[EXTRA]    Extracting 'gdb-6.8'
[DEBUG]    ==> Executing: 'tar xvjf /home/dev/Tecnico/crng-work/targets/tarballs/gdb-6.8.tar.bz2'
[ALL  ]    gdb-6.8/README
[ALL  ]    gdb-6.8/Makefile.in
[ALL  ]    gdb-6.8/configure
[ALL  ]    
[ALL  ]    bzip2: Compressed file ends unexpectedly;
[ALL  ]     perhaps it is corrupted?  *Possible* reason follows.
[ALL  ]    bzip2: Inappropriate ioctl for device
[ALL  ]     Input file = (stdin), output file = (stdout)
[ALL  ]    
[ALL  ]    It is possible that the compressed file(s) have become corrupted.
[ALL  ]    You can use the -tvv option to test integrity of such files.
[ALL  ]    
[ALL  ]    You can use the `bzip2recover' program to attempt to recover
[ALL  ]    data from undamaged sections of corrupted files.
[ALL  ]    
[ALL  ]    tar: Unexpected EOF in archive
[ALL  ]    tar: Unexpected EOF in archive
[ALL  ]    tar: Error is not recoverable: exiting now
[ERROR]    Build failed in step 'Extracting and patching toolchain components'
[ERROR]    Error happened in '/home/dev/Tecnico/crng/lib/ct-ng-1.4.0/scripts/functions' in function 'CT_DoExecLog' (line unknown, sorry)
[ERROR]          called from '/home/dev/Tecnico/crng/lib/ct-ng-1.4.0/scripts/functions' at line # 535 in function 'CT_Extract'
[ERROR]          called from '/home/dev/Tecnico/crng/lib/ct-ng-1.4.0/scripts/build/debug/300-gdb.sh' at line # 60 in function 'do_debug_gdb_extract'
[ERROR]          called from '/home/dev/Tecnico/crng/lib/ct-ng-1.4.0/scripts/build/debug.sh' at line # 28 in function 'do_debug_extract'
[ERROR]          called from '/home/dev/Tecnico/crng/lib/ct-ng-1.4.0/scripts/crosstool-NG.sh' at line # 467 in function 'main'
[ERROR]    Look at '/home/dev/x-tools/arm-unknown-linux-gnu/build.log' for more info on this error.
[ERROR]  (elapsed: 0:03.39)

----------------------------------------------

I've did another little step by myself:) from the log I've suspected a corrupted file then I've downloaded a new fresh copy of the gdb-6.8.tar.bz2 package from this URL http://ftp.gnu.org/gnu/gdb/     

Restarting the compilation process run fine until another stop, here the log details:

...
[INFO ]  Installing C library headers
[EXTRA]    Configuring C library
[EXTRA]    Installing C library headers
[ERROR]    make[2]: *** [/home/dev/x-tools/arm-unknown-linux-gnu/arm-unknown-linux-gnu//sys-root/usr/include/gnu/lib-names.h] Error 1
[ERROR]    make[1]: *** [install-headers] Error 2
[ERROR]    Build failed in step 'Installing C library headers'
[ERROR]    Error happened in '/home/dev/Tecnico/crng/lib/ct-ng-1.4.0/scripts/functions' in function 'CT_DoExecLog' (line unknown, sorry)
[ERROR]          called from '/home/dev/Tecnico/crng/lib/ct-ng-1.4.0/scripts/build/libc/glibc.sh' at line # 185 in function 'do_libc_headers'
[ERROR]          called from '/home/dev/Tecnico/crng/lib/ct-ng-1.4.0/scripts/crosstool-NG.sh' at line # 494 in function 'main'
[ERROR]    Look at '/home/dev/x-tools/arm-unknown-linux-gnu/build.log' for more info on this error.
[ERROR]  (elapsed: 14:04.52)
[14:05] / make: *** [build] Errore 2
dev@dev-laptop:~/Tecnico/crng-work$
...

some hints?

Thanks again for your patience.

Bye
Pow