problem with fetching?


Kumar Gala <galak@...>
 

I'm trying to build the MPC8135E RDB and have the following setup in conf/local.conf:

# Uncomment and set to allow bitbake to execute multiple tasks at once.
# For a quadcore, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j 4" would
# be appropriate.
BB_NUMBER_THREADS = "16"
# Also, make can be passed flags so it run parallel threads e.g.:
PARALLEL_MAKE = "-j 16"

# The machine to target
MACHINE ?= "mpc8315e-rdb"

....

$ bitbake poky-image-minimal

I see errors likes:

Waiting for 1 active tasks to finish:
1: linux-libc-headers-2.6.34-r1 do_fetch (pid 6952)
NOTE: package binutils-cross-2.20.1-r3: task do_unpack: Succeeded
NOTE: linux-libc-headers-2.6.34: http://kernel.org/pub/linux/kernel/v2.6/linux-2.6.34.tar.bz2 has no entry in conf/checksums.ini, not checking URI
NOTE: package linux-libc-headers-2.6.34-r1: task do_fetch: Succeeded
ERROR: 'virtual:native:/local/home/galak/poky-laverne-4.0/meta/recipes-devtools/gnu-config/gnu-config_20080123.bb' failed

---

if I re-run it gets further. ideas on what's going on?

- k


Tian, Kevin <kevin.tian@...>
 

From: Kumar Gala
Sent: Wednesday, November 10, 2010 2:42 PM

I'm trying to build the MPC8135E RDB and have the following setup in conf/local.conf:

# Uncomment and set to allow bitbake to execute multiple tasks at once.
# For a quadcore, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j 4" would
# be appropriate.
BB_NUMBER_THREADS = "16"
# Also, make can be passed flags so it run parallel threads e.g.:
PARALLEL_MAKE = "-j 16"

# The machine to target
MACHINE ?= "mpc8315e-rdb"

....

$ bitbake poky-image-minimal

I see errors likes:

Waiting for 1 active tasks to finish:
1: linux-libc-headers-2.6.34-r1 do_fetch (pid 6952)
NOTE: package binutils-cross-2.20.1-r3: task do_unpack: Succeeded
NOTE: linux-libc-headers-2.6.34:
http://kernel.org/pub/linux/kernel/v2.6/linux-2.6.34.tar.bz2 has no entry in
conf/checksums.ini, not checking URI
NOTE: package linux-libc-headers-2.6.34-r1: task do_fetch: Succeeded
ERROR:
'virtual:native:/local/home/galak/poky-laverne-4.0/meta/recipes-devtools/gnu-config/gn
u-config_20080123.bb' failed

---

if I re-run it gets further. ideas on what's going on?
Could you post a full log about the error? We have a plan to improve the error message
but for now it's normally messed with other build outputs in a parallel build. You can
perhaps grep those lines with "ERROR:".

Normally there're two possible reasons for that:
- poor parallel make support by the package, or
- some missing dependency problem

Above issues are usually worked around by re-run it, but it'd always good to figure out
the exact failure. :-)

Thanks
Kevin


Kumar Gala <galak@...>
 

On Nov 10, 2010, at 6:20 AM, Tian, Kevin wrote:

From: Kumar Gala
Sent: Wednesday, November 10, 2010 2:42 PM

I'm trying to build the MPC8135E RDB and have the following setup in conf/local.conf:

# Uncomment and set to allow bitbake to execute multiple tasks at once.
# For a quadcore, BB_NUMBER_THREADS = "4", PARALLEL_MAKE = "-j 4" would
# be appropriate.
BB_NUMBER_THREADS = "16"
# Also, make can be passed flags so it run parallel threads e.g.:
PARALLEL_MAKE = "-j 16"

# The machine to target
MACHINE ?= "mpc8315e-rdb"

....

$ bitbake poky-image-minimal

I see errors likes:

Waiting for 1 active tasks to finish:
1: linux-libc-headers-2.6.34-r1 do_fetch (pid 6952)
NOTE: package binutils-cross-2.20.1-r3: task do_unpack: Succeeded
NOTE: linux-libc-headers-2.6.34:
http://kernel.org/pub/linux/kernel/v2.6/linux-2.6.34.tar.bz2 has no entry in
conf/checksums.ini, not checking URI
NOTE: package linux-libc-headers-2.6.34-r1: task do_fetch: Succeeded
ERROR:
'virtual:native:/local/home/galak/poky-laverne-4.0/meta/recipes-devtools/gnu-config/gn
u-config_20080123.bb' failed

---

if I re-run it gets further. ideas on what's going on?
Could you post a full log about the error? We have a plan to improve the error message
but for now it's normally messed with other build outputs in a parallel build. You can
perhaps grep those lines with "ERROR:".

Normally there're two possible reasons for that:
- poor parallel make support by the package, or
- some missing dependency problem

Above issues are usually worked around by re-run it, but it'd always good to figure out
the exact failure. :-)

Thanks
Kevin
ERROR: Task failed: Fetch failed: Unable to fetch URL cvs://anonymous@.../cvsroot/config;module=config;method=pserver;date=20080123 from any source.
NOTE: package gnu-config-native-0.1+cvs20080123-r1: task do_fetch: Failed
ERROR: Task 211 (virtual:native:/local/home/galak/poky-laverne-4.0/meta/recipes-devtools/gnu-config/gnu-config_20080123.bb, do_fetch) failed with 1
ERROR: 'virtual:native:/local/home/galak/poky-laverne-4.0/meta/recipes-devtools/gnu-config/gnu-config_20080123.bb' failed

Attached is the full log.

- k


Richard Purdie <rpurdie@...>
 

On Wed, 2010-11-10 at 06:32 -0600, Kumar Gala wrote:
ERROR: Task failed: Fetch failed: Unable to fetch URL cvs://anonymous@.../cvsroot/config;module=config;method=pserver;date=20080123 from any source.
NOTE: package gnu-config-native-0.1+cvs20080123-r1: task do_fetch: Failed
ERROR: Task 211 (virtual:native:/local/home/galak/poky-laverne-4.0/meta/recipes-devtools/gnu-config/gnu-config_20080123.bb, do_fetch) failed with 1
ERROR: 'virtual:native:/local/home/galak/poky-laverne-4.0/meta/recipes-devtools/gnu-config/gnu-config_20080123.bb' failed

Attached is the full log.
Are you behind some kind of proxy/firewall? Its interesting its a cvs
based recipe that is failing so it could be your cvs setup.

You could try placing
http://autobuilder.pokylinux.org/sources/config_cvs.sv.gnu.org__20080123.tar.gz

into the downloads directory manually and touching the
config_cvs.sv.gnu.org__20080123.tar.gz.md5 file there to show the
fetcher the fetch is complete. If that works it would suggest the mirror
fallback code in the fetcher isn't working as intended.

Cheers,

Richard


Kumar Gala <galak@...>
 

On Nov 10, 2010, at 7:29 AM, Richard Purdie wrote:

On Wed, 2010-11-10 at 06:32 -0600, Kumar Gala wrote:
ERROR: Task failed: Fetch failed: Unable to fetch URL cvs://anonymous@.../cvsroot/config;module=config;method=pserver;date=20080123 from any source.
NOTE: package gnu-config-native-0.1+cvs20080123-r1: task do_fetch: Failed
ERROR: Task 211 (virtual:native:/local/home/galak/poky-laverne-4.0/meta/recipes-devtools/gnu-config/gnu-config_20080123.bb, do_fetch) failed with 1
ERROR: 'virtual:native:/local/home/galak/poky-laverne-4.0/meta/recipes-devtools/gnu-config/gnu-config_20080123.bb' failed

Attached is the full log.
Are you behind some kind of proxy/firewall? Its interesting its a cvs
based recipe that is failing so it could be your cvs setup.
Yes, behind a proxy/firewall. cvs is not normally allowed out.

You could try placing
http://autobuilder.pokylinux.org/sources/config_cvs.sv.gnu.org__20080123.tar.gz

into the downloads directory manually and touching the
config_cvs.sv.gnu.org__20080123.tar.gz.md5 file there to show the
fetcher the fetch is complete. If that works it would suggest the mirror
fallback code in the fetcher isn't working as intended.
I'm new to this, where would my download dir be?

- k


Richard Purdie <rpurdie@...>
 

On Wed, 2010-11-10 at 07:31 -0600, Kumar Gala wrote:
On Nov 10, 2010, at 7:29 AM, Richard Purdie wrote:

On Wed, 2010-11-10 at 06:32 -0600, Kumar Gala wrote:
ERROR: Task failed: Fetch failed: Unable to fetch URL cvs://anonymous@.../cvsroot/config;module=config;method=pserver;date=20080123 from any source.
NOTE: package gnu-config-native-0.1+cvs20080123-r1: task do_fetch: Failed
ERROR: Task 211 (virtual:native:/local/home/galak/poky-laverne-4.0/meta/recipes-devtools/gnu-config/gnu-config_20080123.bb, do_fetch) failed with 1
ERROR: 'virtual:native:/local/home/galak/poky-laverne-4.0/meta/recipes-devtools/gnu-config/gnu-config_20080123.bb' failed

Attached is the full log.
Are you behind some kind of proxy/firewall? Its interesting its a cvs
based recipe that is failing so it could be your cvs setup.
Yes, behind a proxy/firewall. cvs is not normally allowed out.

You could try placing
http://autobuilder.pokylinux.org/sources/config_cvs.sv.gnu.org__20080123.tar.gz

into the downloads directory manually and touching the
config_cvs.sv.gnu.org__20080123.tar.gz.md5 file there to show the
fetcher the fetch is complete. If that works it would suggest the mirror
fallback code in the fetcher isn't working as intended.
I'm new to this, where would my download dir be?
It defaults to "build/downloads" so in the build directory unless you
changed it in local.conf.

Cheers,

Richard


Kumar Gala <galak@...>
 

On Nov 10, 2010, at 7:50 AM, Richard Purdie wrote:

On Wed, 2010-11-10 at 07:31 -0600, Kumar Gala wrote:
On Nov 10, 2010, at 7:29 AM, Richard Purdie wrote:

On Wed, 2010-11-10 at 06:32 -0600, Kumar Gala wrote:
ERROR: Task failed: Fetch failed: Unable to fetch URL cvs://anonymous@.../cvsroot/config;module=config;method=pserver;date=20080123 from any source.
NOTE: package gnu-config-native-0.1+cvs20080123-r1: task do_fetch: Failed
ERROR: Task 211 (virtual:native:/local/home/galak/poky-laverne-4.0/meta/recipes-devtools/gnu-config/gnu-config_20080123.bb, do_fetch) failed with 1
ERROR: 'virtual:native:/local/home/galak/poky-laverne-4.0/meta/recipes-devtools/gnu-config/gnu-config_20080123.bb' failed

Attached is the full log.
Are you behind some kind of proxy/firewall? Its interesting its a cvs
based recipe that is failing so it could be your cvs setup.
Yes, behind a proxy/firewall. cvs is not normally allowed out.

You could try placing
http://autobuilder.pokylinux.org/sources/config_cvs.sv.gnu.org__20080123.tar.gz

into the downloads directory manually and touching the
config_cvs.sv.gnu.org__20080123.tar.gz.md5 file there to show the
fetcher the fetch is complete. If that works it would suggest the mirror
fallback code in the fetcher isn't working as intended.
I'm new to this, where would my download dir be?
It defaults to "build/downloads" so in the build directory unless you
changed it in local.conf.
Looks like that makes things work, so appears as if fallback code in the fetcher is having issues.

See the issue again with another pkg:

NOTE: Fetch cvs://anoncvs:anoncvs@.../cvs;module=apps/update-rc.d;tag=r0_7
ERROR: Task failed: Fetch failed: Unable to fetch URL cvs://anoncvs:anoncvs@.../cvs;module=apps/update-rc.d;tag=r0_7 from any source.
ERROR: Task 1217 (virtual:native:/local/home/galak/poky-laverne-4.0/meta/recipes-core/update-rc.d/update-rc.d_0.7.bb, do_fetch) failed with 1
ERROR: 'virtual:native:/local/home/galak/poky-laverne-4.0/meta/recipes-core/update-rc.d/update-rc.d_0.7.bb' failed

- k


Richard Purdie <rpurdie@...>
 

On Wed, 2010-11-10 at 08:22 -0600, Kumar Gala wrote:
On Nov 10, 2010, at 7:50 AM, Richard Purdie wrote:

On Wed, 2010-11-10 at 07:31 -0600, Kumar Gala wrote:
On Nov 10, 2010, at 7:29 AM, Richard Purdie wrote:

On Wed, 2010-11-10 at 06:32 -0600, Kumar Gala wrote:
ERROR: Task failed: Fetch failed: Unable to fetch URL cvs://anonymous@.../cvsroot/config;module=config;method=pserver;date=20080123 from any source.
NOTE: package gnu-config-native-0.1+cvs20080123-r1: task do_fetch: Failed
ERROR: Task 211 (virtual:native:/local/home/galak/poky-laverne-4.0/meta/recipes-devtools/gnu-config/gnu-config_20080123.bb, do_fetch) failed with 1
ERROR: 'virtual:native:/local/home/galak/poky-laverne-4.0/meta/recipes-devtools/gnu-config/gnu-config_20080123.bb' failed

Attached is the full log.
Are you behind some kind of proxy/firewall? Its interesting its a cvs
based recipe that is failing so it could be your cvs setup.
Yes, behind a proxy/firewall. cvs is not normally allowed out.

You could try placing
http://autobuilder.pokylinux.org/sources/config_cvs.sv.gnu.org__20080123.tar.gz

into the downloads directory manually and touching the
config_cvs.sv.gnu.org__20080123.tar.gz.md5 file there to show the
fetcher the fetch is complete. If that works it would suggest the mirror
fallback code in the fetcher isn't working as intended.
I'm new to this, where would my download dir be?
It defaults to "build/downloads" so in the build directory unless you
changed it in local.conf.
Looks like that makes things work, so appears as if fallback code in the fetcher is having issues.

See the issue again with another pkg:

NOTE: Fetch cvs://anoncvs:anoncvs@.../cvs;module=apps/update-rc.d;tag=r0_7
ERROR: Task failed: Fetch failed: Unable to fetch URL cvs://anoncvs:anoncvs@.../cvs;module=apps/update-rc.d;tag=r0_7 from any source.
ERROR: Task 1217 (virtual:native:/local/home/galak/poky-laverne-4.0/meta/recipes-core/update-rc.d/update-rc.d_0.7.bb, do_fetch) failed with 1
ERROR: 'virtual:native:/local/home/galak/poky-laverne-4.0/meta/recipes-core/update-rc.d/update-rc.d_0.7.bb' failed
I don't have any fix for the fetcher ready straight away but this sounds
like a testcase we can reproduce. We actually have some plans to do a
redesign of the fetcher code to address issues like this amongst other
reasons.

I did have a quick look at my downloads directory and saw these files:

apps.update-rc.d_anoncvs.handhelds.org_r0_7_.tar.gz
yaffs2_cvs.aleph1.co.uk__20071107.tar.gz
config_cvs.sv.gnu.org__20080123.tar.gz

which I think are the only cvs checkouts we use. You don't need the
yaffs2 one so if you download the other, your build should proceed.

Cheers,

Richard


Scott Garman <scott.a.garman@...>
 

On 11/10/2010 05:31 AM, Kumar Gala wrote:

On Nov 10, 2010, at 7:29 AM, Richard Purdie wrote:

On Wed, 2010-11-10 at 06:32 -0600, Kumar Gala wrote:
ERROR: Task failed: Fetch failed: Unable to fetch URL cvs://anonymous@.../cvsroot/config;module=config;method=pserver;date=20080123 from any source.
NOTE: package gnu-config-native-0.1+cvs20080123-r1: task do_fetch: Failed
ERROR: Task 211 (virtual:native:/local/home/galak/poky-laverne-4.0/meta/recipes-devtools/gnu-config/gnu-config_20080123.bb, do_fetch) failed with 1
ERROR: 'virtual:native:/local/home/galak/poky-laverne-4.0/meta/recipes-devtools/gnu-config/gnu-config_20080123.bb' failed

Attached is the full log.
Are you behind some kind of proxy/firewall? Its interesting its a cvs
based recipe that is failing so it could be your cvs setup.
Yes, behind a proxy/firewall. cvs is not normally allowed out.
If you're behind a SOCKS proxy, these instructions might be helpful to get CVS checkouts working:

https://wiki.yoctoproject.org/wiki/Working_Behind_a_Network_Proxy

Scott

--
Scott Garman
Embedded Linux Distro Engineer - Yocto Project