Problems on armv7l build host

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Problems on armv7l build host

Harald Welte
Hi all!

Since about two days I'm getting strange build failures for armv7l
packages, please see attached e-mail notifications.  It appears that at
least one build host has some kind of local problem?

We use the armv7l packages mainly to confirm that our "make check"
passes on non-x86 architectures, so this is absolutely non-critical for
the osmocom builds, so no rush from my side.

Regards,
        Harald
--
- Harald Welte <[hidden email]>           http://laforge.gnumonks.org/
============================================================================
"Privacy in residential applications is a desirable marketing option."
                                                  (ETSI EN 300 175-7 Ch. A6)

Visit https://build.opensuse.org/package/live_build_log/network:osmocom:nightly/osmo-pcap/Debian_9.0/armv7l

Package network:osmocom:nightly/osmo-pcap failed to build in Debian_9.0/armv7l

Check out the package for editing:
  osc checkout network:osmocom:nightly osmo-pcap

Last lines of build log:
[   46s] [   12.010295] [<c0063d8c>] (cpu_startup_entry) from [<40008844>] (0x40008844)
[   46s] [   12.025275] CPU3: stopping
[   46s] [   12.026380] CPU: 3 PID: 0 Comm: swapper/3 Not tainted 3.19.2-0-guest #1
[   46s] [   12.028508] Hardware name: Generic DT based system
[   46s] [   12.030217] [<c0020194>] (unwind_backtrace) from [<c001c5a0>] (show_stack+0x10/0x14)
[   46s] [   12.032811] [<c001c5a0>] (show_stack) from [<c049e5cc>] (dump_stack+0x88/0x98)
[   46s] [   12.035253] [<c049e5cc>] (dump_stack) from [<c001e134>] (handle_IPI+0x154/0x170)
[   46s] [   12.036901] [<c001e134>] (handle_IPI) from [<c0008738>] (gic_handle_irq+0x58/0x5c)
[   46s] [   12.056583] [<c0008738>] (gic_handle_irq) from [<c001d100>] (__irq_svc+0x40/0x54)
[   46s] [   12.059126] Exception stack(0xee08beb8 to 0xee08bf00)
[   46s] [   12.060861] bea0:                                                       00000000 00000003
[   46s] [   12.063564] bec0: 00000003 ee08a000 00000002 00000000 c06b8080 ee08a000 ee08bf00 ee08a000
[   46s] [   12.076246] bee0: c06b8080 00000000 c06ef580 ee08bf00 c0034d24 c0034e24 200b0113 ffffffff
[   46s] [   12.078560] [<c001d100>] (__irq_svc) from [<c0034e24>] (__do_softirq+0x118/0x250)
[   46s] [   12.087611] [<c0034e24>] (__do_softirq) from [<c00351b8>] (irq_exit+0x78/0xb0)
[   46s] [   12.090040] [<c00351b8>] (irq_exit) from [<c006e1a8>] (__handle_domain_irq+0x60/0xb0)
[   46s] [   12.096935] [<c006e1a8>] (__handle_domain_irq) from [<c0008704>] (gic_handle_irq+0x24/0x5c)
[   46s] [   12.098941] [<c0008704>] (gic_handle_irq) from [<c001d100>] (__irq_svc+0x40/0x54)
[   46s] [   12.101611] Exception stack(0xee08bf88 to 0xee08bfd0)
[   46s] [   12.115357] bf80:                   ffffffed 00000000 ffffffed c00296e0 c06be5b0 c04a6a18
[   46s] [   12.127236] bfa0: 00000000 00000000 ee08bfd8 ee08a000 c06b3d50 00000000 00000000 ee08bfd0
[   46s] [   12.129031] bfc0: c0019ed4 c0019ed8 600b0013 ffffffff
[   46s] [   12.130161] [<c001d100>] (__irq_svc) from [<c0019ed8>] (arch_cpu_idle+0x38/0x3c)
[   46s] [   12.131781] [<c0019ed8>] (arch_cpu_idle) from [<c0063d8c>] (cpu_startup_entry+0x170/0x238)
[   46s] [   12.133578] [<c0063d8c>] (cpu_startup_entry) from [<40008844>] (0x40008844)
[   48s] [   12.145288] Rebooting in 1 seconds..### VM INTERACTION END ###
[   48s] /var/run/obs/worker/1/build/build-vm: line 913: warning: command substitution: ignored null byte in input
[   48s] No buildstatus set, either the base system is broken (kernel/initrd/udev/glibc/bash/perl)
[   48s] or the build host has a kernel or hardware problem...

--
Configure notifications at https://build.opensuse.org/user/notifications
openSUSE Build Service (https://build.opensuse.org/)

Visit https://build.opensuse.org/package/live_build_log/network:osmocom:nightly/osmo-bts/Debian_9.0/armv7l

Package network:osmocom:nightly/osmo-bts failed to build in Debian_9.0/armv7l

Check out the package for editing:
  osc checkout network:osmocom:nightly osmo-bts

Last lines of build log:
[   26s] [   11.333614] [<c0063d8c>] (cpu_startup_entry) from [<40008844>] (0x40008844)
[   26s] [   11.337625] CPU1: stopping
[   26s] [   11.338325] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 3.19.2-0-guest #1
[   26s] [   11.339783] Hardware name: Generic DT based system
[   26s] [   11.340858] [<c0020194>] (unwind_backtrace) from [<c001c5a0>] (show_stack+0x10/0x14)
[   26s] [   11.342549] [<c001c5a0>] (show_stack) from [<c049e5cc>] (dump_stack+0x88/0x98)
[   26s] [   11.348450] [<c049e5cc>] (dump_stack) from [<c001e134>] (handle_IPI+0x154/0x170)
[   26s] [   11.350081] [<c001e134>] (handle_IPI) from [<c0008738>] (gic_handle_irq+0x58/0x5c)
[   26s] [   11.351728] [<c0008738>] (gic_handle_irq) from [<c001d100>] (__irq_svc+0x40/0x54)
[   26s] [   11.357720] Exception stack(0xee085eb8 to 0xee085f00)
[   26s] [   11.358884] 5ea0:                                                       00000000 00000001
[   26s] [   11.360678] 5ec0: 00000001 ee084000 00000282 00000000 c06b8080 ee084000 ee085f00 ee084000
[   26s] [   11.362449] 5ee0: c06b8080 00000000 c06ef580 ee085f00 c0034d24 c0034e24 200b0113 ffffffff
[   26s] [   11.365383] [<c001d100>] (__irq_svc) from [<c0034e24>] (__do_softirq+0x118/0x250)
[   26s] [   11.368532] [<c0034e24>] (__do_softirq) from [<c00351b8>] (irq_exit+0x78/0xb0)
[   26s] [   11.375256] [<c00351b8>] (irq_exit) from [<c006e1a8>] (__handle_domain_irq+0x60/0xb0)
[   26s] [   11.376988] [<c006e1a8>] (__handle_domain_irq) from [<c0008704>] (gic_handle_irq+0x24/0x5c)
[   26s] [   11.378892] [<c0008704>] (gic_handle_irq) from [<c001d100>] (__irq_svc+0x40/0x54)
[   26s] [   11.380581] Exception stack(0xee085f88 to 0xee085fd0)
[   26s] [   11.383045] 5f80:                   ffffffed 00000000 ffffffed c00296e0 c06be5b0 c04a6a18
[   26s] [   11.387900] 5fa0: 00000000 00000000 ee085fd8 ee084000 c06b3d50 00000000 00000000 ee085fd0
[   26s] [   11.389742] 5fc0: c0019ed4 c0019ed8 600b0013 ffffffff
[   26s] [   11.390869] [<c001d100>] (__irq_svc) from [<c0019ed8>] (arch_cpu_idle+0x38/0x3c)
[   26s] [   11.396807] [<c0019ed8>] (arch_cpu_idle) from [<c0063d8c>] (cpu_startup_entry+0x170/0x238)
[   26s] [   11.398688] [<c0063d8c>] (cpu_startup_entry) from [<40008844>] (0x40008844)
[   27s] [   11.402633] Rebooting in 1 seconds..### VM INTERACTION END ###
[   27s] /var/run/obs/worker/1/build/build-vm: line 913: warning: command substitution: ignored null byte in input
[   27s] No buildstatus set, either the base system is broken (kernel/initrd/udev/glibc/bash/perl)
[   27s] or the build host has a kernel or hardware problem...

--
Configure notifications at https://build.opensuse.org/user/notifications
openSUSE Build Service (https://build.opensuse.org/)

Visit https://build.opensuse.org/package/live_build_log/network:osmocom:latest/osmo-bsc/Debian_9.0/armv7l

Package network:osmocom:latest/osmo-bsc failed to build in Debian_9.0/armv7l

Check out the package for editing:
  osc checkout network:osmocom:latest osmo-bsc

Last lines of build log:
[   43s] [   11.893373] [<c0063d8c>] (cpu_startup_entry) from [<40008844>] (0x40008844)
[   43s] [   11.898853] CPU1: stopping
[   43s] [   11.899696] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 3.19.2-0-guest #1
[   43s] [   11.901415] Hardware name: Generic DT based system
[   43s] [   11.902669] [<c0020194>] (unwind_backtrace) from [<c001c5a0>] (show_stack+0x10/0x14)
[   43s] [   11.904634] [<c001c5a0>] (show_stack) from [<c049e5cc>] (dump_stack+0x88/0x98)
[   43s] [   11.906528] [<c049e5cc>] (dump_stack) from [<c001e134>] (handle_IPI+0x154/0x170)
[   43s] [   11.908443] [<c001e134>] (handle_IPI) from [<c0008738>] (gic_handle_irq+0x58/0x5c)
[   43s] [   11.920641] [<c0008738>] (gic_handle_irq) from [<c001d100>] (__irq_svc+0x40/0x54)
[   43s] [   11.922460] Exception stack(0xee085eb8 to 0xee085f00)
[   43s] [   11.923712] 5ea0:                                                       00000000 00000001
[   43s] [   11.925686] 5ec0: 00000001 ee084000 00000282 00000000 00000000 00000001 ee005000 ee084000
[   43s] [   11.927785] 5ee0: c06b3d50 00000000 c06ef580 ee085f00 c0034d24 c0034dc0 200b0113 ffffffff
[   43s] [   11.929787] [<c001d100>] (__irq_svc) from [<c0034dc0>] (__do_softirq+0xb4/0x250)
[   43s] [   11.931591] [<c0034dc0>] (__do_softirq) from [<c00351b8>] (irq_exit+0x78/0xb0)
[   43s] [   11.936869] [<c00351b8>] (irq_exit) from [<c006e1a8>] (__handle_domain_irq+0x60/0xb0)
[   43s] [   11.938800] [<c006e1a8>] (__handle_domain_irq) from [<c0008704>] (gic_handle_irq+0x24/0x5c)
[   43s] [   11.940812] [<c0008704>] (gic_handle_irq) from [<c001d100>] (__irq_svc+0x40/0x54)
[   43s] [   11.955308] Exception stack(0xee085f88 to 0xee085fd0)
[   43s] [   11.956602] 5f80:                   ffffffed 00000000 ffffffed c00296e0 c06be5b0 c04a6a18
[   43s] [   11.958586] 5fa0: 00000000 00000000 ee085fd8 ee084000 c06b3d50 00000000 00000000 ee085fd0
[   43s] [   11.960555] 5fc0: c0019ed4 c0019ed8 600b0013 ffffffff
[   43s] [   11.961820] [<c001d100>] (__irq_svc) from [<c0019ed8>] (arch_cpu_idle+0x38/0x3c)
[   43s] [   11.963636] [<c0019ed8>] (arch_cpu_idle) from [<c0063d8c>] (cpu_startup_entry+0x170/0x238)
[   43s] [   11.965626] [<c0063d8c>] (cpu_startup_entry) from [<40008844>] (0x40008844)
[   45s] [   11.967378] Rebooting in 1 seconds..### VM INTERACTION END ###
[   45s] /var/run/obs/worker/1/build/build-vm: line 913: warning: command substitution: ignored null byte in input
[   45s] No buildstatus set, either the base system is broken (kernel/initrd/udev/glibc/bash/perl)
[   45s] or the build host has a kernel or hardware problem...

--
Configure notifications at https://build.opensuse.org/user/notifications
openSUSE Build Service (https://build.opensuse.org/)
Reply | Threaded
Open this post in threaded view
|

Re: Problems on armv7l build host

Adrian Schröter
On Freitag, 17. November 2017, 08:28:39 CET wrote Harald Welte:
> Hi all!
>
> Since about two days I'm getting strange build failures for armv7l
> packages, please see attached e-mail notifications.  It appears that at
> least one build host has some kind of local problem?

hm, armbuild03 seems to work okay atm. The crashes are from the guest kernel.
However, our debian setup is not providing an own build kernel, so
the host kernel is taken.

You may ask the people on opensuse-arm list for feedback here. We use
the tumbleweed kernel here.

> We use the armv7l packages mainly to confirm that our "make check"
> passes on non-x86 architectures, so this is absolutely non-critical for
> the osmocom builds, so no rush from my side.
>
> Regards,
> Harald
>


--

Adrian Schroeter
email: [hidden email]

SUSE Linux GmbH, GF: Felix Imendörffer, Jane Smithard, Graham Norton, HRB 21284 (AG Nürnberg)
 
Maxfeldstraße 5                        
90409 Nürnberg
Germany


--
To unsubscribe, e-mail: [hidden email]
To contact the owner, e-mail: [hidden email]

Reply | Threaded
Open this post in threaded view
|

Re: Problems on armv7l build host

Harald Welte
Hi Adrian,

On Fri, Nov 17, 2017 at 08:49:41AM +0100, Adrian Schröter wrote:

> hm, armbuild03 seems to work okay atm. The crashes are from the guest kernel.
> However, our debian setup is not providing an own build kernel, so
> the host kernel is taken.
>
> You may ask the people on opensuse-arm list for feedback here. We use
> the tumbleweed kernel here.

I've reported it to opensuse-arm, as per your request, see:
https://lists.opensuse.org/opensuse-arm/2017-11/msg00032.html

However, I think actually it's not a kernel problem but somehow an initrd issue:

from https://build.opensuse.org/package/live_build_log/network:osmocom:latest/libsmpp34/Debian_9.0/armv7l
[   32s] FATAL: Could not load /lib/modules/3.19.2-0-guest/modules.dep: No such file or directory
[   32s] FATAL: Could not load /lib/modules/3.19.2-0-guest/modules.dep: No such file or directory
[   32s] FATAL: Could not load /lib/modules/3.19.2-0-guest/modules.dep: No such file or directory
[   32s] FATAL: Could not load /lib/modules/3.19.2-0-guest/modules.dep: No such file or directory
[   32s] FATAL: Could not load /lib/modules/3.19.2-0-guest/modules.dep: No such file or directory
[   32s] FATAL: Could not load /lib/modules/3.19.2-0-guest/modules.dep: No such file or directory
[   32s] FATAL: Could not load /lib/modules/3.19.2-0-guest/modules.dep: No such file or directory
[   32s] FATAL: Could not load /lib/modules/3.19.2-0-guest/modules.dep: No such file or directory
[   32s] Waiting for device /dev/disk/by-id/virtio-0 to appear:  ok
[   32s] fsck from util-linux 2.23.2
[   32s] [/sbin/fsck.ext4 (1) -- /] fsck.ext4 -a /dev/vdb
[   32s] /dev/vdb: clean, 7199/2097152 files, 186184/8388608 blocks
[   32s] fsck succeeded. Mounting root device read-write.
[   32s] Mounting root /dev/disk/by-id/virtio-0
[   32s] mount -o rw,noatime,noatime,nobarrier -t ext4 /dev/disk/by-id/virtio-0 /root
[   32s] replacing /etc/mtab with symlink to /proc/self/mounts
[   32s] run-init: /.build/initvm.aarch64: Exec format error

So it's unable to find kernel modules and then claims that .build/initvm.aarch64 is in the
wrong format (i.e. not armv7l).

--
- Harald Welte <[hidden email]>           http://laforge.gnumonks.org/
============================================================================
"Privacy in residential applications is a desirable marketing option."
                                                  (ETSI EN 300 175-7 Ch. A6)
--
To unsubscribe, e-mail: [hidden email]
To contact the owner, e-mail: [hidden email]