Re: NO INTERNET ENVIRONMENT - USING PREMIRROR fails -> gstreamer1.0_1.12.2.bb:do_unpack failed due to a fetch issue


Martin Jansa
 

Add "common" git repo to SRC_URI and set SRCREV + SRCREV_FORMAT for it, instead of using git submodules to fetch it.


On Thu, Jul 23, 2020 at 2:40 PM <baranarman@...> wrote:
Hi,

I have a problem. I am trying to set up development environment that runs offline. For this purpose i set up a repository folder by the following local.conf file:

"
MACHINE ??= 'imx6dlsabresd'
DISTRO ?= 'fsl-imx-fb'
PACKAGE_CLASSES ?= "package_rpm"
EXTRA_IMAGE_FEATURES ?= "debug-tweaks dbg-pkgs dev-pkgs package-management ssh-server-dropbear ssh-server-openssh staticdev-pkgs "
USER_CLASSES ?= "buildstats image-mklibs image-prelink"
PATCHRESOLVE = "noop"
BB_DISKMON_DIRS ??= "\
    STOPTASKS,${TMPDIR},1G,100K \
    STOPTASKS,${DL_DIR},1G,100K \
    STOPTASKS,${SSTATE_DIR},1G,100K \
    STOPTASKS,/tmp,100M,100K \
    ABORT,${TMPDIR},100M,1K \
    ABORT,${DL_DIR},100M,1K \
    ABORT,${SSTATE_DIR},100M,1K \
    ABORT,/tmp,10M,1K"
PACKAGECONFIG_append_pn-qemu-native = " sdl"
PACKAGECONFIG_append_pn-nativesdk-qemu = " sdl"
CONF_VERSION = "1"

IMAGE_INSTALL_append = " gstreamer imx-test"

DL_DIR ?= "${BSPDIR}/downloads/"
SSTATE_DIR ?= "${BSPDIR}/sstate-cache/"
ACCEPT_FSL_EULA = "1"


# ADDED
BB_NO_NETWORK = "1"

INHERIT += "own-mirrors"
BB_GENERATE_MIRROR_TARBALLS = "1"

SOURCE_MIRROR_URL = "file://${BSPDIR}/repository"

PREMIRRORS_prepend = "\
git://.*/.* file://${BSPDIR}/repository/ \n \
svn://.*/.* file://${BSPDIR}/repository/ \n \
cvs://.*/.* file://${BSPDIR}/repository/ \n \
ftp://.*/.* file://${BSPDIR}/repository/ \n \
http://.*/.* file://${BSPDIR}/repository/ \n \
https://.*/.* file://${BSPDIR}/repository/ \n "
"

initially i run the conf above with "BB_NO_NETWORK = "0" to generate the tarballs in downloads dir. 
Run the command: bitbake fsl-image-multimedia-full

After initial run I copied the content of the downloads folder into repository folder. removed build/tmp folder, downloads folder and sstate-cache folder to be on the clear page.
Then I set [BB_NO_NETWORK = "1" ] and execute "tar -czvf ... " to compress all the imx-yocto-bsp folder.

Then I port the imx-tar.gz file to a crops environment on Windows.

The set environment is crops/poky and no internet [unplugged ethernet].

then I run the command bitbake fsl-image-multimedia-full again.
I expect that the build will be successful as the repository shall be enough.
But I get the following error:

"
ERROR: gstreamer1.0-1.12.2-r0 do_unpack: Fetcher failure: Fetch command export DBUS_SESSION_BUS_ADDRESS="unix:path=/run/user/1000/bus"; export SSH_AGENT_PID="2184"; export SSH_AUTH_SOCK="/run/user/1000/keyring/ssh"; export all_proxy="http://ikitis:Oe6aoaeaf@....1.51:8080"; export ALL_PROXY="http://ikitis:Oe6aoaeaf@....1.51:8080"; export ftp_proxy="http://ikitis:Oe6aoaeaf@....1.51:8080"; export FTP_PROXY="http://10.1.1.51:8080/"; export https_proxy="http://ikitis:Oe6aoaeaf@....1.51:8080"; export HTTPS_PROXY="http://10.1.1.51:8080/"; export http_proxy="http://ikitis:Oe6aoaeaf@....1.51:8080"; export HTTP_PROXY="http://10.1.1.51:8080/"; export PATH="/home/aselsan/imx-yocto-bsp/build-image-minimal/tmp/work/cortexa9hf-neon-poky-linux-gnueabi/gstreamer1.0/1.12.2-r0/recipe-sysroot-native/usr/bin/python3-native:/home/aselsan/imx-yocto-bsp/sources/poky/scripts:/home/aselsan/imx-yocto-bsp/build-image-minimal/tmp/work/cortexa9hf-neon-poky-linux-gnueabi/gstreamer1.0/1.12.2-r0/recipe-sysroot-native/usr/bin/arm-poky-linux-gnueabi:/home/aselsan/imx-yocto-bsp/build-image-minimal/tmp/work/cortexa9hf-neon-poky-linux-gnueabi/gstreamer1.0/1.12.2-r0/recipe-sysroot/usr/bin/crossscripts:/home/aselsan/imx-yocto-bsp/build-image-minimal/tmp/work/cortexa9hf-neon-poky-linux-gnueabi/gstreamer1.0/1.12.2-r0/recipe-sysroot-native/usr/sbin:/home/aselsan/imx-yocto-bsp/build-image-minimal/tmp/work/cortexa9hf-neon-poky-linux-gnueabi/gstreamer1.0/1.12.2-r0/recipe-sysroot-native/usr/bin:/home/aselsan/imx-yocto-bsp/build-image-minimal/tmp/work/cortexa9hf-neon-poky-linux-gnueabi/gstreamer1.0/1.12.2-r0/recipe-sysroot-native/sbin:/home/aselsan/imx-yocto-bsp/build-image-minimal/tmp/work/cortexa9hf-neon-poky-linux-gnueabi/gstreamer1.0/1.12.2-r0/recipe-sysroot-native/bin:/home/aselsan/imx-yocto-bsp/sources/poky/bitbake/bin:/home/aselsan/imx-yocto-bsp/build-image-minimal/tmp/hosttools"; export HOME="/home/aselsan"; git -c core.fsyncobjectfiles=0 submodule update --init --recursive failed with exit code 1, output:
Submodule 'common' (https://anongit.freedesktop.org/git/gstreamer/common.git) registered for path 'common'
Cloning into '/home/aselsan/imx-yocto-bsp/build-image-minimal/tmp/work/cortexa9hf-neon-poky-linux-gnueabi/gstreamer1.0/1.12.2-r0/git/common'...
fatal: unable to access 'https://anongit.freedesktop.org/git/gstreamer/common.git/': Received HTTP code 407 from proxy after CONNECT
fatal: clone of 'https://anongit.freedesktop.org/git/gstreamer/common.git' into submodule path '/home/aselsan/imx-yocto-bsp/build-image-minimal/tmp/work/cortexa9hf-neon-poky-linux-gnueabi/gstreamer1.0/1.12.2-r0/git/common' failed
Failed to clone 'common'. Retry scheduled
Cloning into '/home/aselsan/imx-yocto-bsp/build-image-minimal/tmp/work/cortexa9hf-neon-poky-linux-gnueabi/gstreamer1.0/1.12.2-r0/git/common'...
fatal: unable to access 'https://anongit.freedesktop.org/git/gstreamer/common.git/': Received HTTP code 407 from proxy after CONNECT
fatal: clone of 'https://anongit.freedesktop.org/git/gstreamer/common.git' into submodule path '/home/aselsan/imx-yocto-bsp/build-image-minimal/tmp/work/cortexa9hf-neon-poky-linux-gnueabi/gstreamer1.0/1.12.2-r0/git/common' failed
Failed to clone 'common' a second time, aborting

ERROR: gstreamer1.0-1.12.2-r0 do_unpack: Function failed: base_do_unpack
ERROR: Logfile of failure stored in: /home/aselsan/imx-yocto-bsp/build-image-minimal/tmp/work/cortexa9hf-neon-poky-linux-gnueabi/gstreamer1.0/1.12.2-r0/temp/log.do_unpack.54012
ERROR: Task (/home/aselsan/imx-yocto-bsp/sources/poky/meta/recipes-multimedia/gstreamer/gstreamer1.0_1.12.2.bb:do_unpack) failed with exit code '1'
"

I checked out but could not find a reason

I would highly appreciate if you be kind enough to give support on the issue.


Best Regards
B. A.

Join yocto@lists.yoctoproject.org to automatically receive all group messages.