Debugging not possible because board can not find docker image in registry

Hi,

we have an verdin board with imx8m-plus and docker info gives the following output (from the board):

t@verdin-imx8mp-07174496:~$ docker info
Client:
 Context:    default
 Debug Mode: false
 Plugins:
  compose: Docker Compose (Docker Inc., v2.17.2)

Server:
 Containers: 0
  Running: 0
  Paused: 0
  Stopped: 0
 Images: 1
 Server Version: 20.10.25-ce
 Storage Driver: overlay2
  Backing Filesystem: extfs
  Supports d_type: true
  Native Overlay Diff: true
  userxattr: false
 Logging Driver: json-file
 Cgroup Driver: cgroupfs
 Cgroup Version: 1
 Plugins:
  Volume: local
  Network: bridge host ipvlan macvlan null overlay
  Log: awslogs fluentd gcplogs gelf journald json-file local logentries splunk syslog
 Swarm: inactive
 Runtimes: io.containerd.runc.v2 io.containerd.runtime.v1.linux runc
 Default Runtime: runc
 Init Binary: docker-init
 containerd version: 1e1ea6e986c6c86565bc33d52e34b81b3e2bc71f.m
 runc version: v1.1.4-8-g974efd2d-dirty
 init version: b9f42a0-dirty
 Security Options:
  seccomp
   Profile: default
 Kernel Version: 5.15.129-6.4.0+git.67c3153d20ff
 Operating System: TorizonCore 6.4.0+build.5 (kirkstone)
 OSType: linux
 Architecture: aarch64
 CPUs: 4
 Total Memory: 3.83GiB
 Name: verdin-imx8mp-07174496
 ID: QTRQ:F2LM:WY3K:4RO3:KA3C:3WXU:N6ZQ:5PJU:3F54:D4K5:E5DX:GLSI
 Docker Root Dir: /var/lib/docker
 Debug Mode: false
 Registry: https://index.docker.io/v1/
 Labels:
 Experimental: false
 Insecure Registries:
  10.131.90.37:5002
  127.0.0.0/8
 Live Restore Enabled: false

10.131.90.37 is the ip of my host pc.

But if i try to debug from my host pc it always fails with:

WARNING: Some service image(s) must be built from source by running:
    docker compose build mycobot-toradex-debug
1 error occurred:
        * Error response from daemon: manifest for 10.131.90.37:5002/mycobot-toradex-debug:arm64 not found: manifest unknown: manifest unknown

If I run the failing step from the board:

torizon@verdin-imx8mp-07174496:~$ LOCAL_REGISTRY=10.131.90.37 TAG=arm64 docker-compose pull mycobot-toradex-debug
WARN[0000] The "DOCKER_LOGIN" variable is not set. Defaulting to a blank string. 
[+] Running 1/1
 ! mycobot-toradex-debug Warning                                                                                                                                                 0.1s 
WARNING: Some service image(s) must be built from source by running:
    docker compose build mycobot-toradex-debug
1 error occurred:
        * Error response from daemon: manifest for 10.131.90.37:5002/mycobot-toradex-debug:arm64 not found: manifest unknown: manifest unknown

I am using docker desktop

I think the problem is after building the container is pushed to registry “localhost” :

and during pulling it is :

And doing on the host pc
docker system prune -a
also did not help

.

Hi, I’m the Toradex AI Assistant. The Toradex Support team will follow up with you shortly!

Did you like my answer?

:+1: :-1:


The issue you’re encountering seems to be related to the mismatch between where the container image is being pushed and where it’s being pulled from. Here are a few steps to troubleshoot and potentially resolve the issue:

  1. Check Image Tagging: Ensure that the image is tagged correctly with the IP address of your host PC (10.131.90.37:5002) before pushing it to the local registry. You can do this by using the docker tag command:

    docker tag mycobot-toradex-debug:latest 10.131.90.37:5002/mycobot-toradex-debug:arm64
    
  2. Push to the Correct Registry: After tagging, push the image to the local registry:

    docker push 10.131.90.37:5002/mycobot-toradex-debug:arm64
    
  3. Verify Local Registry Configuration: Ensure that your local registry is set up correctly and is accessible from the Verdin board. You might need to configure Docker to allow communication with an insecure registry if TLS is not set up:

    • Modify the Docker daemon configuration on the Verdin board to allow the insecure registry by editing /etc/docker/daemon.json:
      {
        "insecure-registries" : ["10.131.90.37:5002"]
      }
      
    • Restart the Docker service after making changes.
  4. Check Docker Compose Configuration: Ensure that your docker-compose.yml file is correctly referencing the image with the full registry path:

    services:
      mycobot-toradex-debug:
        image: 10.131.90.37:5002/mycobot-toradex-debug:arm64
    
  5. Rebuild and Push the Image: If the image was initially built with a different tag, you might need to rebuild it with the correct tag and push it again.

By ensuring that the image is correctly tagged and pushed to the local registry, and that the Verdin board is configured to pull from this registry, you should be able to resolve the issue. If the problem persists, double-check network connectivity between the host PC and the Verdin board, and ensure there are no firewall rules blocking access.

Please, also check if these links can help you solve your problem:

Issue with TorizonCore builder.

I really do not know why but after disabling this setting in docker desktop


and enabling it again and a restart of the host pc
everything works.

I think Docker Desktop did an update

Sorry, consider this as fixed.

Interesting, glad you were able to resolve this on your end. Sometimes Docker Desktop updates can cause such strange behaviors. It’s why some prefer to just have the Docker engine installed and work with that instead of having the entire Docker Desktop stack installed.

Best Regards,
Jeremias