新增 runtime/ 板端运行时镜像线 (全内置)
- TROS/ROS/hobot 栈走与宿主机相同的 apt 源 (d-robotics + tuna ros2), build.sh 默认锁宿主机版本 (源内已下架时 --no-pin 装源内最新) - /app 全量案例与 hbm_runtime/Hobot.GPIO 从目标板拷贝, 附 sha256 清单回验 - 运行时仅 --device 透传 (复用 common 单元设备集), 零 bind-mount - 适配 hobot-dnn postinst: 预置宿主机版本构建工具链 (新版 scikit-build-core 无 clean 子命令会令 postinst 失败) + python-is-python3 + libcjson1 补未声明依赖 - nashem(S100P)/nashp(S600) 双线板上构建并 verify.sh 11/11 全绿
This commit is contained in:
parent
6faa932dce
commit
b4835a096d
3
.gitignore
vendored
3
.gitignore
vendored
@ -16,3 +16,6 @@ examples/bpu_model_perf/*/hrt_model_exec
|
||||
|
||||
# coremark-pro 第三方源码 (65MB, build.sh 首次构建时自动从镜像克隆, 不入库)
|
||||
examples/coremark/any/coremark-pro/
|
||||
|
||||
# runtime 镜像验证日志 (verify.sh 生成, 不入库)
|
||||
examples/runtime/output/
|
||||
|
||||
33
README.md
33
README.md
@ -22,6 +22,9 @@
|
||||
- [目录结构](#目录结构-1)
|
||||
- [使用方法](#使用方法)
|
||||
- [输出结果说明](#输出结果说明-1)
|
||||
- [板端运行时镜像(runtime,全内置)](#板端运行时镜像runtime全内置)
|
||||
- [runtime 工具说明](#runtime-工具说明)
|
||||
- [runtime 使用方法](#runtime-使用方法)
|
||||
|
||||
|
||||
---
|
||||
@ -634,3 +637,33 @@ bash bench.sh all # 或指定单元: bpu gpu vpu vdsp hbmem
|
||||
```
|
||||
|
||||
对 `/app` 下的代表性案例(BPU 推理、OpenCL、VPU 编码、VDSP、共享内存),在宿主机与容器内分别编译运行并对比。容器侧日志由容器经挂载直接写入 examples 目录(穿透),与宿主侧日志并列保存。测试结论见 `examples/app_base/any/output/<板型>/report.md`。
|
||||
|
||||
---
|
||||
|
||||
## 板端运行时镜像(runtime,全内置)
|
||||
|
||||
### runtime 工具说明
|
||||
|
||||
`examples/runtime/` 制作**全内置**的板端运行时镜像 `rdk_runtime_<family>`,与
|
||||
app_base 的"通用镜像 + 运行时挂载宿主目录"路线相反:TROS/ROS/hobot 栈通过与宿主机
|
||||
相同的 apt 源(d-robotics 专属源 + tuna ros2 源)安装进镜像,`/app` 全量案例与
|
||||
hbm_runtime/Hobot.GPIO 硬件 python 包从目标板拷贝(附 sha256 清单可回验一致性),
|
||||
运行时**仅透传设备节点,不 bind-mount 任何宿主目录**。
|
||||
|
||||
| family | 板卡 | BASE | d-robotics suite | ROS |
|
||||
|---|---|---|---|---|
|
||||
| nashem | S100 / S100P | ubuntu:22.04 | ubuntu-rdk-s100-beta (jammy) | humble |
|
||||
| nashp | RDK S600 | ubuntu:24.04 | ubuntu-rdk-s600-beta (noble) | jazzy |
|
||||
|
||||
### runtime 使用方法
|
||||
|
||||
在目标板上执行(构建即以该板真实运行环境为基准):
|
||||
|
||||
```bash
|
||||
cd examples/runtime
|
||||
bash build.sh # 组装上下文并构建 (默认锁宿主机 apt 版本, 源内无该版本时用 --no-pin)
|
||||
bash verify.sh # 零挂载容器内自测 (BPU 推理/TROS/python/APP 一致性, 必须全绿)
|
||||
bash run.sh # 交互式进容器 (已加载 TROS 环境); -d 为 sshd 常驻 (2222->22)
|
||||
```
|
||||
|
||||
设计说明与已知边界见 `examples/runtime/README.md`。
|
||||
|
||||
@ -22,6 +22,9 @@ examples/
|
||||
├── vpu/any/ # VPU+JPU 单元案例: sample_codec 双路径 (H264 走 VPU, JPEG 走 JPU)
|
||||
├── dsp/any/ # DSP 单元案例: S600/S100 为 VDSP(vdsp_sample), X5 为 aDSP(sample_dsp)
|
||||
├── hbmem/any/ # 共享内存单元案例: cached/uncached memset
|
||||
├── runtime/ # 板端运行时镜像 (全内置): TROS/ROS/hobot 走 apt 同源安装,
|
||||
│ │ # /app 与硬件 python 包从板端拷贝, 运行时仅透传设备零挂载
|
||||
│ └── apt/sunrise.gpg # d-robotics 源公钥 (与宿主机 /usr/share/keyrings/sunrise.gpg 一致)
|
||||
└── mcu/any/ # MCU 单元案例: ipcbox_runcmd 经 IPCF 与 MCU 收发
|
||||
├── firmware/ # MCU 固件 (BSP 版本记录见 firmware/README.md)
|
||||
└── install_mcu_runtime.sh# MCU 固件装载 + 开机自启服务
|
||||
|
||||
172
examples/runtime/Dockerfile
Normal file
172
examples/runtime/Dockerfile
Normal file
@ -0,0 +1,172 @@
|
||||
# rdk_runtime 板端运行时镜像 (全内置版)
|
||||
#
|
||||
# 与 app_base 的"通用镜像 + 运行时挂载"路线相反, 本镜像把板卡环境全部内置:
|
||||
# - TROS/ROS/hobot 栈: 走与宿主机完全相同的 apt 源 (d-robotics + tuna ros2),
|
||||
# 并锁定为宿主机当前版本 (build.sh 生成 pkg-pins.txt), 固件同源一致;
|
||||
# - /app 案例与硬件 python 包 (hbm_runtime/Hobot.GPIO): 直接从目标板拷贝,
|
||||
# 保证镜像内 APP 源与板卡一致、python 包与固件 ABI 匹配;
|
||||
# - 运行时仅 --device 透传 (见 run.sh), 不 bind-mount 任何宿主目录。
|
||||
#
|
||||
# 板型参数 (build.sh 自动传入, 也可手动):
|
||||
# nashem (S100/S100P): BASE_IMAGE=ubuntu:22.04 RDK_SUITE=ubuntu-rdk-s100-beta CODENAME=jammy ROS_DISTRO=humble PYTHON_VER=3.10
|
||||
# nashp (RDK S600): BASE_IMAGE=ubuntu:24.04 RDK_SUITE=ubuntu-rdk-s600-beta CODENAME=noble ROS_DISTRO=jazzy PYTHON_VER=3.12
|
||||
#
|
||||
# 构建上下文由 build.sh 在目标板上组装 (app/ pkg-pins.txt requirements.lock
|
||||
# py_overrides/ board-etc-version build-info.txt app-manifest.txt), 不要手动 docker build。
|
||||
ARG BASE_IMAGE=ubuntu:22.04
|
||||
FROM ${BASE_IMAGE}
|
||||
|
||||
ARG RDK_SUITE=ubuntu-rdk-s100-beta
|
||||
ARG CODENAME=jammy
|
||||
ARG ROS_DISTRO=humble
|
||||
ARG PYTHON_VER=3.10
|
||||
|
||||
ENV DEBIAN_FRONTEND=noninteractive
|
||||
ENV ROS_DISTRO=${ROS_DISTRO}
|
||||
|
||||
# ============================================================
|
||||
# apt 源: tuna 基础源 (arm64 base 默认源在 ports.ubuntu.com, 极慢)
|
||||
# + d-robotics 专属源 (hobot 栈 / TROS, 与宿主机 sunrise.list 同源)
|
||||
# + tuna ros2 源 (ROS 发行版, 与宿主机 multistrap-tsinghua-ros2.list 同源)
|
||||
# ============================================================
|
||||
RUN sed -i 's|ports.ubuntu.com/ubuntu-ports|mirrors.tuna.tsinghua.edu.cn/ubuntu-ports|g' /etc/apt/sources.list 2>/dev/null || true; \
|
||||
sed -i 's|ports.ubuntu.com/ubuntu-ports|mirrors.tuna.tsinghua.edu.cn/ubuntu-ports|g' /etc/apt/sources.list.d/*.sources 2>/dev/null || true
|
||||
COPY apt/sunrise.gpg /usr/share/keyrings/sunrise.gpg
|
||||
RUN printf 'deb [arch=arm64 signed-by=/usr/share/keyrings/sunrise.gpg] http://archive.d-robotics.cc/%s %s main\n' "$RDK_SUITE" "$CODENAME" > /etc/apt/sources.list.d/sunrise.list \
|
||||
&& printf 'deb [arch=arm64 trusted=true] http://mirrors4.tuna.tsinghua.edu.cn/ros2/ubuntu %s main\n' "$CODENAME" > /etc/apt/sources.list.d/ros2.list
|
||||
|
||||
# ============================================================
|
||||
# 通用工具层 (沿用 app_base 已验证清单: 工具链/调试/网络/SSH)
|
||||
# ============================================================
|
||||
RUN apt-get update && apt-get install -y \
|
||||
build-essential \
|
||||
cmake \
|
||||
pkg-config \
|
||||
libgflags-dev \
|
||||
libfmt-dev \
|
||||
gdb \
|
||||
strace \
|
||||
python3 \
|
||||
python3-pip \
|
||||
python3-venv \
|
||||
python-is-python3 \
|
||||
python3-colcon-common-extensions \
|
||||
git \
|
||||
wget \
|
||||
curl \
|
||||
vim \
|
||||
tmux \
|
||||
less \
|
||||
file \
|
||||
bzip2 \
|
||||
xz-utils \
|
||||
iputils-ping \
|
||||
net-tools \
|
||||
i2c-tools \
|
||||
libsndfile1-dev \
|
||||
libsamplerate0-dev \
|
||||
openssh-server \
|
||||
locales \
|
||||
&& mkdir -p /var/run/sshd \
|
||||
&& rm -rf /var/lib/apt/lists/*
|
||||
|
||||
# 配置中文 locale (防止终端中文乱码)
|
||||
RUN locale-gen zh_CN.UTF-8 && update-locale LANG=zh_CN.UTF-8
|
||||
|
||||
# SSH 调试入口 (root:root, 与 app_base / 沙箱镜像一致)
|
||||
RUN sed -i 's/#PermitRootLogin prohibit-password/PermitRootLogin yes/' /etc/ssh/sshd_config \
|
||||
&& sed -i 's/#PasswordAuthentication yes/PasswordAuthentication yes/' /etc/ssh/sshd_config \
|
||||
&& echo "MaxAuthTries 3" >> /etc/ssh/sshd_config \
|
||||
&& echo "MaxStartups 3:50:10" >> /etc/ssh/sshd_config \
|
||||
&& echo "LoginGraceTime 30" >> /etc/ssh/sshd_config \
|
||||
&& echo "ClientAliveInterval 60" >> /etc/ssh/sshd_config \
|
||||
&& echo "ClientAliveCountMax 3" >> /etc/ssh/sshd_config \
|
||||
&& ssh-keygen -A \
|
||||
&& echo 'root:root' | chpasswd
|
||||
|
||||
# ============================================================
|
||||
# pip 引导 + hbm_runtime 源码构建工具链 (与宿主机同版本, build.sh 生成锁)
|
||||
# hobot-dnn 的 postinst 会现场构建 hbm_runtime wheel 并以 clean 收尾:
|
||||
# 新版 scikit-build-core CLI 无 clean 子命令(rc!=0)会令 postinst 失败,
|
||||
# 预置宿主机版本后 postinst 的 "pip3 show 已装则跳过" 会直接沿用。
|
||||
# (先升级 pip 以统一支持 --break-system-packages, 22.04 自带 pip 无此选项)
|
||||
# ============================================================
|
||||
COPY pip-build-tools.lock /tmp/pip-build-tools.lock
|
||||
# 22.04 自带 pip 22.x 无 --break-system-packages 选项, 需先升级 pip;
|
||||
# 24.04 自带 pip 24.0 已支持该选项, 跳过升级 (升级 debian 管理的 pip 会因
|
||||
# RECORD 缺失失败)。后续层的硬编码 --break-system-packages 在两条线上都成立。
|
||||
RUN set -e; \
|
||||
if pip3 install --help 2>/dev/null | grep -q -- --break-system-packages; then \
|
||||
PIPFLAG="--break-system-packages"; \
|
||||
else \
|
||||
pip3 install --no-cache-dir --upgrade pip -i https://pypi.tuna.tsinghua.edu.cn/simple; \
|
||||
PIPFLAG="--break-system-packages"; \
|
||||
fi; \
|
||||
pip3 install --no-cache-dir $PIPFLAG -i https://pypi.tuna.tsinghua.edu.cn/simple -r /tmp/pip-build-tools.lock; \
|
||||
rm -f /tmp/pip-build-tools.lock
|
||||
|
||||
# ============================================================
|
||||
# 板卡栈层: TROS / ROS / hobot (与宿主机同源同版本)
|
||||
# pkg-pins.txt 由 build.sh 按宿主机 dpkg 版本生成, 形如 "pkg=version"
|
||||
# (或 --no-pin 模式下的纯包名)。tros 元包会带上全部 tros-* 组件与模型包。
|
||||
# ============================================================
|
||||
COPY pkg-pins.txt /tmp/pkg-pins.txt
|
||||
RUN apt-get update \
|
||||
&& xargs -a /tmp/pkg-pins.txt apt-get install -y --allow-downgrades \
|
||||
&& apt-get install -y ros-${ROS_DISTRO}-ros-base \
|
||||
&& rm -f /tmp/pkg-pins.txt \
|
||||
&& rm -rf /var/lib/apt/lists/*
|
||||
|
||||
# hobot 包未声明 Depends 的系统库补丁层:
|
||||
# libdnn.so / hrt_model_exec / hbm_runtime 均链 libcjson.so.1 (宿主机由
|
||||
# ubuntu 仓库 libcjson1 提供), 缺它 BPU 全链路不可用。
|
||||
# 独立成层是为了不打破上方重型 apt 层的构建缓存。
|
||||
RUN apt-get update && apt-get install -y --no-install-recommends libcjson1 \
|
||||
&& rm -rf /var/lib/apt/lists/*
|
||||
|
||||
# ============================================================
|
||||
# Python 层
|
||||
# 1. numpy/opencv/scipy 与宿主机同版本 (requirements.lock 由 build.sh 生成);
|
||||
# 2. hobot_vio 来自 hobot-spdev apt 包自带的 wheel (上一步已装出 /usr/lib/hobot_spdev);
|
||||
# 3. hbm_runtime / Hobot.GPIO 不走 pip, 由下一层从板端直接拷入 (与固件 ABI 匹配)。
|
||||
# ============================================================
|
||||
COPY requirements.lock /tmp/requirements.lock
|
||||
RUN pip3 install --no-cache-dir --break-system-packages \
|
||||
-i https://pypi.tuna.tsinghua.edu.cn/simple \
|
||||
-r /tmp/requirements.lock \
|
||||
&& pip3 install --no-cache-dir --break-system-packages /usr/lib/hobot_spdev/*.whl \
|
||||
&& rm -f /tmp/requirements.lock
|
||||
|
||||
# ============================================================
|
||||
# 板端内容层: 硬件 python 包 overlay / 板卡标识 / 构建信息 / /app 全量案例
|
||||
# /app 放最后一层 (体积最大, 便于其余层跨构建复用缓存)
|
||||
# ============================================================
|
||||
COPY py_overrides/ /usr/local/lib/python${PYTHON_VER}/dist-packages/
|
||||
COPY board-etc-version /etc/version
|
||||
COPY build-info.txt app-manifest.txt /etc/rdk-runtime-image/
|
||||
COPY app/ /app/
|
||||
|
||||
# ============================================================
|
||||
# 环境层: 路径与 app_base 约定一致, 但不再有 /host_lib /host_inc ——
|
||||
# 板卡库/头文件已在镜像内真实路径上 (apt 装出 /usr/hobot, ldconfig 已覆盖)
|
||||
# ============================================================
|
||||
ENV PATH=/usr/hobot/bin:/app/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
|
||||
ENV LD_LIBRARY_PATH=/usr/hobot/lib:/usr/hobot/lib/sensor
|
||||
ENV CPATH=/usr/hobot/include:/usr/include/cjson:/usr/include/opencv4
|
||||
ENV LIBRARY_PATH=/usr/hobot/lib
|
||||
ENV HOBOT_ROOTFS_DIR=/usr/hobot
|
||||
ENV GST_PLUGIN_PATH=/usr/hobot/lib/gst-plugins
|
||||
ENV LANG=zh_CN.UTF-8
|
||||
ENV LC_ALL=zh_CN.UTF-8
|
||||
ENV PYTHONUNBUFFERED=1
|
||||
ENV ROS_DOMAIN_ID=0
|
||||
|
||||
# 交互 shell 自动加载 TROS 环境 (entrypoint 已导出给 sshd 子进程, 此处兜底)
|
||||
RUN echo '[ -f /opt/tros/$ROS_DISTRO/setup.bash ] && . /opt/tros/$ROS_DISTRO/setup.bash || { [ -f /opt/ros/$ROS_DISTRO/setup.bash ] && . /opt/ros/$ROS_DISTRO/setup.bash; }' >> /root/.bashrc
|
||||
|
||||
COPY entrypoint.sh /entrypoint.sh
|
||||
RUN chmod +x /entrypoint.sh
|
||||
ENTRYPOINT ["/entrypoint.sh"]
|
||||
CMD ["/usr/sbin/sshd", "-D"]
|
||||
|
||||
WORKDIR /app
|
||||
55
examples/runtime/README.md
Normal file
55
examples/runtime/README.md
Normal file
@ -0,0 +1,55 @@
|
||||
# runtime/ 板端运行时镜像 (全内置)
|
||||
|
||||
与 `app_base` 的"通用镜像 + 运行时挂载宿主目录"路线相反, 本线把板卡运行环境
|
||||
**全部内置进镜像**, 容器运行时只透传设备节点, 不 bind-mount 任何宿主目录:
|
||||
|
||||
| 内容 | 内置方式 |
|
||||
|---|---|
|
||||
| TROS / ROS | apt 安装, 源与宿主机相同 (d-robotics `sunrise.list` + tuna ros2), **默认锁定宿主机当前版本** |
|
||||
| hobot 栈 (libdnn/多媒体/IO/spdev/相机) | 同上, apt 安装 d-robotics 源内包 |
|
||||
| /app 全量案例 (含专属测试用例) | build 时从目标板 `/app` 拷贝, 附 sha256 清单 (镜像内 `/etc/rdk-runtime-image/app-manifest.txt`) |
|
||||
| hbm_runtime / Hobot.GPIO | 从目标板 dist-packages 拷贝 (与固件 BPU 驱动 ABI 配对, 不走 pip) |
|
||||
| hobot_vio | apt 包 hobot-spdev 自带 wheel, 镜像内 pip 安装 |
|
||||
| numpy/opencv/scipy | pip 安装, 版本锁定与宿主机一致 |
|
||||
| /etc/version 板卡标识 | 从目标板拷贝 (平台检测依赖, 历史踩坑项) |
|
||||
|
||||
镜像线 (与仓库家族约定一致):
|
||||
|
||||
| family | 板卡 | BASE | d-robotics suite | ROS |
|
||||
|---|---|---|---|---|
|
||||
| `nashem` | S100 / S100P | ubuntu:22.04 | ubuntu-rdk-s100-beta (jammy) | humble |
|
||||
| `nashp` | RDK S600 | ubuntu:24.04 | ubuntu-rdk-s600-beta (noble) | jazzy |
|
||||
|
||||
## 使用
|
||||
|
||||
在**目标板**上执行 (构建即以该板真实运行环境为基准):
|
||||
|
||||
```bash
|
||||
cd examples/runtime
|
||||
bash build.sh # 组装上下文 (/app 快照、版本锁) 并构建 rdk_runtime_<family>:<时间tag>
|
||||
bash verify.sh # 零挂载容器内自测, 必须全绿
|
||||
bash run.sh # 交互式进容器 (已加载 TROS 环境)
|
||||
bash run.sh -d # sshd 常驻 (宿主 2222 -> 22, root/root)
|
||||
```
|
||||
|
||||
可选参数: `build.sh --no-pin` (不锁宿主机版本, 装源内最新) / `--keep-ctx` (保留构建上下文调试)。
|
||||
|
||||
## 设计说明
|
||||
|
||||
- **版本锁**: `build.sh` 用 `dpkg-query` 抓宿主机版本生成 `pkg-pins.txt`,
|
||||
镜像内 `apt install pkg=version` —— 与固件同源同版。源里取不到该版本时
|
||||
apt 会报错, 用 `--no-pin` 重跑改装源内最新 (镜像与宿主可能存在小版本差)。
|
||||
- **设备透传**: `run.sh`/`verify.sh` 复用 `common/app_base_common.sh` 的
|
||||
按单元设备集 (bpu/gpu/vpu/dsp/vio/mcu/hbmem 并集), 不使用 privileged。
|
||||
- **一致性回验**: 镜像内带 `/app` 的 sha256 清单, `verify.sh` 逐文件校验,
|
||||
固件升级后重跑 `verify.sh` 即可发现 APP 漂移。
|
||||
- **与沙箱平台的关系**: 该线是板端运行时镜像的全内置新版本试验田, 成熟后
|
||||
沙箱 compose 可整体切换 (删除全部 bind-mount, 换 image 即可)。
|
||||
|
||||
## 已知边界
|
||||
|
||||
- X5 (bayese) 暂未纳入, `build.sh` 会明确拒绝。
|
||||
- 镜像体积: nashem ~5G / nashp ~5.5G (TROS 全组件 + 模型 + /app 全量),
|
||||
构建上下文同样量级 —— build 会优先把 staging 放 `/root/ssd`。
|
||||
- S600 宿主机 dist-packages 中的 torch/nvidia/triton (~4.5G AI 计算栈)
|
||||
**不内置**: 非硬件访问必备, 按需在容器内自装。
|
||||
BIN
examples/runtime/apt/sunrise.gpg
Normal file
BIN
examples/runtime/apt/sunrise.gpg
Normal file
Binary file not shown.
181
examples/runtime/build.sh
Executable file
181
examples/runtime/build.sh
Executable file
@ -0,0 +1,181 @@
|
||||
#!/bin/bash
|
||||
# rdk_runtime_<family> 板端运行时镜像构建 —— 须在目标板上执行
|
||||
#
|
||||
# 全内置路线 (与 app_base 的"挂载宿主"路线相反):
|
||||
# 1. TROS/ROS/hobot 栈走与宿主机相同的 apt 源, 默认锁定宿主机当前版本;
|
||||
# 2. /app 全量案例、hbm_runtime/Hobot.GPIO 硬件 python 包从本板拷贝;
|
||||
# 3. 产物 rdk_runtime_<family>:<时间tag>, 运行时仅透传设备 (run.sh)。
|
||||
#
|
||||
# 用法:
|
||||
# bash build.sh # 在 S100/S100P/S600 上直接执行
|
||||
# bash build.sh --no-pin # 不锁宿主机版本, 装 d-robotics 源内最新
|
||||
# bash build.sh --keep-ctx # 构建后保留 staging 目录 (调试用)
|
||||
# 注意: 不用 pipefail —— common 库的 resolve_tag 管道 (grep 无匹配 rc=1) 会误杀脚本
|
||||
set -eu
|
||||
SCRIPT_DIR="$(cd "$(dirname "$0")" && pwd)"
|
||||
source "$SCRIPT_DIR/../common/app_base_common.sh"
|
||||
|
||||
PIN=1
|
||||
KEEP_CTX=0
|
||||
for arg in "$@"; do
|
||||
case "$arg" in
|
||||
--no-pin) PIN=0 ;;
|
||||
--keep-ctx) KEEP_CTX=1 ;;
|
||||
*) echo "[ERROR] 未知参数: $arg (可选 --no-pin --keep-ctx)"; exit 1 ;;
|
||||
esac
|
||||
done
|
||||
|
||||
case "$FAMILY" in
|
||||
nashem) BASE_IMAGE="ubuntu:22.04"; SUITE="ubuntu-rdk-s100-beta"; CODENAME="jammy"; ROS="humble"; PYVER="3.10" ;;
|
||||
nashp) BASE_IMAGE="ubuntu:24.04"; SUITE="ubuntu-rdk-s600-beta"; CODENAME="noble"; ROS="jazzy"; PYVER="3.12" ;;
|
||||
*) echo "[ERROR] family=$FAMILY 暂未纳入 runtime 线 (当前支持 nashem/nashp)"; exit 1 ;;
|
||||
esac
|
||||
echo "[INFO] 板型: $FAMILY base:$BASE_IMAGE suite:$SUITE ros:$ROS pin:$PIN"
|
||||
|
||||
# ------------------------------------------------------------
|
||||
# 板卡栈包清单: 核心集 + tros 元包在宿主机上展开的全部 tros-*/模型组件
|
||||
# ------------------------------------------------------------
|
||||
CORE_PKGS="tros-${ROS} hobot-utils hobot-configs hobot-dnn hobot-multimedia hobot-multimedia-dev hobot-multimedia-samples hobot-io hobot-io-samples hobot-spdev hobot-sp-samples hobot-camera hobot-models-basic hobot-audio-config"
|
||||
|
||||
TROS_DEPS="$(apt-cache depends "tros-${ROS}" 2>/dev/null | awk '/^ *Depends:/ {print $2}' | grep -E '^tros-|^hobot-models-basic$' || true)"
|
||||
if [ -z "$TROS_DEPS" ]; then
|
||||
echo "[WARN] apt-cache 未能展开 tros 元包依赖 (宿主 apt 索引缺失?), 仅安装核心集"
|
||||
fi
|
||||
ALL_PKGS="$(echo "$CORE_PKGS $TROS_DEPS" | tr ' ' '\n' | sort -u)"
|
||||
echo "[INFO] 板卡栈包数量: $(echo "$ALL_PKGS" | wc -l)"
|
||||
|
||||
# ------------------------------------------------------------
|
||||
# staging 上下文 (优先 ssd: /app 快照体积大, mmc 上 / 空间紧张)
|
||||
# ------------------------------------------------------------
|
||||
STAGE_PARENT="/root/ssd"
|
||||
[ -d "$STAGE_PARENT" ] || STAGE_PARENT="/tmp"
|
||||
STAGE="$(mktemp -d "$STAGE_PARENT/rdk_runtime_ctx.XXXXXX")"
|
||||
cleanup() { [ "$KEEP_CTX" = 1 ] || rm -rf "$STAGE"; }
|
||||
trap cleanup EXIT
|
||||
echo "[INFO] staging: $STAGE"
|
||||
|
||||
cp "$SCRIPT_DIR/Dockerfile" "$SCRIPT_DIR/entrypoint.sh" "$STAGE/"
|
||||
cp -r "$SCRIPT_DIR/apt" "$STAGE/apt"
|
||||
|
||||
# ------------------------------------------------------------
|
||||
# 1) python 依赖锁: numpy/opencv-python/scipy 与宿主机同版本
|
||||
# ------------------------------------------------------------
|
||||
LOCK="$STAGE/requirements.lock"; : > "$LOCK"
|
||||
for p in numpy opencv-python scipy; do
|
||||
v="$(python3 -c "import importlib.metadata as m; print(m.version('$p'))" 2>/dev/null || true)"
|
||||
if [ -n "$v" ]; then
|
||||
echo "$p==$v" >> "$LOCK"
|
||||
else
|
||||
echo "[WARN] 宿主机未装 $p, 不锁定 (镜像内 pip 将解析依赖版本)"
|
||||
fi
|
||||
done
|
||||
|
||||
# ------------------------------------------------------------
|
||||
# 1b) hbm_runtime 源码构建工具链版本锁 (与宿主机同版本)
|
||||
# hobot-dnn 的 postinst 会现场构建 hbm_runtime wheel, 并用
|
||||
# build.sh clean 收尾 —— 新版 scikit-build-core 的 CLI 无 clean
|
||||
# 子命令(rc!=0)会令 postinst 失败, 故预置宿主机版本,
|
||||
# postinst 的 "pip3 show 已装则跳过" 逻辑会直接沿用。
|
||||
# ------------------------------------------------------------
|
||||
BTOOLS="$STAGE/pip-build-tools.lock"; : > "$BTOOLS"
|
||||
for p in scikit-build-core pybind11 build auditwheel; do
|
||||
v="$(pip3 show "$p" 2>/dev/null | awk '/^Version:/ {print $2}')"
|
||||
[ -n "$v" ] && echo "$p==$v" >> "$BTOOLS" || echo "[WARN] 宿主机无 $p"
|
||||
done
|
||||
[ -s "$BTOOLS" ] || printf 'scikit-build-core==0.12.2\npybind11==3.0.4\nbuild==1.5.0\nauditwheel==6.7.0\n' > "$BTOOLS"
|
||||
|
||||
# ------------------------------------------------------------
|
||||
# 2) 硬件 python 包: hbm_runtime / Hobot.GPIO 必须从本板拷贝
|
||||
# (与固件 BPU 驱动 ABI 配对, PyPI 上未必有对应版本)
|
||||
# ------------------------------------------------------------
|
||||
PYDIST="$(ls -d /usr/local/lib/python3.*/dist-packages 2>/dev/null | head -1)"
|
||||
if [ -z "$PYDIST" ]; then
|
||||
echo "[ERROR] 未找到宿主机 dist-packages"; exit 1
|
||||
fi
|
||||
mkdir -p "$STAGE/py_overrides"
|
||||
for pat in hbm_runtime 'Hobot.GPIO*'; do
|
||||
found=0
|
||||
for d in $PYDIST/$pat; do
|
||||
[ -e "$d" ] || continue
|
||||
cp -a "$d" "$STAGE/py_overrides/" && found=1
|
||||
done
|
||||
[ "$found" = 1 ] || echo "[WARN] 宿主机无 $pat, 镜像将缺少该硬件包"
|
||||
done
|
||||
|
||||
# ------------------------------------------------------------
|
||||
# 3) /app 全量快照 (镜像内 APP 源与板卡一致)
|
||||
# ------------------------------------------------------------
|
||||
if ! [ -d /app ]; then
|
||||
echo "[ERROR] 本板无 /app 目录"; exit 1
|
||||
fi
|
||||
echo "[INFO] 拷贝 /app (可能与固件样例包内容重叠, 以本板实际内容为准)..."
|
||||
if command -v rsync >/dev/null 2>&1; then
|
||||
rsync -a /app/ "$STAGE/app/"
|
||||
else
|
||||
mkdir -p "$STAGE/app" && cp -a /app/. "$STAGE/app/"
|
||||
fi
|
||||
|
||||
# ------------------------------------------------------------
|
||||
# 4) 包版本锁文件 (pin 模式 = 宿主机版本; 源里无该版本时 apt 会报错,
|
||||
# 此时用 --no-pin 重跑即改装源内最新)
|
||||
# ------------------------------------------------------------
|
||||
PINS="$STAGE/pkg-pins.txt"; : > "$PINS"
|
||||
miss=0
|
||||
while read -r p; do
|
||||
[ -n "$p" ] || continue
|
||||
v="$(dpkg-query -W -f='${Version}' "$p" 2>/dev/null || true)"
|
||||
if [ -z "$v" ] && ! dpkg-query -W "$p" >/dev/null 2>&1; then
|
||||
# 元包展开出的组件未装在宿主机上: pin 模式下无法锁, 记名交给 apt 解析
|
||||
echo "[WARN] 宿主机未装 $p (镜像内随元包解析版本)"
|
||||
echo "$p" >> "$PINS"; continue
|
||||
fi
|
||||
if [ "$PIN" = 1 ] && [ -n "$v" ]; then
|
||||
echo "${p}=${v}" >> "$PINS"
|
||||
else
|
||||
echo "$p" >> "$PINS"
|
||||
fi
|
||||
done <<< "$ALL_PKGS"
|
||||
echo "[INFO] pkg-pins: $(wc -l < "$PINS") 条 ($( [ $PIN = 1 ] && echo '锁定宿主机版本' || echo '不锁版本'))"
|
||||
|
||||
# ------------------------------------------------------------
|
||||
# 5) 板卡标识 / 构建信息 / APP 清单
|
||||
# ------------------------------------------------------------
|
||||
if [ -f /etc/version ]; then cp /etc/version "$STAGE/board-etc-version"; else echo unknown > "$STAGE/board-etc-version"; fi
|
||||
|
||||
MODEL="$(cat /proc/device-tree/model 2>/dev/null | tr -d '\0' || echo unknown)"
|
||||
cat > "$STAGE/build-info.txt" <<EOF
|
||||
image=rdk_runtime_${FAMILY}
|
||||
family=${FAMILY}
|
||||
board_model=${MODEL}
|
||||
rdk_os_version=$(cat "$STAGE/board-etc-version")
|
||||
base_image=${BASE_IMAGE}
|
||||
rdk_apt_suite=${SUITE}
|
||||
ros_distro=${ROS}
|
||||
pin_host_versions=${PIN}
|
||||
built_at=$(date '+%Y-%m-%d %H:%M:%S')
|
||||
built_on=$(hostname)
|
||||
tros_meta_version=$(dpkg-query -W -f='${Version}' "tros-${ROS}" 2>/dev/null || echo unknown)
|
||||
hobot_dnn_version=$(dpkg-query -W -f='${Version}' hobot-dnn 2>/dev/null || echo unknown)
|
||||
EOF
|
||||
|
||||
echo "[INFO] 生成 /app 清单 sha256 (用于镜像-板卡一致性比对)..."
|
||||
( cd /app && find . -type f -print0 | LC_ALL=C sort -z | xargs -0 sha256sum ) > "$STAGE/app-manifest.txt"
|
||||
|
||||
# ------------------------------------------------------------
|
||||
# 6) 构建
|
||||
# ------------------------------------------------------------
|
||||
TAG="rdk_runtime_${FAMILY}:$(date +%y%m%d_%H%M%S)"
|
||||
echo "[INFO] docker build -t $TAG (上下文 $(du -sh "$STAGE" | cut -f1), 耐心等待)..."
|
||||
docker build \
|
||||
--build-arg BASE_IMAGE="$BASE_IMAGE" \
|
||||
--build-arg RDK_SUITE="$SUITE" \
|
||||
--build-arg CODENAME="$CODENAME" \
|
||||
--build-arg ROS_DISTRO="$ROS" \
|
||||
--build-arg PYTHON_VER="$PYVER" \
|
||||
-t "$TAG" \
|
||||
-t "rdk_runtime_${FAMILY}:latest" \
|
||||
-f "$STAGE/Dockerfile" "$STAGE"
|
||||
|
||||
echo "[OK] 构建完成: $TAG"
|
||||
echo " 下一步: bash verify.sh # 板上验证 (必须全绿)"
|
||||
echo " bash run.sh # 零挂载交互运行"
|
||||
12
examples/runtime/entrypoint.sh
Executable file
12
examples/runtime/entrypoint.sh
Executable file
@ -0,0 +1,12 @@
|
||||
#!/bin/bash
|
||||
# rdk_runtime 入口: 导出 TROS/ROS 环境后 exec 目标命令
|
||||
# (sshd 常驻时, SSH 登入的子进程即继承完整 ROS 环境)
|
||||
set -e
|
||||
|
||||
if [ -f "/opt/tros/${ROS_DISTRO}/setup.bash" ]; then
|
||||
set -a; . "/opt/tros/${ROS_DISTRO}/setup.bash"; set +a
|
||||
elif [ -f "/opt/ros/${ROS_DISTRO}/setup.bash" ]; then
|
||||
set -a; . "/opt/ros/${ROS_DISTRO}/setup.bash"; set +a
|
||||
fi
|
||||
|
||||
exec "$@"
|
||||
53
examples/runtime/run.sh
Executable file
53
examples/runtime/run.sh
Executable file
@ -0,0 +1,53 @@
|
||||
#!/bin/bash
|
||||
# rdk_runtime 运行: 零 bind-mount, 仅按硬件单元透传设备
|
||||
# (bpu gpu vpu dsp vio mcu hbmem 设备并集, 复用 common/app_base_common.sh
|
||||
# 的精确设备集; 不用 all/privileged —— 与仓库"最小透传"哲学一致)
|
||||
#
|
||||
# 用法:
|
||||
# bash run.sh # 交互式进容器 (bash, 已加载 TROS 环境)
|
||||
# bash run.sh -d # sshd 常驻服务 (宿主 2222 -> 容器 22)
|
||||
# bash run.sh <image:tag> # 指定镜像 (默认 rdk_runtime_<family>:latest)
|
||||
# 注意: 不用 pipefail —— resolve_tag 管道 grep 无匹配 rc=1 会误杀脚本
|
||||
set -eu
|
||||
SCRIPT_DIR="$(cd "$(dirname "$0")" && pwd)"
|
||||
source "$SCRIPT_DIR/../common/app_base_common.sh"
|
||||
|
||||
REPO="rdk_runtime_${FAMILY}"
|
||||
IMG="$REPO:latest"
|
||||
DETACH=0
|
||||
for arg in "$@"; do
|
||||
case "$arg" in
|
||||
-d) DETACH=1 ;;
|
||||
*) IMG="$arg" ;;
|
||||
esac
|
||||
done
|
||||
if ! docker image inspect "$IMG" >/dev/null 2>&1; then
|
||||
t="$(resolve_tag "$REPO")"
|
||||
if [ -n "$t" ]; then
|
||||
IMG="$REPO:$t"
|
||||
else
|
||||
echo "[ERROR] 无 $REPO 镜像 (先运行本目录 build.sh)"; exit 1
|
||||
fi
|
||||
fi
|
||||
echo "[INFO] 镜像: $IMG"
|
||||
|
||||
# 设备并集 (build_device_args 仅回显本板存在的节点)
|
||||
DEVICE_ARGS=""
|
||||
for unit in bpu gpu vpu dsp vio mcu hbmem; do
|
||||
DEVICE_ARGS="$DEVICE_ARGS $(build_device_args "$unit")"
|
||||
done
|
||||
|
||||
NAME="rdk-runtime-$FAMILY"
|
||||
if [ "$DETACH" = 1 ]; then
|
||||
docker rm -f "$NAME" >/dev/null 2>&1 || true
|
||||
docker run -d --name "$NAME" --hostname rdk-runtime \
|
||||
--restart unless-stopped \
|
||||
-p 2222:22 \
|
||||
$DEVICE_ARGS \
|
||||
"$IMG"
|
||||
echo "[OK] sshd 常驻: ssh -p 2222 root@<板卡IP> (密码 root)"
|
||||
else
|
||||
exec docker run -it --rm --hostname rdk-runtime \
|
||||
$DEVICE_ARGS \
|
||||
"$IMG" bash
|
||||
fi
|
||||
110
examples/runtime/verify.sh
Executable file
110
examples/runtime/verify.sh
Executable file
@ -0,0 +1,110 @@
|
||||
#!/bin/bash
|
||||
# rdk_runtime 板上验证: 在"仅设备透传、零 bind-mount"的容器里跑最小自测集
|
||||
# (模拟用户真实拿到镜像的使用方式 —— 环境全部来自镜像内部)
|
||||
#
|
||||
# 用法: bash verify.sh [image:tag] (默认 rdk_runtime_<family>:latest)
|
||||
# 注意: 不用全局 pipefail —— resolve_tag 管道 grep 无匹配 rc=1 会误杀脚本;
|
||||
# docker|tee 的真实退出码经 PIPESTATUS 获取
|
||||
set -eu
|
||||
SCRIPT_DIR="$(cd "$(dirname "$0")" && pwd)"
|
||||
source "$SCRIPT_DIR/../common/app_base_common.sh"
|
||||
|
||||
REPO="rdk_runtime_${FAMILY}"
|
||||
IMG="$REPO:latest"
|
||||
[ $# -ge 1 ] && IMG="$1"
|
||||
if ! docker image inspect "$IMG" >/dev/null 2>&1; then
|
||||
t="$(resolve_tag "$REPO")"
|
||||
[ -n "$t" ] && IMG="$REPO:$t" || { echo "[ERROR] 无 $REPO 镜像"; exit 1; }
|
||||
fi
|
||||
echo "[INFO] 验证镜像: $IMG"
|
||||
|
||||
DEVICE_ARGS=""
|
||||
for unit in bpu gpu vpu dsp vio mcu hbmem; do
|
||||
DEVICE_ARGS="$DEVICE_ARGS $(build_device_args "$unit")"
|
||||
done
|
||||
|
||||
OUT_DIR="$SCRIPT_DIR/output"; mkdir -p "$OUT_DIR"
|
||||
LOG="$OUT_DIR/verify_${FAMILY}_$(date +%y%m%d_%H%M%S).log"
|
||||
|
||||
timeout 600 docker run --rm -i --name "rdk-runtime-verify-$FAMILY" \
|
||||
$DEVICE_ARGS \
|
||||
-e HB_DNN_USER_DEFINED_L2M_SIZES="${HB_DNN_USER_DEFINED_L2M_SIZES:-6:6:6:6}" \
|
||||
"$IMG" bash -s <<'INNER' | tee "$LOG"
|
||||
#!/bin/bash
|
||||
# ---- 容器内自测 (环境全部来自镜像) ----
|
||||
PASS=0; FAIL=0
|
||||
ck() { # ck <名称> <判定命令...>
|
||||
local name="$1"; shift
|
||||
if "$@" >/dev/null 2>&1; then
|
||||
echo "PASS $name"; PASS=$((PASS+1))
|
||||
else
|
||||
echo "FAIL $name"; FAIL=$((FAIL+1))
|
||||
fi
|
||||
}
|
||||
|
||||
# 1. 板卡标识 (平台检测依赖 /etc/version, 沙箱历史踩坑项)
|
||||
v="$(cat /etc/version 2>/dev/null)"
|
||||
[ -n "$v" ] && [ "$v" != "unknown" ] && echo "PASS /etc/version 标识 ($v)" || { echo "FAIL /etc/version 标识"; FAIL=$((FAIL+1)); }
|
||||
|
||||
# 2. 板卡工具链在 PATH
|
||||
ck "hrt_model_exec 可用" command -v hrt_model_exec
|
||||
ck "hobot 库目录" test -d /usr/hobot/lib
|
||||
|
||||
# 3. TROS/ROS 环境 (entrypoint 已 source; 此处验证其真实可用)
|
||||
n="$(ros2 pkg list 2>/dev/null | wc -l)"
|
||||
if [ "${n:-0}" -gt 50 ]; then
|
||||
echo "PASS ROS 环境 (ros2 pkg list = $n 个包)"
|
||||
PASS=$((PASS+1))
|
||||
else
|
||||
echo "FAIL ROS 环境 (ros2 pkg list = $n)"
|
||||
FAIL=$((FAIL+1))
|
||||
fi
|
||||
ros2 pkg list 2>/dev/null | grep -q "dnn_node" && { echo "PASS TROS 组件 (dnn_node)"; PASS=$((PASS+1)); } \
|
||||
|| { echo "FAIL TROS 组件 (dnn_node)"; FAIL=$((FAIL+1)); }
|
||||
|
||||
# 4. Python 硬件/科学栈
|
||||
ck "python: numpy/cv2/scipy" python3 -c "import numpy, cv2, scipy"
|
||||
ck "python: hbm_runtime" python3 -c "import hbm_runtime"
|
||||
ck "python: hobot_vio" python3 -c "import hobot_vio"
|
||||
|
||||
# 5. BPU 实推理 (hbm 模型来自镜像内 hobot-models-basic; 子命令在前)
|
||||
MODEL="$(ls /opt/hobot/model/*/basic/*.hbm 2>/dev/null | head -1)"
|
||||
if [ -n "$MODEL" ]; then
|
||||
OUT="$(timeout 120 hrt_model_exec perf --model_file "$MODEL" 2>&1)"; RC=$?
|
||||
if [ $RC -eq 0 ]; then
|
||||
echo "PASS BPU 推理 perf ($(basename "$MODEL"))"; PASS=$((PASS+1))
|
||||
echo "$OUT" | grep -iE "latency|fps" | head -2 | sed 's/^/ /'
|
||||
else
|
||||
echo "FAIL BPU 推理 perf (rc=$RC)"; FAIL=$((FAIL+1)); echo "$OUT" | tail -3 | sed 's/^/ /'
|
||||
fi
|
||||
else
|
||||
echo "FAIL 镜像内无 hbm 模型 (/opt/hobot/model/*/basic)"; FAIL=$((FAIL+1))
|
||||
fi
|
||||
|
||||
# 6. 库完整性: libdnn 无缺失依赖 (全内置是否装齐的试金石)
|
||||
miss="$(ldd /usr/hobot/lib/libdnn.so 2>/dev/null | grep -c 'not found')"
|
||||
if [ "${miss:-1}" -eq 0 ]; then echo "PASS libdnn 依赖完整"; PASS=$((PASS+1)); else echo "FAIL libdnn 缺 $miss 个依赖"; FAIL=$((FAIL+1)); fi
|
||||
|
||||
# 7. /app 与板卡构建时一致 (build.sh 生成的清单回验)
|
||||
if [ -f /etc/rdk-runtime-image/app-manifest.txt ]; then
|
||||
bad="$(cd /app && sha256sum -c /etc/rdk-runtime-image/app-manifest.txt --quiet 2>/dev/null | wc -l)"
|
||||
if [ "${bad:-1}" -eq 0 ]; then
|
||||
echo "PASS /app 与板卡一致 ($(wc -l < /etc/rdk-runtime-image/app-manifest.txt) 个文件)"; PASS=$((PASS+1))
|
||||
else
|
||||
echo "FAIL /app 有 $bad 个文件与构建清单不符"; FAIL=$((FAIL+1))
|
||||
fi
|
||||
else
|
||||
echo "FAIL 无 /etc/rdk-runtime-image/app-manifest.txt"; FAIL=$((FAIL+1))
|
||||
fi
|
||||
|
||||
# 8. 构建信息在位
|
||||
ck "构建信息 /etc/rdk-runtime-image/build-info.txt" test -s /etc/rdk-runtime-image/build-info.txt
|
||||
|
||||
echo "----------------------------------------"
|
||||
echo "RESULT: PASS=$PASS FAIL=$FAIL"
|
||||
[ $FAIL -eq 0 ] && echo "TEST PASS (rdk_runtime 全部自测通过)" || echo "TEST FAIL (存在失败项)"
|
||||
exit $FAIL
|
||||
INNER
|
||||
rc=${PIPESTATUS[0]}
|
||||
echo "[INFO] 日志: $LOG"
|
||||
exit $rc
|
||||
Loading…
x
Reference in New Issue
Block a user