You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/en/tutorials/05-model-porting/model-porting.md
+33-5Lines changed: 33 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -14,14 +14,14 @@ next: false
14
14
| Who this is for | ML engineers and integration developers bringing a custom detector or classifier to CosmoEdge |
15
15
| What you will accomplish | Evaluate runtime compatibility, convert and upload a model, configure parsing, and complete image, video, and sustained-run validation |
16
16
| Prerequisites | Understand Pipelines and know the model input, output, preprocessing, postprocessing, and label order |
17
-
| Estimated time | About 40–60 minutes for x86 ONNX; Sophon conversion commonly adds 30–60 minutes |
18
-
| Device required | x86 requires an ONNX Runtime CosmoEdge build; Sophon requires a BM1688/CV186X device and matching conversion toolchain |
17
+
| Estimated time | About 40–60 minutes for x86 ONNX; Sophon or Rockchip conversion commonly adds 30–60 minutes |
18
+
| Device required | x86 requires an ONNX Runtime CosmoEdge build; Sophon and Rockchip require the actual target device and matching conversion toolchain |
19
19
| Final acceptance result | The model loads, its output is parsed correctly, image and video results pass, and it runs without resource failure on the target device |
20
20
21
21
Complete third-party integration in this order:
22
22
23
23
1. Confirm support conditions and the model contract.
24
-
2. Export ONNX; for Sophon, convert it again into a chip-specific `bmodel`.
24
+
2. Export ONNX; convert it into a chip-specific `bmodel` for Sophon or `rknn` for Rockchip.
25
25
3. Validate the artifact on the conversion host.
26
26
4. Upload and configure the model.
27
27
5. Run positive and negative image tests first.
@@ -39,12 +39,14 @@ output layout, and postprocessing are compatible with CosmoEdge.
39
39
| --- | --- | --- | --- | --- |
40
40
| x86 CPU |`.onnx`|`model.onnx`| ONNX Runtime CPU | x86_64 host and matching CosmoEdge build |
41
41
| Sophon |`.bmodel`|`model.nn`| Sophon BMRT | BM1688 or CV186X; the artifact must target the actual chip |
42
+
| Rockchip RKNN |`.rknn`|`model.rknn`| RKNN Runtime | RK3576 or RV1126B; the artifact must target the actual chip |
42
43
43
44
`model.nn` is the internal file name in a CosmoEdge model package. It wraps the device model. When adding
44
45
an individual Sophon model in the UI, select its `.bmodel`; do not rename an extension to `.nn`.
45
46
46
47
PyTorch `.pt`, TensorFlow SavedModel, and other training-framework artifacts cannot be uploaded directly.
47
-
Export them to ONNX first. Sophon deployments then convert ONNX into a chip-specific `.bmodel`.
48
+
Export them to ONNX first. Sophon deployments then convert ONNX into a chip-specific `.bmodel`, while
49
+
Rockchip deployments produce a chip-specific `.rknn`. RK3576 and RV1126B `.rknn` artifacts are not interchangeable.
48
50
49
51
### 1.2 Contracts Beyond the File Format
50
52
@@ -66,7 +68,7 @@ or runtime code.
66
68
### 1.3 Verified Capability vs Conditional Compatibility
67
69
68
70
-**Directly supported by current code**: Add `.onnx` on x86, add `.bmodel` on Sophon, and import packages
69
-
containing `model.onnx` or `model.nn`.
71
+
containing `model.onnx` or `model.nn`; RKNN builds add `.rknn` and package it as `model.rknn`.
70
72
-**Reference evidence in this repository**: a YOLOv8 detector has completed x86 ONNX import, live overlay,
71
73
and event output.
72
74
-**Still required on the target candidate**: validate your exact model, Sophon artifact, performance,
@@ -387,6 +389,32 @@ task acceptance, but it must not borrow another example's fixed shapes or hashes
387
389
388
390
The Sophon Add Model page requires a `.bmodel` file.
0 commit comments