89 lines
6.6 KiB
Plaintext
89 lines
6.6 KiB
Plaintext
2026-02-18 15:52:40.806389: I tensorflow/core/util/port.cc:113] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable `TF_ENABLE_ONEDNN_OPTS=0`.
|
|
2026-02-18 15:52:40.853597: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:9261] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
|
|
2026-02-18 15:52:40.853640: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:607] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
|
|
2026-02-18 15:52:40.854695: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1515] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
|
|
2026-02-18 15:52:40.861460: I tensorflow/core/platform/cpu_feature_guard.cc:182] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
|
|
To enable the following instructions: AVX2 AVX512F AVX512_VNNI FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
|
|
Traceback (most recent call last):
|
|
File "/home/qhy/miniforge/envs/unifolm-wma/lib/python3.10/site-packages/tensorboard/compat/__init__.py", line 42, in tf
|
|
from tensorboard.compat import notf # noqa: F401
|
|
ImportError: cannot import name 'notf' from 'tensorboard.compat' (/home/qhy/miniforge/envs/unifolm-wma/lib/python3.10/site-packages/tensorboard/compat/__init__.py)
|
|
|
|
During handling of the above exception, another exception occurred:
|
|
|
|
AttributeError: 'MessageFactory' object has no attribute 'GetPrototype'
|
|
Traceback (most recent call last):
|
|
File "/home/qhy/miniforge/envs/unifolm-wma/lib/python3.10/site-packages/tensorboard/compat/__init__.py", line 42, in tf
|
|
from tensorboard.compat import notf # noqa: F401
|
|
ImportError: cannot import name 'notf' from 'tensorboard.compat' (/home/qhy/miniforge/envs/unifolm-wma/lib/python3.10/site-packages/tensorboard/compat/__init__.py)
|
|
|
|
During handling of the above exception, another exception occurred:
|
|
|
|
AttributeError: 'MessageFactory' object has no attribute 'GetPrototype'
|
|
Traceback (most recent call last):
|
|
File "/home/qhy/miniforge/envs/unifolm-wma/lib/python3.10/site-packages/tensorboard/compat/__init__.py", line 42, in tf
|
|
from tensorboard.compat import notf # noqa: F401
|
|
ImportError: cannot import name 'notf' from 'tensorboard.compat' (/home/qhy/miniforge/envs/unifolm-wma/lib/python3.10/site-packages/tensorboard/compat/__init__.py)
|
|
|
|
During handling of the above exception, another exception occurred:
|
|
|
|
AttributeError: 'MessageFactory' object has no attribute 'GetPrototype'
|
|
Traceback (most recent call last):
|
|
File "/home/qhy/miniforge/envs/unifolm-wma/lib/python3.10/site-packages/tensorboard/compat/__init__.py", line 42, in tf
|
|
from tensorboard.compat import notf # noqa: F401
|
|
ImportError: cannot import name 'notf' from 'tensorboard.compat' (/home/qhy/miniforge/envs/unifolm-wma/lib/python3.10/site-packages/tensorboard/compat/__init__.py)
|
|
|
|
During handling of the above exception, another exception occurred:
|
|
|
|
AttributeError: 'MessageFactory' object has no attribute 'GetPrototype'
|
|
2026-02-18 15:52:41.778285: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
|
|
Traceback (most recent call last):
|
|
File "/home/qhy/miniforge/envs/unifolm-wma/lib/python3.10/site-packages/tensorboard/compat/__init__.py", line 42, in tf
|
|
from tensorboard.compat import notf # noqa: F401
|
|
ImportError: cannot import name 'notf' from 'tensorboard.compat' (/home/qhy/miniforge/envs/unifolm-wma/lib/python3.10/site-packages/tensorboard/compat/__init__.py)
|
|
|
|
During handling of the above exception, another exception occurred:
|
|
|
|
AttributeError: 'MessageFactory' object has no attribute 'GetPrototype'
|
|
Global seed set to 123
|
|
>>> Loading prepared model from ckpts/unifolm_wma_dual.ckpt.prepared.pt ...
|
|
>>> Prepared model loaded.
|
|
>>> Diffusion backbone (model.model) converted to FP16.
|
|
>>> Projectors (image_proj_model, state_projector, action_projector) converted to FP16.
|
|
>>> Encoders (cond_stage_model, embedder) converted to FP16.
|
|
INFO:root:***** Configing Data *****
|
|
>>> unitree_z1_stackbox: 1 data samples loaded.
|
|
>>> unitree_z1_stackbox: data stats loaded.
|
|
>>> unitree_z1_stackbox: normalizer initiated.
|
|
>>> unitree_z1_dual_arm_stackbox: 1 data samples loaded.
|
|
>>> unitree_z1_dual_arm_stackbox: data stats loaded.
|
|
>>> unitree_z1_dual_arm_stackbox: normalizer initiated.
|
|
>>> unitree_z1_dual_arm_stackbox_v2: 1 data samples loaded.
|
|
>>> unitree_z1_dual_arm_stackbox_v2: data stats loaded.
|
|
>>> unitree_z1_dual_arm_stackbox_v2: normalizer initiated.
|
|
>>> unitree_z1_dual_arm_cleanup_pencils: 1 data samples loaded.
|
|
>>> unitree_z1_dual_arm_cleanup_pencils: data stats loaded.
|
|
>>> unitree_z1_dual_arm_cleanup_pencils: normalizer initiated.
|
|
>>> unitree_g1_pack_camera: 1 data samples loaded.
|
|
>>> unitree_g1_pack_camera: data stats loaded.
|
|
>>> unitree_g1_pack_camera: normalizer initiated.
|
|
>>> Dataset is successfully loaded ...
|
|
✓ KV fused: 66 attention layers
|
|
TRT output 'y': [1, 4, 16, 40, 64] torch.float32
|
|
TRT output 'hs_a_0': [1, 16, 320, 40, 64] torch.float32
|
|
TRT output 'hs_a_1': [1, 16, 640, 20, 32] torch.float32
|
|
TRT output 'hs_a_2': [1, 16, 1280, 10, 16] torch.float32
|
|
TRT output 'hs_a_3': [1, 16, 1280, 5, 8] torch.float32
|
|
TRT output 'hs_a_4': [1, 16, 1280, 5, 8] torch.float32
|
|
TRT output 'hs_a_5': [1, 16, 1280, 5, 8] torch.float32
|
|
TRT output 'hs_a_6': [1, 16, 1280, 10, 16] torch.float32
|
|
TRT output 'hs_a_7': [1, 16, 640, 20, 32] torch.float32
|
|
TRT output 'hs_a_8': [1, 16, 320, 40, 64] torch.float32
|
|
>>> TRT backbone loaded from /home/qhy/unifolm-world-model-action/scripts/evaluation/../../trt_engines/video_backbone.engine
|
|
>>> Generate 16 frames under each generation ...
|
|
DEBUG:h5py._conv:Creating converter from 3 to 5
|
|
DEBUG:PIL.PngImagePlugin:STREAM b'IHDR' 16 13
|
|
DEBUG:PIL.PngImagePlugin:STREAM b'pHYs' 41 9
|
|
DEBUG:PIL.PngImagePlugin:STREAM b'IDAT' 62 4096
|
|
|
|
0%| | 0/11 [00:00<?, ?it/s][02/18/2026-15:52:55] [TRT] [W] Using default stream in enqueueV3() may lead to performance issues due to additional calls to cudaStreamSynchronize() by TensorRT to ensure correct synchronization. Please use non-default stream instead.
|
|
|
|
9%|▉ | 1/11 [00:16<02:45, 16.58s/it]
|
|
18%|█▊ | 2/11 [00:32<02:23, 15.92s/it]
|
|
27%|██▋ | 3/11 [00:47<02:05, 15.73s/it]
|
|
36%|███▋ | 4/11 [01:03<01:51, 15.93s/it]
|
|
45%|████▌ | 5/11 [01:20<01:36, 16.07s/it] |