Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

(FeatureExtraction:27300): GStreamer-PBUtils-CRITICAL **: 02:56:06.922: gst_missing_encoder_message_new: assertion 'gst_caps_is_fixed (encode_caps)' failed #1093

Open
linhcentrio opened this issue Sep 25, 2024 · 12 comments

Comments

@linhcentrio
Copy link

[root@aiclip-dfl gst-plugins-bad]# ./bin/FeatureExtraction -f ../samples/multi_face.avi
-bash: ./bin/FeatureExtraction: No such file or directory
[root@aiclip-dfl gst-plugins-bad]# cd /root/OpenFace/build
[root@aiclip-dfl build]# ./bin/FeatureExtraction -f ../samples/multi_face.avi
Could not find the HAAR face detector location
Reading the landmark detector/tracker from: ./bin/model/main_ceclm_general.txt
Reading the landmark detector module from: ./bin/model/cen_general.txt
Reading the PDM module from: ./bin/model/pdms/In-the-wild_aligned_PDM_68.txt....Done
Reading the Triangulations module from: ./bin/model/tris_68.txt....Done
Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.25_of.dat....Done
Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.35_of.dat....Done
Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.50_of.dat....Done
Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_1.00_of.dat....Done
Reading part based module....left_eye_28
Reading the landmark detector/tracker from: ./bin/model/model_eye/main_clnf_synth_left.txt
Reading the landmark detector module from: ./bin/model/model_eye/clnf_left_synth.txt
Reading the PDM module from: ./bin/model/model_eye/pdms/pdm_28_l_eye_3D_closed.txt....Done
Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/left_ccnf_patches_1.00_synth_lid_.txt....Done
Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/left_ccnf_patches_1.50_synth_lid_.txt....Done
Could not find the HAAR face detector location
Done
Reading part based module....right_eye_28
Reading the landmark detector/tracker from: ./bin/model/model_eye/main_clnf_synth_right.txt
Reading the landmark detector module from: ./bin/model/model_eye/clnf_right_synth.txt
Reading the PDM module from: ./bin/model/model_eye/pdms/pdm_28_eye_3D_closed.txt....Done
Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/ccnf_patches_1.00_synth_lid_.txt....Done
Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/ccnf_patches_1.50_synth_lid_.txt....Done
Could not find the HAAR face detector location
Done
Reading the landmark validation module....Done
Reading the AU analysis module from: ./bin/AU_predictors/main_dynamic_svms.txt
Reading the AU predictors from: ./bin/AU_predictors/AU_all_best.txt... Done
Reading the PDM from: ./bin/AU_predictors/In-the-wild_aligned_PDM_68.txt... Done
Reading the triangulation from:./bin/AU_predictors/tris_68_full.txt... Done
Attempting to read from file: ../samples/multi_face.avi

(FeatureExtraction:27300): GStreamer-CRITICAL **: 02:56:06.551: gst_query_set_position: assertion 'format == g_value_get_enum (gst_structure_id_get_value (s, GST_QUARK (FORMAT)))' failed
Device or file opened
Starting tracking
Reading the MTCNN face detector from: ./bin/model/mtcnn_detector/MTCNN_detector.txt
Reading the PNet module from: ./bin/model/mtcnn_detector/PNet.dat
Reading the RNet module from: ./bin/model/mtcnn_detector/RNet.dat
Reading the ONet module from: ./bin/model/mtcnn_detector/ONet.dat

(FeatureExtraction:27300): GStreamer-PBUtils-CRITICAL **: 02:56:06.922: gst_missing_encoder_message_new: assertion 'gst_caps_is_fixed (encode_caps)' failed

(FeatureExtraction:27300): GStreamer-CRITICAL **: 02:56:06.925: gst_element_post_message: assertion 'message != NULL' failed
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Closing output recorder
Closing input reader
Closed successfully
Postprocessing the Action Unit predictions

@linhcentrio
Copy link
Author

i run on almalinux 9 and my open cv:
Video I/O:
-- DC1394: YES (2.2.6)
-- FFMPEG: NO
-- avcodec: YES (57.107.100)
-- avformat: YES (57.83.100)
-- avutil: YES (55.78.100)
-- swscale: YES (4.8.100)
-- avresample: NO
-- GStreamer: YES (1.22.1)
-- v4l/v4l2: YES (linux/videodev2.h)

@brmarkus
Copy link

How have you installed OpenFace?
I don't know "almalinux 9", have you experienced problems calling the installation-setup-script "install.sh"?

Are you able to playback the video file "../samples/multi_face.avi" on your system using gstreamer manually (just to check if the video-file is correct and complete, sometimes it contains HTML-text when downloading went wrong)?

@linhcentrio
Copy link
Author

linhcentrio commented Sep 25, 2024

install.sh which only for ubuntu i can not run it on centos 8,9 same as almalinux (upgrade from centos 7) so i try many way but still has some issue with openface, pls help more

@brmarkus
Copy link

Looks like a gstreamer problem on your system, and especially with encoding (recording), maybe a missing codec library (and/or incompatible GPU).

Are you able to playback the video file manually (gstreamer, VLC, any media-player)?

Can you try to specify another output codec via command line parameter -oc <FOURCC_CODE> (see "https://github.com/TadasBaltrusaitis/OpenFace/wiki/Command-line-arguments")

Like

./bin/FeatureExtraction -f ../samples/multi_face.avi -oc MPEG
./bin/FeatureExtraction -f ../samples/multi_face.avi -oc X264
./bin/FeatureExtraction -f ../samples/multi_face.avi -oc mp4v

@linhcentrio
Copy link
Author

there are steps i try to install openface on linux 9:
sudo yum install gtk2-devel ffmpeg ffmpeg-devel
sudo yum install tbb tbb-devel
sudo yum install libjpeg-turbo-devel libpng-devel libtiff-devel
sudo yum install python3-devel
sudo yum install opencv opencv-devel ffmpeg ffmpeg-devel
sudo yum install epel-release
sudo yum update
sudo yum install libtiff libtiff-devel

sudo yum install gstreamer1 gstreamer1-plugins-base gstreamer1-plugins-good gstreamer1-plugins-bad gstreamer1-plugins-ugly gstreamer1-libav gstreamer1-devel
sudo yum install gstreamer1-plugins-good gstreamer1-plugins-base gstreamer1-plugins-ugly gstreamer1-devel

export PKG_CONFIG_PATH=/usr/lib/pkgconfig:/usr/local/lib/pkgconfig:$PKG_CONFIG_PATH
export PKG_CONFIG_PATH=/opt/ffmpeg/lib/pkgconfig:$PKG_CONFIG_PATH

sudo yum install meson ninja-build
pip3 install meson

Tải GStreamer core

cd /usr/local/src
wget https://gstreamer.freedesktop.org/src/gstreamer/gstreamer-1.22.1.tar.xz
tar -xf gstreamer-1.22.1.tar.xz
cd gstreamer-1.22.1

Build và cài đặt bằng meson và ninja

meson build
cd build
ninja
sudo ninja install

Plugins cơ bản

cd /usr/local/src
wget https://gstreamer.freedesktop.org/src/gst-plugins-base/gst-plugins-base-1.22.1.tar.xz
tar -xf gst-plugins-base-1.22.1.tar.xz
cd gst-plugins-base-1.22.1

Build và cài đặt

meson build
cd build
ninja
sudo ninja install

export PKG_CONFIG_PATH=/usr/local/lib/pkgconfig:$PKG_CONFIG_PATH

pkg-config --modversion gstreamer-video-1.0
pkg-config --modversion gstreamer-app-1.0
pkg-config --modversion gstreamer-audio-1.0
pkg-config --modversion gstreamer-pbutils-1.0

git clone https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad.git
cd gst-plugins-bad
meson build
ninja -C build
sudo ninja -C build install

pkg-config --modversion gstreamer-1.0

wget https://github.com/opencv/opencv/archive/4.1.0.zip
unzip 4.1.0.zip
cd opencv-4.1.0
mkdir build
cd build
cmake -DBUILD_TIFF=ON -DWITH_V4L=ON -DWITH_FFMPEG=ON -DWITH_GSTREAMER=ON -D CMAKE_BUILD_TYPE=RELEASE ..
make -j$(nproc)
sudo make install

git clone https://github.com/TadasBaltrusaitis/OpenFace.git
cd OpenFace
mkdir build
cd build

cmake -D CMAKE_C_COMPILER=/usr/local/bin/gcc -D CMAKE_CXX_COMPILER=/usr/local/bin/g++ -D CMAKE_BUILD_TYPE=RELEASE ..
make clean
make -j$(nproc)
sudo make install

@linhcentrio
Copy link
Author

Looks like a gstreamer problem on your system, and especially with encoding (recording), maybe a missing codec library (and/or incompatible GPU).

Are you able to playback the video file manually (gstreamer, VLC, any media-player)?

Can you try to specify another output codec via command line parameter -oc <FOURCC_CODE> (see "https://github.com/TadasBaltrusaitis/OpenFace/wiki/Command-line-arguments")

Like

./bin/FeatureExtraction -f ../samples/multi_face.avi -oc MPEG
./bin/FeatureExtraction -f ../samples/multi_face.avi -oc X264
./bin/FeatureExtraction -f ../samples/multi_face.avi -oc mp4v

yeah i can run these cli on my linux 9, as log bellow:

(/home/SyncTalk/venv) [root@aiclip-dfl build]# ./bin/FeatureExtraction -f ../samples/multi_face.avi -oc MPEG
Could not find the HAAR face detector location
Reading the landmark detector/tracker from: ./bin/model/main_ceclm_general.txt
Reading the landmark detector module from: ./bin/model/cen_general.txt
Reading the PDM module from: ./bin/model/pdms/In-the-wild_aligned_PDM_68.txt....Done
Reading the Triangulations module from: ./bin/model/tris_68.txt....Done
Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.25_of.dat....Done
Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.35_of.dat....Done
Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.50_of.dat....Done
Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_1.00_of.dat....Done
Reading part based module....left_eye_28
Reading the landmark detector/tracker from: ./bin/model/model_eye/main_clnf_synth_left.txt
Reading the landmark detector module from: ./bin/model/model_eye/clnf_left_synth.txt
Reading the PDM module from: ./bin/model/model_eye/pdms/pdm_28_l_eye_3D_closed.txt....Done
Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/left_ccnf_patches_1.00_synth_lid_.txt....Done
Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/left_ccnf_patches_1.50_synth_lid_.txt....Done
Could not find the HAAR face detector location
Done
Reading part based module....right_eye_28
Reading the landmark detector/tracker from: ./bin/model/model_eye/main_clnf_synth_right.txt
Reading the landmark detector module from: ./bin/model/model_eye/clnf_right_synth.txt
Reading the PDM module from: ./bin/model/model_eye/pdms/pdm_28_eye_3D_closed.txt....Done
Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/ccnf_patches_1.00_synth_lid_.txt....Done
Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/ccnf_patches_1.50_synth_lid_.txt....Done
Could not find the HAAR face detector location
Done
Reading the landmark validation module....Done
Reading the AU analysis module from: ./bin/AU_predictors/main_dynamic_svms.txt
Reading the AU predictors from: ./bin/AU_predictors/AU_all_best.txt... Done
Reading the PDM from: ./bin/AU_predictors/In-the-wild_aligned_PDM_68.txt... Done
Reading the triangulation from:./bin/AU_predictors/tris_68_full.txt... Done
Attempting to read from file: ../samples/multi_face.avi

(FeatureExtraction:61855): GStreamer-CRITICAL **: 04:05:14.962: gst_query_set_position: assertion 'format == g_value_get_enum (gst_structure_id_get_value (s, GST_QUARK (FORMAT)))' failed
Device or file opened
Starting tracking
Reading the MTCNN face detector from: ./bin/model/mtcnn_detector/MTCNN_detector.txt
Reading the PNet module from: ./bin/model/mtcnn_detector/PNet.dat
Reading the RNet module from: ./bin/model/mtcnn_detector/RNet.dat
Reading the ONet module from: ./bin/model/mtcnn_detector/ONet.dat

(FeatureExtraction:61855): GStreamer-PBUtils-CRITICAL **: 04:05:15.430: gst_missing_encoder_message_new: assertion 'gst_caps_is_fixed (encode_caps)' failed

(FeatureExtraction:61855): GStreamer-CRITICAL **: 04:05:15.430: gst_element_post_message: assertion 'message != NULL' failed
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Closing output recorder
Closing input reader
Closed successfully
Postprocessing the Action Unit predictions
(/home/SyncTalk/venv) [root@aiclip-dfl build]# ./bin/FeatureExtraction -f ../samples/multi_face.avi -oc X264
Could not find the HAAR face detector location
Reading the landmark detector/tracker from: ./bin/model/main_ceclm_general.txt
Reading the landmark detector module from: ./bin/model/cen_general.txt
Reading the PDM module from: ./bin/model/pdms/In-the-wild_aligned_PDM_68.txt....Done
Reading the Triangulations module from: ./bin/model/tris_68.txt....Done
Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.25_of.dat....Done
Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.35_of.dat....Done
Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.50_of.dat....Done
Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_1.00_of.dat....Done
Reading part based module....left_eye_28
Reading the landmark detector/tracker from: ./bin/model/model_eye/main_clnf_synth_left.txt
Reading the landmark detector module from: ./bin/model/model_eye/clnf_left_synth.txt
Reading the PDM module from: ./bin/model/model_eye/pdms/pdm_28_l_eye_3D_closed.txt....Done
Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/left_ccnf_patches_1.00_synth_lid_.txt....Done
Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/left_ccnf_patches_1.50_synth_lid_.txt....Done
Could not find the HAAR face detector location
Done
Reading part based module....right_eye_28
Reading the landmark detector/tracker from: ./bin/model/model_eye/main_clnf_synth_right.txt
Reading the landmark detector module from: ./bin/model/model_eye/clnf_right_synth.txt
Reading the PDM module from: ./bin/model/model_eye/pdms/pdm_28_eye_3D_closed.txt....Done
Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/ccnf_patches_1.00_synth_lid_.txt....Done
Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/ccnf_patches_1.50_synth_lid_.txt....Done
Could not find the HAAR face detector location
Done
Reading the landmark validation module....Done
Reading the AU analysis module from: ./bin/AU_predictors/main_dynamic_svms.txt
Reading the AU predictors from: ./bin/AU_predictors/AU_all_best.txt... Done
Reading the PDM from: ./bin/AU_predictors/In-the-wild_aligned_PDM_68.txt... Done
Reading the triangulation from:./bin/AU_predictors/tris_68_full.txt... Done
Attempting to read from file: ../samples/multi_face.avi

(FeatureExtraction:61905): GStreamer-CRITICAL **: 04:05:45.922: gst_query_set_position: assertion 'format == g_value_get_enum (gst_structure_id_get_value (s, GST_QUARK (FORMAT)))' failed
Device or file opened
Starting tracking
Reading the MTCNN face detector from: ./bin/model/mtcnn_detector/MTCNN_detector.txt
Reading the PNet module from: ./bin/model/mtcnn_detector/PNet.dat
Reading the RNet module from: ./bin/model/mtcnn_detector/RNet.dat
Reading the ONet module from: ./bin/model/mtcnn_detector/ONet.dat

(FeatureExtraction:61905): GStreamer-PBUtils-CRITICAL **: 04:05:46.416: gst_missing_encoder_message_new: assertion 'gst_caps_is_fixed (encode_caps)' failed

(FeatureExtraction:61905): GStreamer-CRITICAL **: 04:05:46.416: gst_element_post_message: assertion 'message != NULL' failed
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Closing output recorder
Closing input reader
Closed successfully
Postprocessing the Action Unit predictions
(/home/SyncTalk/venv) [root@aiclip-dfl build]# ./bin/FeatureExtraction -f ../samples/multi_face.avi -oc mp4v
Could not find the HAAR face detector location
Reading the landmark detector/tracker from: ./bin/model/main_ceclm_general.txt
Reading the landmark detector module from: ./bin/model/cen_general.txt
Reading the PDM module from: ./bin/model/pdms/In-the-wild_aligned_PDM_68.txt....Done
Reading the Triangulations module from: ./bin/model/tris_68.txt....Done
Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.25_of.dat....Done
Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.35_of.dat....Done
Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.50_of.dat....Done
Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_1.00_of.dat....Done
Reading part based module....left_eye_28
Reading the landmark detector/tracker from: ./bin/model/model_eye/main_clnf_synth_left.txt
Reading the landmark detector module from: ./bin/model/model_eye/clnf_left_synth.txt
Reading the PDM module from: ./bin/model/model_eye/pdms/pdm_28_l_eye_3D_closed.txt....Done
Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/left_ccnf_patches_1.00_synth_lid_.txt....Done
Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/left_ccnf_patches_1.50_synth_lid_.txt....Done
Could not find the HAAR face detector location
Done
Reading part based module....right_eye_28
Reading the landmark detector/tracker from: ./bin/model/model_eye/main_clnf_synth_right.txt
Reading the landmark detector module from: ./bin/model/model_eye/clnf_right_synth.txt
Reading the PDM module from: ./bin/model/model_eye/pdms/pdm_28_eye_3D_closed.txt....Done
Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/ccnf_patches_1.00_synth_lid_.txt....Done
Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/ccnf_patches_1.50_synth_lid_.txt....Done
Could not find the HAAR face detector location
Done
Reading the landmark validation module....Done
Reading the AU analysis module from: ./bin/AU_predictors/main_dynamic_svms.txt
Reading the AU predictors from: ./bin/AU_predictors/AU_all_best.txt... Done
Reading the PDM from: ./bin/AU_predictors/In-the-wild_aligned_PDM_68.txt... Done
Reading the triangulation from:./bin/AU_predictors/tris_68_full.txt... Done
Attempting to read from file: ../samples/multi_face.avi

(FeatureExtraction:61957): GStreamer-CRITICAL **: 04:06:14.857: gst_query_set_position: assertion 'format == g_value_get_enum (gst_structure_id_get_value (s, GST_QUARK (FORMAT)))' failed
Device or file opened
Starting tracking
Reading the MTCNN face detector from: ./bin/model/mtcnn_detector/MTCNN_detector.txt
Reading the PNet module from: ./bin/model/mtcnn_detector/PNet.dat
Reading the RNet module from: ./bin/model/mtcnn_detector/RNet.dat
Reading the ONet module from: ./bin/model/mtcnn_detector/ONet.dat

(FeatureExtraction:61957): GStreamer-PBUtils-CRITICAL **: 04:06:15.344: gst_missing_encoder_message_new: assertion 'gst_caps_is_fixed (encode_caps)' failed

(FeatureExtraction:61957): GStreamer-CRITICAL **: 04:06:15.344: gst_element_post_message: assertion 'message != NULL' failed
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Closing output recorder
Closing input reader
Closed successfully
Postprocessing the Action Unit predictions

@linhcentrio
Copy link
Author

although log inform GStreamer-CRITICAL but still complete process:
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Closing output recorder
Closing input reader
Closed successfully

@linhcentrio
Copy link
Author

when i run:

GST_DEBUG=3 ./bin/FeatureExtraction -f ../samples/multi_face.avi -oc MPEG

i got:
(/home/SyncTalk/venv) [root@aiclip-dfl build]# GST_DEBUG=3 ./bin/FeatureExtraction -f ../samples/multi_face.avi -oc MPEG
Could not find the HAAR face detector location
Reading the landmark detector/tracker from: ./bin/model/main_ceclm_general.txt
Reading the landmark detector module from: ./bin/model/cen_general.txt
Reading the PDM module from: ./bin/model/pdms/In-the-wild_aligned_PDM_68.txt....Done
Reading the Triangulations module from: ./bin/model/tris_68.txt....Done
Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.25_of.dat....Done
Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.35_of.dat....Done
Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_0.50_of.dat....Done
Reading the intensity CEN patch experts from: ./bin/model/patch_experts/cen_patches_1.00_of.dat....Done
Reading part based module....left_eye_28
Reading the landmark detector/tracker from: ./bin/model/model_eye/main_clnf_synth_left.txt
Reading the landmark detector module from: ./bin/model/model_eye/clnf_left_synth.txt
Reading the PDM module from: ./bin/model/model_eye/pdms/pdm_28_l_eye_3D_closed.txt....Done
Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/left_ccnf_patches_1.00_synth_lid_.txt....Done
Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/left_ccnf_patches_1.50_synth_lid_.txt....Done
Could not find the HAAR face detector location
Done
Reading part based module....right_eye_28
Reading the landmark detector/tracker from: ./bin/model/model_eye/main_clnf_synth_right.txt
Reading the landmark detector module from: ./bin/model/model_eye/clnf_right_synth.txt
Reading the PDM module from: ./bin/model/model_eye/pdms/pdm_28_eye_3D_closed.txt....Done
Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/ccnf_patches_1.00_synth_lid_.txt....Done
Reading the intensity CCNF patch experts from: ./bin/model/model_eye/patch_experts/ccnf_patches_1.50_synth_lid_.txt....Done
Could not find the HAAR face detector location
Done
Reading the landmark validation module....Done
Reading the AU analysis module from: ./bin/AU_predictors/main_dynamic_svms.txt
Reading the AU predictors from: ./bin/AU_predictors/AU_all_best.txt... Done
Reading the PDM from: ./bin/AU_predictors/In-the-wild_aligned_PDM_68.txt... Done
Reading the triangulation from:./bin/AU_predictors/tris_68_full.txt... Done
Attempting to read from file: ../samples/multi_face.avi
0:00:00.022579105 62011 0xb8370b0 WARN basesrc gstbasesrc.c:3693:gst_base_src_start_complete: pad not activated yet
0:00:00.023060296 62011 0xb8370b0 WARN basesrc gstbasesrc.c:3693:gst_base_src_start_complete: pad not activated yet

(FeatureExtraction:62011): GStreamer-CRITICAL **: 04:10:26.709: gst_query_set_position: assertion 'format == g_value_get_enum (gst_structure_id_get_value (s, GST_QUARK (FORMAT)))' failed
Device or file opened
Starting tracking
Reading the MTCNN face detector from: ./bin/model/mtcnn_detector/MTCNN_detector.txt
Reading the PNet module from: ./bin/model/mtcnn_detector/PNet.dat
Reading the RNet module from: ./bin/model/mtcnn_detector/RNet.dat
Reading the ONet module from: ./bin/model/mtcnn_detector/ONet.dat
0:00:00.627616468 62011 0xb8370b0 ERROR GST_PIPELINE gst/parse/grammar.y:570:gst_parse_element_make: no element "processed"
0:00:00.627684367 62011 0xb8370b0 ERROR GST_PIPELINE gst/parse/grammar.y:1331:priv_gst_parse_yyparse: no source element for URI "/multi_face.avi"
0:00:00.638951027 62011 0x7fd8f80015c0 FIXME default gstutils.c:4031:gst_pad_create_stream_id_internal:appsrc0:src Creating random stream-id, consider implementing a deterministic way of creating a stream-id
0:00:00.639345912 62011 0x7fd8f80015c0 WARN GST_CAPS gstpad.c:3240:gst_pad_query_accept_caps_default:mpeg4vparse1:sink caps: video/x-raw, format=(string)BGR, width=(int)640, height=(int)480, framerate=(fraction)30/1 were not compatible with: video/mpeg, mpegversion=(int)4, systemstream=(boolean)false; video/x-divx, divxversion=(int)[ 4, 5 ]
0:00:00.639531790 62011 0x7fd8f80015c0 WARN GST_CAPS gstpad.c:3240:gst_pad_query_accept_caps_default:mpeg4vparse1:sink caps: video/x-raw, format=(string)BGR, width=(int)640, height=(int)480, framerate=(fraction)30/1 were not compatible with: video/mpeg, mpegversion=(int)4, systemstream=(boolean)false; video/x-divx, divxversion=(int)[ 4, 5 ]
0:00:00.639813792 62011 0x7fd8f80018d0 WARN GST_CAPS gstpad.c:3240:gst_pad_query_accept_caps_default:mpeg4vparse1:sink caps: video/x-raw, format=(string)BGR, width=(int)640, height=(int)480, framerate=(fraction)30/1 were not compatible with: video/mpeg, mpegversion=(int)4, systemstream=(boolean)false; video/x-divx, divxversion=(int)[ 4, 5 ]
0:00:00.717397984 62011 0x7fd8f80018d0 ERROR encodebasebin gstencodebasebin.c:1274:_post_missing_plugin_message: Couldn't create encoder with preset (NULL) and preset name (NULL) for format video/x-divx, divxversion=(int)4, framerate=(fraction)[ 0/1, 2147483647/1 ], width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ]

(FeatureExtraction:62011): GStreamer-PBUtils-CRITICAL **: 04:10:27.183: gst_missing_encoder_message_new: assertion 'gst_caps_is_fixed (encode_caps)' failed

(FeatureExtraction:62011): GStreamer-CRITICAL **: 04:10:27.183: gst_element_post_message: assertion 'message != NULL' failed
0:00:00.717637175 62011 0x7fd8f80018d0 WARN encodebasebin gstencodebasebin.c:1283:_post_missing_plugin_message: error: Couldn't create encoder for format video/x-divx, divxversion=(int)4, framerate=(fraction)[ 0/1, 2147483647/1 ], width=(int)[ 1, 2147483647 ], height=(int)[ 1, 2147483647 ]
0% 10% 20% 30% 40% 50% 60% 70% 80% 90% 100%
Closing output recorder
Closing input reader
Closed successfully
Postprocessing the Action Unit predictions

@linhcentrio
Copy link
Author

image
this is out put of openface

@brmarkus
Copy link

hmm, ok, so the application is working?

@linhcentrio
Copy link
Author

linhcentrio commented Sep 25, 2024

hmm, ok, so the application is working?

no i'm not sure, i need file au.csv and open with excel i see the content off it:
is this allright?
image

@brmarkus
Copy link

The table looks good.

Have a closer look into "https://github.com/TadasBaltrusaitis/OpenFace/wiki/Output-Format" to study the columns and values and meanings.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants