build xrdp v0.10.4.1 on ubuntu22.04 with error: RFX_FLAGS_PRO_KEY undeclared

[huganle]

system: ubuntu22.04
I followed https://github.com/neutrinolabs/xrdp/wiki#building-from-sources steps, but with errors as follow:

xrdp_encoder.c: In function ‘process_enc_rfx’:
xrdp_encoder.c:628:36: error: ‘RFX_FLAGS_PRO_KEY’ undeclared (first use in this function); did you mean ‘RFX_FLAGS_NONE’?
628 | encode_flags = RFX_FLAGS_PRO_KEY;
| ^~~~~~~~~~~~~~~~~
| RFX_FLAGS_NONE
xrdp_encoder.c:628:36: note: each undeclared identifier is reported only once for each function it appears in
xrdp_encoder.c: In function ‘gfx_wiretosurface2’:
xrdp_encoder.c:1116:35: error: ‘RFX_FLAGS_PRO1’ undeclared (first use in this function); did you mean ‘RFX_FLAGS_OPT1’?
1116 | RFX_FLAGS_RLGR1 | RFX_FLAGS_PRO1);
| ^~~~~~~~~~~~~~
| RFX_FLAGS_OPT1

[metalefty]

I don't think you followed the instructions. Could you please provide all of the exact commands you executed one by one?

[huganle]

Thank you very much for reponse, I paste all the command and output as follows.
And I suspect the micro 'RFX_FLAGS_PRO_KEY' may be in './librfxcodec/include/rfxcodec_common.h', but I can not find it.

sudo ./scripts/install_xrdp_build_dependencies_with_apt.sh max

• FEATURE_SET=min

• ARCH=amd64

• DEBUG_OPTS=

• [ 1 -ge 1 ]

• FEATURE_SET=max

• shift

• [ 0 -ge 1 ]

• APT_EXTRA_ARGS=

• PACKAGES= autoconf automake clang gcc g++ libtool make nasm pkg-config check libcmocka-dev

• lsb_release -si

• lsb_release -sr

• LIBFREETYPE_DEV=libfreetype-dev

• command -v systemctl

• systemctl --version

• set -- systemd 249 (249.11-0ubuntu3.17) +PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified

• [ 37 -gt 2 ]

• [ systemd = systemd ]

• [ 249 -ge 255 ]

• PACKAGES_AMD64_MIN= libpam0g-dev libssl-dev libx11-dev libxrandr-dev libxfixes-dev

• PACKAGES= autoconf automake clang gcc g++ libtool make nasm pkg-config check libcmocka-dev
  libpam0g-dev libssl-dev libx11-dev libxrandr-dev libxfixes-dev libfreetype-dev libfuse3-dev libjpeg-dev libmp3lame-dev libfdk-aac-dev libimlib2-dev libopus-dev libpixman-1-dev libx264-dev
  libopenh264-dev

• apt-get update
  Hit:1 https://mirrors.aliyun.com/ubuntu jammy InRelease
  Hit:2 https://mirrors.aliyun.com/ubuntu jammy-security InRelease
  Hit:3 https://mirrors.aliyun.com/ubuntu jammy-updates InRelease
  Hit:4 https://mirrors.aliyun.com/ubuntu jammy-backports InRelease
  Hit:5 https://packages.microsoft.com/repos/code stable InRelease
  Hit:6 https://dl.google.com/linux/chrome/deb stable InRelease
  Hit:7 http://archive.ubuntu.com/ubuntu focal InRelease
  Hit:8 https://download.sublimetext.com apt/stable/ InRelease
  Hit:9 https://ppa.launchpadcontent.net/graphics-drivers/ppa/ubuntu jammy InRelease
  Hit:10 https://esm.ubuntu.com/apps/ubuntu jammy-apps-security InRelease
  Hit:11 https://esm.ubuntu.com/apps/ubuntu jammy-apps-updates InRelease
  Hit:12 https://esm.ubuntu.com/infra/ubuntu jammy-infra-security InRelease
  Hit:13 https://esm.ubuntu.com/infra/ubuntu jammy-infra-updates InRelease
  Ign:14 https://www.scootersoftware.com bcompare4 InRelease
  Hit:15 https://linux.teamviewer.com/deb stable InRelease
  Hit:16 http://download.opensuse.org/repositories/home:/manuelschneid3r/xUbuntu_22.04 InRelease
  Hit:17 https://download.docker.com/linux/ubuntu jammy InRelease
  Hit:18 https://www.scootersoftware.com bcompare4 Release
  Get:20 https://nvidia.github.io/libnvidia-container/stable/deb/amd64 InRelease [1,477 B]
  Get:21 https://nvidia.github.io/libnvidia-container/stable/ubuntu18.04/amd64 InRelease [1,484 B]
  Fetched 2,961 B in 3s (1,048 B/s)
  Reading package lists... Done

• apt-get upgrade
  Reading package lists... Done
  Building dependency tree... Done
  Reading state information... Done
  Calculating upgrade... Done
  0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.

• apt-get -yq --no-install-suggests --no-install-recommends install autoconf automake clang gcc g++ libtool make nasm pkg-config check libcmocka-dev libpam0g-dev libssl-dev libx11-dev libxrandr-dev libxfixes-dev libfreetype-dev libfuse3-dev libjpeg-dev libmp3lame-dev libfdk-aac-dev libimlib2-dev libopus-dev libpixman-1-dev libx264-dev libopenh264-dev
  Reading package lists...
  Building dependency tree...
  Reading state information...
  autoconf is already the newest version (2.71-2).
  automake is already the newest version (1:1.16.5-1.3).
  g++ is already the newest version (4:11.2.0-1ubuntu1).
  gcc is already the newest version (4:11.2.0-1ubuntu1).
  libfuse3-dev is already the newest version (3.10.5-1build1).
  libjpeg-dev is already the newest version (8c-2ubuntu10).
  libmp3lame-dev is already the newest version (3.100-3build2).
  libopus-dev is already the newest version (1.3.1-0.1build2).
  libtool is already the newest version (2.4.6-15build2).
  libxfixes-dev is already the newest version (1:6.0.0-1).
  libxrandr-dev is already the newest version (2:1.5.2-1build1).
  make is already the newest version (4.3-4.1build1).
  pkg-config is already the newest version (0.29.2-1ubuntu3).
  check is already the newest version (0.15.2-2).
  clang is already the newest version (1:14.0-55~exp2).
  libcmocka-dev is already the newest version (1.1.5-2).
  libimlib2-dev is already the newest version (1.7.4-1build1).
  libopenh264-dev is already the newest version (2.2.0+dfsg-2).
  libx264-dev is already the newest version (2:0.163.3060+git5db6aa6-2build1).
  nasm is already the newest version (2.15.05-1).
  libfdk-aac-dev is already the newest version (2.0.2-1).
  libfreetype-dev is already the newest version (2.11.1+dfsg-1ubuntu0.3).
  libpam0g-dev is already the newest version (1.4.0-11ubuntu2.6).
  libpixman-1-dev is already the newest version (0.40.0-1ubuntu0.22.04.1).
  libssl-dev is already the newest version (3.0.2-0ubuntu1.20).
  libx11-dev is already the newest version (2:1.7.5-1ubuntu0.3).
  0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded.

./bootstrap
/usr/bin/autoconf
/usr/bin/automake
/usr/bin/libtoolize
/usr/bin/pkg-config
autoreconf: export WARNINGS=
autoreconf: Entering directory '.'
autoreconf: configure.ac: not using Gettext
autoreconf: running: aclocal --force -I m4
autoreconf: configure.ac: tracing
autoreconf: configure.ac: adding subdirectory libpainter to autoreconf
autoreconf: Entering directory 'libpainter'
autoreconf: configure.ac: not using Gettext
autoreconf: running: aclocal --force -I m4
autoreconf: configure.ac: tracing
autoreconf: running: libtoolize --copy --force
libtoolize: putting auxiliary files in '.'.
libtoolize: copying file './ltmain.sh'
libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'.
libtoolize: copying file 'm4/libtool.m4'
libtoolize: copying file 'm4/ltoptions.m4'
libtoolize: copying file 'm4/ltsugar.m4'
libtoolize: copying file 'm4/ltversion.m4'
libtoolize: copying file 'm4/ltobsolete.m4'
autoreconf: configure.ac: not using Intltool
autoreconf: configure.ac: not using Gtkdoc
autoreconf: running: aclocal --force -I m4
autoreconf: running: /usr/bin/autoconf --force
configure.ac:10: warning: The macro AC_PROG_LIBTOOL' is obsolete. configure.ac:10: You should run autoupdate. m4/libtool.m4:99: AC_PROG_LIBTOOL is expanded from... configure.ac:10: the top level autoreconf: running: /usr/bin/autoheader --force autoreconf: running: automake --add-missing --copy --force-missing configure.ac:8: installing './compile' configure.ac:6: installing './missing' src/Makefile.am: installing './depcomp' autoreconf: Leaving directory 'libpainter' autoreconf: configure.ac: adding subdirectory librfxcodec to autoreconf autoreconf: Entering directory 'librfxcodec' autoreconf: configure.ac: not using Gettext autoreconf: running: aclocal --force -I m4 autoreconf: configure.ac: tracing autoreconf: running: libtoolize --copy --force libtoolize: putting auxiliary files in '.'. libtoolize: copying file './ltmain.sh' libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. libtoolize: copying file 'm4/libtool.m4' libtoolize: copying file 'm4/ltoptions.m4' libtoolize: copying file 'm4/ltsugar.m4' libtoolize: copying file 'm4/ltversion.m4' libtoolize: copying file 'm4/lt~obsolete.m4' autoreconf: configure.ac: not using Intltool autoreconf: configure.ac: not using Gtkdoc autoreconf: running: aclocal --force -I m4 autoreconf: running: /usr/bin/autoconf --force configure.ac:11: warning: The macro AC_PROG_LIBTOOL' is obsolete.
configure.ac:11: You should run autoupdate.
m4/libtool.m4:99: AC_PROG_LIBTOOL is expanded from...
configure.ac:11: the top level
configure.ac:19: warning: The macro AC_HELP_STRING' is obsolete. configure.ac:19: You should run autoupdate. ./lib/autoconf/general.m4:204: AC_HELP_STRING is expanded from... configure.ac:19: the top level configure.ac:26: warning: The macro AC_FD_CC' is obsolete.
configure.ac:26: You should run autoupdate.
./lib/autoconf/general.m4:399: AC_FD_CC is expanded from...
m4/nasm.m4:4: AC_PROG_NASM is expanded from...
configure.ac:26: the top level
configure.ac:32: warning: The macro `AC_FD_CC' is obsolete.
configure.ac:32: You should run autoupdate.
./lib/autoconf/general.m4:399: AC_FD_CC is expanded from...
m4/nasm.m4:4: AC_PROG_NASM is expanded from...
configure.ac:32: the top level
autoreconf: running: /usr/bin/autoheader --force
autoreconf: running: automake --add-missing --copy --force-missing
configure.ac:9: installing './compile'
configure.ac:6: installing './missing'
src/Makefile.am: installing './depcomp'
autoreconf: Leaving directory 'librfxcodec'
autoreconf: running: libtoolize --copy --force
libtoolize: putting auxiliary files in '.'.
libtoolize: copying file './ltmain.sh'
libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'.
libtoolize: copying file 'm4/libtool.m4'
libtoolize: copying file 'm4/ltoptions.m4'
libtoolize: copying file 'm4/ltsugar.m4'
libtoolize: copying file 'm4/ltversion.m4'
libtoolize: copying file 'm4/ltobsolete.m4'
autoreconf: configure.ac: not using Intltool
autoreconf: configure.ac: not using Gtkdoc
autoreconf: running: aclocal --force -I m4
autoreconf: running: /usr/bin/autoconf --force
autoreconf: running: /usr/bin/autoheader --force
autoreconf: running: automake --add-missing --copy --force-missing
configure.ac:9: installing './compile'
configure.ac:7: installing './missing'
common/Makefile.am: installing './depcomp'
autoreconf: Leaving directory '.'

./configure --with-systemdsystemunitdir=/usr/lib/systemd/system
--enable-ibus --enable-ipv6 --enable-jpeg --enable-fuse --enable-mp3lame
--enable-fdkaac --enable-opus --enable-rfxcodec --enable-painter
--enable-pixman --enable-utmp -with-imlib2 --with-freetype2
--enable-tests --enable-x264 --enable-openh264 --enable-vsock
checking for a BSD-compatible install... /usr/bin/install -c
checking whether build environment is sane... yes
checking for a race-free mkdir -p... /usr/bin/mkdir -p
checking for gawk... gawk
checking whether make sets $(MAKE)... yes
checking whether make supports nested variables... yes
checking whether make supports the include directive... yes (GNU style)
checking for gcc... gcc
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables...
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether the compiler supports GNU C... yes
checking whether gcc accepts -g... yes
checking for gcc option to enable C11 features... none needed
checking whether gcc understands -c and -o together... yes
checking dependency style of gcc... gcc3
checking for stdio.h... yes
checking for stdlib.h... yes
checking for string.h... yes
checking for inttypes.h... yes
checking for stdint.h... yes
checking for strings.h... yes
checking for sys/stat.h... yes
checking for sys/types.h... yes
checking for unistd.h... yes
checking for wchar.h... yes
checking for minix/config.h... no
checking whether it is safe to define EXTENSIONS... yes
checking whether XOPEN_SOURCE should be defined... no
checking for gcc... (cached) gcc
checking whether the compiler supports GNU C... (cached) yes
checking whether gcc accepts -g... (cached) yes
checking for gcc option to enable C11 features... (cached) none needed
checking whether gcc understands -c and -o together... (cached) yes
checking dependency style of gcc... (cached) gcc3
checking for g++... g++
checking whether the compiler supports GNU C++... yes
checking whether g++ accepts -g... yes
checking for g++ option to enable C++11 features... none needed
checking dependency style of g++... gcc3
checking whether ln -s works... yes
checking for an ANSI C-conforming const... yes
checking build system type... x86_64-pc-linux-gnu
checking host system type... x86_64-pc-linux-gnu
checking how to print strings... printf
checking for a sed that does not truncate output... /usr/bin/sed
checking for grep that handles long lines and -e... /usr/bin/grep
checking for egrep... /usr/bin/grep -E
checking for fgrep... /usr/bin/grep -F
checking for ld used by gcc... /usr/bin/ld
checking if the linker (/usr/bin/ld) is GNU ld... yes
checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B
checking the name lister (/usr/bin/nm -B) interface... BSD nm
checking the maximum length of command line arguments... 1572864
checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop
checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop
checking for /usr/bin/ld option to reload object files... -r
checking for objdump... objdump
checking how to recognize dependent libraries... pass_all
checking for dlltool... no
checking how to associate runtime and link libraries... printf %s\n
checking for ar... ar
checking for archiver @file support... @
checking for strip... strip
checking for ranlib... ranlib
checking command to parse /usr/bin/nm -B output from gcc object... ok
checking for sysroot... no
checking for a working dd... /usr/bin/dd
checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1
checking for mt... mt
checking if mt is a manifest tool... no
checking for dlfcn.h... yes
checking for objdir... .libs
checking if gcc supports -fno-rtti -fno-exceptions... no
checking for gcc option to produce PIC... -fPIC -DPIC
checking if gcc PIC flag -fPIC -DPIC works... yes
checking if gcc static flag -static works... yes
checking if gcc supports -c -o file.o... yes
checking if gcc supports -c -o file.o... (cached) yes
checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes
checking whether -lc should be explicitly linked in... no
checking dynamic linker characteristics... GNU/Linux ld.so
checking how to hardcode library paths into programs... immediate
checking whether stripping libraries is possible... yes
checking if libtool supports shared libraries... yes
checking whether to build shared libraries... yes
checking whether to build static libraries... yes
checking how to run the C++ preprocessor... g++ -E
checking for ld used by g++... /usr/bin/ld -m elf_x86_64
checking if the linker (/usr/bin/ld -m elf_x86_64) is GNU ld... yes
checking whether the g++ linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes
checking for g++ option to produce PIC... -fPIC -DPIC
checking if g++ PIC flag -fPIC -DPIC works... yes
checking if g++ static flag -static works... yes
checking if g++ supports -c -o file.o... yes
checking if g++ supports -c -o file.o... (cached) yes
checking whether the g++ linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes
checking dynamic linker characteristics... (cached) GNU/Linux ld.so
checking how to hardcode library paths into programs... immediate
checking for pkg-config... /usr/bin/pkg-config
checking pkg-config is at least version 0.9.0... yes
checking whether make supports nested variables... (cached) yes
checking size of int... 4
checking size of long... 8
checking size of void *... 8
checking for attribute((format))... yes
checking for socklen_t... yes
checking CFLAGS for maximum warnings... -Wall
checking whether C compiler accepts -Wwrite-strings... yes
checking whether C compiler accepts -Werror... yes
checking whether C compiler accepts -O2... yes
checking for library containing setusercontext... no
checking for setusercontext... no
checking for getgrouplist... yes
checking for clearenv... yes
checking how to run the C preprocessor... gcc -E
checking for uid_t in sys/types.h... yes
checking type of array argument to getgroups... gid_t
checking for dlopen... yes
checking for OPENSSL... yes
checking for openssl... /usr/bin/openssl
checking for security/pam_types.h... yes
checking for security/pam_constants.h... no
checking for IMLIB2... yes
checking for FREETYPE2... yes
checking for security/pam_appl.h... yes
checking for linux/socket.h... yes
checking for linux/vm_sockets.h... yes
checking for jpeglib.h... yes
checking for FUSE... yes
checking for FDKAAC... yes
checking for opus/opus.h... yes
checking for lame/lame.h... yes
checking for PIXMAN... yes
checking for XRDP_X264... yes
checking for XRDP_OPENH264... yes
checking for X... libraries , headers
checking for gethostbyname... yes
checking for connect... yes
checking for remove... yes
checking for shmat... yes
checking for IceConnectionNumber in -lICE... yes
checking for X11/extensions/Xfixes.h... yes
checking for X11/extensions/Xrandr.h... yes
checking for utmp.h... yes
checking for utmpx.h... yes
checking for ut_host in struct utmpx... yes
checking for ut_exit in struct utmpx... yes
checking for CHECK... yes
checking for CMOCKA... yes
configure: libcheck found, unit tests will be performed
checking for sys/prctl.h... yes
checking for uchar.h... yes
checking that generated files are newer than configure... done
configure: creating ./config.status
config.status: creating common/Makefile
config.status: creating docs/Makefile
config.status: creating docs/man/Makefile
config.status: creating fontutils/Makefile
config.status: creating genkeymap/Makefile
config.status: creating instfiles/default/Makefile
config.status: creating instfiles/init.d/Makefile
config.status: creating instfiles/Makefile
config.status: creating instfiles/pam.d/Makefile
config.status: creating instfiles/pulse/Makefile
config.status: creating instfiles/rc.d/Makefile
config.status: creating keygen/Makefile
config.status: creating waitforx/Makefile
config.status: creating libipm/Makefile
config.status: creating libxrdp/Makefile
config.status: creating Makefile
config.status: creating mc/Makefile
config.status: creating neutrinordp/Makefile
config.status: creating ulalaca/Makefile
config.status: creating pkgconfig/Makefile
config.status: creating pkgconfig/xrdp.pc
config.status: creating pkgconfig/xrdp-uninstalled.pc
config.status: creating sesman/libsesman/Makefile
config.status: creating sesman/chansrv/Makefile
config.status: creating sesman/Makefile
config.status: creating sesman/sesexec/Makefile
config.status: creating sesman/tools/Makefile
config.status: creating tests/Makefile
config.status: creating tests/common/Makefile
config.status: creating tests/libipm/Makefile
config.status: creating tests/libxrdp/Makefile
config.status: creating tests/memtest/Makefile
config.status: creating tests/xrdp/Makefile
config.status: creating tools/Makefile
config.status: creating tools/devel/Makefile
config.status: creating tools/devel/tcp_proxy/Makefile
config.status: creating tools/chkpriv/Makefile
config.status: creating vnc/Makefile
config.status: creating xrdpapi/Makefile
config.status: creating xrdp/Makefile
config.status: creating xrdpvr/Makefile
config.status: creating xup/Makefile
config.status: creating third_party/Makefile
config.status: creating third_party/tomlc99/Makefile
config.status: creating config_ac.h
config.status: config_ac.h is unchanged
config.status: executing depfiles commands
config.status: executing libtool commands
=== configuring in libpainter (/mnt/data/git/xrdp/libpainter)
configure: running /bin/bash ./configure --disable-option-checking '--prefix=/usr/local' '--with-systemdsystemunitdir=/usr/lib/systemd/system' '--enable-ibus' '--enable-ipv6' '--enable-jpeg' '--enable-fuse' '--enable-mp3lame' '--enable-fdkaac' '--enable-opus' '--enable-rfxcodec' '--enable-painter' '--enable-pixman' '--enable-utmp' '-with-imlib2' '--with-freetype2' '--enable-tests' '--enable-x264' '--enable-openh264' '--enable-vsock' --cache-file=/dev/null --srcdir=.
checking for a BSD-compatible install... /usr/bin/install -c
checking whether build environment is sane... yes
checking for a race-free mkdir -p... /usr/bin/mkdir -p
checking for gawk... gawk
checking whether make sets $(MAKE)... yes
checking whether make supports nested variables... yes
checking for gcc... gcc
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables...
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether the compiler supports GNU C... yes
checking whether gcc accepts -g... yes
checking for gcc option to enable C11 features... none needed
checking whether gcc understands -c and -o together... yes
checking whether make supports the include directive... yes (GNU style)
checking dependency style of gcc... gcc3
checking for an ANSI C-conforming const... yes
checking build system type... x86_64-pc-linux-gnu
checking host system type... x86_64-pc-linux-gnu
checking how to print strings... printf
checking for a sed that does not truncate output... /usr/bin/sed
checking for grep that handles long lines and -e... /usr/bin/grep
checking for egrep... /usr/bin/grep -E
checking for fgrep... /usr/bin/grep -F
checking for ld used by gcc... /usr/bin/ld
checking if the linker (/usr/bin/ld) is GNU ld... yes
checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B
checking the name lister (/usr/bin/nm -B) interface... BSD nm
checking whether ln -s works... yes
checking the maximum length of command line arguments... 1572864
checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop
checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop
checking for /usr/bin/ld option to reload object files... -r
checking for objdump... objdump
checking how to recognize dependent libraries... pass_all
checking for dlltool... no
checking how to associate runtime and link libraries... printf %s\n
checking for ar... ar
checking for archiver @file support... @
checking for strip... strip
checking for ranlib... ranlib
checking command to parse /usr/bin/nm -B output from gcc object... ok
checking for sysroot... no
checking for a working dd... /usr/bin/dd
checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1
checking for mt... mt
checking if mt is a manifest tool... no
checking for stdio.h... yes
checking for stdlib.h... yes
checking for string.h... yes
checking for inttypes.h... yes
checking for stdint.h... yes
checking for strings.h... yes
checking for sys/stat.h... yes
checking for sys/types.h... yes
checking for unistd.h... yes
checking for dlfcn.h... yes
checking for objdir... .libs
checking if gcc supports -fno-rtti -fno-exceptions... no
checking for gcc option to produce PIC... -fPIC -DPIC
checking if gcc PIC flag -fPIC -DPIC works... yes
checking if gcc static flag -static works... yes
checking if gcc supports -c -o file.o... yes
checking if gcc supports -c -o file.o... (cached) yes
checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes
checking whether -lc should be explicitly linked in... no
checking dynamic linker characteristics... GNU/Linux ld.so
checking how to hardcode library paths into programs... immediate
checking whether stripping libraries is possible... yes
checking if libtool supports shared libraries... yes
checking whether to build shared libraries... yes
checking whether to build static libraries... yes
checking whether make supports nested variables... (cached) yes
checking CFLAGS for maximum warnings... -Wall
checking whether C compiler accepts -Wwrite-strings... yes
checking that generated files are newer than configure... done
configure: creating ./config.status
config.status: creating Makefile
config.status: creating include/Makefile
config.status: creating pkgconfig/libpainter.pc
config.status: creating pkgconfig/libpainter-uninstalled.pc
config.status: creating pkgconfig/Makefile
config.status: creating src/Makefile
config.status: creating tests/Makefile
config.status: creating config_ac.h
config.status: config_ac.h is unchanged
config.status: executing depfiles commands
config.status: executing libtool commands
=== configuring in librfxcodec (/mnt/data/git/xrdp/librfxcodec)
configure: running /bin/bash ./configure --disable-option-checking '--prefix=/usr/local' '--with-systemdsystemunitdir=/usr/lib/systemd/system' '--enable-ibus' '--enable-ipv6' '--enable-jpeg' '--enable-fuse' '--enable-mp3lame' '--enable-fdkaac' '--enable-opus' '--enable-rfxcodec' '--enable-painter' '--enable-pixman' '--enable-utmp' '-with-imlib2' '--with-freetype2' '--enable-tests' '--enable-x264' '--enable-openh264' '--enable-vsock' --cache-file=/dev/null --srcdir=.
checking for a BSD-compatible install... /usr/bin/install -c
checking whether build environment is sane... yes
checking for a race-free mkdir -p... /usr/bin/mkdir -p
checking for gawk... gawk
checking whether make sets $(MAKE)... yes
checking whether make supports nested variables... yes
checking whether make supports nested variables... (cached) yes
checking for gcc... gcc
checking whether the C compiler works... yes
checking for C compiler default output file name... a.out
checking for suffix of executables...
checking whether we are cross compiling... no
checking for suffix of object files... o
checking whether the compiler supports GNU C... yes
checking whether gcc accepts -g... yes
checking for gcc option to enable C11 features... none needed
checking whether gcc understands -c and -o together... yes
checking whether make supports the include directive... yes (GNU style)
checking dependency style of gcc... gcc3
checking for an ANSI C-conforming const... yes
checking build system type... x86_64-pc-linux-gnu
checking host system type... x86_64-pc-linux-gnu
checking how to print strings... printf
checking for a sed that does not truncate output... /usr/bin/sed
checking for grep that handles long lines and -e... /usr/bin/grep
checking for egrep... /usr/bin/grep -E
checking for fgrep... /usr/bin/grep -F
checking for ld used by gcc... /usr/bin/ld
checking if the linker (/usr/bin/ld) is GNU ld... yes
checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B
checking the name lister (/usr/bin/nm -B) interface... BSD nm
checking whether ln -s works... yes
checking the maximum length of command line arguments... 1572864
checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop
checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop
checking for /usr/bin/ld option to reload object files... -r
checking for objdump... objdump
checking how to recognize dependent libraries... pass_all
checking for dlltool... no
checking how to associate runtime and link libraries... printf %s\n
checking for ar... ar
checking for archiver @file support... @
checking for strip... strip
checking for ranlib... ranlib
checking command to parse /usr/bin/nm -B output from gcc object... ok
checking for sysroot... no
checking for a working dd... /usr/bin/dd
checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1
checking for mt... mt
checking if mt is a manifest tool... no
checking for stdio.h... yes
checking for stdlib.h... yes
checking for string.h... yes
checking for inttypes.h... yes
checking for stdint.h... yes
checking for strings.h... yes
checking for sys/stat.h... yes
checking for sys/types.h... yes
checking for unistd.h... yes
checking for dlfcn.h... yes
checking for objdir... .libs
checking if gcc supports -fno-rtti -fno-exceptions... no
checking for gcc option to produce PIC... -fPIC -DPIC
checking if gcc PIC flag -fPIC -DPIC works... yes
checking if gcc static flag -static works... yes
checking if gcc supports -c -o file.o... yes
checking if gcc supports -c -o file.o... (cached) yes
checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes
checking whether -lc should be explicitly linked in... no
checking dynamic linker characteristics... GNU/Linux ld.so
checking how to hardcode library paths into programs... immediate
checking whether stripping libraries is possible... yes
checking if libtool supports shared libraries... yes
checking whether to build shared libraries... yes
checking whether to build static libraries... yes
checking CFLAGS for maximum warnings... -Wall
checking whether C compiler accepts -Wwrite-strings... yes
checking if we have SIMD optimisations for cpu type... yes (x86_64)
checking for nasm... nasm
checking for object file format of host system... ELF64
checking for object file format specifier (NAFLAGS) ... -felf64 -DELF -D__x86_64
checking whether the assembler (nasm -felf64 -DELF -D__x86_64__) works... yes
checking whether the linker accepts assembler output... yes
checking that generated files are newer than configure... done
configure: creating ./config.status
config.status: creating Makefile
config.status: creating include/Makefile
config.status: creating src/Makefile
config.status: creating src/amd64/Makefile
config.status: creating src/x86/Makefile
config.status: creating tests/Makefile
config.status: creating rfxcodec.pc
config.status: creating rfxcodec-uninstalled.pc
config.status: creating config_ac.h
config.status: config_ac.h is unchanged
config.status: executing depfiles commands
config.status: executing libtool commands

xrdp will be compiled with:

mp3lame yes
opus yes
fdkaac yes
jpeg yes
turbo jpeg no
rfxcodec yes
x264 yes
openh264 yes
painter yes
pixman yes
fuse yes
ipv6 yes
ipv6only no
vsock yes
auth mechanism PAM
rdpsndaudin no
utmp support yes
utmpx.ut_host yes
utmpx.ut_exit yes
systemd support yes
unit file directory /usr/lib/systemd/system

with imlib2 yes
with freetype2 yes

development logging no
development streamcheck no

strict_locations no
prefix /usr/local
exec_prefix ${prefix}
libdir ${exec_prefix}/lib
bindir ${exec_prefix}/bin
sysconfdir /etc
sysconfdir+subdir /etc/xrdp
pamconfdir /etc/pam.d
localstatedir /var
runstatedir ${localstatedir}/run
socketdir ${localstatedir}/run/xrdp

unit tests performable yes

CFLAGS = -g -O2 -Wall -Wwrite-strings -Werror
LDFLAGS =

make
make all-recursive
make[1]: Entering directory '/mnt/data/git/xrdp'
Making all in third_party
make[2]: Entering directory '/mnt/data/git/xrdp/third_party'
make[2]: Nothing to be done for 'all'.
make[2]: Leaving directory '/mnt/data/git/xrdp/third_party'
Making all in third_party/tomlc99
make[2]: Entering directory '/mnt/data/git/xrdp/third_party/tomlc99'
make[2]: Nothing to be done for 'all'.
make[2]: Leaving directory '/mnt/data/git/xrdp/third_party/tomlc99'
Making all in common
make[2]: Entering directory '/mnt/data/git/xrdp/common'
make[2]: Nothing to be done for 'all'.
make[2]: Leaving directory '/mnt/data/git/xrdp/common'
Making all in vnc
make[2]: Entering directory '/mnt/data/git/xrdp/vnc'
make[2]: Nothing to be done for 'all'.
make[2]: Leaving directory '/mnt/data/git/xrdp/vnc'
Making all in xup
make[2]: Entering directory '/mnt/data/git/xrdp/xup'
make[2]: Nothing to be done for 'all'.
make[2]: Leaving directory '/mnt/data/git/xrdp/xup'
Making all in mc
make[2]: Entering directory '/mnt/data/git/xrdp/mc'
make[2]: Nothing to be done for 'all'.
make[2]: Leaving directory '/mnt/data/git/xrdp/mc'
Making all in libipm
make[2]: Entering directory '/mnt/data/git/xrdp/libipm'
make[2]: Nothing to be done for 'all'.
make[2]: Leaving directory '/mnt/data/git/xrdp/libipm'
Making all in libxrdp
make[2]: Entering directory '/mnt/data/git/xrdp/libxrdp'
make[2]: Nothing to be done for 'all'.
make[2]: Leaving directory '/mnt/data/git/xrdp/libxrdp'
Making all in libpainter
make[2]: Entering directory '/mnt/data/git/xrdp/libpainter'
make all-recursive
make[3]: Entering directory '/mnt/data/git/xrdp/libpainter'
Making all in src
make[4]: Entering directory '/mnt/data/git/xrdp/libpainter/src'
make[4]: Nothing to be done for 'all'.
make[4]: Leaving directory '/mnt/data/git/xrdp/libpainter/src'
Making all in include
make[4]: Entering directory '/mnt/data/git/xrdp/libpainter/include'
make[4]: Nothing to be done for 'all'.
make[4]: Leaving directory '/mnt/data/git/xrdp/libpainter/include'
Making all in pkgconfig
make[4]: Entering directory '/mnt/data/git/xrdp/libpainter/pkgconfig'
make[4]: Nothing to be done for 'all'.
make[4]: Leaving directory '/mnt/data/git/xrdp/libpainter/pkgconfig'
Making all in tests
make[4]: Entering directory '/mnt/data/git/xrdp/libpainter/tests'
make[4]: Nothing to be done for 'all'.
make[4]: Leaving directory '/mnt/data/git/xrdp/libpainter/tests'
make[4]: Entering directory '/mnt/data/git/xrdp/libpainter'
make[4]: Leaving directory '/mnt/data/git/xrdp/libpainter'
make[3]: Leaving directory '/mnt/data/git/xrdp/libpainter'
make[2]: Leaving directory '/mnt/data/git/xrdp/libpainter'
Making all in librfxcodec
make[2]: Entering directory '/mnt/data/git/xrdp/librfxcodec'
make all-recursive
make[3]: Entering directory '/mnt/data/git/xrdp/librfxcodec'
Making all in include
make[4]: Entering directory '/mnt/data/git/xrdp/librfxcodec/include'
make[4]: Nothing to be done for 'all'.
make[4]: Leaving directory '/mnt/data/git/xrdp/librfxcodec/include'
Making all in src
make[4]: Entering directory '/mnt/data/git/xrdp/librfxcodec/src'
Making all in amd64
make[5]: Entering directory '/mnt/data/git/xrdp/librfxcodec/src/amd64'
make[5]: Nothing to be done for 'all'.
make[5]: Leaving directory '/mnt/data/git/xrdp/librfxcodec/src/amd64'
make[5]: Entering directory '/mnt/data/git/xrdp/librfxcodec/src'
make[5]: Nothing to be done for 'all-am'.
make[5]: Leaving directory '/mnt/data/git/xrdp/librfxcodec/src'
make[4]: Leaving directory '/mnt/data/git/xrdp/librfxcodec/src'
Making all in tests
make[4]: Entering directory '/mnt/data/git/xrdp/librfxcodec/tests'
make[4]: Nothing to be done for 'all'.
make[4]: Leaving directory '/mnt/data/git/xrdp/librfxcodec/tests'
make[4]: Entering directory '/mnt/data/git/xrdp/librfxcodec'
make[4]: Leaving directory '/mnt/data/git/xrdp/librfxcodec'
make[3]: Leaving directory '/mnt/data/git/xrdp/librfxcodec'
make[2]: Leaving directory '/mnt/data/git/xrdp/librfxcodec'
Making all in sesman
make[2]: Entering directory '/mnt/data/git/xrdp/sesman'
Making all in libsesman
make[3]: Entering directory '/mnt/data/git/xrdp/sesman/libsesman'
make[3]: Nothing to be done for 'all'.
make[3]: Leaving directory '/mnt/data/git/xrdp/sesman/libsesman'
Making all in sesexec
make[3]: Entering directory '/mnt/data/git/xrdp/sesman/sesexec'
make[3]: Nothing to be done for 'all'.
make[3]: Leaving directory '/mnt/data/git/xrdp/sesman/sesexec'
Making all in tools
make[3]: Entering directory '/mnt/data/git/xrdp/sesman/tools'
make[3]: Nothing to be done for 'all'.
make[3]: Leaving directory '/mnt/data/git/xrdp/sesman/tools'
Making all in chansrv
make[3]: Entering directory '/mnt/data/git/xrdp/sesman/chansrv'
make[3]: Nothing to be done for 'all'.
make[3]: Leaving directory '/mnt/data/git/xrdp/sesman/chansrv'
make[3]: Entering directory '/mnt/data/git/xrdp/sesman'
CC sesman.o

CCLD xrdp-sesman
make[3]: Leaving directory '/mnt/data/git/xrdp/sesman'
make[2]: Leaving directory '/mnt/data/git/xrdp/sesman'
Making all in xrdp
make[2]: Entering directory '/mnt/data/git/xrdp/xrdp'
CC xrdp.o
CC xrdp_encoder.o
xrdp_encoder.c: In function ‘process_enc_rfx’:
xrdp_encoder.c:628:36: error: ‘RFX_FLAGS_PRO_KEY’ undeclared (first use in this function); did you mean ‘RFX_FLAGS_NONE’?
628 | encode_flags = RFX_FLAGS_PRO_KEY;
| ^~~~~~~~~~~~~~~~~
| RFX_FLAGS_NONE
xrdp_encoder.c:628:36: note: each undeclared identifier is reported only once for each function it appears in
xrdp_encoder.c: In function ‘gfx_wiretosurface2’:
xrdp_encoder.c:1116:35: error: ‘RFX_FLAGS_PRO1’ undeclared (first use in this function); did you mean ‘RFX_FLAGS_OPT1’?
1116 | RFX_FLAGS_RLGR1 | RFX_FLAGS_PRO1);
| ^~~~~~~~~~~~~~
| RFX_FLAGS_OPT1
make[2]: *** [Makefile:647: xrdp_encoder.o] Error 1
make[2]: Leaving directory '/mnt/data/git/xrdp/xrdp'
make[1]: *** [Makefile:509: all-recursive] Error 1
make[1]: Leaving directory '/mnt/data/git/xrdp'
make: *** [Makefile:441: all] Error 2

[metalefty]

How did you get the source? Provide the command you executed again, please.

[huganle]

I clone the code again and work now, Thank you very much.