Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

controller spawner error/ur_hardware_interface died #370

Closed
UmutUz opened this issue May 11, 2021 · 42 comments
Closed

controller spawner error/ur_hardware_interface died #370

UmutUz opened this issue May 11, 2021 · 42 comments
Labels
close if no update Solution proposed A solution has been proposed inside the issue. Waiting for user feedback.

Comments

@UmutUz
Copy link

UmutUz commented May 11, 2021

For a few days now, I have been getting the same problem over and over.

transport error completing service call: unable to receive data from sender, check sender's logs for details
[INFO] [1620732549.081360]: Shutting down spawner. Stopping and unloading controllers...
[INFO] [1620732549.082243]: Stopping all controllers...
[WARN] [1620732549.083736]: Controller Spawner error while taking down controllers: unable to connect to service: [Errno 111] Connection refused

Controller Spawner error while taking down controllers: unable to connect to service: [Errno 111] Connection refused

REQUIRED process [ur10_right/ur_hardware_interface_right-3] has died! ......

Usually, I would enter my command roslaunch ur_robot_driver ur10_bringup.launch [reverse_port:=REVERSE_PORT] and both my UR10 robots would start with no problem.

Now, it's hit or miss. More often than not, the controllers crash and I get the text on top.

Looking around, I should either 1)update all my ROS packages 2)rebuild my workspace 3)both.

I did both (in fact, I did the rebuild part a lot the last few weeks) and my assumption would be that updating caused these problems. Before I updated all my packages it was working fine. This is the command I ran to update and upgrade
sudo apt update && sudo apt upgrade

I am on Ubuntu 18.04 and ROS Melodic. I did google and tried again the stuff mentioned above. I don't know why it's still hit or miss(more often miss than hit sadly)

@ChangcongWang
Copy link

ChangcongWang commented May 11, 2021

I meet the same problem too. Two days ago, I can successfully start my ur5, but it didn't work since yesterday. I did the rebuild too, but it didn't work. I am on Ubuntu 18.04 and ROS Melodic too. But sometime I can successfully connect, the probability is almost 5%. If this problem happen to most of computer suddenly, I guess it may cause by update of some package. I hope anyone can solve this problem, because my work should be finish in 3 days.

Btw, I can successfully connect to the ur5 by ur_bringup everytime(Trough it isn't support Melodic? ), but I found the tf tree is broken, so I think it isn't a good way to solve this problem.

@fmauch
Copy link
Collaborator

fmauch commented May 12, 2021

Uh, that sounds interesting!

We did indeed a change in the library regarding tcp_server implementation.

For this to fully understand, I would kindly ask you to help us debugging this:

  • Please post the full output of roslaunch ur_robot_driver ur10_bringup.launch [reverse_port:=REVERSE_PORT] (with just one robot)
  • You can try getting it to run with the commit before that merge (this will require an all-src build with the library):
    • uninstall the ur_client_library -> sudo apt remove ros-melodic-ur-client-library (it seems to shadow a source version of the library in some cases, otherwise)
    • In case you used catkin_make to build your workspace, delete the build, devel, (install, if present) folders of your workspace
    • Clone the library repository into your workspace's src folder (git clone -b boost https://github.com/UniversalRobots/Universal_Robots_Client_Library.git src/Universal_Robots_Client_Library)
    • build your workspace using either catkin_make_isolated or catkin build (see https://github.com/UniversalRobots/Universal_Robots_ROS_Driver#alternative-all-source-build)
    • If this gives the same connection results, try to go to this commit (roscd ur_client_library && git checkout e66b7b01cef268c7361f0d8be27b151d9c5e28e1), build your workspace and check again. If this resolves your problem, we'll have to find out what is going wrong.

@UmutUz
Copy link
Author

UmutUz commented May 12, 2021

Hey, thanks for your answer.

But I can't do these right now because I have no access to the robots until monday, so I will have to try these next week. I hope this isn't an issue.

I might look into my update logs what exactly was updated, maybe this might help narrowing it down.

@fmauch
Copy link
Collaborator

fmauch commented May 12, 2021

I might look into my update logs what exactly was updated, maybe this might help narrowing it down.

oh yeah, the client-library hasn't been synced to the main ROS repository, yet, so that's probably not the source of these problems. (Given that you don't build the library from source inside your workspace, already).

@UmutUz
Copy link
Author

UmutUz commented May 12, 2021

SO my update log from the 5th of may:

2021-05-05 22:57:25 status installed ros-melodic-geometry-msgs:amd64 1.12.8-1bionic.20210414.210949
2021-05-05 22:57:25 status installed ros-melodic-gazebo-video-monitor-msgs:amd64 0.6.0-2bionic.20210414.212200
2021-05-05 22:57:25 status installed ros-melodic-rosbuild:amd64 1.14.9-1bionic.20210414.174822
2021-05-05 22:57:25 status installed ros-melodic-actionlib-msgs:amd64 1.12.8-1bionic.20210414.211208
2021-05-05 22:57:25 status installed systemd-sysv:amd64 237-3ubuntu10.46
2021-05-05 22:57:25 status installed ros-melodic-bond:amd64 1.8.5-1bionic.20210414.211232
2021-05-05 22:57:25 status installed ros-melodic-diagnostic-msgs:amd64 1.12.8-1bionic.20210414.212106
2021-05-05 22:57:26 status installed python3-click:all 6.7-3
2021-05-05 22:57:26 status installed ros-melodic-shape-msgs:amd64 1.12.8-1bionic.20210414.211625
2021-05-05 22:57:26 status installed ros-melodic-smach-msgs:amd64 2.0.1-0bionic.20210414.211005
2021-05-05 22:57:26 status installed ros-melodic-trajectory-msgs:amd64 1.12.8-1bionic.20210414.211631
2021-05-05 22:57:26 status installed ros-melodic-rosgraph-msgs:amd64 1.11.2-0bionic.20210414.212459
2021-05-05 22:57:26 status installed ros-melodic-rosconsole:amd64 1.13.18-1bionic.20210414.210611
2021-05-05 22:57:26 status installed ubuntu-release-upgrader-core:all 1:18.04.44
2021-05-05 22:57:26 status installed python-rospkg:all 1.3.0-100
2021-05-05 22:57:27 status installed ubuntu-drivers-common:amd64 1:0.8.6.3~0.18.04.1
2021-05-05 22:57:27 status installed ros-melodic-qt-gui:amd64 0.4.2-1bionic.20210414.212741
2021-05-05 22:57:27 status installed ros-melodic-octomap-msgs:amd64 0.3.5-1bionic.20210414.211546
2021-05-05 22:57:27 status installed ros-melodic-qt-gui-py-common:amd64 0.4.2-1bionic.20210414.212743
2021-05-05 22:57:27 status installed ros-melodic-roslisp:amd64 1.9.24-1bionic.20210414.212712
2021-05-05 22:57:27 status installed ros-melodic-control-msgs:amd64 1.5.1-1bionic.20210414.211840
2021-05-05 22:57:27 status installed ros-melodic-roscpp:amd64 1.14.10-1bionic.20210414.212611
2021-05-05 22:57:27 status installed ros-melodic-industrial-msgs:amd64 0.7.1-1bionic.20210414.211857
2021-05-05 22:57:27 status installed ros-melodic-rosout:amd64 1.14.10-1bionic.20210414.214914
2021-05-05 22:57:27 status installed ros-melodic-roslaunch:amd64 1.14.10-1bionic.20210414.215147
2021-05-05 22:57:27 status installed ros-melodic-kdl-conversions:amd64 1.12.1-1bionic.20210414.214652
2021-05-05 22:57:27 status installed ros-melodic-sensor-msgs:amd64 1.12.8-1bionic.20210414.220738
2021-05-05 22:57:27 status installed ros-melodic-camera-calibration-parsers:amd64 1.11.13-0bionic.20210414.222337
2021-05-05 22:57:27 status installed ros-melodic-eigen-conversions:amd64 1.12.1-1bionic.20210414.212707
2021-05-05 22:57:27 status installed ros-melodic-diagnostic-updater:amd64 1.9.7-1bionic.20210414.215926
2021-05-05 22:57:27 status installed ros-melodic-roscpp-tutorials:amd64 0.9.3-1bionic.20210414.213915
2021-05-05 22:57:27 status installed ros-melodic-rosconsole-bridge:amd64 0.5.3-0bionic.20210414.212737
2021-05-05 22:57:27 status installed ros-melodic-visualization-msgs:amd64 1.12.8-1bionic.20210414.214606
2021-05-05 22:57:27 status installed ubuntu-release-upgrader-gtk:all 1:18.04.44
2021-05-05 22:57:27 status installed ros-melodic-nav-msgs:amd64 1.12.8-1bionic.20210414.211513
2021-05-05 22:57:27 status installed ros-melodic-topic-tools:amd64 1.14.10-1bionic.20210414.215841
2021-05-05 22:57:27 status installed ros-melodic-stereo-msgs:amd64 1.12.8-1bionic.20210414.221407
2021-05-05 22:57:28 status installed libpam-systemd:amd64 237-3ubuntu10.46
2021-05-05 22:57:28 status installed ros-melodic-tf2-msgs:amd64 0.6.5-0bionic.20210414.211627
2021-05-05 22:57:28 status installed ros-melodic-mk:amd64 1.14.9-1bionic.20210414.210653
2021-05-05 22:57:28 status installed ros-melodic-resource-retriever:amd64 1.12.6-1bionic.20210414.212731
2021-05-05 22:57:28 status installed ros-melodic-common-msgs:amd64 1.12.8-1bionic.20210414.222402
2021-05-05 22:57:28 status installed ros-melodic-pluginlib:amd64 1.12.1-0bionic.20210414.212726
2021-05-05 22:57:28 status installed python-rosdep-modules:all 0.20.1-1
2021-05-05 22:57:28 status installed ros-melodic-pcl-msgs:amd64 0.2.0-0bionic.20210414.221344
2021-05-05 22:57:28 status installed ros-melodic-rospy:amd64 1.14.10-1bionic.20210414.213738
2021-05-05 22:57:28 status installed ros-melodic-image-geometry:amd64 1.13.0-0bionic.20210414.224004
2021-05-05 22:57:28 status installed ros-melodic-ros:amd64 1.14.9-1bionic.20210414.212605
2021-05-05 22:57:28 status installed ros-melodic-rqt-gui:amd64 0.5.2-1bionic.20210414.214501
2021-05-05 22:57:28 status installed ros-melodic-bondpy:amd64 1.8.5-1bionic.20210414.214706
2021-05-05 22:57:28 status installed ros-melodic-qt-gui-cpp:amd64 0.4.2-1bionic.20210414.214457
2021-05-05 22:57:28 status installed ros-melodic-message-filters:amd64 1.14.10-1bionic.20210414.220116
2021-05-05 22:57:28 status installed ros-melodic-gazebo-msgs:amd64 2.8.7-1bionic.20210414.221132
2021-05-05 22:57:28 status installed python-rosdep:all 0.20.1-1
2021-05-05 22:57:28 status installed ros-melodic-tf2:amd64 0.6.5-0bionic.20210414.214656
2021-05-05 22:57:29 status installed ros-melodic-hardware-interface:amd64 0.18.3-1bionic.20210414.215149
2021-05-05 22:57:29 status installed ros-melodic-turtlesim:amd64 0.9.3-1bionic.20210414.214012
2021-05-05 22:57:29 status installed ros-melodic-bondcpp:amd64 1.8.5-1bionic.20210414.214703
2021-05-05 22:57:29 status installed ros-melodic-object-recognition-msgs:amd64 0.4.1-0bionic.20210414.221347
2021-05-05 22:57:29 status installed ros-melodic-map-msgs:amd64 1.14.1-1bionic.20210414.221158
2021-05-05 22:57:29 status installed ros-melodic-filters:amd64 1.8.1-0bionic.20210414.220126
2021-05-05 22:57:29 status installed ros-melodic-joint-state-publisher:amd64 1.12.15-1bionic.20210414.223148
2021-05-05 22:57:29 status installed ros-melodic-self-test:amd64 1.9.7-1bionic.20210414.220342
2021-05-05 22:57:29 status installed ros-melodic-xacro:amd64 1.13.10-1bionic.20210414.220908
2021-05-05 22:57:29 status installed ros-melodic-geometric-shapes:amd64 0.6.3-1bionic.20210414.214739
2021-05-05 22:57:29 status installed ros-melodic-cv-bridge:amd64 1.13.0-0bionic.20210414.222319
2021-05-05 22:57:29 status installed ros-melodic-rqt-gui-py:amd64 0.5.2-1bionic.20210414.215002
2021-05-05 22:57:29 status installed ros-melodic-nodelet:amd64 1.9.16-0bionic.20210414.214956
2021-05-05 22:57:29 status installed ros-melodic-pluginlib-tutorials:amd64 0.1.11-0bionic.20210414.215022
2021-05-05 22:57:29 status installed ros-melodic-moveit-msgs:amd64 0.10.1-1bionic.20210414.221602
2021-05-05 22:57:29 status installed ros-melodic-visualization-marker-tutorials:amd64 0.10.5-1bionic.20210414.214740
2021-05-05 22:57:29 status installed ros-melodic-rostest:amd64 1.14.10-1bionic.20210414.215519
2021-05-05 22:57:29 status installed ros-melodic-rqt-shell:amd64 0.4.9-0bionic.20210414.215346
2021-05-05 22:57:29 status installed ros-melodic-rospy-tutorials:amd64 0.9.3-1bionic.20210414.215825
2021-05-05 22:57:29 status installed ros-melodic-diagnostic-aggregator:amd64 1.9.7-1bionic.20210414.220148
2021-05-05 22:57:29 status installed ros-melodic-nodelet-tutorial-math:amd64 0.1.11-0bionic.20210414.215759
2021-05-05 22:57:29 status installed ros-melodic-industrial-robot-status-interface:amd64 0.1.2-1bionic.20210414.215607
2021-05-05 22:57:29 status installed ros-melodic-urdfdom-py:amd64 0.4.5-1bionic.20210414.215547
2021-05-05 22:57:29 status installed ros-melodic-rqt-web:amd64 0.4.8-0bionic.20210414.215351
2021-05-05 22:57:29 status installed ros-melodic-rosbag-storage:amd64 1.14.10-1bionic.20210414.215916
2021-05-05 22:57:29 status installed ros-melodic-rqt-top:amd64 0.4.8-0bionic.20210414.215357
2021-05-05 22:57:29 status installed ros-melodic-pcl-conversions:amd64 1.7.1-1bionic.20210414.222115
2021-05-05 22:57:29 status installed ros-melodic-urdf:amd64 1.13.2-1bionic.20210414.220204
2021-05-05 22:57:29 status installed ros-melodic-image-transport:amd64 1.11.13-0bionic.20210414.222340
2021-05-05 22:57:29 status installed ros-melodic-rqt-gui-cpp:amd64 0.5.2-1bionic.20210414.215433
2021-05-05 22:57:29 status installed ros-melodic-combined-robot-hw:amd64 0.18.3-1bionic.20210414.215443
2021-05-05 22:57:29 status installed ros-melodic-ros-tutorials:amd64 0.9.3-1bionic.20210414.220824
2021-05-05 22:57:29 status installed ros-melodic-rqt-image-view:amd64 0.4.16-1bionic.20210414.222857
2021-05-05 22:57:29 status installed ros-melodic-tf2-py:amd64 0.6.5-0bionic.20210414.215545
2021-05-05 22:57:29 status installed ros-melodic-controller-interface:amd64 0.18.3-1bionic.20210414.215458
2021-05-05 22:57:29 status installed ros-melodic-rqt-py-console:amd64 0.4.8-0bionic.20210414.215330
2021-05-05 22:57:29 status installed ros-melodic-rqt-runtime-monitor:amd64 0.5.7-0bionic.20210414.215337
2021-05-05 22:57:29 status installed ros-melodic-transmission-interface:amd64 0.18.3-1bionic.20210414.215444
2021-05-05 22:57:30 status installed ros-melodic-camera-calibration:amd64 1.15.0-1bionic.20210414.224359
2021-05-05 22:57:30 status installed ros-melodic-polled-camera:amd64 1.11.13-0bionic.20210414.222746
2021-05-05 22:57:30 status installed ros-melodic-vision-opencv:amd64 1.13.0-0bionic.20210415.000650
2021-05-05 22:57:30 status installed ros-melodic-tf2-eigen:amd64 0.6.5-0bionic.20210414.214954
2021-05-05 22:57:30 status installed ros-melodic-srdfdom:amd64 0.5.2-1bionic.20210414.220909
2021-05-05 22:57:30 status installed ros-melodic-kdl-parser:amd64 1.13.1-0bionic.20210414.223549
2021-05-05 22:57:30 status installed ros-melodic-bond-core:amd64 1.8.5-1bionic.20210414.214958
2021-05-05 22:57:30 status installed ros-melodic-rosbag:amd64 1.14.10-1bionic.20210414.220334
2021-05-05 22:57:30 status installed ros-melodic-joint-limits-interface:amd64 0.18.3-1bionic.20210414.220539
2021-05-05 22:57:30 status installed ros-melodic-kdl-parser-py:amd64 1.13.1-0bionic.20210414.220903
2021-05-05 22:57:30 status installed ros-melodic-trac-ik-lib:amd64 1.5.1-1bionic.20210414.223656
2021-05-05 22:57:30 status installed ros-melodic-camera-info-manager:amd64 1.11.13-0bionic.20210414.222929
2021-05-05 22:57:30 status installed ros-melodic-rosmsg:amd64 1.14.10-1bionic.20210414.220706
2021-05-05 22:57:30 status installed ros-melodic-diagnostic-analysis:amd64 1.9.7-1bionic.20210414.220804
2021-05-05 22:57:30 status installed ros-melodic-rostopic:amd64 1.14.10-1bionic.20210414.220710
2021-05-05 22:57:30 status installed ros-melodic-rosservice:amd64 1.14.10-1bionic.20210414.220938
2021-05-05 22:57:30 status installed ros-melodic-image-common:amd64 1.11.13-0bionic.20210415.000622
2021-05-05 22:57:30 status installed ros-melodic-rqt-robot-steering:amd64 0.5.10-1bionic.20210414.221045
2021-05-05 22:57:30 status installed ros-melodic-controller-manager-msgs:amd64 0.18.3-1bionic.20210414.221028
2021-05-05 22:57:30 status installed ros-melodic-rqt-topic:amd64 0.4.11-1bionic.20210414.221042
2021-05-05 22:57:30 status installed ros-melodic-rqt-joint-trajectory-controller:amd64 0.17.2-1bionic.20210414.222529
2021-05-05 22:57:30 status installed ros-melodic-controller-manager:amd64 0.18.3-1bionic.20210414.222301
2021-05-05 22:57:30 status installed ros-melodic-dynamic-reconfigure:amd64 1.6.3-1bionic.20210414.221034
2021-05-05 22:57:30 status installed ros-melodic-theora-image-transport:amd64 1.9.5-0bionic.20210414.222805
2021-05-05 22:57:30 status installed ros-melodic-actionlib:amd64 1.12.1-1bionic.20210414.224037
2021-05-05 22:57:30 status installed ros-melodic-rosnode:amd64 1.14.10-1bionic.20210414.223443
2021-05-05 22:57:30 status installed ros-melodic-nodelet-topic-tools:amd64 1.9.16-0bionic.20210414.222553
2021-05-05 22:57:30 status installed ros-melodic-image-publisher:amd64 1.15.0-1bionic.20210414.223345
2021-05-05 22:57:30 status installed ros-melodic-rqt-py-common:amd64 0.5.2-1bionic.20210414.224410
2021-05-05 22:57:30 status installed ros-melodic-nodelet-core:amd64 1.9.16-0bionic.20210414.223253
2021-05-05 22:57:30 status installed ros-melodic-tf2-ros:amd64 0.6.5-0bionic.20210414.224846
2021-05-05 22:57:30 status installed ros-melodic-compressed-depth-image-transport:amd64 1.9.5-0bionic.20210414.224240
2021-05-05 22:57:30 status installed ros-melodic-tf2-geometry-msgs:amd64 0.6.5-0bionic.20210414.225409
2021-05-05 22:57:30 status installed ros-melodic-turtle-tf2:amd64 0.2.2-0bionic.20210414.225346
2021-05-05 22:57:30 status installed ros-melodic-compressed-image-transport:amd64 1.9.5-0bionic.20210414.224256
2021-05-05 22:57:30 status installed ros-melodic-realtime-tools:amd64 1.15.1-1bionic.20210414.225207
2021-05-05 22:57:30 status installed ros-melodic-rqt-logger-level:amd64 0.4.8-0bionic.20210414.224106
2021-05-05 22:57:30 status installed ros-melodic-forward-command-controller:amd64 0.17.2-1bionic.20210414.225555
2021-05-05 22:57:31 status installed ros-melodic-rqt-moveit:amd64 0.5.10-1bionic.20210414.224933
2021-05-05 22:57:31 status installed ros-melodic-smach-ros:amd64 2.0.1-0bionic.20210414.224841
2021-05-05 22:57:49 status installed ros-melodic-rqt-bag:amd64 0.5.1-1bionic.20210414.224057
2021-05-05 22:57:49 status installed ros-melodic-actionlib-tutorials:amd64 0.1.11-0bionic.20210414.224433
2021-05-05 22:57:49 status installed ros-melodic-image-proc:amd64 1.15.0-1bionic.20210414.224405
2021-05-05 22:57:49 status installed ros-melodic-stereo-image-proc:amd64 1.15.0-1bionic.20210414.225647
2021-05-05 22:57:49 status installed ros-melodic-image-view:amd64 1.15.0-1bionic.20210414.222753
2021-05-05 22:57:49 status installed ros-melodic-control-toolbox:amd64 1.18.2-1bionic.20210414.225552
2021-05-05 22:57:49 status installed ros-melodic-image-transport-plugins:amd64 1.9.5-0bionic.20210415.000813
2021-05-05 22:57:49 status installed ros-melodic-depth-image-proc:amd64 1.15.0-1bionic.20210414.225449
2021-05-05 22:57:49 status installed ros-melodic-moveit-core:amd64 1.0.7-1bionic.20210414.235849
2021-05-05 22:57:49 status installed ros-melodic-turtle-actionlib:amd64 0.1.11-0bionic.20210414.224643
2021-05-05 22:57:49 status installed ros-melodic-rqt-service-caller:amd64 0.4.8-0bionic.20210414.225539
2021-05-05 22:57:49 status installed ros-melodic-rqt-robot-monitor:amd64 0.5.13-1bionic.20210414.224943
2021-05-05 22:57:49 status installed ros-melodic-force-torque-sensor-controller:amd64 0.17.2-1bionic.20210414.225558
2021-05-05 22:57:49 status installed ros-melodic-moveit-simple-controller-manager:amd64 1.0.7-1bionic.20210415.001402
2021-05-05 22:57:49 status installed ros-melodic-rqt-graph:amd64 0.4.11-1bionic.20210414.224057
2021-05-05 22:57:49 status installed ros-melodic-image-rotate:amd64 1.15.0-1bionic.20210414.231540
2021-05-05 22:57:49 status installed ros-melodic-roswtf:amd64 1.14.10-1bionic.20210414.224044
2021-05-05 22:57:49 status installed ros-melodic-ros-control:amd64 0.18.3-1bionic.20210414.225704
2021-05-05 22:57:49 status installed ros-melodic-position-controllers:amd64 0.17.2-1bionic.20210414.234406
2021-05-05 22:57:49 status installed ros-melodic-rqt-plot:amd64 0.4.13-1bionic.20210414.224739
2021-05-05 22:57:49 status installed ros-melodic-tf2-kdl:amd64 0.6.5-0bionic.20210414.225541
2021-05-05 22:57:49 status installed ros-melodic-ros-comm:amd64 1.14.10-1bionic.20210414.224355
2021-05-05 22:57:49 status installed ros-melodic-rqt-console:amd64 0.4.9-1bionic.20210414.224928
2021-05-05 22:57:49 status installed ros-melodic-rqt-publisher:amd64 0.4.8-0bionic.20210414.224936
2021-05-05 22:57:49 status installed ros-melodic-rqt-launch:amd64 0.4.8-0bionic.20210414.225043
2021-05-05 22:57:49 status installed ros-melodic-industrial-robot-status-controller:amd64 0.1.2-1bionic.20210414.225610
2021-05-05 22:57:49 status installed ros-melodic-executive-smach:amd64 2.0.1-0bionic.20210414.224951
2021-05-05 22:57:49 status installed ros-melodic-moveit-ros-control-interface:amd64 1.0.7-1bionic.20210415.001853
2021-05-05 22:57:49 status installed ros-melodic-imu-sensor-controller:amd64 0.17.2-1bionic.20210414.225643
2021-05-05 22:57:49 status installed ros-melodic-rqt-reconfigure:amd64 0.5.4-1bionic.20210414.225051
2021-05-05 22:57:49 status installed ros-melodic-moveit-ros-occupancy-map-monitor:amd64 1.0.7-1bionic.20210415.001412
2021-05-05 22:57:50 status installed ros-melodic-common-tutorials:amd64 0.1.11-0bionic.20210414.225559
2021-05-05 22:57:50 status installed ros-melodic-joint-state-controller:amd64 0.17.2-1bionic.20210414.225642
2021-05-05 22:57:50 status installed ros-melodic-velocity-controllers:amd64 0.17.2-1bionic.20210414.234157
2021-05-05 22:57:50 status installed ros-melodic-joint-trajectory-controller:amd64 0.17.2-1bionic.20210414.233758
2021-05-05 22:57:50 status installed ros-melodic-moveit-ros-perception:amd64 1.0.7-1bionic.20210415.001912
2021-05-05 22:57:50 status installed ros-melodic-effort-controllers:amd64 0.17.2-1bionic.20210414.231806
2021-05-05 22:57:50 status installed ros-melodic-chomp-motion-planner:amd64 1.0.7-1bionic.20210415.001556
2021-05-05 22:57:50 status installed ros-melodic-rqt-tf-tree:amd64 0.6.0-0bionic.20210414.225411
2021-05-05 22:57:50 status installed ros-melodic-rqt-dep:amd64 0.4.9-0bionic.20210414.224324
2021-05-05 22:57:50 status installed ros-melodic-tf:amd64 1.12.1-1bionic.20210414.225340
2021-05-05 22:57:50 status installed ros-melodic-gripper-action-controller:amd64 0.17.2-1bionic.20210414.233755
2021-05-05 22:57:50 status installed ros-melodic-image-pipeline:amd64 1.15.0-1bionic.20210415.000829
2021-05-05 22:57:50 status installed ros-melodic-turtle-tf:amd64 0.2.2-0bionic.20210414.231150
2021-05-05 22:57:50 status installed ros-melodic-robot-state-publisher:amd64 1.14.1-1bionic.20210414.231356
2021-05-05 22:57:50 status installed ros-melodic-ros-core:amd64 1.4.1-0bionic.20210414.224553
2021-05-05 22:57:50 status installed ros-melodic-laser-geometry:amd64 1.6.7-1bionic.20210414.235047
2021-05-05 22:57:50 status installed ros-melodic-moveit-ros-planning:amd64 1.0.7-1bionic.20210415.001917
2021-05-05 22:57:50 status installed ros-melodic-diagnostic-common-diagnostics:amd64 1.9.7-1bionic.20210414.235150
2021-05-05 22:57:50 status installed ros-melodic-laser-assembler:amd64 1.7.7-2bionic.20210414.235449
2021-05-05 22:57:50 status installed ros-melodic-laser-filters:amd64 1.8.11-1bionic.20210414.235502
2021-05-05 22:57:50 status installed ros-melodic-rqt-msg:amd64 0.4.8-0bionic.20210414.225052
2021-05-05 22:57:50 status installed ros-melodic-rqt-bag-plugins:amd64 0.5.1-1bionic.20210414.224831
2021-05-05 22:57:50 status installed ros-melodic-moveit-planners-chomp:amd64 1.0.7-1bionic.20210421.063421
2021-05-05 22:57:50 status installed ros-melodic-moveit-planners-ompl:amd64 1.0.7-1bionic.20210415.003054
2021-05-05 22:57:50 status installed ros-melodic-rqt-nav-view:amd64 0.5.7-0bionic.20210414.231447
2021-05-05 22:57:50 status installed ros-melodic-tf-conversions:amd64 1.12.1-1bionic.20210414.232637
2021-05-05 22:57:50 status installed ros-melodic-rqt-pose-view:amd64 0.5.8-0bionic.20210414.231455
2021-05-05 22:57:50 status installed ros-melodic-ros-base:amd64 1.4.1-0bionic.20210414.225544
2021-05-05 22:57:50 status installed ros-melodic-pcl-ros:amd64 1.7.1-1bionic.20210414.230520
2021-05-05 22:57:50 status installed ros-melodic-diagnostics:amd64 1.9.7-1bionic.20210414.235850
2021-05-05 22:57:50 status installed ros-melodic-geometry:amd64 1.12.1-1bionic.20210414.234353
2021-05-05 22:57:50 status installed ros-melodic-diff-drive-controller:amd64 0.17.2-1bionic.20210414.231331
2021-05-05 22:57:50 status installed ros-melodic-geometry-tutorials:amd64 0.2.2-0bionic.20210415.001123
2021-05-05 22:57:50 status installed ros-melodic-warehouse-ros:amd64 0.9.4-1bionic.20210414.231204
2021-05-05 22:57:50 status installed ros-melodic-gazebo-ros:amd64 2.8.7-1bionic.20210414.230945
2021-05-05 22:57:51 status installed ros-melodic-moveit-fake-controller-manager:amd64 1.0.7-1bionic.20210415.003149
2021-05-05 22:57:51 status installed ros-melodic-rqt-srv:amd64 0.4.8-0bionic.20210414.225302
2021-05-05 22:57:51 status installed ros-melodic-interactive-markers:amd64 1.11.5-1bionic.20210414.230947
2021-05-05 22:57:51 status installed ros-melodic-gazebo-ros-dbgsym:amd64 2.8.7-1bionic.20210414.230945
2021-05-05 22:57:51 status installed ros-melodic-moveit-planners:amd64 1.0.7-1bionic.20210421.063912
2021-05-05 22:57:51 status installed ros-melodic-perception-pcl:amd64 1.7.1-1bionic.20210415.000436
2021-05-05 22:57:51 status installed ros-melodic-stage-ros:amd64 1.8.0-0bionic.20210414.231152
2021-05-05 22:57:51 status installed ros-melodic-rqt-robot-dashboard:amd64 0.5.7-0bionic.20210414.231536
2021-05-05 22:57:51 status installed ros-melodic-laser-pipeline:amd64 1.6.3-0bionic.20210415.002035
2021-05-05 22:57:51 status installed ros-melodic-perception:amd64 1.4.1-0bionic.20210415.002155
2021-05-05 22:57:51 status installed ros-melodic-moveit-ros-move-group:amd64 1.0.7-1bionic.20210415.003644
2021-05-05 22:57:51 status installed ros-melodic-gazebo-video-monitor-plugins:amd64 0.6.0-2bionic.20210414.231649
2021-05-05 22:57:51 status installed ros-melodic-rqt-action:amd64 0.4.9-0bionic.20210414.225300
2021-05-05 22:57:51 status installed ros-melodic-moveit-plugins:amd64 1.0.7-1bionic.20210415.003828
2021-05-05 22:57:51 status installed ros-melodic-gazebo-ros-control:amd64 2.8.7-1bionic.20210414.231558
2021-05-05 22:57:51 status installed ros-melodic-moveit-ros-robot-interaction:amd64 1.0.7-1bionic.20210415.003154
2021-05-05 22:57:51 status installed ros-melodic-gazebo-video-monitor-plugins-dbgsym:amd64 0.6.0-2bionic.20210414.231649
2021-05-05 22:57:51 status installed ros-melodic-robot:amd64 1.4.1-0bionic.20210414.235950
2021-05-05 22:57:51 status installed ros-melodic-gazebo-plugins:amd64 2.8.7-1bionic.20210414.231552
2021-05-05 22:57:51 status installed ros-melodic-interactive-marker-tutorials:amd64 0.10.5-1bionic.20210414.232816
2021-05-05 22:57:51 status installed ros-melodic-gazebo-video-monitors:amd64 0.6.0-2bionic.20210414.234200
2021-05-05 22:57:51 status installed ros-melodic-ackermann-steering-controller:amd64 0.17.2-1bionic.20210414.231701
2021-05-05 22:57:51 status installed ros-melodic-moveit-ros-warehouse:amd64 1.0.7-1bionic.20210415.003100
2021-05-05 22:57:51 status installed ros-melodic-moveit-ros-manipulation:amd64 1.0.7-1bionic.20210415.004317
2021-05-05 22:57:51 status installed ros-melodic-rviz:amd64 1.13.17-1bionic.20210414.235451
2021-05-05 22:57:51 status installed ros-melodic-rqt-rviz:amd64 0.6.0-0bionic.20210415.002756
2021-05-05 22:57:51 status installed ros-melodic-ros-controllers:amd64 0.17.2-1bionic.20210415.001140
2021-05-05 22:57:51 status installed ros-melodic-moveit-ros-benchmarks:amd64 1.0.7-1bionic.20210415.003807
2021-05-05 22:57:51 status installed ros-melodic-rqt-robot-plugins:amd64 0.5.7-0bionic.20210415.003553
2021-05-05 22:57:51 status installed ros-melodic-gazebo-ros-pkgs:amd64 2.8.7-1bionic.20210415.000415
2021-05-05 22:57:51 status installed ros-melodic-rqt-common-plugins:amd64 0.4.8-0bionic.20210414.225652
2021-05-05 22:57:51 status installed ros-melodic-moveit-ros-planning-interface:amd64 1.0.7-1bionic.20210421.062457
2021-05-05 22:57:52 status installed ros-melodic-rviz-python-tutorial:amd64 0.10.5-1bionic.20210415.003900
2021-05-05 22:57:52 status installed ros-melodic-gazebo-ros-control-dbgsym:amd64 2.8.7-1bionic.20210414.231558
2021-05-05 22:57:52 status installed ros-melodic-rviz-plugin-tutorials:amd64 0.10.5-1bionic.20210415.003849
2021-05-05 22:57:52 status installed ros-melodic-gazebo-plugins-dbgsym:amd64 2.8.7-1bionic.20210414.231552
2021-05-05 22:57:52 status installed ros-melodic-librviz-tutorial:amd64 0.10.5-1bionic.20210415.002907
2021-05-05 22:57:52 status installed ros-melodic-simulators:amd64 1.4.1-0bionic.20210415.003754
2021-05-05 22:57:52 status installed ros-melodic-urdf-tutorial:amd64 0.4.0-0bionic.20210415.003551
2021-05-05 22:57:52 status installed ros-melodic-urdf-sim-tutorial:amd64 0.4.0-0bionic.20210415.003656
2021-05-05 22:57:52 status installed ros-melodic-moveit-commander:amd64 1.0.7-1bionic.20210421.063538
2021-05-05 22:57:52 status installed ros-melodic-viz:amd64 1.4.1-0bionic.20210415.003748
2021-05-05 22:57:52 status installed ros-melodic-moveit-ros-visualization:amd64 1.0.7-1bionic.20210421.063433
2021-05-05 22:57:52 status installed ros-melodic-visualization-tutorials:amd64 0.10.5-1bionic.20210415.004354
2021-05-05 22:57:52 status installed ros-melodic-moveit-ros:amd64 1.0.7-1bionic.20210421.065145
2021-05-05 22:57:52 status installed ros-melodic-desktop:amd64 1.4.1-0bionic.20210415.004458
2021-05-05 22:57:52 status installed ros-melodic-moveit-setup-assistant:amd64 1.0.7-1bionic.20210421.065657
2021-05-05 22:57:52 status installed ros-melodic-moveit:amd64 1.0.7-1bionic.20210421.070859
2021-05-05 22:57:52 status installed ros-melodic-desktop-full:amd64 1.4.1-0bionic.20210415.004555

I included everything ros-related, my assumption would be that it's ros_control/ros_controllers? What I found googling around is that some "ABI breaking changes were pushed" and it should be all done updating every package/rebuilding the workspace (as mentioned above). Also the error seems controller related (sadly, can't post the full logs right now). But I am already up to date I guess and rebuild the workspace more than I want to admit.

I also think it's kind of weird that I had so many updates open, even though installing ROS Melodic not long ago (maybe 2-3 months ago). Is there a reason for such a thing?

Anyway, I hope this does help a bit!

@ChangcongWang
Copy link

Uh, that sounds interesting!

We did indeed a change in the library regarding tcp_server implementation.

For this to fully understand, I would kindly ask you to help us debugging this:

* Please post the **full** output of `roslaunch ur_robot_driver ur10_bringup.launch [reverse_port:=REVERSE_PORT]` (with just one robot)

* You can try getting it to run with the commit before that merge (this will require an all-src build with the library):
  
  * uninstall the `ur_client_library` -> `sudo apt remove ros-melodic-ur-client-library` (it seems to shadow a source version of the library in some cases, otherwise)
  * In case you used `catkin_make` to build your workspace, delete the `build`, `devel`, (`install`, if present) folders of your workspace
  * Clone the library repository into your workspace's `src` folder (`git clone -b boost https://github.com/UniversalRobots/Universal_Robots_Client_Library.git src/Universal_Robots_Client_Library`)
  * build your workspace using either `catkin_make_isolated` or `catkin build` (see https://github.com/UniversalRobots/Universal_Robots_ROS_Driver#alternative-all-source-build)
  * If this gives the same connection results, try to go to [this commit](https://github.com/UniversalRobots/Universal_Robots_Client_Library/commit/e66b7b01cef268c7361f0d8be27b151d9c5e28e1) (`roscd ur_client_library && git checkout e66b7b01cef268c7361f0d8be27b151d9c5e28e1), build your workspace and check again. If this resolves your problem, we'll have to find out what is going wrong.

Hey, fmauch. The following is my full output of roslaunch ur_robot_driver ur5_bringup.launch

roslaunch ur_robot_driver ur5_bringup.launch 
... logging to /home/shadowolf/.ros/log/1037e158-b3a6-11eb-9dce-80fa5b3c0e94/roslaunch-Shadowolf-3875.log
Checking log directory for disk usage. This may take a while.
Press Ctrl-C to interrupt
Done checking log file disk usage. Usage is <1GB.

xacro: in-order processing became default in ROS Melodic. You can drop the option.
started roslaunch server http://Shadowolf:43483/

SUMMARY
========

PARAMETERS
 * /controller_stopper/consistent_controllers: ['joint_state_con...
 * /force_torque_sensor_controller/publish_rate: 125
 * /force_torque_sensor_controller/type: force_torque_sens...
 * /hardware_control_loop/loop_hz: 125
 * /joint_group_vel_controller/joints: ['shoulder_pan_jo...
 * /joint_group_vel_controller/type: velocity_controll...
 * /joint_state_controller/publish_rate: 125
 * /joint_state_controller/type: joint_state_contr...
 * /pos_joint_traj_controller/action_monitor_rate: 20
 * /pos_joint_traj_controller/constraints/elbow_joint/goal: 0.1
 * /pos_joint_traj_controller/constraints/elbow_joint/trajectory: 0.2
 * /pos_joint_traj_controller/constraints/goal_time: 0.6
 * /pos_joint_traj_controller/constraints/shoulder_lift_joint/goal: 0.1
 * /pos_joint_traj_controller/constraints/shoulder_lift_joint/trajectory: 0.2
 * /pos_joint_traj_controller/constraints/shoulder_pan_joint/goal: 0.1
 * /pos_joint_traj_controller/constraints/shoulder_pan_joint/trajectory: 0.2
 * /pos_joint_traj_controller/constraints/stopped_velocity_tolerance: 0.05
 * /pos_joint_traj_controller/constraints/wrist_1_joint/goal: 0.1
 * /pos_joint_traj_controller/constraints/wrist_1_joint/trajectory: 0.2
 * /pos_joint_traj_controller/constraints/wrist_2_joint/goal: 0.1
 * /pos_joint_traj_controller/constraints/wrist_2_joint/trajectory: 0.2
 * /pos_joint_traj_controller/constraints/wrist_3_joint/goal: 0.1
 * /pos_joint_traj_controller/constraints/wrist_3_joint/trajectory: 0.2
 * /pos_joint_traj_controller/joints: ['shoulder_pan_jo...
 * /pos_joint_traj_controller/state_publish_rate: 125
 * /pos_joint_traj_controller/stop_trajectory_duration: 0.5
 * /pos_joint_traj_controller/type: position_controll...
 * /robot_description: <?xml version="1....
 * /robot_status_controller/handle_name: industrial_robot_...
 * /robot_status_controller/publish_rate: 10
 * /robot_status_controller/type: industrial_robot_...
 * /rosdistro: melodic
 * /rosversion: 1.14.10
 * /scaled_pos_joint_traj_controller/action_monitor_rate: 20
 * /scaled_pos_joint_traj_controller/constraints/elbow_joint/goal: 0.1
 * /scaled_pos_joint_traj_controller/constraints/elbow_joint/trajectory: 0.2
 * /scaled_pos_joint_traj_controller/constraints/goal_time: 0.6
 * /scaled_pos_joint_traj_controller/constraints/shoulder_lift_joint/goal: 0.1
 * /scaled_pos_joint_traj_controller/constraints/shoulder_lift_joint/trajectory: 0.2
 * /scaled_pos_joint_traj_controller/constraints/shoulder_pan_joint/goal: 0.1
 * /scaled_pos_joint_traj_controller/constraints/shoulder_pan_joint/trajectory: 0.2
 * /scaled_pos_joint_traj_controller/constraints/stopped_velocity_tolerance: 0.05
 * /scaled_pos_joint_traj_controller/constraints/wrist_1_joint/goal: 0.1
 * /scaled_pos_joint_traj_controller/constraints/wrist_1_joint/trajectory: 0.2
 * /scaled_pos_joint_traj_controller/constraints/wrist_2_joint/goal: 0.1
 * /scaled_pos_joint_traj_controller/constraints/wrist_2_joint/trajectory: 0.2
 * /scaled_pos_joint_traj_controller/constraints/wrist_3_joint/goal: 0.1
 * /scaled_pos_joint_traj_controller/constraints/wrist_3_joint/trajectory: 0.2
 * /scaled_pos_joint_traj_controller/joints: ['shoulder_pan_jo...
 * /scaled_pos_joint_traj_controller/state_publish_rate: 125
 * /scaled_pos_joint_traj_controller/stop_trajectory_duration: 0.5
 * /scaled_pos_joint_traj_controller/type: position_controll...
 * /scaled_vel_joint_traj_controller/action_monitor_rate: 20
 * /scaled_vel_joint_traj_controller/constraints/elbow_joint/goal: 0.1
 * /scaled_vel_joint_traj_controller/constraints/elbow_joint/trajectory: 0.1
 * /scaled_vel_joint_traj_controller/constraints/goal_time: 0.6
 * /scaled_vel_joint_traj_controller/constraints/shoulder_lift_joint/goal: 0.1
 * /scaled_vel_joint_traj_controller/constraints/shoulder_lift_joint/trajectory: 0.1
 * /scaled_vel_joint_traj_controller/constraints/shoulder_pan_joint/goal: 0.1
 * /scaled_vel_joint_traj_controller/constraints/shoulder_pan_joint/trajectory: 0.1
 * /scaled_vel_joint_traj_controller/constraints/stopped_velocity_tolerance: 0.05
 * /scaled_vel_joint_traj_controller/constraints/wrist_1_joint/goal: 0.1
 * /scaled_vel_joint_traj_controller/constraints/wrist_1_joint/trajectory: 0.1
 * /scaled_vel_joint_traj_controller/constraints/wrist_2_joint/goal: 0.1
 * /scaled_vel_joint_traj_controller/constraints/wrist_2_joint/trajectory: 0.1
 * /scaled_vel_joint_traj_controller/constraints/wrist_3_joint/goal: 0.1
 * /scaled_vel_joint_traj_controller/constraints/wrist_3_joint/trajectory: 0.1
 * /scaled_vel_joint_traj_controller/gains/elbow_joint/d: 0.1
 * /scaled_vel_joint_traj_controller/gains/elbow_joint/i: 0.05
 * /scaled_vel_joint_traj_controller/gains/elbow_joint/i_clamp: 1
 * /scaled_vel_joint_traj_controller/gains/elbow_joint/p: 5.0
 * /scaled_vel_joint_traj_controller/gains/shoulder_lift_joint/d: 0.1
 * /scaled_vel_joint_traj_controller/gains/shoulder_lift_joint/i: 0.05
 * /scaled_vel_joint_traj_controller/gains/shoulder_lift_joint/i_clamp: 1
 * /scaled_vel_joint_traj_controller/gains/shoulder_lift_joint/p: 5.0
 * /scaled_vel_joint_traj_controller/gains/shoulder_pan_joint/d: 0.1
 * /scaled_vel_joint_traj_controller/gains/shoulder_pan_joint/i: 0.05
 * /scaled_vel_joint_traj_controller/gains/shoulder_pan_joint/i_clamp: 1
 * /scaled_vel_joint_traj_controller/gains/shoulder_pan_joint/p: 5.0
 * /scaled_vel_joint_traj_controller/gains/wrist_1_joint/d: 0.1
 * /scaled_vel_joint_traj_controller/gains/wrist_1_joint/i: 0.05
 * /scaled_vel_joint_traj_controller/gains/wrist_1_joint/i_clamp: 1
 * /scaled_vel_joint_traj_controller/gains/wrist_1_joint/p: 5.0
 * /scaled_vel_joint_traj_controller/gains/wrist_2_joint/d: 0.1
 * /scaled_vel_joint_traj_controller/gains/wrist_2_joint/i: 0.05
 * /scaled_vel_joint_traj_controller/gains/wrist_2_joint/i_clamp: 1
 * /scaled_vel_joint_traj_controller/gains/wrist_2_joint/p: 5.0
 * /scaled_vel_joint_traj_controller/gains/wrist_3_joint/d: 0.1
 * /scaled_vel_joint_traj_controller/gains/wrist_3_joint/i: 0.05
 * /scaled_vel_joint_traj_controller/gains/wrist_3_joint/i_clamp: 1
 * /scaled_vel_joint_traj_controller/gains/wrist_3_joint/p: 5.0
 * /scaled_vel_joint_traj_controller/joints: ['shoulder_pan_jo...
 * /scaled_vel_joint_traj_controller/state_publish_rate: 125
 * /scaled_vel_joint_traj_controller/stop_trajectory_duration: 0.5
 * /scaled_vel_joint_traj_controller/type: velocity_controll...
 * /scaled_vel_joint_traj_controller/velocity_ff/elbow_joint: 1.0
 * /scaled_vel_joint_traj_controller/velocity_ff/shoulder_lift_joint: 1.0
 * /scaled_vel_joint_traj_controller/velocity_ff/shoulder_pan_joint: 1.0
 * /scaled_vel_joint_traj_controller/velocity_ff/wrist_1_joint: 1.0
 * /scaled_vel_joint_traj_controller/velocity_ff/wrist_2_joint: 1.0
 * /scaled_vel_joint_traj_controller/velocity_ff/wrist_3_joint: 1.0
 * /speed_scaling_state_controller/publish_rate: 125
 * /speed_scaling_state_controller/type: ur_controllers/Sp...
 * /ur_hardware_interface/headless_mode: False
 * /ur_hardware_interface/input_recipe_file: /home/shadowolf/c...
 * /ur_hardware_interface/joints: ['shoulder_pan_jo...
 * /ur_hardware_interface/kinematics/forearm/pitch: 0
 * /ur_hardware_interface/kinematics/forearm/roll: 0
 * /ur_hardware_interface/kinematics/forearm/x: -0.425
 * /ur_hardware_interface/kinematics/forearm/y: 0
 * /ur_hardware_interface/kinematics/forearm/yaw: 0
 * /ur_hardware_interface/kinematics/forearm/z: 0
 * /ur_hardware_interface/kinematics/hash: calib_20954911754...
 * /ur_hardware_interface/kinematics/shoulder/pitch: 0
 * /ur_hardware_interface/kinematics/shoulder/roll: 0
 * /ur_hardware_interface/kinematics/shoulder/x: 0
 * /ur_hardware_interface/kinematics/shoulder/y: 0
 * /ur_hardware_interface/kinematics/shoulder/yaw: 0
 * /ur_hardware_interface/kinematics/shoulder/z: 0.089159
 * /ur_hardware_interface/kinematics/upper_arm/pitch: 0
 * /ur_hardware_interface/kinematics/upper_arm/roll: 1.570796327
 * /ur_hardware_interface/kinematics/upper_arm/x: 0
 * /ur_hardware_interface/kinematics/upper_arm/y: 0
 * /ur_hardware_interface/kinematics/upper_arm/yaw: 0
 * /ur_hardware_interface/kinematics/upper_arm/z: 0
 * /ur_hardware_interface/kinematics/wrist_1/pitch: 0
 * /ur_hardware_interface/kinematics/wrist_1/roll: 0
 * /ur_hardware_interface/kinematics/wrist_1/x: -0.39225
 * /ur_hardware_interface/kinematics/wrist_1/y: 0
 * /ur_hardware_interface/kinematics/wrist_1/yaw: 0
 * /ur_hardware_interface/kinematics/wrist_1/z: 0.10915
 * /ur_hardware_interface/kinematics/wrist_2/pitch: 0
 * /ur_hardware_interface/kinematics/wrist_2/roll: 1.570796327
 * /ur_hardware_interface/kinematics/wrist_2/x: 0
 * /ur_hardware_interface/kinematics/wrist_2/y: -0.09465
 * /ur_hardware_interface/kinematics/wrist_2/yaw: 0
 * /ur_hardware_interface/kinematics/wrist_2/z: -1.9413039509e-11
 * /ur_hardware_interface/kinematics/wrist_3/pitch: 3.14159265359
 * /ur_hardware_interface/kinematics/wrist_3/roll: 1.57079632659
 * /ur_hardware_interface/kinematics/wrist_3/x: 0
 * /ur_hardware_interface/kinematics/wrist_3/y: 0.0823
 * /ur_hardware_interface/kinematics/wrist_3/yaw: 3.14159265359
 * /ur_hardware_interface/kinematics/wrist_3/z: -1.68800121668e-11
 * /ur_hardware_interface/output_recipe_file: /home/shadowolf/c...
 * /ur_hardware_interface/reverse_port: 50001
 * /ur_hardware_interface/robot_ip: 192.168.0.2
 * /ur_hardware_interface/script_file: /home/shadowolf/c...
 * /ur_hardware_interface/script_sender_port: 50002
 * /ur_hardware_interface/tf_prefix: 
 * /ur_hardware_interface/tool_baud_rate: 115200
 * /ur_hardware_interface/tool_parity: 0
 * /ur_hardware_interface/tool_rx_idle_chars: 1.5
 * /ur_hardware_interface/tool_stop_bits: 1
 * /ur_hardware_interface/tool_tx_idle_chars: 3.5
 * /ur_hardware_interface/tool_voltage: 0
 * /ur_hardware_interface/use_tool_communication: False
 * /vel_joint_traj_controller/action_monitor_rate: 20
 * /vel_joint_traj_controller/constraints/elbow_joint/goal: 0.1
 * /vel_joint_traj_controller/constraints/elbow_joint/trajectory: 0.1
 * /vel_joint_traj_controller/constraints/goal_time: 0.6
 * /vel_joint_traj_controller/constraints/shoulder_lift_joint/goal: 0.1
 * /vel_joint_traj_controller/constraints/shoulder_lift_joint/trajectory: 0.1
 * /vel_joint_traj_controller/constraints/shoulder_pan_joint/goal: 0.1
 * /vel_joint_traj_controller/constraints/shoulder_pan_joint/trajectory: 0.1
 * /vel_joint_traj_controller/constraints/stopped_velocity_tolerance: 0.05
 * /vel_joint_traj_controller/constraints/wrist_1_joint/goal: 0.1
 * /vel_joint_traj_controller/constraints/wrist_1_joint/trajectory: 0.1
 * /vel_joint_traj_controller/constraints/wrist_2_joint/goal: 0.1
 * /vel_joint_traj_controller/constraints/wrist_2_joint/trajectory: 0.1
 * /vel_joint_traj_controller/constraints/wrist_3_joint/goal: 0.1
 * /vel_joint_traj_controller/constraints/wrist_3_joint/trajectory: 0.1
 * /vel_joint_traj_controller/gains/elbow_joint/d: 0.1
 * /vel_joint_traj_controller/gains/elbow_joint/i: 0.05
 * /vel_joint_traj_controller/gains/elbow_joint/i_clamp: 1
 * /vel_joint_traj_controller/gains/elbow_joint/p: 5.0
 * /vel_joint_traj_controller/gains/shoulder_lift_joint/d: 0.1
 * /vel_joint_traj_controller/gains/shoulder_lift_joint/i: 0.05
 * /vel_joint_traj_controller/gains/shoulder_lift_joint/i_clamp: 1
 * /vel_joint_traj_controller/gains/shoulder_lift_joint/p: 5.0
 * /vel_joint_traj_controller/gains/shoulder_pan_joint/d: 0.1
 * /vel_joint_traj_controller/gains/shoulder_pan_joint/i: 0.05
 * /vel_joint_traj_controller/gains/shoulder_pan_joint/i_clamp: 1
 * /vel_joint_traj_controller/gains/shoulder_pan_joint/p: 5.0
 * /vel_joint_traj_controller/gains/wrist_1_joint/d: 0.1
 * /vel_joint_traj_controller/gains/wrist_1_joint/i: 0.05
 * /vel_joint_traj_controller/gains/wrist_1_joint/i_clamp: 1
 * /vel_joint_traj_controller/gains/wrist_1_joint/p: 5.0
 * /vel_joint_traj_controller/gains/wrist_2_joint/d: 0.1
 * /vel_joint_traj_controller/gains/wrist_2_joint/i: 0.05
 * /vel_joint_traj_controller/gains/wrist_2_joint/i_clamp: 1
 * /vel_joint_traj_controller/gains/wrist_2_joint/p: 5.0
 * /vel_joint_traj_controller/gains/wrist_3_joint/d: 0.1
 * /vel_joint_traj_controller/gains/wrist_3_joint/i: 0.05
 * /vel_joint_traj_controller/gains/wrist_3_joint/i_clamp: 1
 * /vel_joint_traj_controller/gains/wrist_3_joint/p: 5.0
 * /vel_joint_traj_controller/joints: ['shoulder_pan_jo...
 * /vel_joint_traj_controller/state_publish_rate: 125
 * /vel_joint_traj_controller/stop_trajectory_duration: 0.5
 * /vel_joint_traj_controller/type: velocity_controll...
 * /vel_joint_traj_controller/velocity_ff/elbow_joint: 1.0
 * /vel_joint_traj_controller/velocity_ff/shoulder_lift_joint: 1.0
 * /vel_joint_traj_controller/velocity_ff/shoulder_pan_joint: 1.0
 * /vel_joint_traj_controller/velocity_ff/wrist_1_joint: 1.0
 * /vel_joint_traj_controller/velocity_ff/wrist_2_joint: 1.0
 * /vel_joint_traj_controller/velocity_ff/wrist_3_joint: 1.0

NODES
  /
    controller_stopper (controller_stopper/node)
    robot_state_publisher (robot_state_publisher/robot_state_publisher)
    ros_control_controller_spawner (controller_manager/spawner)
    ros_control_stopped_spawner (controller_manager/spawner)
    ur_hardware_interface (ur_robot_driver/ur_robot_driver_node)
  /ur_hardware_interface/
    ur_robot_state_helper (ur_robot_driver/robot_state_helper)

auto-starting new master
process[master]: started with pid [3894]
ROS_MASTER_URI=http://localhost:11311

setting /run_id to 1037e158-b3a6-11eb-9dce-80fa5b3c0e94
process[rosout-1]: started with pid [3908]
started core service [/rosout]
process[robot_state_publisher-2]: started with pid [3915]
process[ur_hardware_interface-3]: started with pid [3916]
process[ros_control_controller_spawner-4]: started with pid [3918]
process[ros_control_stopped_spawner-5]: started with pid [3930]
[ INFO] [1620881139.966952464]: Initializing dashboard client
process[controller_stopper-6]: started with pid [3932]
[ INFO] [1620881139.981328862]: Initializing urdriver
Warning: No realtime capabilities found. Consider using a realtime system for better performance
         at line 396 in /tmp/binarydeb/ros-melodic-ur-client-library-0.1.1/include/ur_client_library/comm/pipeline.h
process[ur_hardware_interface/ur_robot_state_helper-7]: started with pid [3933]
[ INFO] [1620881139.990124664]: Waiting for controller manager service to come up on /controller_manager/switch_controller
[ INFO] [1620881139.992066091]: waitForService: Service [/controller_manager/switch_controller] has not been advertised, waiting...
[INFO] [1620881140.364361]: Controller Spawner: Waiting for service controller_manager/load_controller
[INFO] [1620881140.416065]: Controller Spawner: Waiting for service controller_manager/load_controller
Error:   The calibration parameters of the connected robot don't match the ones from the given kinematics config file. Please be aware that this can lead to critical inaccuracies of tcp positions. Use the ur_calibration tool to extract the correct calibration from the robot and pass that into the description. See [https://github.com/UniversalRobots/Universal_Robots_ROS_Driver#extract-calibration-information] for details.
         at line 45 in /tmp/binarydeb/ros-melodic-ur-client-library-0.1.1/src/ur/calibration_checker.cpp
Warning: No realtime capabilities found. Consider using a realtime system for better performance
         at line 396 in /tmp/binarydeb/ros-melodic-ur-client-library-0.1.1/include/ur_client_library/comm/pipeline.h
Warning: No realtime capabilities found. Consider using a realtime system for better performance
         at line 396 in /tmp/binarydeb/ros-melodic-ur-client-library-0.1.1/include/ur_client_library/comm/pipeline.h
[ INFO] [1620881142.418678444]: Loaded ur_robot_driver hardware_interface
[INFO] [1620881142.483063]: Controller Spawner: Waiting for service controller_manager/switch_controller
[INFO] [1620881142.485116]: Controller Spawner: Waiting for service controller_manager/unload_controller
[INFO] [1620881142.487041]: Loading controller: pos_joint_traj_controller
[ INFO] [1620881142.496237286]: waitForService: Service [/controller_manager/switch_controller] is now available.
[ INFO] [1620881142.496295883]: Service available.
[ INFO] [1620881142.496334916]: Waiting for controller list service to come up on /controller_manager/list_controllers
[ INFO] [1620881142.496781544]: Service available.
[INFO] [1620881142.515102]: Loading controller: joint_group_vel_controller
[INFO] [1620881142.523225]: Controller Spawner: Loaded controllers: pos_joint_traj_controller, joint_group_vel_controller
[INFO] [1620881142.537054]: Controller Spawner: Waiting for service controller_manager/switch_controller
[INFO] [1620881142.539361]: Controller Spawner: Waiting for service controller_manager/unload_controller
[INFO] [1620881142.541735]: Loading controller: joint_state_controller
[INFO] [1620881142.555425]: Loading controller: scaled_pos_joint_traj_controller
[INFO] [1620881142.595416]: Loading controller: speed_scaling_state_controller
[INFO] [1620881142.612147]: Loading controller: force_torque_sensor_controller
[INFO] [1620881142.619342]: Controller Spawner: Loaded controllers: joint_state_controller, scaled_pos_joint_traj_controller, speed_scaling_state_controller, force_torque_sensor_controller
Traceback (most recent call last):
  File "/opt/ros/melodic/lib/controller_manager/spawner", line 212, in <module>
    if __name__ == '__main__': main()
  File "/opt/ros/melodic/lib/controller_manager/spawner", line 204, in main
    resp = switch_controller(loaded, [], 2, False, 0.0)
  File "/opt/ros/melodic/lib/python2.7/dist-packages/rospy/impl/tcpros_service.py", line 442, in __call__
    return self.call(*args, **kwds)
  File "/opt/ros/melodic/lib/python2.7/dist-packages/rospy/impl/tcpros_service.py", line 532, in call
    raise ServiceException("transport error completing service call: %s"%(str(e)))
rospy.service.ServiceException: transport error completing service call: unable to receive data from sender, check sender's logs for details
[INFO] [1620881142.757047]: Shutting down spawner. Stopping and unloading controllers...
[INFO] [1620881142.758292]: Stopping all controllers...
[WARN] [1620881142.760705]: Controller Spawner error while taking down controllers: unable to connect to service: [Errno 111] Connection refused
================================================================================REQUIRED process [ur_hardware_interface-3] has died!
process has died [pid 3916, exit code -11, cmd /home/shadowolf/catkin_wst/devel/lib/ur_robot_driver/ur_robot_driver_node __name:=ur_hardware_interface __log:=/home/shadowolf/.ros/log/1037e158-b3a6-11eb-9dce-80fa5b3c0e94/ur_hardware_interface-3.log].
log file: /home/shadowolf/.ros/log/1037e158-b3a6-11eb-9dce-80fa5b3c0e94/ur_hardware_interface-3*.log
Initiating shutdown!
================================================================================
[ur_hardware_interface/ur_robot_state_helper-7] killing on exit
[controller_stopper-6] killing on exit
[ros_control_stopped_spawner-5] killing on exit
[ros_control_controller_spawner-4] killing on exit
[ur_hardware_interface-3] killing on exit
[robot_state_publisher-2] killing on exit
[INFO] [1620881142.918999]: Shutting down spawner. Stopping and unloading controllers...
[INFO] [1620881142.920355]: Stopping all controllers...
[WARN] [1620881142.922895]: Controller Spawner error while taking down controllers: unable to connect to service: [Errno 111] Connection refused
[controller_stopper-6] escalating to SIGTERM
[rosout-1] killing on exit
[master] killing on exit
shutting down processing monitor...
... shutting down processing monitor complete
done

I uninstall my ur_client_library and build it from source, but it still have the same problem. Then I go to commit e66b7b01cef268c7361f0d8be27b151d9c5e28e1, and it still have the same connection result.

@fmauch
Copy link
Collaborator

fmauch commented May 15, 2021

[ INFO] [1620881142.418678444]: Loaded ur_robot_driver hardware_interface

This seems as if the driver came up, correctly, but then crashes without any further output. Could you please try to start the robot inside gdb, using the debug:=true argument of the launchfile?

Then, you will end up in a gdb prompt similar to this:

[Thread 0x7ffff2256640 (LWP 854700) exited]
[Thread 0x7ffff1254640 (LWP 854702) exited]
[Thread 0x7ffff1a55640 (LWP 854701) exited]
[Thread 0x7ffff2a57640 (LWP 854699) exited]
[Thread 0x7ffff3258640 (LWP 854698) exited]
[Thread 0x7ffff3a59640 (LWP 854697) exited]
[Inferior 1 (process 854666) exited with code 01]
(gdb) 

There, please enter bt and press Enter

The output of that should show us where that actually crashes.

@ChangcongWang
Copy link

[ INFO] [1620881142.418678444]: Loaded ur_robot_driver hardware_interface

似乎驱动程序正确启动,但随后崩溃,而没有任何进一步的输出。 您能否使用以下命令尝试在gdb中启动机器人? debug:=true启动文件的参数?

然后,您将在类似于以下内容的gdb提示符中结束:

[Thread 0x7ffff2256640 (LWP 854700) exited]
[Thread 0x7ffff1254640 (LWP 854702) exited]
[Thread 0x7ffff1a55640 (LWP 854701) exited]
[Thread 0x7ffff2a57640 (LWP 854699) exited]
[Thread 0x7ffff3258640 (LWP 854698) exited]
[Thread 0x7ffff3a59640 (LWP 854697) exited]
[Inferior 1 (process 854666) exited with code 01]
(gdb) 

在那里,请输入 bt然后按 Enter

该输出将向我们显示实际崩溃的位置。

Hey, fmauch. Thanks for your answer.

The following is some of my output of roslaunch ur_robot_driver ur5_bringup.launch debug:=true

[INFO] [1621172920.156656]: Controller Spawner: Waiting for service controller_manager/load_controller
[INFO] [1621172920.161368]: Controller Spawner: Waiting for service controller_manager/load_controller
Starting program: /home/shadowolf/catkin_wst/devel/lib/ur_robot_driver/ur_robot_driver_node __name:=ur_hardware_interface __log:=/home/shadowolf/.ros/log/6a7b54d4-b64d-11eb-85e1-80fa5b3c0e94/ur_hardware_interface-3.log
[tcsetpgrp failed in terminal_inferior: Inappropriate ioctl for device]
[tcsetpgrp failed in terminal_inferior: Invalid argument]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
[tcsetpgrp failed in terminal_inferior: Invalid argument]
[tcsetpgrp failed in terminal_inferior: Invalid argument]
[New Thread 0x7fffef6b6700 (LWP 3151)]
[New Thread 0x7fffeeeb5700 (LWP 3152)]
[New Thread 0x7fffee6b4700 (LWP 3153)]
[New Thread 0x7fffedeb3700 (LWP 3154)]
[New Thread 0x7fffed6b2700 (LWP 3155)]
[New Thread 0x7fffeceb1700 (LWP 3156)]
[ INFO] [1621172920.901989391]: Initializing dashboard client
[ INFO] [1621172920.911997554]: Initializing urdriver
[New Thread 0x7fffd7fff700 (LWP 3157)]
Warning: No realtime capabilities found. Consider using a realtime system for better performance
         at line 396 in [New Thread 0x7fffd77fe700 (LWP 3158)]
/home/shadowolf/catkin_wsur/src/Universal_Robots_Client_Library/include/ur_client_library/comm/pipeline.h
[ INFO] [1621172920.913197073]: waitForService: Service [/ur_hardware_interface/dashboard/play] is now available.
Error:   The calibration parameters of the connected robot don't match the ones from the given kinematics config file. Please be aware that this can lead to critical inaccuracies of tcp positions. Use the ur_calibration tool to extract the correct calibration from the robot and pass that into the description. See [https://github.com/UniversalRobots/Universal_Robots_ROS_Driver#extract-calibration-information] for details.
         at line 45 in /home/shadowolf/catkin_wsur/src/Universal_Robots_Client_Library/src/ur/calibration_checker.cpp
[Thread 0x7fffd77fe700 (LWP 3158) exited]
[Thread 0x7fffd7fff700 (LWP 3157) exited]
[New Thread 0x7fffd77fe700 (LWP 3159)]
Warning: No realtime capabilities found. Consider using a realtime system for better performance
         at line 396 in /home/shadowolf/catkin_wsur/src/Universal_Robots_Client_Library/include/ur_client_library/comm/pipeline.h
[New Thread 0x7fffd7fff700 (LWP 3160)]
[Thread 0x7fffd77fe700 (LWP 3159) exited]
[New Thread 0x7fffd77fe700 (LWP 3161)]
[New Thread 0x7fffd6ffd700 (LWP 3162)]
[New Thread 0x7fffd67fc700 (LWP 3163)]
[New Thread 0x7fffd5ffb700 (LWP 3164)]
[New Thread 0x7fffd57fa700 (LWP 3165)]
[New Thread 0x7fffd4ff9700 (LWP 3166)]
[New Thread 0x7fffcbfff700 (LWP 3167)]
[New Thread 0x7fffcb7fe700 (LWP 3168)]
Warning: No realtime capabilities found. Consider using a realtime system for better performance
         at line 396 in /home/shadowolf/catkin_wsur/src/Universal_Robots_Client_Library/include/ur_client_library/comm/pipeline.h
[ INFO] [1621172923.053790631]: Loaded ur_robot_driver hardware_interface
[tcsetpgrp failed in terminal_inferior: Invalid argument]
[tcsetpgrp failed in terminal_inferior: Invalid argument]
[ INFO] [1621172923.127554218]: waitForService: Service [/controller_manager/switch_controller] is now available.
[ INFO] [1621172923.127586427]: Service available.
[ INFO] [1621172923.127601927]: Waiting for controller list service to come up on /controller_manager/list_controllers
[ INFO] [1621172923.128137611]: Service available.
[INFO] [1621172923.179333]: Controller Spawner: Waiting for service controller_manager/switch_controller
[INFO] [1621172923.182152]: Controller Spawner: Waiting for service controller_manager/switch_controller
[INFO] [1621172923.183845]: Controller Spawner: Waiting for service controller_manager/unload_controller
[INFO] [1621172923.188014]: Controller Spawner: Waiting for service controller_manager/unload_controller
[INFO] [1621172923.189473]: Loading controller: joint_state_controller
[INFO] [1621172923.195500]: Loading controller: pos_joint_traj_controller
[tcsetpgrp failed in terminal_inferior: Invalid argument]
[New Thread 0x7fffcaffd700 (LWP 3175)]
[INFO] [1621172923.221642]: Loading controller: scaled_pos_joint_traj_controller
[ INFO] [1621172923.294773541]: Robot mode is now RUNNING
[ INFO] [1621172923.294808574]: Robot's safety mode is now NORMAL
[tcsetpgrp failed in terminal_inferior: Invalid argument]
[New Thread 0x7fffc991f700 (LWP 3178)]
[New Thread 0x7fffc911e700 (LWP 3179)]
[INFO] [1621172923.412979]: Loading controller: joint_group_vel_controller
[tcsetpgrp failed in terminal_inferior: Invalid argument]
[New Thread 0x7fffb7fff700 (LWP 3181)]
[INFO] [1621172923.549076]: Loading controller: speed_scaling_state_controller
[tcsetpgrp failed in terminal_inferior: Invalid argument]
[INFO] [1621172923.564883]: Controller Spawner: Loaded controllers: pos_joint_traj_controller, joint_group_vel_controller
[New Thread 0x7fffb77fe700 (LWP 3183)]
[INFO] [1621172923.573086]: Loading controller: force_torque_sensor_controller
[tcsetpgrp failed in terminal_inferior: Invalid argument]
[New Thread 0x7fffb6ffd700 (LWP 3185)]
[INFO] [1621172923.581105]: Controller Spawner: Loaded controllers: joint_state_controller, scaled_pos_joint_traj_controller, speed_scaling_state_controller, force_torque_sensor_controller
[ERROR] [1621172924.100535602]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621172924.108510769]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621172924.116497933]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621172924.124479100]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621172924.132530923]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621172924.140578342]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621172924.148480755]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621172924.156482536]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621172924.164466389]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621172924.172477408]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621172924.180475870]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621172924.188501060]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621172924.196469550]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621172924.204454232]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621172924.212446126]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621172924.220439673]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621172924.228492426]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621172924.236499154]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621172924.244426408]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621172924.252472857]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621172924.260498347]: Pipeline producer overflowed! <RTDE Data Pipeline>

Thread 1 "ur_robot_driver" received signal SIGSEGV, Segmentation fault.
joint_trajectory_controller::TrajectoryBuilder<trajectory_interface::QuinticSplineSegment<double> >::createGoalHandlePtr (this=this@entry=0x7fffd8007050)
    at ./include/joint_trajectory_controller/trajectory_builder.h:161
161	./include/joint_trajectory_controller/trajectory_builder.h: No such file or directory.
(gdb) bt
#0  joint_trajectory_controller::TrajectoryBuilder<trajectory_interface::QuinticSplineSegment<double> >::createGoalHandlePtr (this=this@entry=0x7fffd8007050)
    at ./include/joint_trajectory_controller/trajectory_builder.h:161
#1  0x00007fffd439e429 in joint_trajectory_controller::StopTrajectoryBuilder<trajectory_interface::QuinticSplineSegment<double> >::buildTrajectory (
    this=0x7fffd8007050, hold_traj=0x7fffd801e7e0)
    at ./include/joint_trajectory_controller/stop_trajectory_builder.h:113
#2  0x00007fffc865e807 in joint_trajectory_controller::JointTrajectoryController<trajectory_interface::QuinticSplineSegment<double>, ur_controllers::ScaledPositionJointInterface>::setHoldPosition(ros::Time const&, boost::shared_ptr<realtime_tools::RealtimeServerGoalHandle<control_msgs::FollowJointTrajectoryAction_<std::allocator<void> > > >) ()
   from /home/shadowolf/catkin_wst/devel/lib//libur_controllers.so
#3  0x00007fffc864cbb2 in joint_trajectory_controller::JointTrajectoryController<trajectory_interface::QuinticSplineSegment<double>, ur_controllers::ScaledPositionJointInterface>::starting(ros::Time const&) ()
   from /home/shadowolf/catkin_wst/devel/lib//libur_controllers.so
#4  0x00007ffff7ba673a in controller_interface::ControllerBase::startRequest (
    this=0x7fffd8008760, time=...)
    at /opt/ros/melodic/include/controller_interface/controller_base.h:151
#5  0x00007ffff7b98af1 in controller_manager::ControllerManager::startControllers (this=0x7fffffffc7d0, time=...) at ./src/controller_manager.cpp:157
#6  0x00005555555a9644 in main (argc=<optimized out>, argv=<optimized out>)
---Type <return> to continue, or q <return> to quit---
    at /home/shadowolf/catkin_wst/src/Universal_Robots_ROS_Driver/ur_robot_driver/src/hardware_interface_node.cpp:144

@fmauch
Copy link
Collaborator

fmauch commented May 16, 2021

Hm, that looks different to your previous output, as we see the output [ERROR] [1621172924.100535602]: Pipeline producer overflowed! <RTDE Data Pipeline>...

@UmutUz
Copy link
Author

UmutUz commented May 17, 2021

Alrighty, I am back on the robots and this is my terminal:

NODES
  /
    robot_state_publisher (robot_state_publisher/robot_state_publisher)
  /ur10_left/
    base_tf_left (tf/static_transform_publisher)
    controller_stopper_left (controller_stopper/node)
    robot_state_publisher_left (robot_state_publisher/robot_state_publisher)
    ros_control_controller_spawner_left (controller_manager/spawner)
    ros_control_stopped_spawner_left (controller_manager/spawner)
    ur_hardware_interface_left (ur_robot_driver/ur_robot_driver_node)
  /ur10_left/ur_hardware_interface/
    ur_robot_state_helper_left (ur_robot_driver/robot_state_helper)
  /ur10_right/
    base_tf_right (tf/static_transform_publisher)
    controller_stopper_right (controller_stopper/node)
    ros_control_controller_spawner_right (controller_manager/spawner)
    ros_control_stopped_spawner_right (controller_manager/spawner)
    ur_hardware_interface_right (ur_robot_driver/ur_robot_driver_node)
  /ur10_right/ur_hardware_interface/
    ur_robot_state_helper_right (ur_robot_driver/robot_state_helper)

ROS_MASTER_URI=http://localhost:11311

process[robot_state_publisher-1]: started with pid [29451]
process[ur10_right/ur_hardware_interface_right-2]: started with pid [29452]
process[ur10_right/ros_control_controller_spawner_right-3]: started with pid [29453]
process[ur10_right/ros_control_stopped_spawner_right-4]: started with pid [29460]
process[ur10_right/controller_stopper_right-5]: started with pid [29467]
[ INFO] [1621252706.043088037]: Initializing dashboard client
process[ur10_right/ur_hardware_interface/ur_robot_state_helper_right-6]: started with pid [29470]
process[ur10_right/base_tf_right-7]: started with pid [29475]
process[ur10_left/ur_hardware_interface_left-8]: started with pid [29481]
[ INFO] [1621252706.061693297]: Waiting for controller manager service to come up on /ur10_right/controller_manager/switch_controller
[ WARN] [1621252706.063937501]: Shutdown request received.
process[ur10_left/ros_control_controller_spawner_left-9]: started with pid [29487]
[ INFO] [1621252706.068349535]: waitForService: Service [/ur10_right/controller_manager/switch_controller] has not been advertised, waiting...
[ WARN] [1621252706.068846947]: Reason given for shutdown: [[/robot_state_publisher] Reason: new node registered with same name]
process[ur10_left/ros_control_stopped_spawner_left-10]: started with pid [29493]
[ INFO] [1621252706.075524930]: waitForService: Service [/ur10_right/ur_hardware_interface/dashboard/play] has not been advertised, waiting...
process[ur10_left/controller_stopper_left-11]: started with pid [29495]
[ INFO] [1621252706.083939345]: Initializing dashboard client
[ INFO] [1621252706.084487494]: Initializing urdriver
Warning: No realtime capabilities found. Consider using a realtime system for better performance
         at line 396 in /tmp/binarydeb/ros-melodic-ur-client-library-0.1.1/include/ur_client_library/comm/pipeline.h
process[ur10_left/ur_hardware_interface/ur_robot_state_helper_left-12]: started with pid [29499]
[ INFO] [1621252706.095566263]: Waiting for controller manager service to come up on /ur10_left/controller_manager/switch_controller
[ INFO] [1621252706.097487555]: waitForService: Service [/ur10_left/controller_manager/switch_controller] has not been advertised, waiting...
[ INFO] [1621252706.098961958]: Initializing urdriver
Warning: No realtime capabilities found. Consider using a realtime system for better performance
         at line 396 in /tmp/binarydeb/ros-melodic-ur-client-library-0.1.1/include/ur_client_library/comm/pipeline.h
process[ur10_left/base_tf_left-13]: started with pid [29507]
[ INFO] [1621252706.113558499]: waitForService: Service [/ur10_left/ur_hardware_interface/dashboard/play] has not been advertised, waiting...
process[ur10_left/robot_state_publisher_left-14]: started with pid [29514]
[robot_state_publisher-1] process has finished cleanly
log file: /home/umut/.ros/log/d9f06eae-b6f6-11eb-9ae9-02426a5db20d/robot_state_publisher-1*.log
[INFO] [1621252706.374919]: Controller Spawner: Waiting for service controller_manager/load_controller
[INFO] [1621252706.375661]: Controller Spawner: Waiting for service controller_manager/load_controller
[INFO] [1621252706.379680]: Controller Spawner: Waiting for service controller_manager/load_controller
[INFO] [1621252706.381124]: Controller Spawner: Waiting for service controller_manager/load_controller
Warning: No realtime capabilities found. Consider using a realtime system for better performance
         at line 396 in /tmp/binarydeb/ros-melodic-ur-client-library-0.1.1/include/ur_client_library/comm/pipeline.h
Warning: No realtime capabilities found. Consider using a realtime system for better performance
         at line 396 in /tmp/binarydeb/ros-melodic-ur-client-library-0.1.1/include/ur_client_library/comm/pipeline.h
Warning: No realtime capabilities found. Consider using a realtime system for better performance
         at line 396 in /tmp/binarydeb/ros-melodic-ur-client-library-0.1.1/include/ur_client_library/comm/pipeline.h
[ INFO] [1621252708.304407066]: Loaded ur_robot_driver hardware_interface
[ INFO] [1621252708.335557475]: waitForService: Service [/ur10_left/controller_manager/switch_controller] is now available.
[ INFO] [1621252708.335579752]: Service available.
[ INFO] [1621252708.335590819]: Waiting for controller list service to come up on /ur10_left/controller_manager/list_controllers
[ INFO] [1621252708.335951376]: Service available.
[INFO] [1621252708.483223]: Controller Spawner: Waiting for service controller_manager/switch_controller
[INFO] [1621252708.484915]: Controller Spawner: Waiting for service controller_manager/unload_controller
[INFO] [1621252708.486361]: Loading controller: joint_state_controller_left
[INFO] [1621252708.488808]: Controller Spawner: Waiting for service controller_manager/switch_controller
[INFO] [1621252708.490922]: Controller Spawner: Waiting for service controller_manager/unload_controller
[INFO] [1621252708.492269]: Loading controller: pos_joint_traj_controller_left
Warning: No realtime capabilities found. Consider using a realtime system for better performance
         at line 396 in /tmp/binarydeb/ros-melodic-ur-client-library-0.1.1/include/ur_client_library/comm/pipeline.h
[ INFO] [1621252708.497344202]: Loaded ur_robot_driver hardware_interface
[INFO] [1621252708.497726]: Loading controller: scaled_pos_joint_traj_controller_left
[INFO] [1621252708.521848]: Loading controller: joint_group_vel_controller_left
[ INFO] [1621252708.533249060]: waitForService: Service [/ur10_right/controller_manager/switch_controller] is now available.
[ INFO] [1621252708.533276346]: Service available.
[ INFO] [1621252708.533295591]: Waiting for controller list service to come up on /ur10_right/controller_manager/list_controllers
[ INFO] [1621252708.533679985]: Service available.
[INFO] [1621252708.545702]: Loading controller: speed_scaling_state_controller_left
[INFO] [1621252708.553596]: Controller Spawner: Loaded controllers: pos_joint_traj_controller_left, joint_group_vel_controller_left
[INFO] [1621252708.561901]: Loading controller: force_torque_sensor_controller_left
[INFO] [1621252708.569683]: Controller Spawner: Loaded controllers: joint_state_controller_left, scaled_pos_joint_traj_controller_left, speed_scaling_state_controller_left, force_torque_sensor_controller_left
Traceback (most recent call last):
  File "/opt/ros/melodic/lib/controller_manager/spawner", line 212, in <module>
    if __name__ == '__main__': main()
  File "/opt/ros/melodic/lib/controller_manager/spawner", line 204, in main
    resp = switch_controller(loaded, [], 2, False, 0.0)
  File "/opt/ros/melodic/lib/python2.7/dist-packages/rospy/impl/tcpros_service.py", line 442, in __call__
    return self.call(*args, **kwds)
  File "/opt/ros/melodic/lib/python2.7/dist-packages/rospy/impl/tcpros_service.py", line 532, in call
    raise ServiceException("transport error completing service call: %s"%(str(e)))
rospy.service.ServiceException: transport error completing service call: unable to receive data from sender, check sender's logs for details
[INFO] [1621252708.659028]: Shutting down spawner. Stopping and unloading controllers...
[INFO] [1621252708.659911]: Stopping all controllers...
[WARN] [1621252708.661783]: Controller Spawner error while taking down controllers: unable to connect to service: [Errno 111] Connection refused
================================================================================REQUIRED process [ur10_left/ur_hardware_interface_left-8] has died!
process has died [pid 29481, exit code -11, cmd /home/umut/ws_moveit/devel/lib/ur_robot_driver/ur_robot_driver_node joint_states:=/joint_states __name:=ur_hardware_interface_left __log:=/home/umut/.ros/log/d9f06eae-b6f6-11eb-9ae9-02426a5db20d/ur10_left-ur_hardware_interface_left-8.log].
log file: /home/umut/.ros/log/d9f06eae-b6f6-11eb-9ae9-02426a5db20d/ur10_left-ur_hardware_interface_left-8*.log
Initiating shutdown!
================================================================================
[INFO] [1621252708.784593]: Controller Spawner: Waiting for service controller_manager/switch_controller
[INFO] [1621252708.785917]: Controller Spawner: Waiting for service controller_manager/unload_controller
[INFO] [1621252708.787083]: Loading controller: joint_state_controller_right
[INFO] [1621252708.787427]: Controller Spawner: Waiting for service controller_manager/switch_controller
[INFO] [1621252708.789012]: Controller Spawner: Waiting for service controller_manager/unload_controller
[INFO] [1621252708.790616]: Loading controller: pos_joint_traj_controller_right
[INFO] [1621252708.793378]: Loading controller: scaled_pos_joint_traj_controller_right
[INFO] [1621252708.817693]: Loading controller: joint_group_vel_controller_right
[ur10_left/robot_state_publisher_left-14] killing on exit
[ur10_left/base_tf_left-13] killing on exit
[ur10_left/ur_hardware_interface/ur_robot_state_helper_left-12] killing on exit
[ur10_left/controller_stopper_left-11] killing on exit
[ur10_left/ros_control_stopped_spawner_left-10] killing on exit
[ur10_left/ros_control_controller_spawner_left-9] killing on exit
[ur10_left/ur_hardware_interface_left-8] killing on exit
[ur10_right/base_tf_right-7] killing on exit
[ur10_right/ur_hardware_interface/ur_robot_state_helper_right-6] killing on exit
[ur10_right/controller_stopper_right-5] killing on exit
[ur10_right/ros_control_stopped_spawner_right-4] killing on exit
[INFO] [1621252708.832825]: Shutting down spawner. Stopping and unloading controllers...
[ur10_right/ros_control_controller_spawner_right-3] killing on exit
[INFO] [1621252708.833974]: Shutting down spawner. Stopping and unloading controllers...
[INFO] [1621252708.833975]: Shutting down spawner. Stopping and unloading controllers...
[INFO] [1621252708.834045]: Stopping all controllers...
[INFO] [1621252708.835280]: Stopping all controllers...
[INFO] [1621252708.835353]: Stopping all controllers...
[WARN] [1621252708.836865]: Controller Spawner error while taking down controllers: unable to connect to service: [Errno 111] Connection refused
[ERROR] [1621252708.849216666]: Could not stop controller 'joint_state_controller_right' since it is not running
[ERROR] [1621252708.849266222]: Could not stop controller 'pos_joint_traj_controller_right' since it is not running
[INFO] [1621252708.849469]: Unloading all loaded controllers...
[INFO] [1621252708.849469]: Unloading all loaded controllers...
[INFO] [1621252708.850494]: Trying to unload pos_joint_traj_controller_right
[INFO] [1621252708.850617]: Trying to unload joint_state_controller_right
[INFO] [1621252708.859784]: Succeeded in unloading pos_joint_traj_controller_right
[INFO] [1621252708.866391]: Succeeded in unloading joint_state_controller_right
Traceback (most recent call last):
  File "/opt/ros/melodic/lib/controller_manager/spawner", line 212, in <module>
    if __name__ == '__main__': main()
  File "/opt/ros/melodic/lib/controller_manager/spawner", line 190, in main
    resp = load_controller(name)
  File "/opt/ros/melodic/lib/python2.7/dist-packages/rospy/impl/tcpros_service.py", line 442, in __call__
    return self.call(*args, **kwds)
  File "/opt/ros/melodic/lib/python2.7/dist-packages/rospy/impl/tcpros_service.py", line 530, in call
    raise rospy.exceptions.ROSInterruptException("node shutdown interrupted service call")
rospy.exceptions.ROSInterruptException: node shutdown interrupted service call
Traceback (most recent call last):
  File "/opt/ros/melodic/lib/controller_manager/spawner", line 212, in <module>
    if __name__ == '__main__': main()
  File "/opt/ros/melodic/lib/controller_manager/spawner", line 190, in main
    resp = load_controller(name)
  File "/opt/ros/melodic/lib/python2.7/dist-packages/rospy/impl/tcpros_service.py", line 442, in __call__
    return self.call(*args, **kwds)
  File "/opt/ros/melodic/lib/python2.7/dist-packages/rospy/impl/tcpros_service.py", line 530, in call
    raise rospy.exceptions.ROSInterruptException("node shutdown interrupted service call")
rospy.exceptions.ROSInterruptException: node shutdown interrupted service call
[ur10_right/ur_hardware_interface_right-2] killing on exit
Interrupt signal (2) received.
terminate called without an active exception
[ur10_left/controller_stopper_left-11] escalating to SIGTERM
[ur10_right/controller_stopper_right-5] escalating to SIGTERM
shutting down processing monitor...
... shutting down processing monitor complete
done

I also tried a few times to get the right output out for comparison:

NODES
  /
    robot_state_publisher (robot_state_publisher/robot_state_publisher)
  /ur10_left/
    base_tf_left (tf/static_transform_publisher)
    controller_stopper_left (controller_stopper/node)
    robot_state_publisher_left (robot_state_publisher/robot_state_publisher)
    ros_control_controller_spawner_left (controller_manager/spawner)
    ros_control_stopped_spawner_left (controller_manager/spawner)
    ur_hardware_interface_left (ur_robot_driver/ur_robot_driver_node)
  /ur10_left/ur_hardware_interface/
    ur_robot_state_helper_left (ur_robot_driver/robot_state_helper)
  /ur10_right/
    base_tf_right (tf/static_transform_publisher)
    controller_stopper_right (controller_stopper/node)
    ros_control_controller_spawner_right (controller_manager/spawner)
    ros_control_stopped_spawner_right (controller_manager/spawner)
    ur_hardware_interface_right (ur_robot_driver/ur_robot_driver_node)
  /ur10_right/ur_hardware_interface/
    ur_robot_state_helper_right (ur_robot_driver/robot_state_helper)

ROS_MASTER_URI=http://localhost:11311

process[robot_state_publisher-1]: started with pid [1687]
process[ur10_right/ur_hardware_interface_right-2]: started with pid [1688]
process[ur10_right/ros_control_controller_spawner_right-3]: started with pid [1690]
process[ur10_right/ros_control_stopped_spawner_right-4]: started with pid [1696]
[ INFO] [1621253131.490735554]: Initializing dashboard client
process[ur10_right/controller_stopper_right-5]: started with pid [1705]
process[ur10_right/ur_hardware_interface/ur_robot_state_helper_right-6]: started with pid [1706]
process[ur10_right/base_tf_right-7]: started with pid [1708]
[ WARN] [1621253131.503369150]: Shutdown request received.
[ WARN] [1621253131.507499739]: Reason given for shutdown: [[/robot_state_publisher] Reason: new node registered with same name]
process[ur10_left/ur_hardware_interface_left-8]: started with pid [1716]
[ INFO] [1621253131.512945085]: Waiting for controller manager service to come up on /ur10_right/controller_manager/switch_controller
[ INFO] [1621253131.515976889]: waitForService: Service [/ur10_right/controller_manager/switch_controller] has not been advertised, waiting...
[ INFO] [1621253131.520295232]: waitForService: Service [/ur10_right/ur_hardware_interface/dashboard/play] has not been advertised, waiting...
[ INFO] [1621253131.522998555]: Initializing urdriver
process[ur10_left/ros_control_controller_spawner_left-9]: started with pid [1724]
Warning: No realtime capabilities found. Consider using a realtime system for better performance
         at line 396 in /tmp/binarydeb/ros-melodic-ur-client-library-0.1.1/include/ur_client_library/comm/pipeline.h
process[ur10_left/ros_control_stopped_spawner_left-10]: started with pid [1733]
[ INFO] [1621253131.534807723]: Initializing dashboard client
process[ur10_left/controller_stopper_left-11]: started with pid [1739]
[ INFO] [1621253131.545180608]: Initializing urdriver
Warning: No realtime capabilities found. Consider using a realtime system for better performance
         at line 396 in /tmp/binarydeb/ros-melodic-ur-client-library-0.1.1/include/ur_client_library/comm/pipeline.h
process[ur10_left/ur_hardware_interface/ur_robot_state_helper_left-12]: started with pid [1741]
[ INFO] [1621253131.552833516]: Waiting for controller manager service to come up on /ur10_left/controller_manager/switch_controller
[ INFO] [1621253131.553808238]: waitForService: Service [/ur10_left/controller_manager/switch_controller] has not been advertised, waiting...
process[ur10_left/base_tf_left-13]: started with pid [1750]
[ INFO] [1621253131.565234147]: waitForService: Service [/ur10_left/ur_hardware_interface/dashboard/play] has not been advertised, waiting...
process[ur10_left/robot_state_publisher_left-14]: started with pid [1756]
[robot_state_publisher-1] process has finished cleanly
log file: /home/umut/.ros/log/d9f06eae-b6f6-11eb-9ae9-02426a5db20d/robot_state_publisher-1*.log
[INFO] [1621253131.814346]: Controller Spawner: Waiting for service controller_manager/load_controller
[INFO] [1621253131.834059]: Controller Spawner: Waiting for service controller_manager/load_controller
[INFO] [1621253131.851602]: Controller Spawner: Waiting for service controller_manager/load_controller
[INFO] [1621253131.861783]: Controller Spawner: Waiting for service controller_manager/load_controller
Warning: No realtime capabilities found. Consider using a realtime system for better performance
         at line 396 in /tmp/binarydeb/ros-melodic-ur-client-library-0.1.1/include/ur_client_library/comm/pipeline.h
Warning: No realtime capabilities found. Consider using a realtime system for better performance
         at line 396 in /tmp/binarydeb/ros-melodic-ur-client-library-0.1.1/include/ur_client_library/comm/pipeline.h
Warning: No realtime capabilities found. Consider using a realtime system for better performance
         at line 396 in /tmp/binarydeb/ros-melodic-ur-client-library-0.1.1/include/ur_client_library/comm/pipeline.h
[ INFO] [1621253133.716795831]: Loaded ur_robot_driver hardware_interface
[ INFO] [1621253133.760086590]: waitForService: Service [/ur10_left/controller_manager/switch_controller] is now available.
[ INFO] [1621253133.760119380]: Service available.
[ INFO] [1621253133.760138097]: Waiting for controller list service to come up on /ur10_left/controller_manager/list_controllers
[ INFO] [1621253133.760654615]: Service available.
Warning: No realtime capabilities found. Consider using a realtime system for better performance
         at line 396 in /tmp/binarydeb/ros-melodic-ur-client-library-0.1.1/include/ur_client_library/comm/pipeline.h
[ INFO] [1621253133.937167151]: Loaded ur_robot_driver hardware_interface
[INFO] [1621253133.959260]: Controller Spawner: Waiting for service controller_manager/switch_controller
[INFO] [1621253133.962547]: Controller Spawner: Waiting for service controller_manager/unload_controller
[ INFO] [1621253133.964220589]: waitForService: Service [/ur10_right/controller_manager/switch_controller] is now available.
[ INFO] [1621253133.964272416]: Service available.
[ INFO] [1621253133.964289458]: Waiting for controller list service to come up on /ur10_right/controller_manager/list_controllers
[ INFO] [1621253133.964800578]: Service available.
[INFO] [1621253133.965341]: Loading controller: joint_state_controller_left
[INFO] [1621253133.969001]: Controller Spawner: Waiting for service controller_manager/switch_controller
[INFO] [1621253133.971475]: Controller Spawner: Waiting for service controller_manager/unload_controller
[INFO] [1621253133.971777]: Loading controller: scaled_pos_joint_traj_controller_left
[INFO] [1621253133.974447]: Loading controller: pos_joint_traj_controller_left
[INFO] [1621253134.003846]: Loading controller: speed_scaling_state_controller_left
[INFO] [1621253134.027705]: Loading controller: joint_group_vel_controller_left
[INFO] [1621253134.035825]: Loading controller: force_torque_sensor_controller_left
[INFO] [1621253134.043817]: Controller Spawner: Loaded controllers: pos_joint_traj_controller_left, joint_group_vel_controller_left
[INFO] [1621253134.051853]: Controller Spawner: Loaded controllers: joint_state_controller_left, scaled_pos_joint_traj_controller_left, speed_scaling_state_controller_left, force_torque_sensor_controller_left
[INFO] [1621253134.060004]: Started controllers: joint_state_controller_left, scaled_pos_joint_traj_controller_left, speed_scaling_state_controller_left, force_torque_sensor_controller_left
[INFO] [1621253134.221840]: Controller Spawner: Waiting for service controller_manager/switch_controller
[INFO] [1621253134.223295]: Controller Spawner: Waiting for service controller_manager/unload_controller
[INFO] [1621253134.224590]: Loading controller: joint_state_controller_right
[INFO] [1621253134.232143]: Loading controller: scaled_pos_joint_traj_controller_right
[INFO] [1621253134.241626]: Controller Spawner: Waiting for service controller_manager/switch_controller
[INFO] [1621253134.243750]: Controller Spawner: Waiting for service controller_manager/unload_controller
[INFO] [1621253134.247491]: Loading controller: pos_joint_traj_controller_right
[INFO] [1621253134.264364]: Loading controller: speed_scaling_state_controller_right
[INFO] [1621253134.288864]: Loading controller: joint_group_vel_controller_right
[INFO] [1621253134.296280]: Loading controller: force_torque_sensor_controller_right
[INFO] [1621253134.304617]: Controller Spawner: Loaded controllers: pos_joint_traj_controller_right, joint_group_vel_controller_right
[INFO] [1621253134.312317]: Controller Spawner: Loaded controllers: joint_state_controller_right, scaled_pos_joint_traj_controller_right, speed_scaling_state_controller_right, force_torque_sensor_controller_rightThread 1 "ur_robot_driver" received signal SIGSEGV, Segmentation fault.
0x00007fffd439da49 in joint_trajectory_controller::TrajectoryBuilder<trajectory_interface::QuinticSplineSegment<double> >::createGoalHandlePtr() const ()
   from /opt/ros/melodic/lib//libjoint_trajectory_controller.so
(gdb) bt
#0  0x00007fffd439da49 in joint_trajectory_controller::TrajectoryBuilder<trajectory_interface::QuinticSplineSegment<double> >::createGoalHandlePtr() const ()
   from /opt/ros/melodic/lib//libjoint_trajectory_controller.so
#1  0x00007fffd439e429 in joint_trajectory_controller::StopTrajectoryBuilder<trajectory_interface::QuinticSplineSegment<double> >::buildTrajectory(std::vector<std::vector<joint_trajectory_controller::JointTrajectorySegment<trajectory_interface::QuinticSplineSegment<double> >, std::allocator<joint_trajectory_controller::JointTrajectorySegment<trajectory_interface::QuinticSplineSegment<double> > > >, std::allocator<std::vector<joint_trajectory_controller::JointTrajectorySegment<trajectory_interface::QuinticSplineSegment<double> >, std::allocator<joint_trajectory_controller::JointTrajectorySegment<trajectory_interface::QuinticSplineSegment<double> > > > > >*) () from /opt/ros/melodic/lib//libjoint_trajectory_controller.so
#2  0x00007fffc865e807 in joint_trajectory_controller::JointTrajectoryController<trajectory_interface::QuinticSplineSegment<double>, ur_controllers::ScaledPositionJointInterface>::setHoldPosition(ros::Time const&, boost::shared_ptr<realtime_tools::RealtimeServerGoalHandle<control_msgs::FollowJointTrajectoryAction_<std::allocator<void> > > >) () from /home/umut/ws_moveit/devel/lib//libur_controllers.so
#3  0x00007fffc864cbb2 in joint_trajectory_controller::JointTrajectoryController<trajectory_interface::QuinticSplineSegment<double>, ur_controllers::ScaledPositionJointInterface>::starting(ros::Time const&) () from /home/umut/ws_moveit/devel/lib//libur_controllers.so
#4  0x00007ffff7ba673a in controller_interface::ControllerBase::startRequest(ros::Time const&) () from /opt/ros/melodic/lib/libcontroller_manager.so
#5  0x00007ffff7b98af1 in controller_manager::ControllerManager::startControllers(ros::Time const&) () from /opt/ros/melodic/lib/libcontroller_manager.so
#6  0x00005555555a9a04 in main (argc=<optimized out>, argv=<optimized out>) at /home/umut/ws_moveit/src/Universal_Robots_ROS_Driver/ur_robot_driver/src/hardware_interface_node.cpp:144

[INFO] [1621253134.320431]: Started controllers: joint_state_controller_right, scaled_pos_joint_traj_controller_right, speed_scaling_state_controller_right, force_torque_sensor_controller_right

The shutdown request in between can be ignored, everything still works fine and problems occurred after updates! I hope this does help?

Edit: the shutdown request was from another rviz which I forgot to close before connecting to the robots (oops, sorry). It can be completely ignored.

Edit part 2: (sorry for those)

I did the debug:=true method which wouldn't work because of ROS killing processes before I could enter bt. Anyway: This is what happens when I use debug:=true but the controllers actually load:


Thread 1 "ur_robot_driver" received signal SIGSEGV, Segmentation fault.
0x00007fffd439da49 in joint_trajectory_controller::TrajectoryBuilder<trajectory_interface::QuinticSplineSegment<double> >::createGoalHandlePtr() const ()
   from /opt/ros/melodic/lib//libjoint_trajectory_controller.so
(gdb) bt
#0  0x00007fffd439da49 in joint_trajectory_controller::TrajectoryBuilder<trajectory_interface::QuinticSplineSegment<double> >::createGoalHandlePtr() const ()
   from /opt/ros/melodic/lib//libjoint_trajectory_controller.so
#1  0x00007fffd439e429 in joint_trajectory_controller::StopTrajectoryBuilder<trajectory_interface::QuinticSplineSegment<double> >::buildTrajectory(std::vector<std::vector<joint_trajectory_controller::JointTrajectorySegment<trajectory_interface::QuinticSplineSegment<double> >, std::allocator<joint_trajectory_controller::JointTrajectorySegment<trajectory_interface::QuinticSplineSegment<double> > > >, std::allocator<std::vector<joint_trajectory_controller::JointTrajectorySegment<trajectory_interface::QuinticSplineSegment<double> >, std::allocator<joint_trajectory_controller::JointTrajectorySegment<trajectory_interface::QuinticSplineSegment<double> > > > > >*) () from /opt/ros/melodic/lib//libjoint_trajectory_controller.so
#2  0x00007fffc865e807 in joint_trajectory_controller::JointTrajectoryController<trajectory_interface::QuinticSplineSegment<double>, ur_controllers::ScaledPositionJointInterface>::setHoldPosition(ros::Time const&, boost::shared_ptr<realtime_tools::RealtimeServerGoalHandle<control_msgs::FollowJointTrajectoryAction_<std::allocator<void> > > >) () from /home/umut/ws_moveit/devel/lib//libur_controllers.so
#3  0x00007fffc864cbb2 in joint_trajectory_controller::JointTrajectoryController<trajectory_interface::QuinticSplineSegment<double>, ur_controllers::ScaledPositionJointInterface>::starting(ros::Time const&) () from /home/umut/ws_moveit/devel/lib//libur_controllers.so
#4  0x00007ffff7ba673a in controller_interface::ControllerBase::startRequest(ros::Time const&) () from /opt/ros/melodic/lib/libcontroller_manager.so
#5  0x00007ffff7b98af1 in controller_manager::ControllerManager::startControllers(ros::Time const&) () from /opt/ros/melodic/lib/libcontroller_manager.so
#6  0x00005555555a9a04 in main (argc=<optimized out>, argv=<optimized out>) at /home/umut/ws_moveit/src/Universal_Robots_ROS_Driver/ur_robot_driver/src/hardware_interface_node.cpp:144

@UmutUz
Copy link
Author

UmutUz commented May 18, 2021

So, today I ran again sudo apt upgrade and got a huge amount of packages to upgrade (practically everything).

Well, things got way worse now. I can't get the driver to start:

ROS_MASTER_URI=http://localhost:11311

process[robot_state_publisher-1]: started with pid [20579]
process[ur10_right/ur_hardware_interface_right-2]: started with pid [20580]
process[ur10_right/ros_control_controller_spawner_right-3]: started with pid [20581]
/home/umut/ws_moveit/devel/lib/ur_robot_driver/ur_robot_driver_node: symbol lookup error: /home/umut/ws_moveit/devel/lib/ur_robot_driver/ur_robot_driver_node: undefined symbol: _ZN4urcl4comm8URServerD1Ev
process[ur10_right/ros_control_stopped_spawner_right-4]: started with pid [20587]
process[ur10_right/controller_stopper_right-5]: started with pid [20588]
process[ur10_right/ur_hardware_interface/ur_robot_state_helper_right-6]: started with pid [20590]
[ INFO] [1621330028.294063885]: Waiting for controller manager service to come up on /ur10_right/controller_manager/switch_controller
[ INFO] [1621330028.294730902]: waitForService: Service [/ur10_right/controller_manager/switch_controller] has not been advertised, waiting...
process[ur10_right/base_tf_right-7]: started with pid [20596]
[ INFO] [1621330028.300142089]: waitForService: Service [/ur10_right/ur_hardware_interface/dashboard/play] has not been advertised, waiting...
process[ur10_left/ur_hardware_interface_left-8]: started with pid [20602]
/home/umut/ws_moveit/devel/lib/ur_robot_driver/ur_robot_driver_node: symbol lookup error: /home/umut/ws_moveit/devel/lib/ur_robot_driver/ur_robot_driver_node: undefined symbol: _ZN4urcl4comm8URServerD1Ev
process[ur10_left/ros_control_controller_spawner_left-9]: started with pid [20604]
process[ur10_left/ros_control_stopped_spawner_left-10]: started with pid [20609]
process[ur10_left/controller_stopper_left-11]: started with pid [20610]
process[ur10_left/ur_hardware_interface/ur_robot_state_helper_left-12]: started with pid [20611]
[ INFO] [1621330028.327762039]: Waiting for controller manager service to come up on /ur10_left/controller_manager/switch_controller
[ INFO] [1621330028.329061053]: waitForService: Service [/ur10_left/controller_manager/switch_controller] has not been advertised, waiting...
process[ur10_left/base_tf_left-13]: started with pid [20616]
[ INFO] [1621330028.334986899]: waitForService: Service [/ur10_left/ur_hardware_interface/dashboard/play] has not been advertised, waiting...
process[ur10_left/robot_state_publisher_left-14]: started with pid [20623]
================================================================================REQUIRED process [ur10_right/ur_hardware_interface_right-2] has died!
process has died [pid 20580, exit code 127, cmd /home/umut/ws_moveit/devel/lib/ur_robot_driver/ur_robot_driver_node joint_states:=/joint_states __name:=ur_hardware_interface_right __log:=/home/umut/.ros/log/a0fdce3e-b7b9-11eb-bc97-5405dbcff6cc/ur10_right-ur_hardware_interface_right-2.log].
log file: /home/umut/.ros/log/a0fdce3e-b7b9-11eb-bc97-5405dbcff6cc/ur10_right-ur_hardware_interface_right-2*.log
Initiating shutdown!
================================================================================
[ur10_left/robot_state_publisher_left-14] killing on exit
[ur10_left/base_tf_left-13] killing on exit
[ur10_left/ur_hardware_interface/ur_robot_state_helper_left-12] killing on exit
[ur10_left/controller_stopper_left-11] killing on exit
[ur10_left/ros_control_stopped_spawner_left-10] killing on exit
[ur10_left/ros_control_controller_spawner_left-9] killing on exit
[ur10_left/ur_hardware_interface_left-8] killing on exit
[ur10_right/base_tf_right-7] killing on exit
[ur10_right/ur_hardware_interface/ur_robot_state_helper_right-6] killing on exit
[ur10_right/controller_stopper_right-5] killing on exit
Traceback (most recent call last):
  File "/opt/ros/melodic/lib/controller_manager/spawner", line 38, in <module>
    import rospy, sys
  File "/opt/ros/melodic/lib/python2.7/dist-packages/rospy/__init__.py", line 49, in <module>
    from .client import spin, myargv, init_node, \
  File "/opt/ros/melodic/lib/python2.7/dist-packages/rospy/client.py", line 52, in <module>
    import roslib
  File "/opt/ros/melodic/lib/python2.7/dist-packages/roslib/__init__.py", line 50, in <module>
    from roslib.launcher import load_manifest  # noqa: F401
  File "/opt/ros/melodic/lib/python2.7/dist-packages/roslib/launcher.py", line 42, in <module>
    import rospkg
  File "/usr/lib/python2.7/dist-packages/rospkg/__init__.py", line 42, in <module>
    from .rospack import expand_to_packages, get_package_name, \
  File "/usr/lib/python2.7/dist-packages/rospkg/rospack.py", line 37, in <module>
Traceback (most recent call last):
  File "/opt/ros/melodic/lib/controller_manager/spawner", line 38, in <module>
    import rospy, sys
[ur10_right/ros_control_stopped_spawner_right-4] killing on exit
  File "/opt/ros/melodic/lib/python2.7/dist-packages/rospy/__init__.py", line 49, in <module>
    from .client import spin, myargv, init_node, \
  File "/opt/ros/melodic/lib/python2.7/dist-packages/rospy/client.py", line 52, in <module>
    import roslib
  File "/opt/ros/melodic/lib/python2.7/dist-packages/roslib/__init__.py", line 53, in <module>
    import roslib.stacks  # noqa: F401, I100
  File "/opt/ros/melodic/lib/python2.7/dist-packages/roslib/stacks.py", line 45, in <module>
    import roslib.packages
  File "/opt/ros/melodic/lib/python2.7/dist-packages/roslib/packages.py", line 45, in <module>
    from subprocess import PIPE
  File "/usr/lib/python2.7/subprocess.py", line 79, in <module>
    import pickle
  File "/usr/lib/python2.7/pickle.py", line 165, in <module>
    from xml.etree.cElementTree import ElementTree
  File "/usr/lib/python2.7/xml/etree/cElementTree.py", line 3, in <module>
    __all__.extend([x for x in dir() if re.match("[A-Z][A-Z0-9_]+$",x)])
  File "/usr/lib/python2.7/re.py", line 141, in match
    return _compile(pattern, flags).match(string)
  File "/usr/lib/python2.7/re.py", line 249, in _compile
    p = sre_compile.compile(pattern, flags)
  File "/usr/lib/python2.7/sre_compile.py", line 576, in compile
    code = _code(p, flags)
  File "/usr/lib/python2.7/sre_compile.py", line 558, in _code
    _compile_info(code, p, flags)
  File "/usr/lib/python2.7/sre_compile.py", line 536, in _compile_info
    _compile_charset(charset, flags, code)
  File "/usr/lib/python2.7/sre_compile.py", line 232, in _compile_charset
    flags & SRE_FLAG_UNICODE):
  File "/usr/lib/python2.7/sre_compile.py", line 316, in _optimize_charset
    p = charmap.find(b'\1', q)
KeyboardInterrupt
    from _elementtree import *
  File "<string>", line 1, in <module>
KeyboardInterrupt
[ur10_right/ros_control_controller_spawner_right-3] killing on exit
[ur10_right/ur_hardware_interface_right-2] killing on exit
[robot_state_publisher-1] killing on exit
[INFO] [1621330028.682568]: Controller Spawner: Waiting for service controller_manager/load_controller
Traceback (most recent call last):
  File "/opt/ros/melodic/lib/controller_manager/spawner", line 212, in <module>
    if __name__ == '__main__': main()
  File "/opt/ros/melodic/lib/controller_manager/spawner", line 105, in main
    rospy.init_node('spawner', anonymous=True)
  File "/opt/ros/melodic/lib/python2.7/dist-packages/rospy/client.py", line 323, in init_node
    raise rospy.exceptions.ROSInitException("init_node interrupted before it could complete")
rospy.exceptions.ROSInitException: init_node interrupted before it could complete
[WARN] [1621330028.683349]: Controller Spawner couldn't find the expected controller_manager ROS interface.
[ur10_left/controller_stopper_left-11] escalating to SIGTERM
[ur10_right/controller_stopper_right-5] escalating to SIGTERM
shutting down processing monitor...
... shutting down processing monitor complete
done

And sometimes somthing like this happens:

ROS_MASTER_URI=http://localhost:11311

process[robot_state_publisher-1]: started with pid [19641]
process[ur10_right/ur_hardware_interface_right-2]: started with pid [19642]
process[ur10_right/ros_control_controller_spawner_right-3]: started with pid [19643]
/home/umut/ws_moveit/devel/lib/ur_robot_driver/ur_robot_driver_node: symbol lookup error: /home/umut/ws_moveit/devel/lib/ur_robot_driver/ur_robot_driver_node: undefined symbol: _ZN4urcl4comm8URServerD1Ev
process[ur10_right/ros_control_stopped_spawner_right-4]: started with pid [19649]
process[ur10_right/controller_stopper_right-5]: started with pid [19650]
process[ur10_right/ur_hardware_interface/ur_robot_state_helper_right-6]: started with pid [19652]
[ INFO] [1621329964.771343677]: Waiting for controller manager service to come up on /ur10_right/controller_manager/switch_controller
[ INFO] [1621329964.771943414]: waitForService: Service [/ur10_right/controller_manager/switch_controller] has not been advertised, waiting...
process[ur10_right/base_tf_right-7]: started with pid [19658]
process[ur10_left/ur_hardware_interface_left-8]: started with pid [19663]
[ INFO] [1621329964.781433935]: waitForService: Service [/ur10_right/ur_hardware_interface/dashboard/play] has not been advertised, waiting...
process[ur10_left/ros_control_controller_spawner_left-9]: started with pid [19670]
/home/umut/ws_moveit/devel/lib/ur_robot_driver/ur_robot_driver_node: symbol lookup error: /home/umut/ws_moveit/devel/lib/ur_robot_driver/ur_robot_driver_node: undefined symbol: _ZN4urcl4comm8URServerD1Ev
[ WARN] [1621329964.788911047]: Shutdown request received.
[ WARN] [1621329964.789594658]: Reason given for shutdown: [[/robot_state_publisher] Reason: new node registered with same name]
[ WARN] [1621329964.790967054]: Shutdown request received.
[ WARN] [1621329964.791026033]: Reason given for shutdown: [[/ur10_right/controller_stopper_right] Reason: new node registered with same name]
[ WARN] [1621329964.792591094]: Shutdown request received.
[ WARN] [1621329964.792615715]: Reason given for shutdown: [[/ur10_right/ur_hardware_interface/ur_robot_state_helper_right] Reason: new node registered with same name]
process[ur10_left/ros_control_stopped_spawner_left-10]: started with pid [19671]
[ WARN] [1621329964.793477176]: Shutdown request received.
[ WARN] [1621329964.794063266]: Reason given for shutdown: [[/ur10_right/base_tf_right] Reason: new node registered with same name]
[ WARN] [1621329964.795156620]: Shutdown request received.
[ WARN] [1621329964.795852735]: Reason given for shutdown: [[/robot_state_publisher] Reason: new node registered with same name]
[ WARN] [1621329964.796331051]: Shutdown request received.
[ WARN] [1621329964.797017475]: Reason given for shutdown: [[/ur10_right/base_tf_right] Reason: new node registered with same name]
process[ur10_left/controller_stopper_left-11]: started with pid [19672]
================================================================================REQUIRED process [ur10_right/ur_hardware_interface_right-2] has died!
process has died [pid 19642, exit code 127, cmd /home/umut/ws_moveit/devel/lib/ur_robot_driver/ur_robot_driver_node joint_states:=/joint_states __name:=ur_hardware_interface_right __log:=/home/umut/.ros/log/a0fdce3e-b7b9-11eb-bc97-5405dbcff6cc/ur10_right-ur_hardware_interface_right-2.log].
log file: /home/umut/.ros/log/a0fdce3e-b7b9-11eb-bc97-5405dbcff6cc/ur10_right-ur_hardware_interface_right-2*.log
Initiating shutdown!
================================================================================
process[ur10_left/ur_hardware_interface/ur_robot_state_helper_left-12]: started with pid [19673]
RLException: cannot add process [ur10_left/base_tf_left-13] after process monitor has been shut down
The traceback for the exception was written to the log file
[ INFO] [1621329964.828980621]: Waiting for controller manager service to come up on /ur10_left/controller_manager/switch_controller
[ INFO] [1621329964.830318121]: waitForService: Service [/ur10_left/controller_manager/switch_controller] has not been advertised, waiting...
[ INFO] [1621329964.831517860]: waitForService: Service [/ur10_left/ur_hardware_interface/dashboard/play] has not been advertised, waiting...
[ur10_left/ur_hardware_interface/ur_robot_state_helper_left-12] killing on exit
[ur10_left/controller_stopper_left-11] killing on exit
[ur10_left/ros_control_stopped_spawner_left-10] killing on exit
[ur10_left/ros_control_controller_spawner_left-9] killing on exit
[ur10_left/ur_hardware_interface_left-8] killing on exit
[ur10_right/base_tf_right-7] killing on exit
[ur10_right/ur_hardware_interface/ur_robot_state_helper_right-6] killing on exit
[ur10_right/controller_stopper_right-5] killing on exit
umut@umut-Lenovo:~$ [INFO] [1621329965.051524]: Controller Spawner: Waiting for service controller_manager/load_controller
[INFO] [1621329965.073285]: Controller Spawner: Waiting for service controller_manager/load_controller
shutdown request: [/ur10_left/ros_control_controller_spawner_left] Reason: new node registered with same name
[INFO] [1621329965.101386]: Controller Spawner: Waiting for service controller_manager/load_controller
[INFO] [1621329965.118321]: Controller Spawner: Waiting for service controller_manager/load_controller
shutdown request: [/ur10_left/ros_control_stopped_spawner_left] Reason: new node registered with same name
[WARN] [1621329965.219465]: Controller Spawner couldn't find the expected controller_manager ROS interface.
[WARN] [1621329965.248403]: Controller Spawner couldn't find the expected controller_manager ROS interface.
shutdown request: [/ur10_left/ros_control_stopped_spawner_left] Reason: new node registered with same name
shutdown request: [/ur10_left/ros_control_controller_spawner_left] Reason: new node registered with same name
[WARN] [1621329965.375133]: Controller Spawner couldn't find the expected controller_manager ROS interface.
[WARN] [1621329965.419967]: Controller Spawner couldn't find the expected controller_manager ROS interface.

@gavanderhoorn
Copy link
Contributor

After updating, have you cleaned your workspace and then rebuilt it?

@UmutUz
Copy link
Author

UmutUz commented May 18, 2021

I just did that and now the driver won't build (among other things) giving me this error:

/home/umut/ws_moveit/src/descartes/descartes_moveit/src/seed_search.cpp: In function ‘bool doIK(moveit::core::RobotState&, const moveit::core::JointModelGroup*, const string&, const string&, const Isometry3d&, const JointConfig&, JointConfig&)’:
/home/umut/ws_moveit/src/descartes/descartes_moveit/src/seed_search.cpp:64:65: warning: ‘bool moveit::core::RobotState::setFromIK(const moveit::core::JointModelGroup*, const Isometry3d&, const string&, unsigned int, double, const GroupStateValidityCallbackFn&, const kinematics::KinematicsQueryOptions&)’ is deprecated: The attempts argument is not supported anymore. [-Wdeprecated-declarations]
   if (!state.setFromIK(group, pose, tool, N_ATTEMPTS, IK_TIMEOUT))
                                                                 ^
In file included from /home/umut/ws_moveit/src/descartes/descartes_moveit/include/descartes_moveit/seed_search.h:38:0,
                 from /home/umut/ws_moveit/src/descartes/descartes_moveit/src/seed_search.cpp:20:
/opt/ros/melodic/include/moveit/robot_state/robot_state.h:1033:3: note: declared here
   setFromIK(const JointModelGroup* group, const Eigen::Isometry3d& pose, const std::string& tip,
   ^~~~~~~~~
/home/umut/ws_moveit/src/Universal_Robots_ROS_Driver/ur_calibration/src/calibration_consumer.cpp: In member function ‘virtual bool ur_calibration::CalibrationConsumer::consume(std::shared_ptr<urcl::primary_interface::PrimaryPackage>)’:
/home/umut/ws_moveit/src/Universal_Robots_ROS_Driver/ur_calibration/src/calibration_consumer.cpp:41:5: error: ‘LOG_INFO’ was not declared in this scope
     LOG_INFO("%s", product->toString().c_str());
     ^~~~~~~~
/home/umut/ws_moveit/src/Universal_Robots_ROS_Driver/ur_calibration/src/calibration_consumer.cpp:41:5: note: suggested alternative: ‘ROS_INFO’
     LOG_INFO("%s", product->toString().c_str());
     ^~~~~~~~
     ROS_INFO
/home/umut/ws_moveit/src/Universal_Robots_ROS_Driver/ur_robot_driver/src/hardware_interface.cpp: In member function ‘bool ur_driver::HardwareInterface::setIO(ur_msgs::SetIORequest&, ur_msgs::SetIOResponse&)’:
/home/umut/ws_moveit/src/Universal_Robots_ROS_Driver/ur_robot_driver/src/hardware_interface.cpp:871:5: error: ‘LOG_ERROR’ was not declared in this scope
     LOG_ERROR("Cannot execute function %u. This is not (yet) supported.", req.fun);
     ^~~~~~~~~
In file included from /opt/ros/melodic/include/moveit/robot_model_loader/robot_model_loader.h:43:0,
                 from /home/umut/ws_moveit/src/descartes/descartes_moveit/include/descartes_moveit/moveit_state_adapter.h:26,
                 from /home/umut/ws_moveit/src/descartes/descartes_moveit/include/descartes_moveit/ikfast_moveit_state_adapter.h:22,
                 from /home/umut/ws_moveit/src/descartes/descartes_moveit/src/ikfast_moveit_state_adapter.cpp:19:
/opt/ros/melodic/include/moveit/kinematics_plugin_loader/kinematics_plugin_loader.h: In constructor ‘kinematics_plugin_loader::KinematicsPluginLoader::KinematicsPluginLoader(const string&, double, unsigned int, const string&, double)’:
/opt/ros/melodic/include/moveit/kinematics_plugin_loader/kinematics_plugin_loader.h:71:95: warning: unused parameter ‘ik_attempts’ [-Wunused-parameter]
   KinematicsPluginLoader(const std::string& solver_plugin, double solve_timeout, unsigned int ik_attempts,
                                                                                               ^~~~~~~~~~~
/home/umut/ws_moveit/src/Universal_Robots_ROS_Driver/ur_robot_driver/src/hardware_interface.cpp:871:5: note: suggested alternative: ‘SO_ERROR’
     LOG_ERROR("Cannot execute function %u. This is not (yet) supported.", req.fun);
     ^~~~~~~~~
     SO_ERROR
In file included from /opt/ros/melodic/include/moveit/robot_model_loader/robot_model_loader.h:43:0,
                 from /home/umut/ws_moveit/src/descartes/descartes_moveit/include/descartes_moveit/moveit_state_adapter.h:26,
                 from /home/umut/ws_moveit/src/descartes/descartes_moveit/src/plugin_init.cpp:20:
/opt/ros/melodic/include/moveit/kinematics_plugin_loader/kinematics_plugin_loader.h: In constructor ‘kinematics_plugin_loader::KinematicsPluginLoader::KinematicsPluginLoader(const string&, double, unsigned int, const string&, double)’:
/opt/ros/melodic/include/moveit/kinematics_plugin_loader/kinematics_plugin_loader.h:71:95: warning: unused parameter ‘ik_attempts’ [-Wunused-parameter]
   KinematicsPluginLoader(const std::string& solver_plugin, double solve_timeout, unsigned int ik_attempts,
                                                                                               ^~~~~~~~~~~
/home/umut/ws_moveit/src/Universal_Robots_ROS_Driver/ur_robot_driver/src/hardware_interface.cpp: In member function ‘bool ur_driver::HardwareInterface::setIO(ur_msgs::SetIORequest&, ur_msgs::SetIOResponse&)’:
/home/umut/ws_moveit/src/Universal_Robots_ROS_Driver/ur_robot_driver/src/hardware_interface.cpp:871:5: error: ‘LOG_ERROR’ was not declared in this scope
     LOG_ERROR("Cannot execute function %u. This is not (yet) supported.", req.fun);
     ^~~~~~~~~
/home/umut/ws_moveit/src/Universal_Robots_ROS_Driver/ur_robot_driver/src/hardware_interface.cpp:871:5: note: suggested alternative: ‘SO_ERROR’
     LOG_ERROR("Cannot execute function %u. This is not (yet) supported.", req.fun);
     ^~~~~~~~~
     SO_ERROR
In file included from /opt/ros/melodic/include/moveit/robot_model_loader/robot_model_loader.h:43:0,
                 from /home/umut/ws_moveit/src/descartes/descartes_moveit/include/descartes_moveit/moveit_state_adapter.h:26,
                 from /home/umut/ws_moveit/src/descartes/descartes_moveit/src/moveit_state_adapter.cpp:22:
/opt/ros/melodic/include/moveit/kinematics_plugin_loader/kinematics_plugin_loader.h: In constructor ‘kinematics_plugin_loader::KinematicsPluginLoader::KinematicsPluginLoader(const string&, double, unsigned int, const string&, double)’:
/opt/ros/melodic/include/moveit/kinematics_plugin_loader/kinematics_plugin_loader.h:71:95: warning: unused parameter ‘ik_attempts’ [-Wunused-parameter]
   KinematicsPluginLoader(const std::string& solver_plugin, double solve_timeout, unsigned int ik_attempts,
                                                                                               ^~~~~~~~~~~
Universal_Robots_ROS_Driver/ur_calibration/CMakeFiles/calibration_correction.dir/build.make:86: recipe for target 'Universal_Robots_ROS_Driver/ur_calibration/CMakeFiles/calibration_correction.dir/src/calibration_consumer.cpp.o' failed
make[2]: *** [Universal_Robots_ROS_Driver/ur_calibration/CMakeFiles/calibration_correction.dir/src/calibration_consumer.cpp.o] Error 1
Universal_Robots_ROS_Driver/ur_robot_driver/CMakeFiles/ur_robot_driver_plugin.dir/build.make:86: recipe for target 'Universal_Robots_ROS_Driver/ur_robot_driver/CMakeFiles/ur_robot_driver_plugin.dir/src/hardware_interface.cpp.o' failed
Universal_Robots_ROS_Driver/ur_robot_driver/CMakeFiles/ur_robot_driver_node.dir/build.make:86: recipe for target 'Universal_Robots_ROS_Driver/ur_robot_driver/CMakeFiles/ur_robot_driver_node.dir/src/hardware_interface.cpp.o' failed
make[2]: *** [Universal_Robots_ROS_Driver/ur_robot_driver/CMakeFiles/ur_robot_driver_plugin.dir/src/hardware_interface.cpp.o] Error 1
make[2]: *** [Universal_Robots_ROS_Driver/ur_robot_driver/CMakeFiles/ur_robot_driver_node.dir/src/hardware_interface.cpp.o] Error 1
CMakeFiles/Makefile2:14696: recipe for target 'Universal_Robots_ROS_Driver/ur_robot_driver/CMakeFiles/ur_robot_driver_plugin.dir/all' failed
make[1]: *** [Universal_Robots_ROS_Driver/ur_robot_driver/CMakeFiles/ur_robot_driver_plugin.dir/all] Error 2
make[1]: *** Waiting for unfinished jobs....
CMakeFiles/Makefile2:9516: recipe for target 'Universal_Robots_ROS_Driver/ur_calibration/CMakeFiles/calibration_correction.dir/all' failed
make[1]: *** [Universal_Robots_ROS_Driver/ur_calibration/CMakeFiles/calibration_correction.dir/all] Error 2
CMakeFiles/Makefile2:15138: recipe for target 'Universal_Robots_ROS_Driver/ur_robot_driver/CMakeFiles/ur_robot_driver_node.dir/all' failed
make[1]: *** [Universal_Robots_ROS_Driver/ur_robot_driver/CMakeFiles/ur_robot_driver_node.dir/all] Error 2
[ 97%] Linking CXX shared library /home/umut/ws_moveit/devel/lib/libdescartes_utilities.so
[ 97%] Built target descartes_utilities
[ 98%] Linking CXX shared library /home/umut/ws_moveit/devel/lib/libdescartes_moveit.so
[ 98%] Built target descartes_moveit
Makefile:140: recipe for target 'all' failed
make: *** [all] Error 2
Invoking "make -j12 -l12" failed

@gavanderhoorn
Copy link
Contributor

gavanderhoorn commented May 18, 2021

You'll probably need to git pull the ur client library package in your workspace.

But it's a bit difficult to read, as you show lots of warnings for packages not the UR driver.

@UmutUz
Copy link
Author

UmutUz commented May 18, 2021

Sorry about that, I removed some packages and this is the error I get when I catkin_make_isolated:


/home/umut/ws_moveit/src/Universal_Robots_ROS_Driver/ur_calibration/src/calibration_consumer.cpp: In member function ‘virtual bool ur_calibration::CalibrationConsumer::consume(std::shared_ptr<urcl::primary_interface::PrimaryPackage>)’:
/home/umut/ws_moveit/src/Universal_Robots_ROS_Driver/ur_calibration/src/calibration_consumer.cpp:41:5: error: ‘LOG_INFO’ was not declared in this scope
     LOG_INFO("%s", product->toString().c_str());
     ^~~~~~~~
/home/umut/ws_moveit/src/Universal_Robots_ROS_Driver/ur_calibration/src/calibration_consumer.cpp:41:5: note: suggested alternative: ‘ROS_INFO’
     LOG_INFO("%s", product->toString().c_str());
     ^~~~~~~~
     ROS_INFO
CMakeFiles/calibration_correction.dir/build.make:86: recipe for target 'CMakeFiles/calibration_correction.dir/src/calibration_consumer.cpp.o' failed
make[2]: *** [CMakeFiles/calibration_correction.dir/src/calibration_consumer.cpp.o] Error 1
make[2]: *** Waiting for unfinished jobs....
CMakeFiles/Makefile2:241: recipe for target 'CMakeFiles/calibration_correction.dir/all' failed
make[1]: *** [CMakeFiles/calibration_correction.dir/all] Error 2
Makefile:140: recipe for target 'all' failed
make: *** [all] Error 2
<== Failed to process package 'ur_calibration': 
  Command '['/home/umut/ws_moveit/devel_isolated/ur_client_library/env.sh', 'make', '-j12', '-l12']' returned non-zero exit status 2

Reproduce this error by running:
==> cd /home/umut/ws_moveit/build_isolated/ur_calibration && /home/umut/ws_moveit/devel_isolated/ur_client_library/env.sh make -j12 -l12

Command failed, exiting.

ur_calibration inside the driver seems to be the problem, I assume?

@gavanderhoorn
Copy link
Contributor

You seem to have a git cloned checkout of Universal_Robots_Client_Library in your workspace.

Did you update that?

@UmutUz
Copy link
Author

UmutUz commented May 18, 2021

I used the commands fmauch wrote in his earlier post from 6 days ago not sure if that is updated though.

@gavanderhoorn
Copy link
Contributor

I'm not sure which commands you're referring to. Please always link to instructions you've followed.

I'm not near a machine where I can check what's going on, but if there are changes in the client library the UR driver is expecting and you don't have those in your local checkout, things won't compile.

@UmutUz
Copy link
Author

UmutUz commented May 18, 2021

Oh sorry, #370 (comment) this comment is what I meant.

I will keep looking, thanks.

@fmauch
Copy link
Collaborator

fmauch commented May 18, 2021

The errors showing up in your build output have been addressed inside #330. Updating both, the client library and the driver to the latest master version using git pull should definitively build.

@UmutUz
Copy link
Author

UmutUz commented May 18, 2021

Yep, thanks. I just saw that in the git commit and changed it by hand (since it's just syntax). Now it built! Buuuut, still the same error as earlier. Might roll back or even reinstall everything at this point :/ thanks for the help though.

@fmauch
Copy link
Collaborator

fmauch commented May 18, 2021

/home/umut/ws_moveit/devel/lib/ur_robot_driver/ur_robot_driver_node: symbol lookup error: /home/umut/ws_moveit/devel/lib/ur_robot_driver/ur_robot_driver_node: undefined symbol: _ZN4urcl4comm8URServerD1Ev

c++filt can help us finding out why that is:

$ c++filt _ZN4urcl4comm8URServerD1Ev
urcl::comm::URServer::~URServer()

The URServer class doesn't exist in the library anymore, so that's probably due to the non-up-to-date workspace before.

So, which output are you referring to?

@UmutUz
Copy link
Author

UmutUz commented May 18, 2021

Sorry for the late answer,

this is the output I am referring to: #370 (comment)

@fmauch
Copy link
Collaborator

fmauch commented May 18, 2021

So, the relevant gdb output seems to be

Thread 1 "ur_robot_driver" received signal SIGSEGV, Segmentation fault.
0x00007fffd439da49 in joint_trajectory_controller::TrajectoryBuilder<trajectory_interface::QuinticSplineSegment<double> >::createGoalHandlePtr() const ()
   from /opt/ros/melodic/lib//libjoint_trajectory_controller.so
(gdb) bt
#0  0x00007fffd439da49 in joint_trajectory_controller::TrajectoryBuilder<trajectory_interface::QuinticSplineSegment<double> >::createGoalHandlePtr() const ()
   from /opt/ros/melodic/lib//libjoint_trajectory_controller.so
#1  0x00007fffd439e429 in joint_trajectory_controller::StopTrajectoryBuilder<trajectory_interface::QuinticSplineSegment<double> >::buildTrajectory(std::vector<std::vector<joint_trajectory_controller::JointTrajectorySegment<trajectory_interface::QuinticSplineSegment<double> >, std::allocator<joint_trajectory_controller::JointTrajectorySegment<trajectory_interface::QuinticSplineSegment<double> > > >, std::allocator<std::vector<joint_trajectory_controller::JointTrajectorySegment<trajectory_interface::QuinticSplineSegment<double> >, std::allocator<joint_trajectory_controller::JointTrajectorySegment<trajectory_interface::QuinticSplineSegment<double> > > > > >*) () from /opt/ros/melodic/lib//libjoint_trajectory_controller.so
#2  0x00007fffc865e807 in joint_trajectory_controller::JointTrajectoryController<trajectory_interface::QuinticSplineSegment<double>, ur_controllers::ScaledPositionJointInterface>::setHoldPosition(ros::Time const&, boost::shared_ptr<realtime_tools::RealtimeServerGoalHandle<control_msgs::FollowJointTrajectoryAction_<std::allocator<void> > > >) () from /home/umut/ws_moveit/devel/lib//libur_controllers.so
#3  0x00007fffc864cbb2 in joint_trajectory_controller::JointTrajectoryController<trajectory_interface::QuinticSplineSegment<double>, ur_controllers::ScaledPositionJointInterface>::starting(ros::Time const&) () from /home/umut/ws_moveit/devel/lib//libur_controllers.so
#4  0x00007ffff7ba673a in controller_interface::ControllerBase::startRequest(ros::Time const&) () from /opt/ros/melodic/lib/libcontroller_manager.so
#5  0x00007ffff7b98af1 in controller_manager::ControllerManager::startControllers(ros::Time const&) () from /opt/ros/melodic/lib/libcontroller_manager.so
#6  0x00005555555a9a04 in main (argc=<optimized out>, argv=<optimized out>) at /home/umut/ws_moveit/src/Universal_Robots_ROS_Driver/ur_robot_driver/src/hardware_interface_node.cpp:144

Just for clarification: Did you clean your environment (delete your build and devel folder of your workspace) after updating the ROS packages? I would just like to rule out any ABI incompatibilities...

If not, this could point to a problem inside our scaled trajectory controller implementation.

@UmutUz
Copy link
Author

UmutUz commented May 18, 2021

Did that a few times (more than I want to admit lol). Something new I noticed now that I got to build my workspace again is that message/warning once a connection goes through and the driver actually starts:
[ WARN] [1621338751.591322983]: Messge on ReverseInterface received. The reverse interface currently does not support any message handling. This message will be ignored.

The warning is getting published god knows how many times a second but doesn't disturb (other than spam).
I can still control the robots with rviz/my python nodes. Maybe it is related to the issues above?

@fmauch
Copy link
Collaborator

fmauch commented May 18, 2021

That should not necessarily be related. Do you use a custom urscript file? Because, this has been addressed in 13db13e.

If you don't use your own script file, that might be a clue that we're still not using the latest master here.

@UmutUz
Copy link
Author

UmutUz commented May 18, 2021

Nope, no custom urscript file. So it seems I am not on master...

Should I just clone the repo from master?

@fmauch
Copy link
Collaborator

fmauch commented May 18, 2021

It looks like you are starting the driver from a more complex launchfile. Maybe let's break it down by just using the ur10_bringup.launch file. Then, we'll see the driver's parametrization in the output.

Additionally, please go to your package clone (roscd ur_robot_driver), verify that you are on the master branch and that everything is up to date and there are no local modifications (git fetch && git status)

$ git fetch && git status
On branch master
Your branch is up to date with 'origin/master'.

nothing to commit, working tree clean

@UmutUz
Copy link
Author

UmutUz commented May 18, 2021

I'll do these (again) next week on monday when I'm back in office (sorry, am an intern, don't have the time to access the robots). Will report back when I tried it with just one robot.

Anyway, I wouldn't call them that complicated, just one bringup calling ur_common etc for each robot (every robot has his own controllers.yaml and own launch file, probably one hell of an ineffiecent way to do that).

Thanks for your time though and sorry for the wait.

@ChangcongWang
Copy link

Hm, that looks different to your previous output, as we see the output [ERROR] [1621172924.100535602]: Pipeline producer overflowed! <RTDE Data Pipeline>...

Sorry, this is my full output of roslaunch ur_robot_driver ur5_bringup.launch debug:=true

[ERROR] [1621172924.100535602]: Pipeline producer overflowed! <RTDE Data Pipeline> only display when I using debug:=true

Is my problem different from UmutUz's? Should I open a new issue?

[ INFO] [1621776618.566576777]: Loaded ur_robot_driver hardware_interface
[tcsetpgrp failed in terminal_inferior: Invalid argument]
[tcsetpgrp failed in terminal_inferior: Invalid argument]
[ INFO] [1621776618.675979855]: waitForService: Service [/controller_manager/switch_controller] is now available.
[ INFO] [1621776618.676013870]: Service available.
[ INFO] [1621776618.676030493]: Waiting for controller list service to come up on /controller_manager/list_controllers
[ INFO] [1621776618.676554092]: Service available.
[ INFO] [1621776618.782886992]: Robot mode is now POWER_OFF
[ INFO] [1621776618.783003705]: Robot's safety mode is now NORMAL
[INFO] [1621776618.892513]: Controller Spawner: Waiting for service controller_manager/switch_controller
[INFO] [1621776618.898675]: Controller Spawner: Waiting for service controller_manager/unload_controller
[INFO] [1621776618.904591]: Loading controller: pos_joint_traj_controller
[INFO] [1621776618.958633]: Controller Spawner: Waiting for service controller_manager/switch_controller
[INFO] [1621776618.961024]: Controller Spawner: Waiting for service controller_manager/unload_controller
[INFO] [1621776618.963315]: Loading controller: joint_state_controller
[tcsetpgrp failed in terminal_inferior: Invalid argument]
[New Thread 0x7fffca356700 (LWP 6069)]
[New Thread 0x7fffc9b55700 (LWP 6070)]
[INFO] [1621776619.121483]: Loading controller: joint_group_vel_controller
[tcsetpgrp failed in terminal_inferior: Invalid argument]
[New Thread 0x7fffc9135700 (LWP 6073)]
[INFO] [1621776619.137669]: Loading controller: scaled_pos_joint_traj_controller
[tcsetpgrp failed in terminal_inferior: Invalid argument]
[INFO] [1621776619.153467]: Controller Spawner: Loaded controllers: pos_joint_traj_controller, joint_group_vel_controller
[tcsetpgrp failed in terminal_inferior: Invalid argument]
[New Thread 0x7fffbffff700 (LWP 6075)]
[INFO] [1621776619.289523]: Loading controller: speed_scaling_state_controller
[New Thread 0x7fffbf7fe700 (LWP 6077)]
[INFO] [1621776619.297658]: Loading controller: force_torque_sensor_controller
[tcsetpgrp failed in terminal_inferior: Invalid argument]
[New Thread 0x7fffbeffd700 (LWP 6079)]
[INFO] [1621776619.313689]: Controller Spawner: Loaded controllers: joint_state_controller, scaled_pos_joint_traj_controller, speed_scaling_state_controller, force_torque_sensor_controller
[ERROR] [1621776619.833056488]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621776619.841066624]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621776619.849047489]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621776619.857023262]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621776619.865065151]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621776619.873092808]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621776619.881082245]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621776619.889033799]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621776619.897059787]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621776619.905017531]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621776619.913087154]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621776619.921033431]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621776619.929071110]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621776619.937010531]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621776619.945097607]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621776619.953013748]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621776619.961032929]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621776619.969032258]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621776619.977001897]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621776619.986210572]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621776619.993139141]: Pipeline producer overflowed! <RTDE Data Pipeline>
[ERROR] [1621776620.001047977]: Pipeline producer overflowed! <RTDE Data Pipeline>

Thread 1 "ur_robot_driver" received signal SIGSEGV, Segmentation fault.
joint_trajectory_controller::TrajectoryBuilder<trajectory_interface::QuinticSplineSegment<double> >::createGoalHandlePtr (this=this@entry=0x7fffd8007580)
    at ./include/joint_trajectory_controller/trajectory_builder.h:161
161	./include/joint_trajectory_controller/trajectory_builder.h: No such file or directory.
(gdb) bt
#0  joint_trajectory_controller::TrajectoryBuilder<trajectory_interface::QuinticSplineSegment<double> >::createGoalHandlePtr (this=this@entry=0x7fffd8007580)
    at ./include/joint_trajectory_controller/trajectory_builder.h:161
#1  0x00007fffd45bd559 in joint_trajectory_controller::StopTrajectoryBuilder<trajectory_interface::QuinticSplineSegment<double> >::buildTrajectory (this=0x7fffd8007580, hold_traj=0x7fffd8056850)
    at ./include/joint_trajectory_controller/stop_trajectory_builder.h:113
#2  0x00007fffc843d807 in joint_trajectory_controller::JointTrajectoryController<trajectory_interface::QuinticSplineSegment<double>, ur_controllers::ScaledPositionJointInterface>::setHoldPosition(ros::Time const&, boost::shared_ptr<realtime_tools::RealtimeServerGoalHandle<control_msgs::FollowJointTrajectoryAction_<std::allocator<void> > > >) ()
   from /home/shadowolf/catkin_ws5/devel/lib//libur_controllers.so
#3  0x00007fffc842bbb2 in joint_trajectory_controller::JointTrajectoryController<trajectory_interface::QuinticSplineSegment<double>, ur_controllers::ScaledPositionJointInterface>::starting(ros::Time const&) () from /home/shadowolf/catkin_ws5/devel/lib//libur_controllers.so
#4  0x00007ffff7ba673a in controller_interface::ControllerBase::startRequest (this=0x7fffd80195e0, time=...) at /opt/ros/melodic/include/controller_interface/controller_base.h:151
#5  0x00007ffff7b98af1 in controller_manager::ControllerManager::startControllers (this=0x7fffffffc8c0, time=...) at ./src/controller_manager.cpp:157
#6  0x00005555555a7b74 in main (argc=<optimized out>, argv=<optimized out>) at /home/shadowolf/catkin_ws5/src/Universal_Robots_ROS_Driver/ur_robot_driver/src/hardware_interface_node.cpp:144
(gdb) q
A debugging session is active.

	Inferior 1 [process 6014] will be killed.

Quit anyway? (y or n) y
Traceback (most recent call last):
  File "/opt/ros/melodic/lib/controller_manager/spawner", line 212, in <module>
    if __name__ == '__main__': main()
  File "/opt/ros/melodic/lib/controller_manager/spawner", line 204, in main
    resp = switch_controller(loaded, [], 2, False, 0.0)
  File "/opt/ros/melodic/lib/python2.7/dist-packages/rospy/impl/tcpros_service.py", line 442, in __call__
    return self.call(*args, **kwds)
  File "/opt/ros/melodic/lib/python2.7/dist-packages/rospy/impl/tcpros_service.py", line 532, in call
    raise ServiceException("transport error completing service call: %s"%(str(e)))
rospy.service.ServiceException: transport error completing service call: unable to receive data from sender, check sender's logs for details
[INFO] [1621776626.846624]: Shutting down spawner. Stopping and unloading controllers...
[INFO] [1621776626.849813]: Stopping all controllers...
[WARN] [1621776626.852565]: Controller Spawner error while taking down controllers: unable to connect to service: [Errno 111] Connection refused
================================================================================REQUIRED process [ur_hardware_interface-3] has died!
process has finished cleanly
log file: /home/shadowolf/.ros/log/00e8d266-bbcb-11eb-ab6c-80fa5b3c0e94/ur_hardware_interface-3*.log
Initiating shutdown!
================================================================================
[ur_hardware_interface/ur_robot_state_helper-7] killing on exit
[controller_stopper-6] killing on exit
[ros_control_stopped_spawner-5] killing on exit
[ros_control_controller_spawner-4] killing on exit
[ur_hardware_interface-3] killing on exit
[robot_state_publisher-2] killing on exit
[INFO] [1621776627.052750]: Shutting down spawner. Stopping and unloading controllers...
[INFO] [1621776627.056386]: Stopping all controllers...
[WARN] [1621776627.063842]: Controller Spawner error while taking down controllers: unable to connect to service: [Errno 111] Connection refused
[controller_stopper-6] escalating to SIGTERM
[rosout-1] killing on exit
[master] killing on exit
shutting down processing monitor...
... shutting down processing monitor complete
done

@qwq321qwq
Copy link

Last week I had the amost the same question, too. I opened the workspace I had been done successfully but the error said:

[INFO] [1622463487.776441]: Controller Spawner: Loaded controllers: joint_state_controller, scaled_pos_joint_traj_controller, speed_scaling_state_controller, force_torque_sensor_controller Traceback (most recent call last): File "/opt/ros/melodic/lib/controller_manager/spawner", line 212, in <module> if __name__ == '__main__': main() File "/opt/ros/melodic/lib/controller_manager/spawner", line 204, in main resp = switch_controller(loaded, [], 2, False, 0.0) File "/opt/ros/melodic/lib/python2.7/dist-packages/rospy/impl/tcpros_service.py", line 442, in __call__ return self.call(*args, **kwds) File "/opt/ros/melodic/lib/python2.7/dist-packages/rospy/impl/tcpros_service.py", line 532, in call raise ServiceException("transport error completing service call: %s"%(str(e))) rospy.service.ServiceException: transport error completing service call: unable to receive data from sender, check sender's logs for details [INFO] [1622463487.952950]: Shutting down spawner. Stopping and unloading controllers... [INFO] [1622463487.954891]: Stopping all controllers... [WARN] [1622463487.964611]: Controller Spawner error while taking down controllers: unable to connect to service: [Errno 111] Connection refused and [ur_hardware_interface-3] has died! process has died [pid 3132, exit code -11, cmd /home/heshui/ur5/devel/lib/ur_robot_driver/ur_robot_driver_node __name:=ur_hardware_interface __log:=/home/heshui/.ros/log/3d0c5692-c20a-11eb-a3df-28d2449a6f6c/ur_hardware_interface-3.log]. log file: /home/heshui/.ros/log/3d0c5692-c20a-11eb-a3df-28d2449a6f6c/ur_hardware_interface-3*.log Initiating shutdown!
I thought maybe we had the same errors. My solution is updating the urcap to external control 1.05.urcap (mine is 1.04). And then I broke the Wifi then checked and reset the net setting in ur5. Then it began to work. [INFO] [1622465396.319196]: Controller Spawner: Loaded controllers: joint_state_controller, scaled_pos_joint_traj_controller, speed_scaling_state_controller, force_torque_sensor_controller [INFO] [1622465396.325720]: Started controllers: joint_state_controller, scaled_pos_joint_traj_controller, speed_scaling_state_controller, force_torque_sensor_controller [ INFO] [1622465637.197392602]: Robot requested program [ INFO] [1622465637.197461794]: Sent program to robot [ INFO] [1622465637.374608623]: Robot connected to reverse interface. Ready to receive control commands.
Now I still don't know why it not work and how it returns to work. I guess maybe the network settings should reset after a long time not used (my partners use C++ rather than ROS to control ur5 during I doing simulation experiments studying).

@UmutUz
Copy link
Author

UmutUz commented Jun 1, 2021

So, I managed to get back to the robots(finally!). Sorry for the very late answer:

I cloned the repo again and and it's still not working it's the same errors.

Since it worked out for @qwq321qwq I might try updating urcap too (if I am allowed to lol).

@qwq321qwq
Copy link

So, I managed to get back to the robots(finally!). Sorry for the very late answer:

I cloned the repo again and and it's still not working it's the same errors.

Since it worked out for @qwq321qwq I might try updating urcap too (if I am allowed to lol).

I got error again but if i changed the position it could work. So I write to ask in another issue.

@UmutUz
Copy link
Author

UmutUz commented Jun 14, 2021

Well, I am not allowed to update urcap. I am stuck I guess..

@pravsels
Copy link

pravsels commented Jun 28, 2021

Did that a few times (more than I want to admit lol). Something new I noticed now that I got to build my workspace again is that message/warning once a connection goes through and the driver actually starts:
[ WARN] [1621338751.591322983]: Messge on ReverseInterface received. The reverse interface currently does not support any message handling. This message will be ignored.

The warning is getting published god knows how many times a second but doesn't disturb (other than spam).
I can still control the robots with rviz/my python nodes. Maybe it is related to the issues above?

I get the same warning message as you.

Additionally, when I click play on my External Control urcap, the URSim gets stuck on a 'Starting program... Please wait..' prompt. I still get the message saying that the robot is ready to receive control commands, though.

@qwq321qwq
Copy link

Did that a few times (more than I want to admit lol). Something new I noticed now that I got to build my workspace again is that message/warning once a connection goes through and the driver actually starts:
[ WARN] [1621338751.591322983]: Messge on ReverseInterface received. The reverse interface currently does not support any message handling. This message will be ignored.
The warning is getting published god knows how many times a second but doesn't disturb (other than spam).
I can still control the robots with rviz/my python nodes. Maybe it is related to the issues above?

I get the same warning message as you.

Additionally, when I click play on my External Control urcap, the URSim gets stuck on a 'Starting program... Please wait..' prompt. I still get the message saying that the robot is ready to receive control commands, though.

yes,it showed the error but could run the controller still

@pravsels
Copy link

pravsels commented Jun 30, 2021

Did that a few times (more than I want to admit lol). Something new I noticed now that I got to build my workspace again is that message/warning once a connection goes through and the driver actually starts:
[ WARN] [1621338751.591322983]: Messge on ReverseInterface received. The reverse interface currently does not support any message handling. This message will be ignored.
The warning is getting published god knows how many times a second but doesn't disturb (other than spam).
I can still control the robots with rviz/my python nodes. Maybe it is related to the issues above?

I get the same warning message as you.
Additionally, when I click play on my External Control urcap, the URSim gets stuck on a 'Starting program... Please wait..' prompt. I still get the message saying that the robot is ready to receive control commands, though.

yes,it showed the error but could run the controller still

Tried running a simple action client to '/scaled_pos_joint_traj_controller/follow_joint_trajectory', but it doesn't seem to work.

Same problem as in issue #305, but I have the correct port 5002 set up as well as inactive firewall on both sides.

@AitorMonreal
Copy link

@UmutUz I was facing similar issues to you. sudo apt update && sudo apt upgrade wasn't working for me either, and I had literally cloned from master three days ago, both for Universal_Robots_ROS_Driver and fmauch_universal_robot. I then deleted my cloned master repository for Universal_Robots_ROS_Driver and instead cloned its beta-testing branch. This now works for me. I also recommend running in a real-time kernel. I'm using 5.4.84-rt47

@pravsels
Copy link

pravsels commented Jul 1, 2021

Did that a few times (more than I want to admit lol). Something new I noticed now that I got to build my workspace again is that message/warning once a connection goes through and the driver actually starts:
[ WARN] [1621338751.591322983]: Messge on ReverseInterface received. The reverse interface currently does not support any message handling. This message will be ignored.
The warning is getting published god knows how many times a second but doesn't disturb (other than spam).
I can still control the robots with rviz/my python nodes. Maybe it is related to the issues above?

I get the same warning message as you.
Additionally, when I click play on my External Control urcap, the URSim gets stuck on a 'Starting program... Please wait..' prompt. I still get the message saying that the robot is ready to receive control commands, though.

yes,it showed the error but could run the controller still

Tried running a simple action client to '/scaled_pos_joint_traj_controller/follow_joint_trajectory', but it doesn't seem to work.

Same problem as in issue #305, but I have the correct port 5002 set up as well as inactive firewall on both sides.

Update: turns out I made a very silly mistake. Was using port 5002 instead of 50002.

@UmutUz
Copy link
Author

UmutUz commented Aug 2, 2021

@UmutUz I was facing similar issues to you. sudo apt update && sudo apt upgrade wasn't working for me either, and I had literally cloned from master three days ago, both for Universal_Robots_ROS_Driver and fmauch_universal_robot. I then deleted my cloned master repository for Universal_Robots_ROS_Driver and instead cloned its beta-testing branch. This now works for me. I also recommend running in a real-time kernel. I'm using 5.4.84-rt47

I switched from my own laptop back to a jetson nano given from work which doesnt have that problem (for now). Thanks for the tip tho! If this happens again I will try your suggestions out :)

@stefanscherzinger stefanscherzinger added the Solution proposed A solution has been proposed inside the issue. Waiting for user feedback. label Aug 9, 2021
@github-actions
Copy link

github-actions bot commented Apr 3, 2023

This issue has not been updated for a long time. If no further updates are added, this will be closed automatically. Comment on the issue to prevent automatic closing.

@github-actions
Copy link

github-actions bot commented May 3, 2023

This issue has been closed due to inactivity. Feel free to comment or reopen if this is still relevant.

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale May 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
close if no update Solution proposed A solution has been proposed inside the issue. Waiting for user feedback.
Projects
None yet
Development

No branches or pull requests

8 participants