RGB-D tracking + UR10e following & picking/placing

Following the first use case described in this last post, the result of the experiment can be seen in this video:



There are still several improvements to be made to this job1 task:
  • The job should wait for the response of each controller before sending the next request
  • The robot xacro should be extended to include every object that compose the real scenario
  •  The procedure should have an interactive way of telling the robot that is time to pick up the object
  • The use case should ensure that the object pick was successful (or not)
This issues can be followed here.





Comments

Post a Comment

Popular posts from this blog

Remote Control of UR10e via MoveIt (ROS)

Image
Installation First, install the External Control URCap on the UR10e Teach Pendant. See this post , to further instructions. Then, you will need to install a few packages on your Ubuntu system: sudo apt install ros-noetic-moveit sudo apt-get install ros-noetic-industrial-robot-status-interface sudo apt-get install ros-noetic-scaled-controllers sudo apt-get install ros-noetic-pass-through-controllers sudo apt-get install ros-noetic-ur-client-library sudo apt-get install ros-noetic-velocity-controllers sudo apt-get install ros-noetic-force-torque-sensor-controller ( Note: At this moment, if you do not have a catkin workspace, you should now create one, by following the steps described here ) cd catkin_ws/src git clone https://github.com/afonsocastro/larcc_interface.git git clone https://github.com/ros-industrial/ur_msgs.git cd ~/catkin_ws catkin_make  Finally, to establish the communication between the robot and the computer, it is required to connect an Ethernet cable from the UR1...
Read more

ViSP - first tutorial

Image
In order to start using (for the very first time) ViSP, I followed the tutorial for installation from source for linux ubuntu: https://visp-doc.inria.fr/doxygen/visp-3.4.0/tutorial-install-ubuntu.html I settled for the Quick ViSP installation , since probably most of the 3rd parties that compose the Advanced ViSP installation won't be useful for my particular goal. Besides that, even if some of the 3rd parties turn out to be useful, they can be installed afterward. First, I created a ViSP workspace: $ echo "export VISP_WS=$HOME/visp-ws" >> ~/.bashrc $ source ~/.bashrc $ mkdir -p $VISP_WS Installed the standard (recommended) 3rd parties: $ sudo apt-get install libopencv-dev libx11-dev liblapack-dev libeigen3-dev libv4l-dev libzbar-dev libpthread-stubs0-dev libjpeg-dev libpng-dev libdc1394-22-dev Cloned the source code: $ cd $VISP_WS $ git clone https://github.com/lagadic/visp.git  And created the build folder, to build ViSP: $ mkdir -p $VISP_WS/visp-build $ cd $VI...
Read more

Installing External Control URCap on robot Teach Pendant

Image
For working on a real robot you need to install the externalcontrol-1.0.5.urcap which can be found inside the resources folder of this repository . Using a USB pen drive, follow: Format the flash drive Download and save the externalcontrol-1.0.5.urcap on the USB pen drive Insert the USB drive on UR10e controller (the controller has two USB ports)        4. Turn on the Teach Pendant      Click on Menu (top right corner) + System + URCaps + Select External Control and press "+"        6.  Configure the remote host's IP to 192.168.56.1 Click on Menu (top right corner) + System + Network Configure: Network method : Static Address IP address: 192.168.56.2 Subnet mask: 255.255.255.0 Default gateway: 192.168.56.2 Click on Apply    10. Disable EtherNet/IP fieldbus: Installation > Fieldbus > EtherNet/IP > Disable  
Read more