Here are videos of a students’ project of a tracker robot that relies on an external kinect sensor driven through ROS. The kinect observes the whole scene. A PhaROS-based node controls the robot to track a ball based on the the kinect output. When no ball is detected, the robot goes back to a home position.
Xuan Sang Le is a PhD student who has joined our team mid-february. His work is co-supervized by Ecole des Mines and ENSTA is about speed optimization of Smalltalk robotic software by means of FPGAs. The first step is to develop an application fully in Smalltalk and our PhaROS Robotics framework that will serve as a reference for our metrics. The app we have chosen is a simple tracker robot that follows an object of a particular color. Beside being fun, the result shown by the video below is interesting. As we have initially expected we can’t pretend to be real-time. Still, Pharo is capable of fetching an image through wifi, process it and discover the position of the object 650 milliseconds. And this is with non-optimized code. Figures are likely to be better after optimization.
In a recent experiment we demoed a scenario of how a robot can be used to help shoppers (see Video below). The robot computes the optimal path for picking items of an arbitrary shopping list. It carries the bag and guides the shopper to items locations. As we explain in the slideshow (below the video), there are other possible applications of mobile robots in a shopping. We also give a quick overview of hardware and software. We reused some existing ROS packages that we combined with our own software built using the PhaROS client based on Pharo a Smalltalk inspired OO dynamic language.
As a recreation for Christmas holidays, I hacked Bot Grid Simulator to render a winter landscape. It is still a robot simulation, since snow flakes are robots with a simple behavior. There about 500 of them. Hope you’ll enjoy the video. Merry Christmas and happy new year 2012.
Two weeks ago, I thought that it’s more than time to revive the work started by my former PhD student Van Tuan Le. His algorithms for on multi-robot cooperation were validated using Bot Grid Simulator (BGS). I posted a while ago a simulation that illustrates our ICTAI2009 paper (Distributed constraint reasoning applied to multi-robot exploration) that relies on the connectivity awareness as introduced in our ICRA2009 paper (Making networked robot connectivity-aware). However, the simulator was just a prototype and the code was mixed with other unrelated stuff. My goal is to make it clean enough so it can be reused by other people. I started a dedicated repo on SqueakSource with the latest version (number 13) of BGS as left by Serge Stinckwhich (co-supervisor of Tuan’s PhD) in fall 2009. Then, I started cutting off parts, refactoring others, and writing tests. Progress at the beginning was slow, but things keep getting better. By the 13th of november 2011, I had a first relatively clean and tested version (number 29) of the kernel. I made a youtube video to celebrate it. One week later, I improved the design and the GUI (version 37). Now, each robot has a heading and a range sensor that are represented graphically as shown on the new video. More to come soon hopefully :-)