In this post we have used 3D images captured in the Auto3D research project. The image below captured with a stripelight projector to prove that a Battery Pack could be located in 3D and changed by a robot without human interaction on an offshore platform.
This is the third post in series of Scorpion Vision Software important tool improvements included in upcoming – Scorpion Vision XII.
The 3D image of the Battery pack is shown.
In the Auto3D project we developed a 3D Pattern Matcher together with SINTEF named 3DMama – this was one of the first 3D pattern matchers in 2009. We have now taken a big step forward developing a significant better 3D Pattern Matcher STC-0124 ObjectFinder3D replacing 3DMama. The 3D pattern matcher has the following important features:
- Automatic model training and feature point selection and verification
- User defined number of featurepoints
- Locates multiple objects in 3D
- Very fast and easy training process
The ObjectFinder3D is optimised for dense 3D points cloud generated by 3D Stereo Vision like the Scorpion 3D Stinger Camera.
3D Model to locate Battery Pack
The image below shows the Learning page and the Battery Pack Model with 3D origin visualised.
STC-0124 ObjectFinder3D Learning Page
Fast and robust location of Battery Pack
The battery is located in a 3D point cloud with 360.000 points in 102.5 ms. The 3D bounding and the pose is shown in red. The 3D pose – (x,y,z) and (rx,ry,rz) is calculated.
Use 3D Pose to verify Top Cover Shape
Once locating the battery pack it is easy to verify that all cover knobs are present. In 3D we can easily do the following with Scorpion Vision Software XII:
- Count the knobs
- Verify the 3D shape by
- Check the rotation angle for each knob
All of these features makes it easy to verify the type of top cover. This important information can be used to select the right tool for replacing the battery pack or identification of the battery pack type to be replaced.
Height Map of Top Cover where the six knobs are counted. The HeightMap is color code – position with no information is coded grey
Scorpion Tools in Action
The following Scorpion Tools and STCs, Scorpion Tool Components, are used in the demo profile SDP-0006 ObjectFinder3D.
- 3DROI – STC-0094-ROICalculator 1.0.0.4
- Defines the 3D Region of interest
- ClusterFilter – STC-0111-ClusterFilter3D 1.0.0.22
- Can filter noise from a 3D Point Cloud
- FindValve – STC-0124 ObjectFinder3D 0.9.0.7
- Locates the valve in 3D based on a 3D Model
- LocateValvePlane – STC-0114 PlaneFit3D 0.9.0.16
- Precise plane location of the top cover
- HMapValve – Tool 122 – ExtractMap3D
- Extract the HeightMap of the Top Cover perpendicular to the top cover plane
- HeightHistogram – Tool 75 – Intensity
- Calculates the height map histogram
- FindKnobs – Tool – 87 – Blob4
- Locates the knobs in 3D in the heightmap
Filed under: General, Industrial Automation, Machine Vision, Scorpion Stinger, Scorpion Vision 3D, Scorpion Vision Software, STC - Scorpion Tool Component, Tordivel Solutions | Leave a comment »
Dagrun
Paul
Thor
