Tuesday, March 19, 2013

Sketch Based Interfaces: Early Processing for Sketch Understanding


Sketch Based Interfaces: Early Processing for Sketch Understanding


Howdy!
            In this blog post, I am going to shortly summarize the above mentioned research paper and express my opinion on it. 

           In the paper, the authors propose a hybrid way to combine knowledge from different areas to recognize a sketch and give the user as much flexibility in drawing as is available while drawing with a pencil and a paper. The process consists of 3 steps: approximation, beautification, and basic recognition. 

         Approximation consists of detecting corners (or vertices) and curves segments of the gesture. For the input gesture, direction graph, curvature graph and speed graph are constructed. For the curvature graph, all the maxima points above the mean value are collected into a set Fd. For the speed graph, all the minima points below 90% of the mean are collected into a set Fs. 
Curvature graph

Speed graph


Now, an iterative algorithm is used to select points from both the sets that have a high confidence value of being a vertex (corner). Once that is done, curve segments are detected using another algorithm. 

Beautification is rendering of the drawing as intended by the user but in a more presentable way. Here is an example from the paper:
Beautification example


Recognition of basic shapes is done using some simple pre- defined rules and procedures. 

The system performs very well and most of the users in the user- study said that they would prefer to use this system to the other ones available at the time.

I find the hybrid approach very interesting. It combines the data available during the gesture making stage with the data available at the end. This can be very useful in drawing sketches in the mechanical and civil engineering domain.

I used the following sources for this blog post:

Thanks for reading my blog! Have a great and blessed day!

Gig'em!!!


No comments:

Post a Comment