5
Prompt Indian Coin Recognition with Rotation Invariance using Image Subtraction Technique Vaibhav Gupta, Rachit Puri, Monir Verma Electronics and Communication Engineering Department Thapar University, Patiala -147001, India [email protected] , [email protected] , [email protected] Abstract This paper detects Indian coins of different denomination. The spiraling business transaction at vending machines and automated systems working on token have spurred better coin recognition techniques saddled with increased robustness. These techniques facilitate transaction making it easier in all forms of trade. Keeping all the essential factors in mind a system has been created which recognizes coin based on image subtraction technique. The process performs 3 checks (radius, coarse and fine) on the input image. The stated subsequent checks enable the technique to endorse Rotation Invariance, thus obviating the need of placing the coin at a certain angle. Also, the technique does away with the requirement of placing the front face of the coin up. Subtraction between the input object image and database image is performed. Further, plotting the resultant values gives minima which if less than a standard threshold establishes the recognition of the coin. Results of MATLAB based simulations have been reported. Keywords – Image Segmentation, Image subtraction, Object Detection. I. INTRODUCTION Humans easily recognize familiar patterns or objects regardless of their size or orientation differences. This is due to our intelligent system of perception which has been trained to recognize the objects over time. However, we are able to simulate our perception of objects and pattern recognition in intelligent machines using trained neural networks [1]. The paper proposes a coin recognition method using image subtraction technique which has an advantage over the conventional identification methods used commonly in slot machines. Most of the coin testers in slot machines, work by testing physical properties of coins such as size, weight and materials. However, if physical similarities exist between coins of different currencies, then the traditional coin testers would fail to distinguish the different coins. The image subtraction technique takes two images as input and gives a third image as output, whose pixel values are simply the pixel values of the first image minus the corresponding pixel values of the second image. Modus operandi consists of the stated technique. It also incorporates the radius check which would assist in choosing the befitting coin from the database. Database amasses the standard coin used for recognizing the input image. Images formulating the database are taken under standard conditions including the distance, background and lighting. Once the precise image is selected, its feature are extracted (explained in II) and subtracted from the input coin image (referred to as object image). Image rotation invariance is introduced by rotating the image at fixed angular interval thus providing us with the exact angle of difference between the coins on analyzing the plot of the subtracted values [2, 3]. Extracting the minima of the plot and on comparing it with a standard threshold value, the object coin can be determined as coin of same denomination or not. Thus, coin stands recognized. Fig. 1 Front side of various Indian coins Fig. 2 Back side of various Indian coins Many pattern recognition systems insensitive to transformation of an input pattern have now been presented. P. Thumwarin [4] presented the rotation invariance feature by the absolute value of 978-1-4244-9190-2/11/$26.00 ©2011 IEEE

Indian Coin Recognition

Embed Size (px)

Citation preview

Page 1: Indian Coin Recognition

Prompt Indian Coin Recognition with Rotation Invariance using Image Subtraction Technique

Vaibhav Gupta, Rachit Puri, Monir Verma

Electronics and Communication Engineering Department Thapar University, Patiala -147001, India

[email protected], [email protected], [email protected]

Abstract – This paper detects Indian coins of different denomination. The spiraling business transaction at vending machines and automated systems working on token have spurred better coin recognition techniques saddled with increased robustness. These techniques facilitate transaction making it easier in all forms of trade. Keeping all the essential factors in mind a system has been created which recognizes coin based on image subtraction technique. The process performs 3 checks (radius, coarse and fine) on the input image. The stated subsequent checks enable the technique to endorse Rotation Invariance, thus obviating the need of placing the coin at a certain angle. Also, the technique does away with the requirement of placing the front face of the coin up. Subtraction between the input object image and database image is performed. Further, plotting the resultant values gives minima which if less than a standard threshold establishes the recognition of the coin. Results of MATLAB based simulations have been reported. Keywords – Image Segmentation, Image subtraction, Object Detection.

I. INTRODUCTION

Humans easily recognize familiar patterns or objects regardless of their size or orientation differences. This is due to our intelligent system of perception which has been trained to recognize the objects over time. However, we are able to simulate our perception of objects and pattern recognition in intelligent machines using trained neural networks [1]. The paper proposes a coin recognition method using image subtraction technique which has an advantage over the conventional identification methods used commonly in slot machines. Most of the coin testers in slot machines, work by testing physical properties of coins such as size, weight and materials. However, if physical similarities exist between coins of different currencies, then the traditional coin testers would fail to distinguish the different coins. The image subtraction technique takes two images as input and gives a third image as output, whose pixel values are simply the pixel values of the first image minus the corresponding pixel values of the second image. Modus operandi consists of the stated technique. It also incorporates the radius check which would assist in choosing the befitting coin from the database. Database amasses the standard coin used for recognizing the input image. Images formulating the database are taken under

standard conditions including the distance, background and lighting. Once the precise image is selected, its feature are extracted (explained in II) and subtracted from the input coin image (referred to as object image). Image rotation invariance is introduced by rotating the image at fixed angular interval thus providing us with the exact angle of difference between the coins on analyzing the plot of the subtracted values [2, 3]. Extracting the minima of the plot and on comparing it with a standard threshold value, the object coin can be determined as coin of same denomination or not. Thus, coin stands recognized.

Fig. 1 Front side of various Indian coins

Fig. 2 Back side of various Indian coins

Many pattern recognition systems insensitive to transformation of an input pattern have now been presented. P. Thumwarin [4] presented the rotation invariance feature by the absolute value of

978-1-4244-9190-2/11/$26.00 ©2011 IEEE

Page 2: Indian Coin Recognition

Fourier coefficients of polar image of coin on circles with different radii. Minoru Fukumi [5] had proposed a neural pattern recognition system, which is insensitive to rotation of input pattern by various degrees. Results show that the neural network approach works well for variable rotation pattern recognition problem. Linlin shen[6] proposed the Gabor feature for coin recognition. In this the centre of the coin is located and concentric rings are used to achieve rotation-invariance. A rotation-invariant pattern recognition system has been constructed using neural networks to recognize the patterns [7]. The mathematical calculations are performed and the output signals are generated and kept ready for training. Thus by identifying the center point alone in a coin may not be sufficient to localize the numeral in the coin because in some coins, the numeral is seen only at the bottom of the coin where the center point identified by the automatic coin-classifying machine may fail to detect the numeral in the coin thus giving a new idea for further studies. This paper presents an image subtraction recognition system which is insensitive to rotation by any number of degrees. As such a system is useful in problem related to coin recognition

II. ASSUMPTIONS

Following parameters are kept constant during image acquisition:

• Lighting condition • Distance and Position • Perpendicular image acquisition

Take care that the surface of the coin is clean.

III. ROTATION-INVARIENT IMAGE SUBTRACTION TECHNIQUE

The proposed approach of coin recognition consists of five modules namely, image acquisition, image segmentation, radius calculation, image subtraction and Threshold comparison. Input image of size (320*320 pixels) is acquired and coin is segmented through it. Fig. 3 elucidates the block diagram of the proposed methodology.

Fig. 3 Block diagram of the methodology

A. IMAGE ACQUISITION AND SEGMENTATION

This section describes the image acquired and the segmentation process required for coin recognition. A good resolution webcam is used for image acquisition. The next step of the coin recognition system would be image segmentation, i.e. separating the coin image from the background. Fig. 4 illustrates the process of image segmentation wherein the image is firstly converted into grayscale image in accordance with the formula described in Eqn. 1

gray = (0.299*r + 0.587*g + 0.114*b) (1)

Yes No

No

Coin Image Acquisition

Image Segmentation

Radius matching with database images

Coarse Image Subtraction between object and test image (rotated by a certain fixed angle at each step)

Fine Image Subtraction between object and test image (concentrated near the obtained position)

Radius Calculation of object image

New test image selected based on radius matching from the database

Minima value of the grayscale value of resultant image checked

Exact overlap position obtained in form of angular difference between the images and

minima compared to threshold

Coin matched

Minima < Threshold

Minima < Threshold

Coin not matched

Coin not matched

Yes

Page 3: Indian Coin Recognition

The image is further adjusted by increasing the contrast and then converting it into a binary image by setting the pixel whose value is greater than a certain threshold value to 1 else 0. The fourth image in Fig 4 describes how a binary image looks like. Traversing row wise we get two positions which depicts the two ends of diameter. We get the centre in terms of horizontal axes. Following the same methodology column wise, we get the centre in terms of vertical axes. Thus, we get the exact position of the coin into which the parent image is readjusted shown in fifth image of fig. 4.

Fig. 4: Image Segmentation

B. Radius Calculation Diameter is calculated by finding the difference between maximum and minimum position of white pixels of the binary image formed during image segmentation shown in Fig. 4. Being aware of the fact that Indian coins have distinct radius, this cardinal step provides the value based on which the suitable image from the database gets selected for further process, abridging the process time and irrelevant data.

C. Image Subtraction with Rotation Invariance Having procured both the object and test image, two subsequent checks are performed narrowing down the recognition process.

1) Coarse Subtraction: The test image is given one full rotation in steps of fixed angular distance of say 10º. At each instance of rotation image subtraction is carried between the rotated test image and the input object image. The two images basically are a 2-d array consisting of gray values. Subtracting these array yields gray values begetting a third image.

Subtracted (r,c) = object (r,c) – test (r,c) (2)

Fig. 5 Image subtraction at 90º difference

Fig. 6 Image subtraction at 135º difference

Fig. 5, 6 illustrates the subtraction at various angles.

These figures elicit that resultant image exhibits darker regions that persistently increases until the rotation crosses the angle of object image. If we plot a sum of gray values of the resultant image we get a minima at some angle near which the test and object image tend to overlap. Sum of grayscale values for the subtracted image at different angles are shown in Table 1. TABLE 1 GRAYSCALE SUMMATION AT VARIOUS ANGULAR DIFFERENCES

BETWEEN OBJECT AND TEST IMAGE

Rotation of coin

(in degrees) Grayscale values sum of subtracted

image ( x 105 ) 0 1.712 30 2.376 60 2.669 90 2.635

120 2.877 150 2.849 180 2.652 210 2.776 240 2.612 270 2.121 300 1.853 330 1.363 360 1.712

Fig. 7 Plot of Grayscale value sum v/s angle of rotation

Page 4: Indian Coin Recognition

Observing the plot in Fig. 7, we note a minima occurring at a certain angle. This angle corresponds to the position of overlap of object and test image. Albeit, the approximate angle of overlap is known the fact that coin matches is still vague thus evoking the need of fine subtraction. However if the minima values is greater than a certain threshold (1.5 x 105 in this case) it can be said directly that the coin does not matches.

2) Fine Subtraction: The central theme of this step is same as the coarse subtraction with the only difference being the step size greatly abated (say 1º) to perform a thorough check and check window limited to angles near minima obtained from the plot shown in Fig. 7. Proceeding further on the previous readings we get minima at around 320° so the rotation window will be ranging from angle of 310° to 330° with the step size of 1°. Fig. 8 illustrates the image incurred on subtraction of the object and test image with a angular difference of 1° between them.

Fig. 8 Image subtraction at 10º difference between object and test image

Comparing the subtraction image during coarse and fine subtraction, its conspicuous that fine subtraction image constitutes of greater number of dark patches which are way darker than the former image. The gray values have considerably decremented resulting into a better and accurate search of the overlapped position of the two images.

Fig. 9 Plot of Grayscale value sum v/s angle of rotation for Fine Subtraction Plot in Fig. 9 can be considered as a magnified view of plot shown in Fig. 7 wherein the fine search concentrates on a terse area (near minima). This gives the exact position of the coin in terms of angular difference between the object and test image.

D. Threshold Comparison Once we get the minima of the gray value sum, based on comparison with a standard threshold, deductions are made whether the coin matches or not. If the minimum value lies below the threshold, coin identification is established.

IV. EXPERIMENTS AND RESULTS

The proposed approach has been implemented in MATLAB. The results were analyzed based on AMD Turion X2 1.9 GHz processor with 2.5 GB DDR RAM. The database consisted of samples of Indian coins (both old and new designs) of all denomination displaying both front and rear face making it rotation invariant and coin side invariant. Fig. 10 exhibits the GUI designed for the process.

Fig. 10 GUI prepared for the technique in MATLAB The GUI espouses all the necessary sections to ease the usage of the application and provide with real time processing and results to the user. Besides holding up the object and test image, real time subtracted image for every rotation given to the test image is showcased in the ‘Image subtracted’ section of the GUI. The results for both coarse and fine subtraction are displayed along with the validation of coin matching. The interface serves as an easy-to-use tool for coin detection. To check the robustness of the process coins of denomination 2 and 10 are checked as they have same radius. Fig. 11 shows the two coins under process and the minima obtained was greater than the threshold (1.5 x 105) states that the coins do not match.

Fig. 11 Comparison of 2 and 10 rupee coin

Page 5: Indian Coin Recognition

Now, to check the face invariance of the process object coin was taken as rupee 5 displaying front side and was compared to the coin with numeral side up.

Fig. 12 Subtraction of 5 rupees coin with different face

Fig.13 Plot of subtraction of two 5 rupees coin with different faces The minima in this case is well above the threshold value of 1.5 x 105, as can be seen in the plot (fig. 13) thus demonstrating that the coins do not match. Since the coin does not match, the next image having the same radius is picked from the database as the test image and matched to the object image, fig. 14. Going through the plot of subtraction of the given two images, it can be easily inferred that the coins do match as the minima lies way below the threshold.

Fig. 14 Subtraction of 5 rupees coin with same face

Fig.15 Plot of subtraction of two 5 rupees coin displaying same face

V. CONCLUSION

Coin recognition using image subtraction shows positive signs for coin recognition. Image segmentation used as the first step which substantially reduces the amount of data to be dealt with, thus decreasing the processing time. Image subtraction provides fast recognition with good accuracy provided the conditions are made standard. Also two subsequent checks are provided to give precise results. This solves a real life problem where physical similarities between these coins led to abusing slot machine. Future works will include modifications of the technique and also merging of other image processing techniques, such as, Neural Networks training using Edge detection which would extricate the process from the dependency over standard light intensity and standard distance between coin and camera during image acquisition adding on to the accuracy of the process.

ACKNOWLEDGMENTS

The authors would like to thank Mr. Parminder Singh Reel, Assistant Professor at ECED, Thapar University for his suggestions and support.

REFERENCES

[1] E. Ashbridge, D.I. Perrett, M.W. Oram and T. Jellema, “Effect of Image Orientation and Size on Object Recognition: Responses of Single Units in the Macaque Monkey Temporal Cortex”, Cognitive Neuropsychology Vol. 17: 1/2/3, pp. 13–34, 2000.

[2] R. Bremananth, B. Balaji, M. Sankari, A. Chitra, “A New Approach to Coin Recognition using Neural Pattern Analysis”, 2005 annual IEEE, Indicon, pp. 366-370

[3] P. Harrop, New Electronics for payment, IEE review, pp.339-342, 1989.

[4] P. Thumwarin, S. Malila, P. Janthawong, W. Pibulwej, T. Matsuura, “A Robust Coin Recognition with Rotation Invariance”, International Conference on Communications, Circuits and System Proceedings,2006

[5] M. Fukumi, S. Omatu, "Rotation-Invariant Neural Pattem Recognition System with Application to Coin Recognition", IEEE Trans. Neural Networks, Vol.3, No. 2, pp. 272-279, March, 1992.

[6] Linlin Shen, Sen Jia, Zhen Ji, “Statictics of Gabor Features for Coin Recognition”, IEEE International Workshop on Imaging Systems and Techniques, 2009. IST '09, pp.295-298.

[7] M.Fukumi, S.Omatu,"Rotation-lnvariant Neural Pattem Recognition System Estimating a Rotation angle", IEEE Trans. Neural Networks,Vol.8, No. 3,pp.568-581,May,1997.

[8] M. N¨olle, P. Harald, R. Michael, K. Mayer, I. Holl¨ander, and R. Granec, .Dagobert - a new coin recognition and sorting system,. in Proc. DICTA Digital image computing techniques and applications, 2003, vol. 1, pp. 329.338.

[9] Minoru Fukumi, S. Omatu, F. Takeda dn T. Koska, “Rotation-invariant neural pattern recognition system with application to coin recognition”,IEEE Trans. on Neural Networks, Vol 3, No. 2, pp.272-278.

[10 D.Zhang and L. Guojun, .Shape-based image retrieval using generic fourier descriptor,. Signal Processing:Image Commun., vol. 17, no. 10, pp.825.848,2002