6
10th Conference on Industrial Computed Tomography, Wels, Austria (iCT 2020), www.ict-conference.com/2020 Image metrics for geometric calibration of a cone-beam tomographic X-ray system based on a single plastic brick Adrian Waldyra 1 , Daniel Suth 1 , Mahmoud Amr 1 , Tobias Schön 1 1 Fraunhofer Entwicklungszentrum Röntgentechnik, Flugplatzstraße 75, 90768 Fürth, Germany, e-mail: [email protected], [email protected] Abstract The exact knowledge of the geometric acquisition parameters directly influences the quality of a tomographic reconstruction. Most calibration procedures use calibration phantoms that consist of metal beads arranged in a specific order. If the exact posi- tions of the metal beads are to be sufficiently known, the production of such calibration phantoms can become very expensive. To avoid this problem, we propose a method that uses single plastic bricks (e.g. LEGO bricks) as calibration phantom. Based on a CAD model, projections with given acquisition parameters are simulated and then compared to the real projection using a metric. The objective of our research is to evaluate which metrics are best suited for the comparison of such projections. The results of applying two metrics on simulated and real data are presented. Keywords: cone-beam geometry, calibration, metric, LEGO phantom 1 Motivation The precise knowledge of the geometric acquisition parameters directly influences the quality of a tomographic reconstruction. It is important to calibrate the computed tomography (CT) system to ensure that the position and orientation of the source and detector are accurately known at any given time. Most calibration procedures use phantoms consisting of metal beads placed in a particular order. If the exact position of the metal beads are to be accurately known, it can become very expensive to produce such calibration phantoms. To avoid this problem, we propose a method that uses single plastic bricks (e.g. LEGO bricks) as calibration phantoms. Furthermore, LEGO bricks are cheap, easy to obtain and the corresponding CAD-Data (computer-aided design) is often available online. With the brick we are attempting to improve the geometric acquisition parameters of an already calibrated CT system. 2 Methodology The approach we propose is to compare a X-ray image with a simulated projection and thus evaluate our system’s acquisition parameters. The high manufacturing accuracy of a LEGO brick with a maximum tolerance of 10 μm [1, 2] offers the possibility to compare a real projection with a simulated projection. 2.1 Local Calibration We assume the CT system is calibrated relatively well (with a deviation of a few millimeters [3]) and therefore only needs minor adjustments. Therefore, the system’s acquisition parameters are used together with the exact description of a LEGO brick to simulate a projection using a ray-tracer. The real and simulated projections are compared with each other and their similarity is determined by a metric. It is hypothesized that the geometric parameters having the highest similarity represent the true acquisition parameters. This calibration can be written as a minimization problem p * = argmin pR 9 d I M , I S T S ( p), T D ( p) . Here p R 9 is the modification of the acquisition parameters and T S ( p), T D ( p) R 4×4 are the altered geometric acquisition parameters of source and detector expressed by an affine transformation matrix. The metric d (·, ·) compares the measured projection I M and simulated projection I S . 2.2 Used LEGO brick LEGO bricks are widespread, easily accessible and relatively inexpensive. According to the manufacturer, the mould of the bricks have an accuracy of up to 5 μm [4]. The publications [1] and [2] measured an accuracy of the bricks of up to 10 μm. Due to this manufacturing accuracy, we assume the calibration can be performed with the help of a LEGO brick. In total there are more than 3400 brick shapes [4]. Bricks used with the proposed method should have the following properties: 1 More info about this article: http://www.ndt.net/?id=25094 Copyright 2020 - by the Authors. License to iCT Conference 2020 and NDT.net.

Image metrics for geometric calibration of a cone-beam ... · The precise knowledge of the geometric acquisition parameters directly influences the quality of a tomographic reconstruction

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Image metrics for geometric calibration of a cone-beam ... · The precise knowledge of the geometric acquisition parameters directly influences the quality of a tomographic reconstruction

10th Conference on Industrial Computed Tomography, Wels, Austria (iCT 2020), www.ict-conference.com/2020

Image metrics for geometric calibration of a cone-beam tomographic X-ray systembased on a single plastic brick

Adrian Waldyra1, Daniel Suth1, Mahmoud Amr1, Tobias Schön1

1 Fraunhofer Entwicklungszentrum Röntgentechnik, Flugplatzstraße 75, 90768 Fürth, Germany,

e-mail: [email protected], [email protected]

Abstract

The exact knowledge of the geometric acquisition parameters directly influences the quality of a tomographic reconstruction.

Most calibration procedures use calibration phantoms that consist of metal beads arranged in a specific order. If the exact posi-

tions of the metal beads are to be sufficiently known, the production of such calibration phantoms can become very expensive.

To avoid this problem, we propose a method that uses single plastic bricks (e.g. LEGO bricks) as calibration phantom. Based

on a CAD model, projections with given acquisition parameters are simulated and then compared to the real projection using a

metric. The objective of our research is to evaluate which metrics are best suited for the comparison of such projections. The

results of applying two metrics on simulated and real data are presented.

Keywords: cone-beam geometry, calibration, metric, LEGO phantom

1 Motivation

The precise knowledge of the geometric acquisition parameters directly influences the quality of a tomographic reconstruction.

It is important to calibrate the computed tomography (CT) system to ensure that the position and orientation of the source and

detector are accurately known at any given time. Most calibration procedures use phantoms consisting of metal beads placed in

a particular order. If the exact position of the metal beads are to be accurately known, it can become very expensive to produce

such calibration phantoms. To avoid this problem, we propose a method that uses single plastic bricks (e.g. LEGO bricks) as

calibration phantoms. Furthermore, LEGO bricks are cheap, easy to obtain and the corresponding CAD-Data (computer-aided

design) is often available online. With the brick we are attempting to improve the geometric acquisition parameters of an already

calibrated CT system.

2 Methodology

The approach we propose is to compare a X-ray image with a simulated projection and thus evaluate our system’s acquisition

parameters. The high manufacturing accuracy of a LEGO brick with a maximum tolerance of 10 µm [1, 2] offers the possibility

to compare a real projection with a simulated projection.

2.1 Local Calibration

We assume the CT system is calibrated relatively well (with a deviation of a few millimeters [3]) and therefore only needs minor

adjustments. Therefore, the system’s acquisition parameters are used together with the exact description of a LEGO brick to

simulate a projection using a ray-tracer. The real and simulated projections are compared with each other and their similarity

is determined by a metric. It is hypothesized that the geometric parameters having the highest similarity represent the true

acquisition parameters. This calibration can be written as a minimization problem

p∗ = argminp∈R9

d

(IM, IS

(T̃S(p), T̃D(p)

)).

Here p ∈ R9 is the modification of the acquisition parameters and T̃S(p), T̃D(p) ∈ R

4×4 are the altered geometric acquisition

parameters of source and detector expressed by an affine transformation matrix. The metric d(·, ·) compares the measured

projection IM and simulated projection IS.

2.2 Used LEGO brick

LEGO bricks are widespread, easily accessible and relatively inexpensive. According to the manufacturer, the mould of the

bricks have an accuracy of up to 5 µm [4]. The publications [1] and [2] measured an accuracy of the bricks of up to 10 µm. Due

to this manufacturing accuracy, we assume the calibration can be performed with the help of a LEGO brick. In total there are

more than 3400 brick shapes [4].

Bricks used with the proposed method should have the following properties:

1

Mor

e in

fo a

bout

this

art

icle

: ht

tp://

ww

w.n

dt.n

et/?

id=

2509

4

Copyright 2020 - by the Authors. License to iCT Conference 2020 and NDT.net.

Page 2: Image metrics for geometric calibration of a cone-beam ... · The precise knowledge of the geometric acquisition parameters directly influences the quality of a tomographic reconstruction

10th Conference on Industrial Computed Tomography, Wels, Austria (iCT 2020), www.ict-conference.com/2020

• Easily available

• X-ray projections from two opposing directions differ

• CAD model is available

The 2x2 cornerstone (item no. 2357) fulfills these properties and is therefore used in our work (see Figure 1).

Figure 1: CAD model of the brick (item no. 2357) used for local calibration.

2.3 Metrics

Due to space constraints only two metrics for the comparison of projections are discussed in the paper, on the one hand the

Manhattan metric and on the other the Nabla Histogram of Oriented Gradients (∇HOG) metric. The Manhattan metric is defined

as the sum of the absolute differences between the pixels of two projections. A detailed description of the ∇HOG is described in

[5]. The idea of ∇HOG is similar to the regular histogram of oriented gradients [6]. First, the gradient is determined in vertical

and horizontal direction. From this, angles and lengths of the gradients are determined. For the ∇HOG the histogram calculation

is omitted and orientation filters are applied to the angle image instead. Using the result, the length images and a bilinear filter a

feature vector is calculated. To compare two projections, the feature vectors are determined, they are normalized and the scalar

product is calculated, which yields theirs similarity to each other.

3 Results

In order to evaluate the proposed calibration method, projections with 1008×1008 pixels and a pixel pitch of 400 µm were sim-

ulated. The source to object distance was set to 81.6 mm and the object to detector distance to 648.3 mm. Furthermore Poisson

distributed noise was added to the projections. In Figure 2 and 3 the results for the above mentioned metrics are shown. In each

sub-figure two of the nine geometric acquisition parameters were modified and the metrics evaluated. The values are color-coded

and plotted as a heatmap. It is expected that the minimum value would be at a modification of (0,0), as the acquisition parameters

are known from the simulation. Figure 2 indicates that the minima of the Manhattan metric are not always at (0,0), whereas

Figure 3 shows that all minima are at a modification of (0,0). It is noteworthy that both figures show that the modification of

different geometric parameters have varying influences on the metric.

2

Page 3: Image metrics for geometric calibration of a cone-beam ... · The precise knowledge of the geometric acquisition parameters directly influences the quality of a tomographic reconstruction

10th Conference on Industrial Computed Tomography, Wels, Austria (iCT 2020), www.ict-conference.com/2020

Figure 2: Results of the Manhattan metric for a simulated projection with added noise. A black cross indicates the minimum

value in the image. The x-axis represents the horizontal axis, the y-axis the normal axis, and the z-axis the vertical axis of the

detector.

3

Page 4: Image metrics for geometric calibration of a cone-beam ... · The precise knowledge of the geometric acquisition parameters directly influences the quality of a tomographic reconstruction

10th Conference on Industrial Computed Tomography, Wels, Austria (iCT 2020), www.ict-conference.com/2020

Figure 3: Results of the ∇HOG metric for a simulated projection with added noise. A black cross indicates the minimum value

in the image. The x-axis represents the horizontal axis, the y-axis the normal axis, and the z-axis the vertical axis of the detector.

The Manhattan metric already provides wrong minima for noisy simulated projections, so in the following only the ∇HOG metric

will be considered. The ∇HOG metric is evaluated on five measured circular CT data sets of the brick. The detector had a size of

2016× 2016 pixels and a pixel pitch of 200 µm. In the measurements, the magnification factor was changed and an intentional

horizontal shift was applied to the detector. The exact values can be found in Table 1.

Distance

Source - Brick

Distance

Source - Detector

Horizontal

detector shift

A1 69.4940 mm 699.9590 mm 0 mm

A2 139.4941 mm 699.9600 mm 0 mm

A3 139.4880 mm 699.9570 mm 1 mm

A4 139.4870 mm 699.9560 mm 2 mm

A5 279.4810 mm 699.9610 mm 0 mm

Table 1: Parameters of the measurements A1 to A5.

To ensure that the geometric acquisition parameters determined by the CT system match the simulation, the CAD model has to be

aligned to the initial reconstruction of the LEGO brick. This registration is supposed to be possible due to the initial calibration

(mentioned in chapter 2.1) of the CT system. Due to noise in the real images, local calibration on a single projection of the

4

Page 5: Image metrics for geometric calibration of a cone-beam ... · The precise knowledge of the geometric acquisition parameters directly influences the quality of a tomographic reconstruction

10th Conference on Industrial Computed Tomography, Wels, Austria (iCT 2020), www.ict-conference.com/2020

trajectory provides unsatisfactory results. Therefore the results were averaged over the entire trajectory. In addition, in both the

measured and the simulated projections, the metric was not evaluated above a certain pixel height in order to avoid including

the projection of the manipulator (see Figure 5). The results on the data sets A1 to A5 are shown in Figure 4, where only the

horizontal and vertical shifts of the detector are plotted. For data sets A1, A2 and A5, the minimum is expected to be at (0,0) µm

and for data sets A3 and A4 at (1000,0) µm and (2000,0) µm respectively.

(a) Result of the ∇HOG metric for A1. (b) Result of the ∇HOG metric for A2.

(c) Result of the ∇HOG metric for A3. (d) Result of the ∇HOG metric for A4.

(e) Result of the ∇HOG metric for A5.

Figure 4: Result of the ∇HOG metric averaged over all projections of the trajectory of a real data set. The x-axis represents the

horizontal axis, the y-axis the normal axis, and the z-axis the vertical axis of the detector.

For the data sets A2 to A5 it can be seen that the expected horizontal shift of the detector can be determined correctly. Furthermore,

the vertical shift evaluates to −400 µm and −200 µm. For A1 the minimum is determined at a shift of (200,−800) µm. The values

of the minima are similar for the data-sets A2, A3 and A5. The values for A1 and A5 differ.

5

Page 6: Image metrics for geometric calibration of a cone-beam ... · The precise knowledge of the geometric acquisition parameters directly influences the quality of a tomographic reconstruction

10th Conference on Industrial Computed Tomography, Wels, Austria (iCT 2020), www.ict-conference.com/2020

Figure 5: The red line indicates the pixel from which the metric is no longer evaluated for the real and simulated projection.

4 Discussion

For simulated data we demonstrated that it is possible to perform a local calibration with the ∇HOG metric. It was also shown

that the Manhattan metric is not suited for that procedure. For measured data averaged over all projections of a trajectory it was

demonstrated that the local calibration can be used to determine a horizontal detector shift. For the difference in the expected

and determined vertical detector displacement we can provide two possible explanations. Firstly, cutting out the manipulator

affected the projections such that the minima exhibit a vertical shift. Secondly, the detector actually had a shift of about 200 µm

to 400 µm. This is the parameter of the CT system that is determined most uncertainly. By comparing the three minima of A2 to

A4, the shift of the detector can be determined on real data. In addition, the results are consistent with each other. Furthermore

A1, A2 and A5 show that the magnification factor has a significant influence on the evaluation. For A1, the brick is depicted the

largest and therefore noise has a greater influence on the feature calculation of the ∇HOG metric. As a result the correction

parameters determined on this data set yield the worst results.

5 Conclusion

We proposed a local calibration procedure based on a LEGO brick. With this an improvement of the geometric acquisition

parameters could be achieved on real data. Hereby the results were more accurate than presented in [3]. In future works we want

to create a two-step calibration procedure. For this purpose, a tower made of LEGO bricks with metal beads similar to [1] will

be designed and the geometric recording parameters will be determined using the algorithm described in [7]. In the second step,

the acquisition parameters shall be improved with the method described in this work.

References

[1] V. Nguyen, J. De Beenhouwer, J. Sanctorum, S. Van Wassenbergh, P. Aerts, C. Van Ginneken, J. Dirckx, J. Sijbers, A low-

cost and easy-to-use phantom for cone-beam geometry calibration of a tomographic x-ray system, in: 9th Conference on

Industrial Computed Tomography, Padova, Italy (iCT 2019), 2019.

[2] A. H. Slocum, A. C. Weber, Precision passive mechanical alignment of wafers, Journal of Microelectromechanical systems

12 (6) (2003) 826–834.

[3] F. Stopp, A. J. Wieckowski, M. Käseberg, S. Engel, F. Fehlhaber, E. Keeve, A geometric calibration method for an open

cone-beam ct system, in: 12th International Meeting on Fully Three-Dimensional Image Reconstruction in Radiology and

Nuclear Medicine, 2013, pp. 106–109.

[4] T. L. Group, The lego group, a short presentation, http://lego.build/2lvluJH (2019).

[5] W.-C. Chiu, M. Fritz, See the difference: Direct pre-image reconstruction and pose estimation by differentiating hog, in:

Proceedings of the IEEE International Conference on Computer Vision, 2015, pp. 468–476.

[6] N. Dalal, B. Triggs, Histograms of oriented gradients for human detection, in: 2005 IEEE Computer Society Conference on

Computer Vision and Pattern Recognition (CVPR’05), Vol. 1, 2005, pp. 886–893 vol. 1. ❞♦✐✿✶✵✳✶✶✵✾✴❈❱P❘✳✷✵✵✺✳✶✼✼.

[7] P. Jonas, Design criteria for geometrical calibration phantoms in fan and cone beam ct systems, Journal of Inverse and

Ill-posed Problems 26 (6) (2018) 729–753.

6