6
SURGICAL SIMULATION USING MASS-SPRING MODEL VAmANT Salina Sulaiman, Abdullah Bade and Si ti Hasnah Tanalol School of Science and Technology Universiti Malaysia Sabah ABS TRACT Even though soft tissue deformation is one of the essential components ofa real time surgical simulation, very little is kn own about the physical properti es of general human tissues. So ft tissue def ormations in computer graphics and surgical simulations are commonly modelled with Finite Element method (FEM) and Mass-spring Method (MSM) because they take the physics of de formation into consideration. Even though the FEM produces more p hy sically realistic de fo rmations, it is computationally costly and more vulnerable to surgical procedures. However, MSM is low computational complexity and simple implementation. These f actors make the latter method highly attractive fo r virtual reality based surgical simulators. Th is p aper discusses several methodologies for simulating soft-tissues in the reference frame of mass-spring models. In particular, the pa per buiLds on the recent work on mass-spring model (MSM) and mass-tensor model (MTM). Keyw ords - ma ss-sp rin g model, surgical simulation, mass-tensor model, virtu al reality, soft tissue deform ations 1. INTRODUCTI ON For years, surgical traini ng is develo ped on animals, cadavers and patients. Many serious challenges arise from th ese training methods such as animals do not al ways reflect hwnan anatomy; cadavers have different properties from living tissues; training on patients is highly risky. With th e development of minimally invasive surgical procedures (MIS), surgeons have to ful fil higher requi rement due to poor depth perception, limited fi eld of view, and improper hand-eye coordination. It takes many years for surgeons to gai n enough exposure to become specialist. Therefore, a major goal of all virtual surgical simulation systems is to assist the novices in speeding up the learning curve by providing a platform where medical procedures, dj agoosis or planning can be performed in cy berspace as if in reality (Choi et aI. , 2004). e Realistic behaviour and real-time capability are two main featu res required for effective surgical simulation. Real-time interaction requires that all action exhibit physically correct behaviours and instantaneous response from the simulated so ft tissue or organ correspond in g to the behaviours of real human organs and tissues. Unfortunately, hwnan t iss ue is very complex (Qin et aI. , 201 0). While high accuracy is needed to achieve realism, higbJy complex models usually lead to increased computation times. [n practice, the desired realism of the physical models must be balanced against the need for speed. Primarily two most conunon methods are used for modelling of soft tissues in surgical simulation which are Mass-spring model (MSM) and fin ite-element model (FEM). Finite El ement Method (FEM) based on 1

procedures (MIS), surgeons have to fulfileprints.ums.edu.my/9107/1/cp0000000131.pdf · mX = k(xo - x) - yi where Xo is the rest position of the mass, k and yare the stiffness and

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: procedures (MIS), surgeons have to fulfileprints.ums.edu.my/9107/1/cp0000000131.pdf · mX = k(xo - x) - yi where Xo is the rest position of the mass, k and yare the stiffness and

SURGICAL SIMULATION USING MASS-SPRING MODEL VAmANT

Salina Sulaiman, Abdullah Bade and Siti Hasnah Tanalol School of Science and Technology

Universiti Malaysia Sabah

ABSTRACT

Even though soft tissue deformation is one ofthe essential components ofa real time surgical simulation, very little is known about the physical properties ofgeneral human tissues. Soft tissue def ormations in computer graphics and surgical simulations are commonly modelled with Finite Element method (FEM) and Mass-spring Method (MSM) because they take the physics ofdef ormation into consideration. Even though the FEM produces more physically realistic deformations, it is computationally costly and more vulnerable to surgical procedures. However, MSM is low computational complexity and simple implementation. These f actors make the latter method highly attractive for virtual reality based surgical simulators. This p aper discusses several methodologies for simulating soft-tissues in the reference frame ofmass-spring models. In particular, the paper buiLds on the recent work on mass-spring model (MSM) and mass-tensor model (MTM).

Keywords - mass-spring model, surgical simulation, mass-tensor model, virtual reality, soft tissue deformations

e 1. INTRODUCTION

For years, surgical traini ng is developed on animals, cadavers and patients. Many serious challenges arise from

these training methods such as animals do not always reflect hwnan anatomy; cadavers have different properties

from living tissues; training on patients is highly risky. With the development of minimally invasive surgical

procedures (MIS), surgeons have to ful fil higher requirement due to poor depth perception, limited fi eld of view,

and improper hand-eye coordination. It takes many years for surgeons to gain enough exposure to become

specialist. Therefore, a major goal of all virtual surgical simulation systems is to assist the novices in speeding up

the learning curve by providing a platform where medical procedures, djagoosis or planning can be performed in

cyberspace as if in reality (Choi et aI., 2004).

e Realistic behaviour and real-time capability are two main features required for effective surgical simulation.

Real-time interaction requires that all action exhibit physically correct behaviours and instantaneous response from

the simulated soft tissue or organ corresponding to the behaviours of real human organs and tissues. Unfortunately,

hwnan tissue is very complex (Qin et aI., 2010). While high accuracy is needed to achieve realism, higbJy complex

models usually lead to increased computation times. [n practice, the desired realism of the physical models must be

balanced against the need for speed.

Primarily two most conunon methods are used for modell ing of soft tissues in surgical simulation which

are Mass-spring model (MSM) and finite-element model (FEM). Finite Element Method (FEM) based on 1

Page 2: procedures (MIS), surgeons have to fulfileprints.ums.edu.my/9107/1/cp0000000131.pdf · mX = k(xo - x) - yi where Xo is the rest position of the mass, k and yare the stiffness and

continuum mechanics, provides high degree of accuracy but computationaUy intensive So, it is undesirable for

applications that demand real time interactions (Liu et al.. 2003). Meanwhile, Mass Spring Model (MSM) has a

very easy architecture, low memory usage and is fast, which m~e it very attractive for real-time and filst surgical

simulators (Mollemans et al. 2005).

In this paper we will present some variants o f Mass-Spring Model (MSM) in determining its system

parameters (masses, spring constants, mesh topology) such as Mass-tensor model and modified mass tensor model.

2. CONVENTIONAL MASS-SPRING MODEL (MSM)

e In mass-spring models, object is modelled as a collection of point masses connected by springs in a lattice structure

(as shown in fi gure 2.1). Representation of MSM is discrete, contrarily to continuwn based approaches. MSM

represent a body by a single or multiple masses that have no extension and hold the complete mass of the body by

following the idea of classical mechanics. External forces applied to the body are concentrated in the point masses

as well. Thus. every continuous body can be transfonned into a system ofdistributed point masses through this way

(Kenwright et al., 2011).

e Figure 2. 1 : A schematic representation ofa regular 2D MSM

These models include a mesh of springs that interconnect those point masses representing the elastic behaviour of

the bodies. The spring mesh can have many different configurations depending on the geometry of the object and

the topology selected to represent the elasticity properties. There are mainly 2 types of meshes: polyhedral meshes

and nearest neighbour meshes. The polyhedral meshes fi ll the volume of the body with polyhedrons that can be

regular or not. In some applications, regular meshes are preferable since they allow controlling better the elastic

response of the body. Irregular meshes, on the contrary, have the advantage of allowing mesh refinement in those

2

Page 3: procedures (MIS), surgeons have to fulfileprints.ums.edu.my/9107/1/cp0000000131.pdf · mX = k(xo - x) - yi where Xo is the rest position of the mass, k and yare the stiffness and

• • • • • • •

• • • • • • •

I"

areas where the required solution is higher. On the other hi d, nearest neighbour meshes (refer Figure 2.2) make

the elastic connections with a fixed number of nearest neighbours or with all the neighbours that are closer than a

certain distance (Wang et aL, 2009).

'I. • '. ~ i / " · •

• ·' ~~' : . • ~ !.-~ "1-\. •• •

k

• "-- -­

Figure 2.2: A schematic representation of2D MSM where the ¢Onnectivity is governed by an influence distance.

Regardless of the mesh type, when the model interacts with ~e environment new boundary conditions appear on

e the surface of the body. Generally, depending on the interaction type, the new surface conditions can be expressed

in 2 ways: a set of forces exerted over some point masses or a collection of displacements imposed oftbe length of

the springs including forces that act over each point mass of the MSM (Wang et al., 2009).

2.1 Related Work

In this advance technology era. there is an increased demand for real-time surgical simulation. This is because of

the features that present in the virtual simulator can give the realistic behaviours of organs and tissues, haptic

feedback as well as realistic visualization. Behaviour of the object can be defilled by using the mathematical

e equations and the law of physics.

Due to the simplicity of the motion equations, various applications have already used nodal systems to

simulate soft tissues, for instance (Brown et al, 2002) simulates the cutting operation of defonnable tissue based on

MSMs and (Keeve et aI., 1996) models fat tissue in a craniofacial surgery simulator. Liu et al . (2003) described

MSM based on the network of point masses connected by spring-dampers that present in MSM. A spring-damper is

represented by an ideal ized spring function and a velocity dependent damping function. [f a point x has mass m,

then mX = k(xo - x) - yi where Xo is the rest position of the mass, k and yare the stiffness and damping

coefficients respectively. For a set of N points in 3D space, let X be a 3N x I column of vectors representing the

3

Page 4: procedures (MIS), surgeons have to fulfileprints.ums.edu.my/9107/1/cp0000000131.pdf · mX = k(xo - x) - yi where Xo is the rest position of the mass, k and yare the stiffness and

position of all points. Then the mass-spring system can be expressed as MX = KX - YX , where M and Y are 3N x

3N diagonal mass and damping matrices respectively, and K is a 3N x 3N banded matrix of stiffness coefficients.

The equation can be rewritten as a set of first order differential eq';llitions and solved using standard method.

3. MASS-SPRING MODEL VARIANT

3.1 MASS TENSOR MODEL (MTM)

The original Mass Tensor Model (MTM) was jntroduced by Cptin (Cotin et al. 2000). In the MTM the modelled

object is discretized into a tetrahedral mesh. Inside every tetrahedron Ti , the displacement fi eld is defmes by a

linear interpolation of the displacement vectors of the four vertices of Ti • as defined by the finite element theory.

e The linear elastic energy o f tetrahedron Ti can then be expressed as a function of the displacements of the four

vertices and of the two Lame coefficients y and 11 which biomechanical elastic constants. The force applied at

vertex j of the tetrahedron Ti is defined as the derivative of this elastic energy:

3

T 1 iJWelasticCTi) = ~ [K~I] urtCk)F. =- £ J} iJ E] k ±O

where uriCk) is the displacement of vertex k of the tetrahedron Ti and ~~ are the stiffness tensors for this

tetrahedron. These tensors are completely detennined by the inltial position of each vertex of the tetrahedron and

the two Lame coefficients, which are material specific. For the Vfhole mesh. the total force is simply the sum of the

contributions by all adjacent tetrahedral of the vertex j .

e 3.2 PIClNBONO'S TENSOR-MASS MODEL (PMTM)

A variant of a mass-spring system known as mass-tensor mode~ (Choi et aI., 2009) governed by the Voigt's model

of visco-elasticity was imprOVed by Picinbono et al. (2003) where every Link between two nodes consists of a

spring and a damper connected in parallel. The dynamics ofeach node in the system can be obtained by integrating

the Newton 's law numerically using fmite difference method. l'his model is known as dynamic linear model or

Picinbono's tensor-mass model. P icinbono's tensor-mass exteOded model were used by Xu et aI. (2010) to

4

Page 5: procedures (MIS), surgeons have to fulfileprints.ums.edu.my/9107/1/cp0000000131.pdf · mX = k(xo - x) - yi where Xo is the rest position of the mass, k and yare the stiffness and

incorporate visco-elasticity into the model, which is then used as a reference for the system to obtain the parameters

for the MSM model in order to reproduce the actual pbysical behaviours of soft tissue.

Picinbono's tensor-mass model was developed by incorporating visco-elasticity into the model, which is

used as a reference for the system to obtain the parameters for the MSM model in order to reproduce the actual

physical behaviours of soft tissue. Several heuristic techniques such as simulated annealing and genetic algorithm

were employed to extract the system parameters of this model automatically. A1though there are a number of

viscoelastic constitutive models, it has been found that the direct incorporation of viscoelastic models into the

tensor-mass model of soft tissue will lead to a significant increase of computational cost, because the information

must be saved at every previous time step (Xu et al.. 2011). In addition, an improved realistic mass-spring model in

which the internal forces among mass nodes are derived within the framework of nonlinear continuum mechanics.

e By replacing the potential (strain energy) function of a classical mass-spring model with the new proposed one in

accordance with three-dimensional finite strain nonlinear anisotropic elasticity theory, the new model are made

used to describe typical behaviours of living tissue such as incompressibility, nonlinearity and anisotropy (Xu et aI .

2010).

4. FUTURE WORK

The MSM is an interesting alternative to the FEM especiaUy for real-time interactive surgical application. This

work can be further exploited by using a new approach to automaticaUy define the parameters of a MSM based on

a comparison to a linear elastic FEM for small deformations and another method based on the constitutive law of a

e material working under large deformations.

The following are the possible future directions of research related to this discussion:

a. Extend the method with the aim of considering the behavior of a cubical element under additional types of

loads. This could improve in the accuracy of the MSM designed using this method, especially when stretching

is not the dominant Joad.

b. Design of MSM with additional types of springs, such as nonlinear, torsion and angular springs which may

may improve the quality of the approximation.

5

Page 6: procedures (MIS), surgeons have to fulfileprints.ums.edu.my/9107/1/cp0000000131.pdf · mX = k(xo - x) - yi where Xo is the rest position of the mass, k and yare the stiffness and

5. CONCLUSION

This paper presents the framework of Mass-Spring Mode) in surgical simulation. Mass-Spring Model is the

method often used for real-time surgery simulation due to theit fast response and fairly realistic defonnation

replication. Moreover by refining dynamic parameters in Mass Spring Model, more efficient variants ofMSM will

be generated. Thus, mass-spring modeJ will improve the prediction result and to ensure a certain prediction

accuracy for typical surgical procedures.

REFERENCES

Choi, K. S., Sun, H. & Heng, P. A. 2004. An efficient and scalable deformable model for virtual reality-based medical appl ications. In: Artificial Intelligence in Medicine, vol. 32. 5 J-69.

Cotin, S., Delingette, H., & Ayache, N. 2000. A hybrid elastic model allowing real-time cutting, defonnations and e force- feedback for surgery training and simulation. Visual Computer, vol. 16. 437-452.

Kenwright, B., Davison, R., & Morgan, G. 201 J. Real-time defonnable soft-body simulation using distributed mass-spring approximations. In: Proceedings of The Third International Conference on Creative Content Technologies. 29-33.

Liu, A. Tendick, F., Cleary, K. & Kaufmann, C. 2003. A survey of surgical simulation: applications, technology, and education. Presence, Vol. 12, Issue 6. 599-6 14.

McInerny, T. & Terzopoulos, D. J996. Defonnable ModeJs in Medical Image Analysis: A Survey. In: Medical Image Analysis. vol. ],91 -108.

Mollemans, W., Scbutyser, F., Nadjmi, N., Suetens, P. 2005. Very fast soft tissue predictions with mass tensor model for maxillofacial surgery planning systems. In: International Congress Series, Computer Assisted Radiology and Surgery, vol. 1281. 491 -496.

Picinbono, G., Delingette, H. & Ayache, N. 2003. Non-linear anisotropic elasticity for real-time surgery simulation. In: Graphical models, vol. 65 : I. 305-32 1.

Qin, J., Choi, K. S. & Heng, P. A. 2010. CoJJaborative Simulat ion of Soft-Tissue Deformation for Virtual Surgery e Simulation. Journal of Medical Systems: 34: 367-378.

Wang, H., Wang, Y. & Esen, H. 2009. Realization and application of mass-spring model in haptic rendering system for virtual reality. In: Proceedings of the IEEE Second International Conference on Intelligent Computation Technology and Automation. 156-159.

Xu, S., Liu, X. & Zhang, H. 2009. Simulation of soft tissue using mass-spring model with simulated annealing optimization. In: Proceedings of the IEEE International Con ference on Automation and Logistics. 1543-1549.

Xu, S., Liu, X. P., Zhang, H. & Hu, L. 2010. An improved realistic mass-spring model for surgery simulation. In: Proceedings of the IEEE International Symposium on Haptic Audio-Visual Environments and Games. 1-6.

Xu, S., Liu, X.P., Zhang, H., & Hu, L. 201 1. A Nonlinear Viscoelastic Tensor-Mass Visual Model for Surgery Simulation. IEEE Transactions On Instrumentation And Measurement, vol. 60:J . J4-20.

Zhu, L., Ye, X., Ji' er, X., Gu, Y., & Guo. S. 2010. A Real-time defonnation modeling scheme of soft tissue for virtual surgical . In : Proceeedings of tbe IEEE International Conference on Information and Automation. 771-775.

6