Upload
others
View
2
Download
0
Embed Size (px)
Citation preview
Segmentation of Polycrystalline Images Using VoronoiDiagrams
Uzziel Cortez
April 24, 2019
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 1 / 36
Introduction & Motivation
Material development is essential to solving problems our world faces.
Superalloys: Industrial engineering applications such as aerospace andmarine engineeringGraphene: Applications in medicine and electronicsAerogels: Environmental applications
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 2 / 36
Introduction & Motivation
Polycrystalline materials are composed of many crystalline parts thatare randomly oriented with respect to each other.
The material’s properties are largely dependent on its microstructure.
Material properties
conductivitystrengthhardnesscorrosion resistance ...
Material microstrucure properties
Grain sizeGrain boundary distributionGrain deformationsChemical composition ...
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 3 / 36
Introduction & Motivation
Determining a materials properties through analysis of grain boundarystructure is crucial to the development of new materials andsubsequent advancement of engineering.
Obtaining accurate measurements through imaging can be expensiveand tedious.
Electron Backscatter Diffraction: Equipment and technician costsLight optical microscopy: Requires preprocessing of the material andmay affect measurement accuracy
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 4 / 36
Problem Statement
Given an image of a polycrystalline material, can we implement analgorithm that will produce an accurate segmentation?
i.e. Can we produce a binary image that accurately represents thegrain boundary structure?
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 5 / 36
Voronoi Diagrams
We can model grain boundary structure by using Voronoi Diagrams.
Given a set of generating points P = {p1, p2, ..., pn}, a plane ispartitioned into n regions, {R1,R2, ...,Rn}, such that:
Each point pi lies in exactly one region Ri .For any point q /∈ P that lies in region Ri , the Euclidean distance frompi to q will be shorter than the Euclidean distance from pj to q ∀j 6= i
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 6 / 36
Voronoi Diagrams
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 7 / 36
Voronoi Diagrams
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 8 / 36
Voronoi Diagrams
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 9 / 36
Mean Curvature
Mean-Curvature Flow of Voronoi Diagrams - Matt Elsey & DejanSlepcev, 2014
They were interested in gradient flow of Voronoi diagrams andproving universal bounds on coarsening rates.
We followed a similar method while relaxing some constraints such asperiodic boundary conditions. (more later)
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 10 / 36
Voronoi Diagram Energy
Given a Voronoi Diagram with:
Generating points P = {p1, p2, ..., pn}Edges S = {s1, s2, ..., sk}Vertices V = {v1, v2, ..., vm}.
We define the energy of the Voronoi Diagram as:
E =∑sk∈S
Length(sk) =∑i , j s.t.
vivj=sk∈S
|vi − vj |
Using this definition of energy, we can apply gradient descent on thegenerating points P = {p1, p2, ..., pn} and start to view somedynamics of the Voronoi diagrams.
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 11 / 36
Piece-wise Constant Mumford-Shah model
∑i
∫Ri
(f (x , y)− ci )2dxdy
f(x,y): the target image’s grayscale value at the pixel (x,y)
ci : the average pixel value in region Ri computed from f
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 12 / 36
Model
Using the energy we defined earlier and the piece-wise constantMumford-Shah we get:
E =∑i , j s.t.
vivj=sk∈S
|vi − vj |+∑i
∫Ri
(f (x , y)− ci )2dxdy
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 13 / 36
Calculating Gradients: First Term
Edges: S = {s1, s2, ..., sk}Vertices: V = {v1, v2, ..., vm}∂E∂pi
=∑si∈S
∑vi∈vertex(si )
∂Length(si )
∂vi
∂vi∂pi
∂length(si )∂vi
= [vi (x)−vj (x)Length(si )
,vi (y)−vj (y)Length(si )
]
How to calculate ∂vi∂pi
?
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 14 / 36
Calculating Gradients: First Term
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 15 / 36
Calculating Gradients: First Term
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 16 / 36
Calculating Gradients: First Term
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 17 / 36
Calculating Gradients: First Term
We now have a way to calculate changes in vi for perturbations of pialong two specific directions.
Using a change of basis, we can get the gradient in terms of thestandard basis∂v∂p1
= [w1 w2][s1 s2]−1
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 18 / 36
Calculating Gradients: Second Term
g(x , y) = (f (x , y)− ci )2
∂∂pi
∑i
∫Ri
g(x , y)dxdy
note that after perturbing a center, the change in the integral comesfrom the part of the region that is changed.
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 19 / 36
Calculating Gradients: Second Term
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 20 / 36
Calculating Gradients: Second Term
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 21 / 36
Calculating Gradients: Second Term
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 22 / 36
Calculating Gradients: Second Term
g(x , y) = (f (x , y)− ci )2
∂∂pi
∑i
∫Ri
g(x , y)dxdy =∑i
∫∂Ri
g(s)v(s)⊥ds
≈∑Ri
∑si∈edges(Ri )
N∑k=1
g(s)vk(s)⊥∆s
v(s)⊥ = L−rL
∂vi∂p1
n + rL∂vj∂p1
n
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 23 / 36
Gradient Descent Video
play GD Collision.mp4
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 24 / 36
Handling Topological Events
Vertex collisions (handled well by the algorithm)
Center collisions
Vertices escape the boundary
Center regions collapsed
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 25 / 36
Handling Topological Events - Center Collisions
Repulsion:
R(pi , pj) = R(dij) = e−1
θ2(r−dij )2
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 26 / 36
Handling Topological Events - Boundary Event
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 27 / 36
Handling Topological Events - Boundary Event
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 28 / 36
Handling Topological Events - Boundary Event
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 29 / 36
Handling Topological Events - Collapsed Regions
Area(Ri ) ≤ τ =⇒ Removal of pi
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 30 / 36
Gradient Descent Video
play GD RP.mp4
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 31 / 36
Image Segmentation Result
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 32 / 36
Image Segmentation Result
play Sample Segment.mp4
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 33 / 36
Conclusion and Future Work
Our Model / Algorithm was able to properly handle a preliminary testcase segmentation
Future Challenges include
Non-Uniform Grain ColorsNon-Distinct Grain ColorsGenerating Point Initialization - Location and Number of points
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 34 / 36
References
1 Elsey, Matt, and Dejan Slepcev. ”Mean-curvature flow of Voronoidiagrams.” Journal of Nonlinear Science 25.1 (2015): 59-85.
2 Trimby, P., et al. ”Is fast mapping good mapping? A review of thebenefits of high-speed orientation mapping using electron backscatterdiffraction.” Journal of microscopy 205.3 (2002): 259-269.
3 Tai, Xue-cheng, and Chang-hui Yao. ”Image segmentation bypiecewise constant Mumford-Shah model without Estimating theconstants.” Journal of Computational Mathematics, vol. 24, no. 3,2006, pp. 435-443. JSTOR, www.jstor.org/stable/43693303.
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 35 / 36
Acknowledgments
Special Thanks to:Selim Esedoglu, Tiago Salvador, Yi WenRackham Graduate School for funding
Everyone in the Math Department for their support
Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 36 / 36