36
Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi Diagrams April 24, 2019 1 / 36

Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Segmentation of Polycrystalline Images Using VoronoiDiagrams

Uzziel Cortez

April 24, 2019

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 1 / 36

Page 2: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Introduction & Motivation

Material development is essential to solving problems our world faces.

Superalloys: Industrial engineering applications such as aerospace andmarine engineeringGraphene: Applications in medicine and electronicsAerogels: Environmental applications

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 2 / 36

Page 3: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Introduction & Motivation

Polycrystalline materials are composed of many crystalline parts thatare randomly oriented with respect to each other.

The material’s properties are largely dependent on its microstructure.

Material properties

conductivitystrengthhardnesscorrosion resistance ...

Material microstrucure properties

Grain sizeGrain boundary distributionGrain deformationsChemical composition ...

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 3 / 36

Page 4: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Introduction & Motivation

Determining a materials properties through analysis of grain boundarystructure is crucial to the development of new materials andsubsequent advancement of engineering.

Obtaining accurate measurements through imaging can be expensiveand tedious.

Electron Backscatter Diffraction: Equipment and technician costsLight optical microscopy: Requires preprocessing of the material andmay affect measurement accuracy

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 4 / 36

Page 5: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Problem Statement

Given an image of a polycrystalline material, can we implement analgorithm that will produce an accurate segmentation?

i.e. Can we produce a binary image that accurately represents thegrain boundary structure?

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 5 / 36

Page 6: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Voronoi Diagrams

We can model grain boundary structure by using Voronoi Diagrams.

Given a set of generating points P = {p1, p2, ..., pn}, a plane ispartitioned into n regions, {R1,R2, ...,Rn}, such that:

Each point pi lies in exactly one region Ri .For any point q /∈ P that lies in region Ri , the Euclidean distance frompi to q will be shorter than the Euclidean distance from pj to q ∀j 6= i

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 6 / 36

Page 7: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Voronoi Diagrams

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 7 / 36

Page 8: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Voronoi Diagrams

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 8 / 36

Page 9: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Voronoi Diagrams

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 9 / 36

Page 10: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Mean Curvature

Mean-Curvature Flow of Voronoi Diagrams - Matt Elsey & DejanSlepcev, 2014

They were interested in gradient flow of Voronoi diagrams andproving universal bounds on coarsening rates.

We followed a similar method while relaxing some constraints such asperiodic boundary conditions. (more later)

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 10 / 36

Page 11: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Voronoi Diagram Energy

Given a Voronoi Diagram with:

Generating points P = {p1, p2, ..., pn}Edges S = {s1, s2, ..., sk}Vertices V = {v1, v2, ..., vm}.

We define the energy of the Voronoi Diagram as:

E =∑sk∈S

Length(sk) =∑i , j s.t.

vivj=sk∈S

|vi − vj |

Using this definition of energy, we can apply gradient descent on thegenerating points P = {p1, p2, ..., pn} and start to view somedynamics of the Voronoi diagrams.

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 11 / 36

Page 12: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Piece-wise Constant Mumford-Shah model

∑i

∫Ri

(f (x , y)− ci )2dxdy

f(x,y): the target image’s grayscale value at the pixel (x,y)

ci : the average pixel value in region Ri computed from f

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 12 / 36

Page 13: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Model

Using the energy we defined earlier and the piece-wise constantMumford-Shah we get:

E =∑i , j s.t.

vivj=sk∈S

|vi − vj |+∑i

∫Ri

(f (x , y)− ci )2dxdy

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 13 / 36

Page 14: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Calculating Gradients: First Term

Edges: S = {s1, s2, ..., sk}Vertices: V = {v1, v2, ..., vm}∂E∂pi

=∑si∈S

∑vi∈vertex(si )

∂Length(si )

∂vi

∂vi∂pi

∂length(si )∂vi

= [vi (x)−vj (x)Length(si )

,vi (y)−vj (y)Length(si )

]

How to calculate ∂vi∂pi

?

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 14 / 36

Page 15: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Calculating Gradients: First Term

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 15 / 36

Page 16: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Calculating Gradients: First Term

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 16 / 36

Page 17: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Calculating Gradients: First Term

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 17 / 36

Page 18: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Calculating Gradients: First Term

We now have a way to calculate changes in vi for perturbations of pialong two specific directions.

Using a change of basis, we can get the gradient in terms of thestandard basis∂v∂p1

= [w1 w2][s1 s2]−1

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 18 / 36

Page 19: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Calculating Gradients: Second Term

g(x , y) = (f (x , y)− ci )2

∂∂pi

∑i

∫Ri

g(x , y)dxdy

note that after perturbing a center, the change in the integral comesfrom the part of the region that is changed.

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 19 / 36

Page 20: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Calculating Gradients: Second Term

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 20 / 36

Page 21: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Calculating Gradients: Second Term

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 21 / 36

Page 22: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Calculating Gradients: Second Term

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 22 / 36

Page 23: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Calculating Gradients: Second Term

g(x , y) = (f (x , y)− ci )2

∂∂pi

∑i

∫Ri

g(x , y)dxdy =∑i

∫∂Ri

g(s)v(s)⊥ds

≈∑Ri

∑si∈edges(Ri )

N∑k=1

g(s)vk(s)⊥∆s

v(s)⊥ = L−rL

∂vi∂p1

n + rL∂vj∂p1

n

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 23 / 36

Page 24: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Gradient Descent Video

play GD Collision.mp4

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 24 / 36

Page 25: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Handling Topological Events

Vertex collisions (handled well by the algorithm)

Center collisions

Vertices escape the boundary

Center regions collapsed

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 25 / 36

Page 26: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Handling Topological Events - Center Collisions

Repulsion:

R(pi , pj) = R(dij) = e−1

θ2(r−dij )2

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 26 / 36

Page 27: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Handling Topological Events - Boundary Event

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 27 / 36

Page 28: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Handling Topological Events - Boundary Event

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 28 / 36

Page 29: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Handling Topological Events - Boundary Event

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 29 / 36

Page 30: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Handling Topological Events - Collapsed Regions

Area(Ri ) ≤ τ =⇒ Removal of pi

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 30 / 36

Page 31: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Gradient Descent Video

play GD RP.mp4

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 31 / 36

Page 32: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Image Segmentation Result

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 32 / 36

Page 33: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Image Segmentation Result

play Sample Segment.mp4

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 33 / 36

Page 34: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Conclusion and Future Work

Our Model / Algorithm was able to properly handle a preliminary testcase segmentation

Future Challenges include

Non-Uniform Grain ColorsNon-Distinct Grain ColorsGenerating Point Initialization - Location and Number of points

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 34 / 36

Page 35: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

References

1 Elsey, Matt, and Dejan Slepcev. ”Mean-curvature flow of Voronoidiagrams.” Journal of Nonlinear Science 25.1 (2015): 59-85.

2 Trimby, P., et al. ”Is fast mapping good mapping? A review of thebenefits of high-speed orientation mapping using electron backscatterdiffraction.” Journal of microscopy 205.3 (2002): 259-269.

3 Tai, Xue-cheng, and Chang-hui Yao. ”Image segmentation bypiecewise constant Mumford-Shah model without Estimating theconstants.” Journal of Computational Mathematics, vol. 24, no. 3,2006, pp. 435-443. JSTOR, www.jstor.org/stable/43693303.

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 35 / 36

Page 36: Segmentation of Polycrystalline Images Using Voronoi Diagrams · Segmentation of Polycrystalline Images Using Voronoi Diagrams Uzziel Cortez April 24, 2019 Uzziel Cortez Segmentation

Acknowledgments

Special Thanks to:Selim Esedoglu, Tiago Salvador, Yi WenRackham Graduate School for funding

Everyone in the Math Department for their support

Uzziel Cortez Segmentation of Polycrystalline Images Using Voronoi DiagramsApril 24, 2019 36 / 36