Patch-based image similarity for intraoperative 2D/3D pelvis registration during periacetabular osteotomy

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Periacetabular osteotomy is a challenging surgical procedure for treating developmental hip dysplasia, providing greater coverage of the femoral head via relocation of a patient’s acetabulum. Since fluoroscopic imaging is frequently used in the surgical workflow, computer-assisted X-Ray navigation of osteotomes and the relocated acetabular fragment should be feasible. We use intensity-based 2D/3D registration to estimate the pelvis pose with respect to fluoroscopic images, recover relative poses of multiple views, and triangulate landmarks which may be used for navigation. Existing similarity metrics are unable to consistently account for the inherent mismatch between the preoperative intact pelvis, and the intraoperative reality of a fractured pelvis. To mitigate the effect of this mismatch, we continuously estimate the relevance of each pixel to solving the registration and use these values as weightings in a patch-based similarity metric. Limiting computation to randomly selected subsets of patches results in faster runtimes than existing patch-based methods. A simulation study was conducted with random fragment shapes, relocations, and fluoroscopic views, and the proposed method achieved a 1.7 mm mean triangulation error over all landmarks, compared to mean errors of 3 mm and 2.8 mm for the non-patched and image-intensity-variance-weighted patch similarity metrics, respectively.

Original languageEnglish (US)
Title of host publicationOR 2.0 Context-Aware Operating Theaters, Computer Assisted Robotic Endoscopy, Clinical Image-Based Procedures, and Skin Image Analysis - 1st International Workshop, OR 2.0 2018 5th International Workshop, CARE 2018, 7th International Workshop, CLIP 2018, 3rd International Workshop, ISIC 2018 Held in Conjunction with MICCAI 2018
EditorsAnand Malpani, Marco A. Zenati, Cristina Oyarzun Laura, M. Emre Celebi, Duygu Sarikaya, Noel C. Codella, Allan Halpern, Marius Erdt, Lena Maier-Hein, Luo Xiongbiao, Stefan Wesarg, Danail Stoyanov, Zeike Taylor, Klaus Drechsler, Kristin Dana, Anne Martel, Raj Shekhar, Sandrine De Ribaupierre, Tobias Reichl, Jonathan McLeod, Miguel Angel González Ballester, Toby Collins, Marius George Linguraru
PublisherSpringer Verlag
Pages153-163
Number of pages11
ISBN (Print)9783030012007
DOIs
StatePublished - Jan 1 2018
Event1st International Workshop on OR 2.0 Context-Aware Operating Theaters, OR 2.0 2018, 5th International Workshop on Computer Assisted Robotic Endoscopy, CARE 2018, 7th International Workshop on Clinical Image-Based Procedures, CLIP 2018, and 1st International Workshop on Skin Image Analysis, ISIC 2018, held in conjunction with the 21st International Conference on Medical Imaging and Computer-Assisted Intervention, MICCAI 2018 - Granada, Spain
Duration: Sep 16 2018Sep 20 2018

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume11041 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other1st International Workshop on OR 2.0 Context-Aware Operating Theaters, OR 2.0 2018, 5th International Workshop on Computer Assisted Robotic Endoscopy, CARE 2018, 7th International Workshop on Clinical Image-Based Procedures, CLIP 2018, and 1st International Workshop on Skin Image Analysis, ISIC 2018, held in conjunction with the 21st International Conference on Medical Imaging and Computer-Assisted Intervention, MICCAI 2018
CountrySpain
CityGranada
Period9/16/189/20/18

Fingerprint

Relocation
Registration
Patch
Navigation
Triangulation
Landmarks
Set theory
Metric
Fragment
Pixels
Triangulate
Imaging techniques
X rays
Estimate
Work Flow
Weighting
Coverage
Limiting
Pixel
Imaging

Keywords

  • 2D/3D registration
  • Periacetabular osteotomy
  • X-ray navigation

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Grupp, R. B., Armand, M., & Taylor, R. H. (2018). Patch-based image similarity for intraoperative 2D/3D pelvis registration during periacetabular osteotomy. In A. Malpani, M. A. Zenati, C. Oyarzun Laura, M. E. Celebi, D. Sarikaya, N. C. Codella, A. Halpern, M. Erdt, L. Maier-Hein, L. Xiongbiao, S. Wesarg, D. Stoyanov, Z. Taylor, K. Drechsler, K. Dana, A. Martel, R. Shekhar, S. De Ribaupierre, T. Reichl, J. McLeod, M. A. González Ballester, T. Collins, ... M. G. Linguraru (Eds.), OR 2.0 Context-Aware Operating Theaters, Computer Assisted Robotic Endoscopy, Clinical Image-Based Procedures, and Skin Image Analysis - 1st International Workshop, OR 2.0 2018 5th International Workshop, CARE 2018, 7th International Workshop, CLIP 2018, 3rd International Workshop, ISIC 2018 Held in Conjunction with MICCAI 2018 (pp. 153-163). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11041 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-030-01201-4_17

Patch-based image similarity for intraoperative 2D/3D pelvis registration during periacetabular osteotomy. / Grupp, Robert B.; Armand, Mehran; Taylor, Russell H.

OR 2.0 Context-Aware Operating Theaters, Computer Assisted Robotic Endoscopy, Clinical Image-Based Procedures, and Skin Image Analysis - 1st International Workshop, OR 2.0 2018 5th International Workshop, CARE 2018, 7th International Workshop, CLIP 2018, 3rd International Workshop, ISIC 2018 Held in Conjunction with MICCAI 2018. ed. / Anand Malpani; Marco A. Zenati; Cristina Oyarzun Laura; M. Emre Celebi; Duygu Sarikaya; Noel C. Codella; Allan Halpern; Marius Erdt; Lena Maier-Hein; Luo Xiongbiao; Stefan Wesarg; Danail Stoyanov; Zeike Taylor; Klaus Drechsler; Kristin Dana; Anne Martel; Raj Shekhar; Sandrine De Ribaupierre; Tobias Reichl; Jonathan McLeod; Miguel Angel González Ballester; Toby Collins; Marius George Linguraru. Springer Verlag, 2018. p. 153-163 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11041 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Grupp, RB, Armand, M & Taylor, RH 2018, Patch-based image similarity for intraoperative 2D/3D pelvis registration during periacetabular osteotomy. in A Malpani, MA Zenati, C Oyarzun Laura, ME Celebi, D Sarikaya, NC Codella, A Halpern, M Erdt, L Maier-Hein, L Xiongbiao, S Wesarg, D Stoyanov, Z Taylor, K Drechsler, K Dana, A Martel, R Shekhar, S De Ribaupierre, T Reichl, J McLeod, MA González Ballester, T Collins & MG Linguraru (eds), OR 2.0 Context-Aware Operating Theaters, Computer Assisted Robotic Endoscopy, Clinical Image-Based Procedures, and Skin Image Analysis - 1st International Workshop, OR 2.0 2018 5th International Workshop, CARE 2018, 7th International Workshop, CLIP 2018, 3rd International Workshop, ISIC 2018 Held in Conjunction with MICCAI 2018. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11041 LNCS, Springer Verlag, pp. 153-163, 1st International Workshop on OR 2.0 Context-Aware Operating Theaters, OR 2.0 2018, 5th International Workshop on Computer Assisted Robotic Endoscopy, CARE 2018, 7th International Workshop on Clinical Image-Based Procedures, CLIP 2018, and 1st International Workshop on Skin Image Analysis, ISIC 2018, held in conjunction with the 21st International Conference on Medical Imaging and Computer-Assisted Intervention, MICCAI 2018, Granada, Spain, 9/16/18. https://doi.org/10.1007/978-3-030-01201-4_17
Grupp RB, Armand M, Taylor RH. Patch-based image similarity for intraoperative 2D/3D pelvis registration during periacetabular osteotomy. In Malpani A, Zenati MA, Oyarzun Laura C, Celebi ME, Sarikaya D, Codella NC, Halpern A, Erdt M, Maier-Hein L, Xiongbiao L, Wesarg S, Stoyanov D, Taylor Z, Drechsler K, Dana K, Martel A, Shekhar R, De Ribaupierre S, Reichl T, McLeod J, González Ballester MA, Collins T, Linguraru MG, editors, OR 2.0 Context-Aware Operating Theaters, Computer Assisted Robotic Endoscopy, Clinical Image-Based Procedures, and Skin Image Analysis - 1st International Workshop, OR 2.0 2018 5th International Workshop, CARE 2018, 7th International Workshop, CLIP 2018, 3rd International Workshop, ISIC 2018 Held in Conjunction with MICCAI 2018. Springer Verlag. 2018. p. 153-163. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-030-01201-4_17
Grupp, Robert B. ; Armand, Mehran ; Taylor, Russell H. / Patch-based image similarity for intraoperative 2D/3D pelvis registration during periacetabular osteotomy. OR 2.0 Context-Aware Operating Theaters, Computer Assisted Robotic Endoscopy, Clinical Image-Based Procedures, and Skin Image Analysis - 1st International Workshop, OR 2.0 2018 5th International Workshop, CARE 2018, 7th International Workshop, CLIP 2018, 3rd International Workshop, ISIC 2018 Held in Conjunction with MICCAI 2018. editor / Anand Malpani ; Marco A. Zenati ; Cristina Oyarzun Laura ; M. Emre Celebi ; Duygu Sarikaya ; Noel C. Codella ; Allan Halpern ; Marius Erdt ; Lena Maier-Hein ; Luo Xiongbiao ; Stefan Wesarg ; Danail Stoyanov ; Zeike Taylor ; Klaus Drechsler ; Kristin Dana ; Anne Martel ; Raj Shekhar ; Sandrine De Ribaupierre ; Tobias Reichl ; Jonathan McLeod ; Miguel Angel González Ballester ; Toby Collins ; Marius George Linguraru. Springer Verlag, 2018. pp. 153-163 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{7e356aca36ca4cee953ea3d416ac5205,
title = "Patch-based image similarity for intraoperative 2D/3D pelvis registration during periacetabular osteotomy",
abstract = "Periacetabular osteotomy is a challenging surgical procedure for treating developmental hip dysplasia, providing greater coverage of the femoral head via relocation of a patient’s acetabulum. Since fluoroscopic imaging is frequently used in the surgical workflow, computer-assisted X-Ray navigation of osteotomes and the relocated acetabular fragment should be feasible. We use intensity-based 2D/3D registration to estimate the pelvis pose with respect to fluoroscopic images, recover relative poses of multiple views, and triangulate landmarks which may be used for navigation. Existing similarity metrics are unable to consistently account for the inherent mismatch between the preoperative intact pelvis, and the intraoperative reality of a fractured pelvis. To mitigate the effect of this mismatch, we continuously estimate the relevance of each pixel to solving the registration and use these values as weightings in a patch-based similarity metric. Limiting computation to randomly selected subsets of patches results in faster runtimes than existing patch-based methods. A simulation study was conducted with random fragment shapes, relocations, and fluoroscopic views, and the proposed method achieved a 1.7 mm mean triangulation error over all landmarks, compared to mean errors of 3 mm and 2.8 mm for the non-patched and image-intensity-variance-weighted patch similarity metrics, respectively.",
keywords = "2D/3D registration, Periacetabular osteotomy, X-ray navigation",
author = "Grupp, {Robert B.} and Mehran Armand and Taylor, {Russell H}",
year = "2018",
month = "1",
day = "1",
doi = "10.1007/978-3-030-01201-4_17",
language = "English (US)",
isbn = "9783030012007",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "153--163",
editor = "Anand Malpani and Zenati, {Marco A.} and {Oyarzun Laura}, Cristina and Celebi, {M. Emre} and Duygu Sarikaya and Codella, {Noel C.} and Allan Halpern and Marius Erdt and Lena Maier-Hein and Luo Xiongbiao and Stefan Wesarg and Danail Stoyanov and Zeike Taylor and Klaus Drechsler and Kristin Dana and Anne Martel and Raj Shekhar and {De Ribaupierre}, Sandrine and Tobias Reichl and Jonathan McLeod and {Gonz{\'a}lez Ballester}, {Miguel Angel} and Toby Collins and Linguraru, {Marius George}",
booktitle = "OR 2.0 Context-Aware Operating Theaters, Computer Assisted Robotic Endoscopy, Clinical Image-Based Procedures, and Skin Image Analysis - 1st International Workshop, OR 2.0 2018 5th International Workshop, CARE 2018, 7th International Workshop, CLIP 2018, 3rd International Workshop, ISIC 2018 Held in Conjunction with MICCAI 2018",

}

TY - GEN

T1 - Patch-based image similarity for intraoperative 2D/3D pelvis registration during periacetabular osteotomy

AU - Grupp, Robert B.

AU - Armand, Mehran

AU - Taylor, Russell H

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Periacetabular osteotomy is a challenging surgical procedure for treating developmental hip dysplasia, providing greater coverage of the femoral head via relocation of a patient’s acetabulum. Since fluoroscopic imaging is frequently used in the surgical workflow, computer-assisted X-Ray navigation of osteotomes and the relocated acetabular fragment should be feasible. We use intensity-based 2D/3D registration to estimate the pelvis pose with respect to fluoroscopic images, recover relative poses of multiple views, and triangulate landmarks which may be used for navigation. Existing similarity metrics are unable to consistently account for the inherent mismatch between the preoperative intact pelvis, and the intraoperative reality of a fractured pelvis. To mitigate the effect of this mismatch, we continuously estimate the relevance of each pixel to solving the registration and use these values as weightings in a patch-based similarity metric. Limiting computation to randomly selected subsets of patches results in faster runtimes than existing patch-based methods. A simulation study was conducted with random fragment shapes, relocations, and fluoroscopic views, and the proposed method achieved a 1.7 mm mean triangulation error over all landmarks, compared to mean errors of 3 mm and 2.8 mm for the non-patched and image-intensity-variance-weighted patch similarity metrics, respectively.

AB - Periacetabular osteotomy is a challenging surgical procedure for treating developmental hip dysplasia, providing greater coverage of the femoral head via relocation of a patient’s acetabulum. Since fluoroscopic imaging is frequently used in the surgical workflow, computer-assisted X-Ray navigation of osteotomes and the relocated acetabular fragment should be feasible. We use intensity-based 2D/3D registration to estimate the pelvis pose with respect to fluoroscopic images, recover relative poses of multiple views, and triangulate landmarks which may be used for navigation. Existing similarity metrics are unable to consistently account for the inherent mismatch between the preoperative intact pelvis, and the intraoperative reality of a fractured pelvis. To mitigate the effect of this mismatch, we continuously estimate the relevance of each pixel to solving the registration and use these values as weightings in a patch-based similarity metric. Limiting computation to randomly selected subsets of patches results in faster runtimes than existing patch-based methods. A simulation study was conducted with random fragment shapes, relocations, and fluoroscopic views, and the proposed method achieved a 1.7 mm mean triangulation error over all landmarks, compared to mean errors of 3 mm and 2.8 mm for the non-patched and image-intensity-variance-weighted patch similarity metrics, respectively.

KW - 2D/3D registration

KW - Periacetabular osteotomy

KW - X-ray navigation

UR - http://www.scopus.com/inward/record.url?scp=85054878519&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85054878519&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-01201-4_17

DO - 10.1007/978-3-030-01201-4_17

M3 - Conference contribution

AN - SCOPUS:85054878519

SN - 9783030012007

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 153

EP - 163

BT - OR 2.0 Context-Aware Operating Theaters, Computer Assisted Robotic Endoscopy, Clinical Image-Based Procedures, and Skin Image Analysis - 1st International Workshop, OR 2.0 2018 5th International Workshop, CARE 2018, 7th International Workshop, CLIP 2018, 3rd International Workshop, ISIC 2018 Held in Conjunction with MICCAI 2018

A2 - Malpani, Anand

A2 - Zenati, Marco A.

A2 - Oyarzun Laura, Cristina

A2 - Celebi, M. Emre

A2 - Sarikaya, Duygu

A2 - Codella, Noel C.

A2 - Halpern, Allan

A2 - Erdt, Marius

A2 - Maier-Hein, Lena

A2 - Xiongbiao, Luo

A2 - Wesarg, Stefan

A2 - Stoyanov, Danail

A2 - Taylor, Zeike

A2 - Drechsler, Klaus

A2 - Dana, Kristin

A2 - Martel, Anne

A2 - Shekhar, Raj

A2 - De Ribaupierre, Sandrine

A2 - Reichl, Tobias

A2 - McLeod, Jonathan

A2 - González Ballester, Miguel Angel

A2 - Collins, Toby

A2 - Linguraru, Marius George

PB - Springer Verlag

ER -