Biomedical and Environmental Sciences  2018, Vol. 31 Issue (6): 407-412   PDF    
Repeatability and Reproducibility of Quantitative Assessment of the Retinal Microvasculature Using Optical Coherence Tomography Angiography Based on Optical Microangiography*
ZHAO Qi1 , YANG Wen Li1 , WANG Xiao Na2 , Wang Ruikang K2,3 , YOU Qi Sheng2 , CHU Zhong Di3 , XIN Chen2 , ZHANG Meng Yu1 , LI Dong Jun1 , WANG Zi Yang1 , CHEN Wei1 , LI Yi Feng1 , CUI Rui1 , SHEN Lin1 and WEI Wen Bin1,#     
1. Department of Ophthalmology, Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University; Beijing Key Laboratory of Ophthalmology and Visual Sciences, Beijing 100730, China;
2. Beijing Institute of Ophthalmology, Beijing Tongren Eye Center, Beijing Tongren Hospital, Capital Medical University; Beijing Key Laboratory of Ophthalmology and Visual Sciences, Beijing 100005, China;
3. Department of Bioengineering, University of Washington, Seattle Washington 98195, United States of America
Abstract:

Objective The aim of this study was to determine the repeatability and reproducibility of optical coherence tomography angiography (OCTA) based on optical microangiography (OMAG) measurements of macular vessels in normal eyes.

Methods In this prospective cohort study, 40 eyes of 40 healthy volunteers underwent repeated OCTA (Cirrus HD-OCT 5000 angiography system, Carl Zeiss Meditec, Inc.) scans on two separate visit days. On each visit day, the eyes were scanned three times. The following parameters were used to quantitatively describe the OCTA images of the superficial vascular network:vessel area density (VAD), vessel skeleton density (VSD), vessel diameter index (VDI), vessel perimeter index (VPI), vessel complexity index (VCI), flux, and foveal avascular zone (FAZ). Coefficient of variation (CV) and intraclass correlation coefficient (ICC) were calculated for evaluating intravisit and intervisit repeatability, as well as interobserver reproducibility.

Results The measurements showed high repeatability[CVs ≤ 4.2% (intravisit) and ≤ 4.6% (intervisit)] and interobserver reproducibility (ICCs ≥ 0.923) for all parameters.

Conclusion This study demonstrated good repeatability and reproducibility of OCTA based on OMAG for the measurement of superficial vessel parameters in normal eyes.

Key words: Optical coherence tomography angiography     Repeatability     Reproducibility     Macular blood flow     Retinal superficial capillary     Vascular quantification    
INTRODUCTION

Optical coherence tomography (OCT) can provide cross-sectional images of a living sample with microscopic resolution[1] and has become the most widely used optical technique in medical imaging. Optical coherence tomography angiography (OCTA) is a very important extension of OCT that is used to visualize blood flow within microcirculatory tissue beds; it uses motion contrast to produce angiographic data across the retina and the choroid[2].

Optical microangiography (OMAG)[3] is one of the primary OCTA approaches. It can harness motion information to the fullest extent by exploiting both the amplitude and the phase information contained within the OCT signals and produce OCT angiography with better vascular connectivity, higher signal-to-noise ratio, and higher sensitivity to capillary blood flows[2]. In recent years, OMAG has been successfully used for identifying retinal and choroidal microvascular abnormalities[4-12]. However, there is a scarcity of data addressing the repeatability and reproducibility of OMAG, both of which are essential for clinical application. Therefore, this study was designed to assess the repeatability and reproducibility of the following parameters based on OMAG: vessel area density (VAD), vessel skeleton density (VSD), vessel diameter index (VDI), vessel perimeter index (VPI), vessel complexity index (VCI), flux, and foveal avascular zone (FAZ).

MATERIALS AND METHODS Study Design and Population

Normal volunteers were enrolled from March 2017 to May 2017. All the volunteers underwent comprehensive ophthalmologic examinations, including best-corrected visual acuity (BCVA), refraction measurement, intraocular pressure measurement, slit-lamp biomicroscopy, and fundus examination. The medical and family histories of the volunteers were collected. All eyes of the healthy volunteers enrolled in this study had a BCVA ≥ 20/20, a refractive error of about -3.00 to +3.00 diopters (D), an intraocular pressure between 10.0 and 21.0 mmHg, and nonsignificant findings in the anterior and posterior segments. The protocol of the study was approved by the Ethics Committee of Beijing Tongren Hospital, Capital Medical University, and adhered to the tenets of the Declaration of Helsinki. Written informed consent was obtained from each volunteer before enrollment into the study.

Image Acquisition

SD-OCT data were acquired using a Cirrus HD-OCT 5000 angiography system (Carl Zeiss Meditec Inc., Dublin, CA, USA). Image tracing (FastTracTM) and OCTA image quality review were performed for all scans. The signal strength was expressed as a quantitative measure for image quality ranging from 1 (poor) to 10 (good). The signal strength of each scan was not less than 8, following the equipment manufacturer's recommendation to acquire high-quality images. The scan patterns included Angiography 3 × 3 mm and HD Radical. The angiography scans consisted of 245 A-scans at 245 B-scan positions. In the first visit, one eye (randomly selected) of each volunteer was scanned three times continuously; between each scan, the volunteers were asked to sit back and rest for about 30 s to 1 min. The second visit took place 1 week later, when the same scan protocol was followed.

Image Analysis

The obtained OCTA data were analyzed by a standardized procedure using MATLAB (R2016a, MathWorks, Inc., Natick, MA, USA) and semiautomatic software[13]. All the commercially available OCTA instruments are built with automated segmentation, and there are certain differences[14]. In this study, the retinal microvasculature was separated into three distinct physiological layers by manual manipulation[15], and the superficial vascular network encompassing layers from the ganglion cell layer to the inner plexiform layer was chosen as the target level for analysis. Using the OMAG algorithm, all the parameters, viz., VAD, VSD, VDI, VPI, VCI, flux, and FAZ, could be quantified from the images, which have been defined previously as follows[15, 16]: VAD is calculated as a unitless ratio of the total image area occupied by the vasculature to the total image area in the binary vessel maps, VSD is calculated as the ratio of the length occupied by the blood vessels to the total area in the skeletonized vessel map, VDI is calculated using both the vessel area map and the skeletonized vessel map to yield the averaged vessel caliber, VPI is calculated using the vessel perimeter map as the ratio of the vessel perimeter to the total area of the OCTA image, VCI is calculated using both the vessel perimeter map and the vessel area map, flux is defined as the total number of particles across the imaging voxel cross-section per unit time, and FAZ is defined as the macular foveal area without blood flow signal. The range of measurement of OCTA is shown in Figure 1. The boundary of FAZ is marked by the inner ring. The diameters of the middle ring and the outer ring are 1 mm and 3 mm, respectively. The fovea is defined as the area between the inner and the middle ring, and the parafovea is defined as the area between the middle ring and the outer ring. The data of fovea and parafovea were calculated respectively.

Download:
Figure 1 The range of measurement of OCTA. The panel shows sample angiography image of the superficial vascular network of a normal eye using OCTA on a 3 × 3 mm scan. The boundary of FAZ is marked by the inner ring. The diameters of the middle ring and the outer ring are 1 mm and 3 mm, respectively. The fovea is defined as the area between the inner and the middle ring, and the parafovea is defined as the area between the middle ring and the outer ring.
Statistical Analysis

Statistical analysis was performed using SPSS (22.0, IBM SPSS Inc., Armonk, NY, USA). For each eye, two coefficients of variation (CVs) were calculated from three scans acquired at the same visit and six scans acquired at two visits to evaluate the intravisit and intervisit, respectively. Mean CVs and standard deviations (SDs) of the 40 subjects were further calculated to represent the final intravisit and intervisit repeatability for each parameter. The three scans of the first visit were analyzed independently by two technical staffs to evaluate the agreement between the observers' measurements for interobserver reproducibility; the intraclass correlation coefficient (ICC) two-way mixed model with a 95% confidence interval (CI) on absolute agreement was used to analyze measurement reliability.

RESULTS

A total of 40 eyes of 40 normal Asian volunteers (16 males and 24 females) were included in this study. The mean age of the volunteers was 35.0 ± 6.7 years (range: 22-55 years). The examination results were as follows: BCVA ≥ 20/20, mean refractive error -1.03 ± 1.07 D (range: -3.00 to 1.00 D), and mean intraocular pressure 14.2 ± 2.5 mmHg (range: 12.0-19.2 mmHg). All eyes were recruited from volunteers without any previous disease or treatment history, and there were also no abnormalities on the fundus examination or the OCT scanning.

Results of the intravisit and intervisit repeatability of the measurements are summarized in Table 1. The measurements revealed high repeatability [CVs ≤ 4.2% (intravisit) and ≤ 4.6% (intervisit)] for all parameters. The CVs were lower for intravisit than for intervisit.

Table 1
Intravisit and Intervisit Repeatability of Measurements Using OMAG in Normal Eyes

Interobserver reproducibility of various parameters was analyzed using ICC and its 95% CI, which are presented in Table 2. All the parameters showed excellent agreement (ICCs ≥ 0.923) between the observers.

Table 2
Interobserver Reproducibility of Measurements Using OMAG in Normal Eyes
DISCUSSION

The retinal vascular system, especially the macular area, is essential for normal visual function. Various techniques have been used to study retinal perfusion[17-19]; however, some of them are limited by their intrinsic properties, such as nonquantitative or invasive nature[20].

The OCTA as a novel noninvasive imaging technology could provide ocular blood flow imaging and functional visualization of the retinal and choroidal vasculatures[21]. In general, OCTA techniques could be classified into three categories based on the signal information used to contrast flow[22-24]. In previous studies, VAD and VSD were the two primary quantitative parameters reported[25-27], but when the decrease of microvascular perfusion is sometimes accompanied with vessel dilation, VAD is only capable of providing partial information about vascular abnormalities[15].

The OMAG, which was developed by Wang et al.[28], could provide more quantitative parameters to analyze blood flow information[15] as follows: VAD provides the estimate of a real vessel density as it takes both vessel length and vessel diameter into consideration; VSD quantifies the vessel density by only considering whether the vessel exists, which is simply an assessment of the vessel length density regardless of the vessel diameters; VDI describes the vessel size information regardless of the vessel length and is thus sensitive to vascular dilation; VPI uses the perimeter to present every vessel, which includes both the length and the diameter, similar to VAD; and VCI is used to describe vascular tortuosity.

Recently, Lei et al.[29] provided vessel length density (VLD) and perfusion density (PD) of the superficial vascular network, which can be obtained from OCTA images with high levels of repeatability and reproducibility. Our study took a lead in using a relatively large sample and all the parameters to assess the repeatability and reproducibility of OCTA based on OMAG measurements of macular vessels in normal eyes. The CV is a standardized measure of dispersion of a probability distribution or a frequency distribution and could scale the variability for the measurement size to reduce the effect of measurement scaling in estimating reproducibility. The measurements of all parameters showed high repeatability in both intravisit (CVs ≤ 4.2%) and intervisit (CVs ≤ 4.6%). In general, the CVs for intravisit were lower than for intervisit, indicating a better intravisit repeatability than intervisit repeatability. The FAZ size is closely related to age[30], and the FAZ shape, which also varied individually, could influence the measurements for the central foveal region. In this study, the CVs of VAD were lower for the parafovea field than for the fovea field, consistent with previous research[31]. The ICCs ranged from 0.903 to 0.998, also indicating good interobserver reproducibility. Technically, the high reproducibility may be a result of the automatic detection and calculation. Although the semiautomatic software was used, and data were calculated by two technical staffs; nevertheless, the results of our study were satisfactory and consistent with the study by Chen et al.[32] using a similar method.

It is difficult to assess the velocity of retinal blood flow. Although numerous studies have assessed the qualitative relationship between OCTA and retinal blood flow over the past several years, no convincing quantitative relationship has been proven. Choi et al.[16] showed that the OMAG signal was a function of flux within a specific velocity range. Tokayer et al.[24] performed an in-vitro phantom study using whole human blood to investigate the effect of flow velocity on split-spectrum amplitude-decorrelation angiography (SSADA) signal and obtained similar results. In the present study also, we obtained a relatively ideal reproducibility for the flux parameter, which should be analyzed further to determine whether it might become a new indicator of the velocity of retinal blood flow.

There are several limitations in the current study. First, the study was limited by assessing only the repeatability and reproducibility of superficial vessel parameters. One of the reasons for not assessing the deep vessel parameters is that it is difficult to remove projection artifacts of vessels from the superficial vascular network in the deep vascular network. Second, we evaluated only the average state of all parameters in the fovea and the parafovea; the data of the subfields such as the superior, the inferior, the temporal, and the nasal sectors should be analyzed in further studies.

In conclusion, the results of this study demonstrated good repeatability and reproducibility of OCTA based on OMAG for the measurement of superficial vessel parameters in normal eyes.

DISCLOSURE STATEMENT

Ruikang K Wang and the Oregon Health & Science University co-own a patent that is licensed to Carl Zeiss Meditec, Inc. and Kowa, Inc. Ruikang K Wang received an innovative research award from Research to Prevent Blindness. He is a consultant to Carl Zeiss Meditec, Insight Photonic Solutions. The remaining authors declare that they have no competing interests.

REFERENCES
1.
Huang D, Swanson EA, Lin CP, et al. Optical coherence tomography. Science, 1991; 254, 1178-81. doi:10.1126/science.1957169
2.
Zhang A, Zhang Q, Chen CL, et al. Methods and algorithms for optical coherence tomography-based angiography:a review and comparison. J Biomed Opt, 2015; 20, 100901. doi:10.1117/1.JBO.20.10.100901
3.
Wang RK. Three-dimensional optical micro-angiography maps directional blood perfusion deep within microcirculation tissue beds in vivo. Phys Med Biol, 2007; 52, N531-7. doi:10.1088/0031-9155/52/23/N01
4.
Thorell MR, Zhang Q, Huang Y, et al. Swept-source OCT angiography of macular telangiectasia type 2. Ophthalmic Surg Lasers Imaging Retina, 2014; 45, 369-80. doi:10.3928/23258160-20140909-06
5.
Zhang Q, Wang RK, Chen CL, et al. Swept Source Optical Coherence Tomography Angiography of Neovascular Macular Telangiectasia Type 2. Retina, 2015; 35, 2285-99. doi:10.1097/IAE.0000000000000840
6.
Rezaei KA, Zhang Q, Kam J, et al. Optical coherence tomography based microangiography as a non-invasive imaging modality for early detection of choroido-neovascular membrane in choroidal rupture. Springerplus, 2016; 5, 1470. doi:10.1186/s40064-016-3161-x
7.
Kim AY, Rodger DC, Shahidzadeh A, et al. Quantifying Retinal Microvascular Changes in Uveitis Using Spectral-Domain Optical Coherence Tomography Angiography. Am J Ophthalmol, 2016; 171, 101-12. doi:10.1016/j.ajo.2016.08.035
8.
Chen CL, Bojikian KD, Gupta D, et al. Optic nerve head perfusion in normal eyes and eyes with glaucoma using optical coherence tomography-based microangiography. Quant Imaging Med Surg, 2016; 6, 125-33. doi:10.21037/qims
9.
Bojikian KD, Chen CL, Wen JC, et al. Optic Disc Perfusion in Primary Open Angle and Normal Tension Glaucoma Eyes Using Optical Coherence Tomography-Based Microangiography. PLoS One, 2016; 11, e0154691. doi:10.1371/journal.pone.0154691
10.
Lin AD, Lee AY, Zhang Q, et al. Association between OCT-based microangiography perfusion indices and diabetic retinopathy severity. Br J Ophthalmol, 2016; 101, 960-4.
11.
Chen CL, Zhang A, Bojikian KD, et al. Peripapillary Retinal Nerve Fiber Layer Vascular Microcirculation in Glaucoma Using Optical Coherence Tomography-Based Microangiography. Invest Ophthalmol Vis Sci, 2016; 57, OCT475-85. doi:10.1167/iovs.15-18909
12.
Rezaei KA, Zhang Q, Chen CL, et al. Retinal and choroidal vascular features in patients with retinitis pigmentosa imaged by OCT based microangiography. Graefes Arch Clin Exp Ophthalmol, 2017; 255, 1287-95. doi:10.1007/s00417-017-3633-x
13.
Yin X, Chao JR, Wang RK. User-guided segmentation for volumetric retinal optical coherence tomography images. J Biomed Opt, 2014; 19, 086020. doi:10.1117/1.JBO.19.8.086020
14.
Tan ACS, Tan GS, Denniston AK, et al. An overview of the clinical applications of optical coherence tomography angiography. Eye (Lond), 2017; 32, 262-86.
15.
Chu Z, Lin J, Gao C, et al. Quantitative assessment of the retinal microvasculature using optical coherence tomography angiography. J Biomed Opt, 2016; 21, 66008. doi:10.1117/1.JBO.21.6.066008
16.
Choi WJ, Qin W, Chen CL, et al. Characterizing relationship between optical microangiography signals and capillary flow using microfluidic channels. Biomed Opt Express, 2016; 7, 2709-28. doi:10.1364/BOE.7.002709
17.
Michelson G, Langhans MJ, Groh MJ. Clinical investigation of the combination of a scanning laser ophthalmoscope and laser Doppler flowmeter. Ger J Ophthalmol, 1995; 4, 342-9.
18.
Raabe A, Beck J, Gerlach R, et al. Near-infrared indocyanine green video angiography:a new method for intraoperative assessment of vascular flow. Neurosurgery, 2003; 52, 132-9.
19.
Cheng H, Yan Y, Duong TQ. Temporal statistical analysis of laser speckle images and its application to retinal blood-flow imaging. Opt Express, 2008; 16, 10214-9. doi:10.1364/OE.16.010214
20.
Takayama K, Ito Y, Kaneko H, et al. Comparison of indocyanine green angiography and optical coherence tomographic angiography in polypoidal choroidal vasculopathy. Eye (Lond), 2017; 31, 45-52. doi:10.1038/eye.2016.232
21.
Spaide RF, Klancnik JM Jr, Cooney MJ. Retinal vascular layers imaged by fluorescein angiography and optical coherence tomography angiography. JAMA Ophthalmol, 2015; 133, 45-50. doi:10.1001/jamaophthalmol.2014.3616
22.
Mariampillai A, Standish BA, Moriyama EH, et al. Speckle variance detection of microvasculature using swept-source optical coherence tomography. Opt Lett, 2008; 33, 1530-2. doi:10.1364/OL.33.001530
23.
Enfield J, Jonathan E, Leahy M. In vivo imaging of the microcirculation of the volar forearm using correlation mapping optical coherence tomography (cmOCT). Biomed Opt Express, 2011; 2, 1184-93. doi:10.1364/BOE.2.001184
24.
Tokayer J, Jia Y, Dhalla AH, et al. Blood flow velocity quantification using split-spectrum amplitude-decorrelation angiography with optical coherence tomography. Biomed Opt Express, 2013; 4, 1909-24. doi:10.1364/BOE.4.001909
25.
Reif R, Qin J, An L, et al. Quantifying optical microangiography images obtained from a spectral domain optical coherence tomography system. Int J Biomed Imaging, 2012; 2012, 509783.
26.
Jia Y, Bailey ST, Hwang TS, et al. Quantitative optical coherence tomography angiography of vascular abnormalities in the living human eye. Proc Natl Acad Sci USA, 2015; 112, E2395-402. doi:10.1073/pnas.1500185112
27.
Agemy SA, Scripsema NK, Shah CM, et al. Retinal Vascular Perfusion Density Mapping Using Optical Coherence Tomography Angiography in Normals and Diabetic Retinopathy Patients. Retina, 2015; 35, 2353-63. doi:10.1097/IAE.0000000000000862
28.
Wang RK, An L, Francis P, et al. Depth-resolved imaging of capillary networks in retina and choroid using ultrahigh sensitive optical microangiography. Opt Lett, 2010; 35, 1467-9. doi:10.1364/OL.35.001467
29.
Lei J, Durbin MK, Shi Y, et al. Repeatability and Reproducibility of Superficial Macular Retinal Vessel Density Measurements Using Optical Coherence Tomography Angiography En Face Images. JAMA Ophthalmol, 2017; 135, 1092-8. doi:10.1001/jamaophthalmol.2017.3431
30.
Wu LZ, Huang ZS, Wu DZ, et al. Characteristics of the capillary-free zone in the normal human macula. Jpn J Ophthalmol, 1985; 29, 406-11.
31.
You Q, Freeman WR, Weinreb RN, et al. Reproducibility of Vessel Density Measurement with Optical Coherence Tomography Angiography in Eyes with and without Retinopathy. Retina, 2017; 37, 1475. doi:10.1097/IAE.0000000000001407
32.
Chen CL, Bojikian KD, Xin C, et al. Repeatability and reproducibility of optic nerve head perfusion measurements using optical coherence tomography angiography. J Biomed Opt, 2016; 21, 65002. doi:10.1117/1.JBO.21.6.065002