Development and validation of novel digitalized cervicography system

Article information

Obstet Gynecol Sci. 2016;59(3):227-232
Publication date (electronic) : 2016 May 13
doi : https://doi.org/10.5468/ogs.2016.59.3.227
1Department of Obstetrics and Gynecology, Konkuk University Hospital, Seoul, Korea.
2Department of Obstetrics and Gynecology, Ewha Womans University Mokdong Hospital, Seoul, Korea.
3Department of Obstetrics and Gynecology, Soonchunhyang University Hospital, Bucheon, Korea.
4Department of Obstetrics and Gynecology, KyungHee University Medical Center, Seoul, Korea.
5Department of Obstetrics and Gynecology, Daegu Catholic University Medical Center, Daegu, Korea.
6Department of Obstetrics and Gynecology, Chonnam National University Hospital, Gwangju, Korea.
7Department of Obstetrics and Gynecology, Chosun University Hospital, Gwangju, Korea.
Corresponding author: Seung-Cheol Kim. Department of Obstetrics and Gynecology, Ewha Womans University School of Medicine, 1071 Anyangcheon-ro, Yangcheon-gu, Seoul 07985, Korea. Tel: +82-2-2650-5587, Fax: +82-2-2650-5963, onco@ewha.ac.kr
*These authors contributed equally to this work.
Received 2015 September 27; Revised 2015 November 28; Accepted 2015 December 01.

Abstract

Objective

Digital cervicography systems would be expected to reduce the costs of film cervicography, and provide the opportunity for "telemedicine-based" screening. We aimed to develop web-based digital cervicography system, and validate it compared with conventional film cervicography.

Methods

A hundred cases from five centers were prospectively included, and cervical images (analogue, digitalized by scanning analogue, and digital) were taken separately using both analogue (Cerviscope) and digital camera (Dr. Cervicam) in each patient. Nine specialists evaluated the three kinds of images of each case with time interval between evaluations of each image. To validate novel digitalized system, we analyzed intra-observer variance among evaluation results of three kinds of images.

Results

Sixty-three cases were finally analyzed after excluding technically defective cases that cannot be evaluable on analogue images. The generalized kappa for analogue versus digital image was 0.83, for analogue versus scanned image 0.72, and for digital versus scanned image was 0.71; all were in excellent consensus.

Conclusion

Digitalized cervicography system can be substituted for the film cervicography very reliably, and can be used as a promising telemedicine tool for cervical cancer screening.

Introduction

Since the cervicography was developed by Stafle in 1981 [1], cervicography has been considered to be a reliable adjunct to the Pap smear. Till lately, cervicography have been used widely, and the efficacy of it is firmly established in cervical cancer screening. Recently, digital cervicography has been suggested to reduce the costs of performing conventional cervicography and also provide the opportunity for "telemedicine-based" screening. By above reasons, we developed novel digital cervicography system (DCS) in cooperation with national testing laboratory. In order to develop the DCS using internet, we achieved several serial processes such as digitalization of cervicography images, transfer of digitalized images via network or modem, data manipulation on the web server, and evaluation of images by remote professional evaluators. As a final work, we aimed to validate our web-based DCS compared with conventional film cervicography in the present study.

Materials and methods

This work was designed by Korean Cervicography Research Group. Korean Cervicography Research Group, established in 1997, composed of 30 medical college hospital professors who are well trained colposcopists, has performed teaching and research activities for cervicography and cervical cancer prevention in Korea.

Our study was conducted prospectively at 5 institutions (Konkuk University Hospital, Ewha Womans University Mok-dong Hospital, Soonchunhyang University Hospital, Daegu Catholic University Hospital, and Chosun University Hospital) from January 2013 to December 2013 after approval of institutional review board (ECT13-42A-18) in Korea (Fig. 1).

Fig. 1

Study schema. DCS, digital cervicography system; NTL, national testing laboratory.

Firstly, analogue images were obtained by conventional cervicography system (Cerviscope, National Testing Lab Worldwide, Fenton, MO, USA) that has been used to take a 35-mm film photograph of the cervix after applying 5% acetic acid to the cervix. Secondly, digital images of each patient were also taken at the same time by digital camera (Dr. Cervicam, National Testing Lab, Seoul, Korea) (Fig. 2). Then, the films were transferred to a central processing facility for the development of analogue images. Digital images made by digital camera were transmitted to DCS through internet. Lastly, digitalization of the analogue images was processed by scanning the analogue images.

Fig. 2

Digital camera for cervicography, Dr. Cervicam (courtesy of Dr. Cervicam, National Testing Lab, Seoul, Korea).

Three kinds of images (analogue image, digitalized by scanning analogue image, and digital image) were evaluated by specialists with time interval between evaluations of each image. Total nine certified specialists belonging to Korean Cervicography Research Group evaluated the digital images on DCS (Fig. 3), 35-mm analogue slides, and scanned images without patient information. Cervicography findings were classified according to the diagnostic criteria approved by national testing laboratories worldwide as noted in Table 1.

Fig. 3

Digital cervicography system window for evaluators.

Table 1

Cervigraphy diagnostic classification

To validate DCS compared with conventional film cervicography, we analyzed intraobserver variance among evaluation results of conventional analogue images taken by Cerviscope, scanned images obtained from conventional analogue one, and digital images taken by Dr. Cervicam. The degree of consensus was calculated by using kappa statistics. Generally, kappa value of 0 is indicating no agreement and range of 0 to 0.20 is considered slight (or poor), 0.21 to 0.40 fair, 0.41 to 0.60 moderate, 0.61 to 0.80 substantial (or good), and 0.81 to 1.00 almost perfect (or very good) agreement, respectively [2]. Statistical analysis was performed using DBSTAT ver. 5.0 (dBSTAT Co., Chuncheon, Korea).

Results

A hundred cases from five centers were prospectively collected. Among them, 37 cases were excluded because the cases were technically defective or not appropriate for evaluation due to mucus, blood, hair, or prolapsed vaginal sidewalls on analogue or digital cervicography images. Accordingly, total 63 cases and associated 567 images were finally analyzed to assess intraobserver consensus.

The generalized kappas for the cervicography readings were displayed. The consensus in the different categories of interpretations in analogue and digital images is shown in Table 2. 521/567 (91.9%) pairs of interpretations of the cervicographic diagnosis were identical, and the kappa value was 0.83; reflecting "almost perfect agreement". Table 3 shows the levels of consensus for the six categories of interpretation between the analogue and scanned images. The level of consensus was 489/567 (86.2%), and the generalized kappa was 0.72 for six categories; reflecting "substantial agreement". Table 4 presents the consensus of the diagnosis between the digital and scanned images. In 488/567 (86.1%) cases, the evaluators had completed consensus in the diagnosis. The Kappa value between the digital and scanned images was 0.71; reflecting "substantial agreement".

Table 2

Agreement of paired observations between all pairs of observers for analogue and digital images

Table 3

Agreement of paired observations between all pairs of observers for analogue and scanned images

Table 4

Agreement of paired observations between all pairs of observers for digital and scanned images

Discussion

In the present study, we sought to validate the web-based DCS compared with conventional film cervicography, and found very good consensus between two systems.

There have been little investigations about the quality comparison between film and digital cervicography, although a few studies have reported the usefulness of digital cervicography. Chen et al. [3] reported that the use of digital cervicography with the Reid colposcopic index can be a significant device for screening abnormal Pap cases. Bae et at. [4] also found that there were high concordance rate between abnormal findings of digital cervicography and final precancerous lesions. However, above studies did not compared the DCSs with conventional film cervicography. As with the use of a novel test, the validity has to be weighed against the previous or standard one. The present study is the first study in literature that validated the quality of DCS compared with that of the conventional film cervicography system.

Historically, the reliability of digital photographic assessment compared with colposcopy has been reported in many studies. Harper et al. [5] reported that the interobserver consensus for the colposcopic image versus digital colposcopic image was 86%, and suggested that the technical performance and clinical feasibility of telecolposcopy can be implementable. However, Ferris et al. [6] reported fair to poor interobserver consensus among three colposcopists using digital pictures taken during the colposcopic evaluation in ASCUS-LSIL Triage Study.

Various factors may be associated with lack of consensus or reproducibility of photographic assessment. Schneider et al. [7] reported that the quality of digital colposcopic images was deemed by the reviewer to be less than optimal, so the results that correspond to the digital colposcopic image review should be interpreted with caution. Jeronimo et al. [8] also suggested that next to analogue to digital conversion, high resolution is required for a good interpretation of cervicography. However, recent advances in digital instruments make it possible to construct high-quality images.

In the present study, we used high-resolution digital camera and novel web-based software to overcome the poor reproducibility of photographic assessment. Moreover, the evaluators for this study were carefully selected who had highly trained and experienced.

DCS has many advantages of a telemedicine-based screening of cervical cancer, a rapid reporting system, a good quality control and the saving in the expenses of film for analogue images. Digital cervicography also provides excellent possibilities in analogue cervicography for documentation, teaching, patient follow-up, and measurement and judgment of the severity of cervical lesions [910]. Moreover, the visual explanation to the patients can minimize their anxiety and could help patients be aware for the guidelines for cancer screening [3].

Although we successfully showed the very good consensus between film and DCS, there were some limitations in the present study. The present study did not evaluate the interobserver variation among 9 specialists, and did not compare the cervicographic diagnosis with the final cervical pathology. However, we did not aimed to evaluate the efficacy of cervicogarphy but validate the quality of DCS compared with standard film cervicography system.

In conclusions, we found that there is very good intraobserver consensus between conventional film cervicography and DCS. Therefore, introducing DCS should be promoted for the better cervical cancer "telescreening".

Acknowledgments

This study was supported by a grant of the Korean Health Technology R&D Project, Ministry of Health & Welfare, Republic of Korea (HI12C0050).

The authors acknowledge the photos of cervicography provided by National Testing Lab, Seoul, Korea.

Notes

Conflict of interest: No potential conflict of interest relevant to this article was reported.

References

1. Stafl A. Cervicography: a new method for cervical cancer detection. Am J Obstet Gynecol 1981;139:815–825. 7211987.
2. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics 1977;33:159–174. 843571.
3. Chen ZP, Chen HM, Lee TT. Use of compact digital cervicography: an adjuvant screening tool for precancerous cervical lesions. Taiwan J Obstet Gynecol 2008;47:187–191. 18603504.
4. Bae SN, Kim JH, Lee CW, Song MJ, Park EK, Lee YS, et al. Correlation between the digital cervicography and pathological diagnosis performed at private clinics in Korea. Int J Med Sci 2012;9:698–703. 23091406.
5. Harper DM, Moncur MM, Harper WH, Burke GC, Rasmussen CA, Mumford MC. The technical performance and clinical feasibility of telecolposcopy. J Fam Pract 2000;49:623–627. 10923572.
6. Ferris DG, Litaker M. ALTS Group. Interobserver agreement for colposcopy quality control using digitized colposcopic images during the ALTS trial. J Low Genit Tract Dis 2005;9:29–35. 15870519.
7. Schneider DL, Burke L, Wright TC, Spitzer M, Chatterjee N, Wacholder S, et al. Can cervicography be improved? An evaluation with arbitrated cervicography interpretations. Am J Obstet Gynecol 2002;187:15–23. 12114883.
8. Jeronimo J, Long R, Neve L, Ferris D, Noller K, Spitzer M, et al. Preparing digitized cervigrams for colposcopy research and education: determination of optimal resolution and compression parameters. J Low Genit Tract Dis 2006;10:39–44. 16378030.
9. Sellors JW, Jeronimo J, Sankaranarayanan R, Wright TC, Howard M, Blumenthal PD. Assessment of the cervix after acetic acid wash: inter-rater agreement using photographs. Obstet Gynecol 2002;99:635–640. 12039126.
10. Parham GP, Mwanahamuntu MH, Pfaendler KS, Sahasrabuddhe VV, Myung D, Mkumba G, et al. eC3: a modern telecommunications matrix for cervical cancer prevention in Zambia. J Low Genit Tract Dis 2010;14:167–173. 20592550.

Article information Continued

Funded by : Ministry of Health & Welfarehttp://dx.doi.org/10.13039/501100003625
Award ID : HI12C0050

Fig. 1

Study schema. DCS, digital cervicography system; NTL, national testing laboratory.

Fig. 2

Digital camera for cervicography, Dr. Cervicam (courtesy of Dr. Cervicam, National Testing Lab, Seoul, Korea).

Fig. 3

Digital cervicography system window for evaluators.

Table 1

Cervigraphy diagnostic classification

Table 1

Table 2

Agreement of paired observations between all pairs of observers for analogue and digital images

Table 2

Table 3

Agreement of paired observations between all pairs of observers for analogue and scanned images

Table 3

Table 4

Agreement of paired observations between all pairs of observers for digital and scanned images

Table 4