Clinical validation of hrHPV testing on vaginal and urine self-samples in primary cervical screening (cross-sectional results from the Papillomavirus Dumfries and Galloway—PaVDaG study) =========================================================================================================================================================================================== * Grazyna Stanczuk * Gwendoline Baxter * Heather Currie * James Lawrence * Kate Cuschieri * Allan Wilson * Marc Arbyn ## Abstract **Objectives** Papillomavirus Dumfries and Galloway (PaVDaG) assessed the performance of a high-risk human papillomavirus (hrHPV) PCR-based assay to detect high-grade cervical intraepithelial neoplasia (CIN2+) in self-collected vaginal and urine samples. **Setting** Women attending routine cervical screening in primary care. **Participants** 5318 women aged 20–60 years provided self-collected random urine and vaginal samples for hrHPV testing and a clinician-collected liquid-based cytology (LBC) sample for cytology and hrHPV testing. **Interventions** HrHPV testing. All samples were tested for hrHPV using the PCR-based cobas 4800 assay. Colposcopy was offered to women with high-grade or repeated borderline/low-grade cytological abnormalities; also to those who were LBC negative but hrHPV 16/18 positive. **Primary and secondary outcome measures** The self-tests' absolute sensitivity and specificity for CIN2+ were assessed on all biospecimens; also, their relative sensitivity and specificity compared with clinician-taken samples. Interlaboratory and intralaboratory performance of the hrHPV assay in self-collected samples was also established. **Results** HrHPV prevalence was 14.7%, 16.6% and 11.6% in cervical, vaginal and urine samples, respectively. Sensitivity for detecting CIN2+ was 97.7% (95% to 100%), 94.6% (90.7% to 98.5%) and 63.1% (54.6% to 71.7%) for cervical, vaginal and urine hrHPV detection, respectively. The corresponding specificities were 87.3% (86.4% to 88.2%), 85.4% (84.4% to 86.3%) and 89.8% (89.0% to 90.7%). There was a 38% (24% to 57%) higher HPV detection rate in vaginal self-samples from women over 50 years compared with those ≤29 years. Relative sensitivity and specificity of hrHPV positivity for the detection of CIN2+ in vaginal versus cervical samples were 0.97 (0.94 to 1.00) and 0.98 (0.97 to 0.99); urine versus cervical comparisons were 0.53 (0.42 to 0.67) and 1.03 (1.02 to 1.04). The intralaboratory and interlaboratory agreement for hrHPV positivity in self-samples was high (κ values 0.98 (0.96 to 0.99) and 0.94 (0.92 to 0.97) for vaginal samples and 0.95 (0.93 to 0.98) and 0.90 (0.87 to 0.94) for urine samples). **Conclusions** The sensitivity of self-collected vaginal samples for the detection of CIN2+ was similar to that of cervical samples and justifies consideration of this sample for primary screening. * PRIMARY CARE * PUBLIC HEALTH * SEXUAL MEDICINE * VIROLOGY ### Strengths and limitations of this study * Population-based using simple vaginal swabs and random urine samples compared with clinician-taken cervical (liquid-based cytology) samples. * Comparator test was a validated PCR-based assay on a cervical sample, also applied to the self-taken samples. * Reliability of gold standard (colposcopy and histology) assured by consistency of national screening protocol and practices. * Constrained by ethics from undertaking colposcopy in patients who were high-risk human papillomavirus positive in only their self-samples. * Not feasible to optimise the urine sample collection and assay for this study. ## Introduction Global evidence indicates that high-risk human papillomavirus (hrHPV)-based screening is more effective than cytology in reducing the incidence of cervical precancer/cancer1 ,2 using clinically validated hrHPV assays.3 ,4 This is based on the higher sensitivity of hrHPV testing compared with cytology for the detection of high-grade cervical intraepithelial neoplasia (CIN2+) and the scope for extended screening intervals. Accordingly, a clinically validated hrHPV assay on a cervical sample rather than cytology is becoming the preferred policy for cervical cancer screening. Self-taken samples also provide an opportunity to reach women who do not otherwise attend,5–7 although concerns about the quality of samples have been reported.8 ,9 There is a growing body of evidence on the analytical and clinical performance of different assays for detection of hrHPV as well as assessment of devices designed to aid self-collection. The absolute specificity of self-collection tests as assessed in a colposcopy clinic is irrelevant for primary screening, although relative test performance can be assessed with little bias and the need for verifying that women with a negative screening test are truly free from disease.10 A meta-analysis of the clinical accuracy of vaginal self-sampling for CIN2+ detection, assessing studies on these principles, found acceptable sensitivity and specificity of self-vaginal samples if validated PCR-based HPV tests were used.11 That conclusion was swayed by a Chinese study12 whose multiplex primary PCR assay did not meet guideline standards for assay reproducibility. There is, to date, no published primary screening study of self-testing using a fully clinically validated assay. Compared with self-taken vaginal samples, urine sampling offers a less invasive option and it has been reported that women favour this approach to cervical and/or vaginal sampling.13 ,14 Studies of hrHPV detection in urine have been mainly assessed on virological outcomes and only partially address clinical accuracy.15–17 Advantages of self-sampling for women are multiple, yet studies on performance have been derived mainly from women who default from traditional screening.5 Since molecular hrHPV testing rather than cytology will be the method of primary cervical screening for the future, assessment of self-sampling in the general population of eligible women becomes apposite. Self-sampling should be simple and inexpensive. Our objective was to determine the clinical performance of hrHPV testing in self-samples (urine and vaginal swabs) taken by women attending cervical screening as part of a national programme. We aimed to validate self-sampling for routine cervical screening. ## Methods ### Setting and recruitment Papillomavirus Dumfries and Galloway (PaVDaG) is a population-based screening study in a region of Scotland with 160 000 inhabitants served by 40 general practice clinics. All women, other than those previously diagnosed with CIN2+, presenting for routine cervical screening (April 2013 to July 2014) were invited to consent to the study. In Scotland, women receive their first invitation to cervical screening in the year of their 20th birthday (including a ‘catch up’ HPV-vaccinated cohort) and their last invitation in the year of their 59th birthday. Participants first provided a random void urine (if unable to, they were encouraged to hand that in later), then self-collected a vaginal sample prior to a routine cervical sample being collected by the clinician. We followed all recalls for cytology and colposcopy relevant to this screening round for a minimum of 8 months from enrolment. The study was conducted over one round of primary cervical screening in Dumfries and Galloway, Scotland. Clinical performance of self-sampling for the detection of CIN2+ was assessed, as was the relative accuracy of the vaginal and urine samples compared with the clinician-taken cervical sample. The analytical range (cycle threshold (Ct)) values of the three biospecimens were also assessed as was the interlaboratory and intralaboratory agreement for all self-specimens. Finally, the impact of age on hrHPV detection in self-samples was analysed. ### Sample collection, processing and testing Urine was collected in universal containers; in the laboratory, 6 mL was mixed with 3 mL of Roche PCR media (Roche Molecular Systems). Self-collected vaginal samples were obtained using cobas PCR female swab sample packets (Roche Molecular Systems), validated for *chlamydia/gonorrhoea* (CT/NG) self-vaginal sampling. Women were advised to follow instructions printed on the collection kit. Swabs were immediately immersed in tubes containing Roche PCR media. Vaginal samples were vortexed for 30 s with the swab in situ, as per the protocol used for *CT/NG*, before testing. In an early pilot phase, 200 patients used two swabs together for sampling, one immersed immediately in buffer as above, the other left dry for 28 days before immersion in the laboratory immediately prior to assay. Cervical liquid-based cytology (LBC) samples were clinician-collected using a Rovers Cervex-Brush (Oss, the Netherlands) and suspended in 20ml of *ThinPrep* solution (PreservCyt Solution, Hologic, UK) as per routine practice. Three millilitre of LBC sample was aliquoted into a separate tube for HPV testing. All three samples were tested with the cobas 4800 DNA HPV test using the standard procedure. This test is clinically validated and the Food and Drug Administration (FDA) approved for primary cervical screening using LBC samples4 ,18 and was our reference standard. This test is a real-time PCR fully automated method detecting separately HPV 16, HPV 18 and 12 other hrHPV types (HPV 31, 33, 35, 39, 45, 51, 52, 56, 58, 59, 66 and 68) with the β-globin gene as an extraction and amplification control. Sets of 520 vaginal and 526 urine samples were retested in the Dumfries laboratory and in the Coombe Women and Infants University Hospital, Dublin, Ireland, for intralaboratory and interlaboratory reproducibility. Collection and testing kits were supplied by Roche Global. To determine the number of PCR amplification cycles (Ct values) needed to detect hrHPV DNA in the cobas assay, a randomly selected set of positive samples—376 cervical, 381 urine and 449 vaginal—was analysed. ### Management of abnormal smears and ascertainment of CIN2+ Abnormal cytology results and histopathology reporting were according to the UK Cervical Screening Programme guidelines.19 Accordingly, participants with high-grade abnormalities were referred for colposcopy, while women with borderline changes or low-grade cytology were recalled for repeat cytology after 6 months. Women with two low-grade or three borderline smears were referred for colposcopy. Participants with an unsatisfactory smear were recalled for repeat cytology after 3 months. Three consecutive unsatisfactory smears or a subsequent abnormal smear resulted in referral for colposcopy. For the PaVDaG study, all participants with normal cytology but a positive cervical hrHPV test (cyto**−**/hrHPV+) were invited for repeat hrHPV testing on all three samples after 4–6 months. Colposcopy was offered to cyto**−**/hrHPV+ women if they were positive for HPV 16 and/or 18 at their baseline and/or follow-up. To ascertain CIN2+ status, histological abnormalities were graded on the biopsies taken at colposcopy. In cases of significant disparity, a second pathology opinion was standard. Screening history, HPV vaccination and cytology results (past and current) were accessed through the Scottish Cytology Call-Recall System using the person-specific Community Health Index population register. ### Sample size calculation We assumed, on the basis of a published performance of the cobas 4800 assay,4 a sensitivity for CIN2+ of 96% and a specificity of 89%. Since this was a screening study, sensitivity rather than specificity was the driver of the sample size computation. A formula proposed by Tang *et al*20 was used to compute the sample size to address the hypothesis of equivalence of test performance in studies with a matched-pair design (multiple tests applied on the same participants). Under a worst case assumption7 for a PCR-based assay on self-samples that 5% of CIN2+ cases are positive on clinician samples but negative on self-samples and accepting a confidence level of 95% and a power of 80%, the required sample size was 83 CIN2+ cases. Anticipating a detection rate of CIN2+ of 1.7%21 in the population gave a sample size estimate of 4882—rounded up to 5000. ### Ethical approval The study was sponsored by National Health Service (NHS) Dumfries and Galloway and approved by West of Scotland Research Ethics Service. An important prerequisite of approval was that the study should not compromise in any way (or raise public concern about) the effectiveness of standard screening. Women were informed about their hrHPV results after having received the standard information based on their cytology. This demanded a particularly sensitive interchange with patients whose positive hrHPV results were in a setting of negative cytology. To limit the burden of follow-up and risk of overdiagnosis, we focused only on patients positive for HPV 16 and 18 (but not other) types in their cervical sample. It was deemed inappropriate to press for colposcopy in participants positive for hrHPV in only their vaginal and/or urine self-samples, who had normal cervical cytology and were HPV negative in their cervical sample. ### Statistical analysis The primary outcome measure was sensitivity and specificity of the assay in cervical and self-collected samples to detect CIN2+. This analysis was based on hrHPV test results at the initial visit; all cervical and self-test samples with a failed hrHPV result were excluded from analysis. Where only vaginal and/or urine samples were hrHPV positive in this first sample, the calculation was of inferred sensitivity and specificity as these findings in isolation did not permit referral for colposcopy and histological grading. Absolute specificity could not be assessed directly from this study since it is not feasible to submit all screen test-negative women to gold standard verification.10 We assumed that women with no history of CIN2+ and two previous consecutively negative cervical cytology results (for women <23 years, this precondition was necessarily restricted to one previous negative cytology) did not have underlying cervical precancer. This proxy definition of disease outcomes, combined with the use of a highly sensitive and fully validated HPV test, reduces the consequences of verification bias.10 ,22 ,23 Moreover, even if some verification bias would have affected the estimation of the absolute accuracy measures, the relative sensitivity and specificity would not be affected given the PaVDaG design. The relative accuracy of hrHPV test results in vaginal and urine samples versus cervical samples was computed and 95% CIs were calculated according to binomial distributions. The χ2 test of McNemar was used to assess discordances. A χ2 test was used for linear trend. Intralaboratory and interlaboratory reproducibility of the assay in self-samples was assessed by the κ statistic. Outcomes in young women who had received at least two doses of vaccine were recorded separately. ## Results ### Participants In total, 5318 women were enrolled. Mean age was 41.3 (18–76: median=46, <20=7 and >59=145); 97% belonged to the screening target age group 20–59 years. Of the women aged ≤23 years, 66% (354/533) had been vaccinated with at least two doses of the bivalent HPV vaccine. The flow chart of cervical hrHPV detection, cytology results and detection of CIN2+ lesions is presented in figure 1. ![Figure 1](http://bmjopen.bmj.com/https://bmjopen.bmj.com/content/bmjopen/6/4/e010660/F1.medium.gif) [Figure 1](http://bmjopen.bmj.com/content/6/4/e010660/F1) Figure 1 Cytology and hrHPV results with corresponding colposcopies and histological outcomes. Cytology results reported as: negative (normal); unsatisfactory (inadequate); BL (ASCUS)/mild dyskaryosis=LG and moderate/severe dyskaryosis=HG. Histology results reported as CIN grade