A cross-sectional randomised single blind study was conducted to assess how concentrations of chromogen (vital stain) and the characteristics of the assessors affect the assessment of contact rhinoscopy. Twenty-eight patients who had undergone external radiotherapy for nasopharyngeal carcinoma were assessed by contact rhinoscopy using 0.5 per cent and 1 per cent methylene blue stain on opposite sides of the nasopharynx. Three independent observers assessed the visual clarity of the 45 contact endoscopic images showing squamous metaplasia according to a visual analogue scale. The intraclass correlation coefficients were 0.916 to 0.957 and 0.839 to 0.964 for intra-observer reliability of assessors in the groups of 0.5 per cent and 1 per cent stains, respectively. The intraclass correlation coefficients for inter-observer reliability of assessors were 0.884 and 0.885 in the groups of 0.5 per cent and 1 per cent stains, respectively. The mean scores of clarity of the cellular details were statistically higher in the group of 1 per cent stain among all assessors. These results showed that the assessment of squamous metaplasia by contact endoscopy is highly reliable irrespective of the clinical experience and knowledge of histopathology of the assessors. One per cent methylene blue should be the vital stain of choice in contact endoscopy.