Camirand-Lemyre, Félix 
ORCID: https://orcid.org/0000-0003-3277-2729, Desharnais, Brigitte ORCID: https://orcid.org/0000-0001-7373-656X, Laquerre, Julie, Morel, Marc-André, Côté, Cynthia, Mireault, Pascal and Skinner, Cameron D.
(2019)
Qualitative method validation and uncertainty evaluation via the binary output: I – Validation guidelines and theoretical foundations.
(Unpublished)
Preview |
Text (Pre-print: version submitted to the journal) (application/pdf)
736kBqual1.pdf - Submitted Version Available under License Spectrum Terms of Access. |
Preview |
Text (Supplementary Data 1) (application/pdf)
73kBSupplementary Data 1_VF.pdf - Supplemental Material Available under License Spectrum Terms of Access. |
Preview |
Text (Supplementary Data 2) (application/pdf)
81kBSupplementary Data 2_VF.pdf - Supplemental Material Available under License Spectrum Terms of Access. |
Preview |
Text (Supplementary Data 3) (application/pdf)
61kBSupplementary Data 3_VF.pdf - Supplemental Material Available under License Spectrum Terms of Access. |
![[thumbnail of Supplementary Data 4]](https://spectrum.library.concordia.ca/style/images/fileicons/other.png) |
Spreadsheet (Supplementary Data 4) (application/vnd.openxmlformats-officedocument.spreadsheetml.sheet)
102kBSupplementary Data 4_VF.xlsx - Supplemental Material Available under License Spectrum Terms of Access. |
Abstract
Qualitative methods have an important place in forensic toxicology, filling central needs in, amongst others, screening and analyses linked to per se legislation. Nevertheless, bioanalytical method validation guidelines either do not discuss this type of method, or describe method validation procedures ill adapted to qualitative methods. The output of qualitative methods are typically categorical, binary results such as “presence”/“absence” or “above cut-off”/“below cut-off”. Since the goal of any method validation is to demonstrate fitness for use under production conditions, guidelines should evaluate performance by relying on the discrete results, instead of the continuous measurements obtained (e.g. peak height, area ratio).
We have developed a tentative validation guideline for decision point qualitative methods by modeling measurements and derived binary results behaviour, based on the literature and experimental results. This preliminary guideline was applied to an LC-MS/MS method for 40 analytes, each with a defined cut-off concentration. The standard deviation of measurements at cut-off ( ) was estimated based on 10 spiked samples. Analytes were binned according to their %RSD (8.00%, 16.5%, 25.0%). Validation parameters calculated from the analysis of 30 samples spiked at and (false negative rate, false positive rate, selectivity rate, sensitivity rate and reliability rate) showed a surprisingly high failure rate. Overall, 13 out of the 40 analytes were not considered validated. Subsequent examination found that this was attributable to an appreciable shift in the standard deviation of the area ratio between different batches of samples analyzed. Keeping this behaviour in mind when setting the validation concentrations, the developed guideline can be used to validate qualitative decision point methods, relying on binary results for performance evaluation and taking into account measurement uncertainty. An application of this method validation scheme is presented in the accompanying paper (II – Application to a multi-analyte LC-MS/MS method for oral fluid).
| Divisions: | Concordia University > Faculty of Arts and Science > Chemistry and Biochemistry |
|---|---|
| Item Type: | Article |
| Refereed: | No |
| Authors: | Camirand-Lemyre, Félix and Desharnais, Brigitte and Laquerre, Julie and Morel, Marc-André and Côté, Cynthia and Mireault, Pascal and Skinner, Cameron D. |
| Date: | 19 June 2019 |
| Projects: |
|
| Funders: |
|
| Keywords: | Method validation, uncertainty of measurement, qualitative methods, cut-off, threshold |
| ID Code: | 986465 |
| Deposited By: | BRIGITTE DESHARNAIS |
| Deposited On: | 25 Mar 2020 18:10 |
| Last Modified: | 25 Mar 2020 21:45 |
| Additional Information: | Affiliates: Laboratoire de sciences judiciaires et de médecine légale, Department of Toxicology, 1701 Parthenais Street, Montréal, Québec, Canada H2K 3S7 ; Concordia University, Department of Chemistry & Biochemistry, 7141 Sherbrooke Street West, Montréal, Québec, Canada H4B 1R6 ; Université de Sherbrooke, Department of Mathematics, 2500 Université Boulevard, Sherbrooke, Québec, Canada, J1K 2R1 ; The University of Melbourne, School of Mathematics and Statistics, Parkville, Victoria, Australia, 3010 ; Centre de recherche du Centre hospitalier universitaire de Sherbrooke, 12th Avenue North, Sherbrooke, Québec, Canada, J1H 5N4 |
References:
1. Scientific Working Group for Forensic Toxicology (2013) Scientific Working Group for Forensic Toxicology (SWGTOX) standard practices for method validation in forensic toxicology. Journal of Analytical Toxicology, 37, 452–474.2. González, O., Blanco, M.E., Iriarte, G., Bartolomé, L., Maguregui, M.I. and Alonso, R.M. (2014) Bioanalytical chromatographic method validation according to current regulations, with a special focus on the non-well defined parameters limit of quantification, robustness and matrix effect. Journal of Chromatography. A, 1353, 10–27.
3. Hartmann, C., Smeyers-Verbeke, J., Massart, D.L. and McDowall, R.D. (1998) Validation of bioanalytical chromatographic methods. Journal of Pharmaceutical and Biomedical Analysis, 17, 193–218.
4. Hubert, P., Nguyen-Huu, J.-J., Boulanger, B., Chapuzet, E., Cohen, N., Compagnon, P.-A., et al. (2007) Harmonization of strategies for the validation of quantitative analytical procedures. A SFSTP proposal--part III. Journal of Pharmaceutical and Biomedical Analysis, 45, 82–96.
5. Peters, F.T., Drummer, O.H. and Musshoff, F. (2007) Validation of new methods. Forensic Science International, 165, 216–224.
6. Peters, F.T. and Maurer, H.H. (2002) Bioanalytical method validation and its implications for forensic and clinical toxicology – A review. Accreditation and Quality Assurance, 7, 441–449.
7. Wille, S.M.R., Coucke, W., De Baere, T. and Peters, F.T. (2017) Update of Standard Practices for New Method Validation in Forensic Toxicology. Current Pharmaceutical Design, 23, 5442–5454.
8. Bioanalytical Method Validation: Guidance for Industry (2018) Food and Drug Administration, Silver Springs, USA.
https://www.fda.gov/downloads/drugs/guidances/ucm070107.pdf.
9. Guideline on bioanalytical method validation (2011) European Medicines Agency, London, United Kingdom. https://www.ema.europa.eu/documents/scientific-guideline/guideline-bioanalytical-method-validation_en.pdf.
10. Standard Practices for Method Validation in Forensic Toxicology (Draft) (2018) AAFS Standards Board, Colorado Springs, USA. https://asb.aafs.org/wp-content/uploads/2018/09/036_Std_Ballot02.pdf.
11. General requirements for the competence of testing and calibration laboratories (2017) International Organization for Standardization, Geneva, Switzerland. https://www.iso.org/standard/66912.html
12. Gondim, C. de S., Coelho, O.A.M., Alvarenga, R.L., Junqueira, R.G. and de Souza, S.V.C. (2014) An appropriate and systematized procedure for validating qualitative methods: its application in the detection of sulfonamide residues in raw milk. Analytica Chimica Acta, 830, 11–22.
13. López, M.I., Callao, M.P. and Ruisánchez, I. (2015) A tutorial on the validation of qualitative methods: From the univariate to the multivariate approach. Analytica Chimica Acta, 891, 62–72.
14. Trullols, E., Ruisánchez, I., Rius, F.X. and Huguet, J. (2005) Validation of qualitative methods of analysis that use control samples. TrAC Trends in Analytical Chemistry, 24, 516–524.
15. Parikh, R., Mathai, A., Parikh, S., Chandra Sekhar, G. and Thomas, R. (2008) Understanding and using sensitivity, specificity and predictive values. Indian Journal of Ophthalmology, 56, 45–50.
16. Altman, D.G. and Bland, J.M. (1994) Diagnostic tests. 1: Sensitivity and specificity. BMJ : British Medical Journal, 308, 1552.
17. Côté, C., Desharnais, B., Morel, M.-A., Laquerre, J., Taillon, M.-P., Daigneault, G., et al. (2018) High Throughput Protein Precipitation: Screening and Quantification of 106 Drugs and their Metabolites using LC-MS/MS. 2017 Society of Forensic Toxicologists Meeting (SOFT) and 55th Annual Meeting of the International Association of Forensic Toxicologists (TIAFT). Boca Raton, USA.
18. Trullols, E., Ruisánchez, I. and Rius, F.X. (2004) Validation of qualitative analytical methods. TrAC Trends in Analytical Chemistry, 23, 137–145.
19. Yi, G.Y. (2017) Statistical Analysis with Measurement Error or Misclassification: Strategy, Method and Application. Springer-Verlag, New York, USA, 479 pages.
Repository Staff Only: item control page
Download Statistics
Download Statistics