Re: Visual predictive check!

From: Jurgen Bulitta Date: May 25, 2008 technical Source: mail-archive.com
Dear Nick, I do not claim to have much real life experience with HPLC or LC-MS/MS either. However, I think both these methods can yield negative concentrations and both have some measurement noise. As far as I know, for HPLC-UV and HPLC-Fluorescence methods photons are converted into an electronic signal that then becomes the chromatogram. For LC-MS/MS, ions of a specific mass/charge ratio hit a photomultiplier tube and thereby create an electric signal. Some MS have a resolution in the mass/charge ratio of 10^(-5) atomic units. All those devices that provide an electric signal will most likely have some level of random background noise. I think the most likely reason to measure negative concentrations might not be a negative area or negative peak height in a chromatogram. Negative conc. might more likely come from the regression equation of the calibration row itself: Drug_conc = intercept + (area_drug / area_IS) * slope The area denotes the area of the drug of interest and of the internal standard (IS) in the chromatogram. An IS is often spiked to all samples at a known concentration. If you have a chromatogram without noise, then area_drug will be zero and area_IS will be a large number (otherwise e.g. the HPLC-injection went wrong and the sample is likely to be correctly discarded). A truly blank sample will then have a negative concentration, if the intercept is negative. As usually not all samples are measured in one analytical run, one will have several regression equations in a clinical trial with random intercepts which may be negative and should be centered around zero. Hope we will see more of these negative numbers in our datasets (-: Best wishes Juergen ----------------------------------------------- Jurgen Bulitta, PhD, Post-doctoral Fellow ID - Pharmacometrics, University at Buffalo, NY, USA Phone: +1 716 645 2855 ext. 281, [EMAIL PROTECTED] Fax: +1 716 645 3693 ----------------------------------------------- -----Ursprüngliche Nachricht----- Von: "Nick Holford" <[EMAIL PROTECTED]> Gesendet: 23.05.08 17:54:26 An: [email protected] Betreff: Re: [NMusers] Visual predictive check! Ken, First of all -- I have almost no real world experience of modern analytical laboratory methods. But I have seen chromatograms from HPLC machines which have baseline noise. One way to quantitate the sample is to integrate over an interval at the expected retention time after a true zero specimen had passed through the system then the resulting area could be either positive or negative. Another method would be to search for a positive peak around the expected retention time and center the integration around that peak -- this would of course lead to a positive bias. So if the first (potentially unnbiased) method is used for a series of pre-dose concs then the resulting distribution should have both negative and positive values. Whether it was symmetrical or even normal would depend on the factors that cause the baseline noise. I suspect that commonly used methods today rely on software that will have a truncation bias built into it (e.g. using the second method) even before the LLOQ bias is added. I have even less experience of mass spectroscopy methods - my naive understanding is that the mass lines are measured within one atomic weight unit of resolution so it is unlikely even for true zero samples that a negative mass would be obtained. So for mass spec assays the assumption that measurements are non-negative may be true. Best wishes, Nick Ken Kowalski wrote: > Nick, > > Yes, I'm making the assumption that a measured concentration cannot be > negative. Educate me about chemical assays. Can you get troughs rather > than peaks in a chromatogram such that the area below zero is integrated and > reported as a negative concentration? If so, what would happen if you > assayed a bunch of pre-dose samples (before drug is administered) where the > true mean concentration is zero? Would we get measured concentrations > symmetrically distributed about zero (with about 50% of the measured > concentrations reported as negative and 50% positive)? If so, then a normal > residual error model may indeed be appropriate. > > Ken >
Quoted reply history
> -----Original Message----- > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On > Behalf Of Nick Holford > Sent: Friday, May 23, 2008 10:40 AM > To: [email protected] > Subject: Re: [NMusers] Visual predictive check! > > Ken, > > You wrote among other things: > "The combined residual error model cannot be the correct model at very > low concentrations since the normal distribution will put non-zero > probability mass at concentrations less than zero if the mean is low > relative to its SD." > > I think you are making the assumption that *measured* concentrations > have to be non-negative. In a real world measurement system there will > be random measurement noise around true zero. Thus a real world > measurement system would return both negative and positive measurements > for a true zero. Additive residual error models in theory describe this > behaviour. Simulations of *measurements* will then quite reasonably > include negative values. > > In the truncated real world of chemical analysis real measurements of > true zero seem to be always reported as non-negative. Its a pity > chemical analysts don't seem to understand that this truncation always > causes measurement bias (whether the LLOQ is 0 or greater). > > Best wishes, > > Nick > > Ken Kowalski wrote: > >> Andreas, >> >> Your simulations highlight a limitation with the combined (additive + >> proportional or slope-intercept) residual error model. The combined >> residual error model cannot be the correct model at very low >> concentrations since the normal distribution will put non-zero >> probability mass at concentrations less than zero if the mean is low >> relative to its SD. The purist in me says don't truncate as that will >> lead to bias in your simulations although it may be minimal if few >> observations are simulated with negative concentrations. A better >> approach would be to consider an alternative residual error model that >> bounds the concentrations to be positive such as the log-normal >> residual error model (log-transform both sides approach) or fit a >> model that takes into account the censored BQL data ( see Beal, Ways >> to Fit a PK Model with Some Data Below the Quantification Limit. JPP >> 2001;28:481-504). >> >> Ken >> >> Kenneth G. Kowalski >> >> President & CEO >> >> A2PG - Ann Arbor Pharmacometrics Group >> >> 110 E. Miller Ave., Garden Suite >> >> Ann Arbor, MI 48104 >> >> Work: 734-274-8255 >> >> Cell: 248-207-5082 >> >> [EMAIL PROTECTED] >> >> *From:* [EMAIL PROTECTED] >> [mailto:[EMAIL PROTECTED] *On Behalf Of *andreas lindauer >> *Sent:* Friday, May 23, 2008 6:23 AM >> *To:* [email protected] >> *Subject:* [NMusers] Visual predictive check! >> >> Dear NMusers, >> >> I have a question regarding simulations for a VPC. When a combined >> residual error is used it happens that for low concentrations negative >> values are simulated. While this is statistically correct, I wonder if >> it is correct to use these results for the VPC because the >> distribution of the observed low concentrations is truncated by the >> LLOQ. So the VPC might suggest model misspecification for lower >> concentrations. Further, when one wants to use the model for clinical >> trial simulation should then the negative (BQL) values be omitted >> because they would never appear in reality? >> >> I would like to know how the more experienced NMusers handle this. >> >> Thanks in advance, Andreas. >> >> ____________________________ >> >> Andreas Lindauer >> >> University of Bonn >> >> Department of Clinical Pharmacy >> >> An der Immenburg 4 >> >> D-53121 Bonn >> >> phone:+49 228 73 5781 >> >> fax: +49 228 73 9757 >> >> > > -- Nick Holford, Dept Pharmacology & Clinical Pharmacology University of Auckland, 85 Park Rd, Private Bag 92019, Auckland, New Zealand [EMAIL PROTECTED] tel:+64(9)373-7599x86730 fax:+64(9)373-7090 www.health.auckland.ac.nz/pharmacology/staff/nholford
May 23, 2008 Andreas Lindauer Visual predictive check!
May 23, 2008 Nick Holford Re: Visual predictive check!
May 23, 2008 Marc Gastonguay Re: Visual predictive check!
May 23, 2008 Kenneth Kowalski RE: Visual predictive check!
May 23, 2008 Leonid Gibiansky Re: Visual predictive check!
May 23, 2008 T.m Post RE: Visual predictive check!
May 25, 2008 Luis Pereira RE: Visual predictive check!
May 25, 2008 Nick Holford Re: Visual predictive check!
May 25, 2008 Jurgen Bulitta Re: Visual predictive check!
May 25, 2008 Stephen Duffull Re: Visual predictive check!
May 27, 2008 Mark Peterson RE: Visual predictive check!