RE: OFV or Diagnostic Plot ?? Which one rules...

From: DJ Eleveld-Ufkes Date: February 13, 2019 technical Source: mail-archive.com
Hi Sumeet, OFV is an objective fit of the model to the data, so generally that should be your leading criteria. Outside of that you often have to deal with subjectivity. However, there are quite a few caveats to relying too strongly on OFV. You should try to avoid "chasing OFV" by testing too many models or those in which the theoretical justification is lacking. Which error model best agrees with other information you have about the concentrations you have? You might also consider whether poor diagnostics you see as part of the residual error model really originate from structural model-misspecification. It can happen that you "hide" the shortcomings of the structural model by putting too much flexibility into the residual error model. It then becomes very hard to improve the structural model when the information is "swallowed up" by the residual error model. You cant fix what you cant see. I often try to think about how the model will be used outside of the development process. In its intended application does the model need to predict high concentrations or low concentrations more accurately? A proportional error model lets low concentrations play a stronger role in the model likelihood compared to proportional+additive. Basically, getting OFV 20 points lower with prop+add compared to prop means that the model can fit higher concentrations better if a little bit worse fit can be tolerated in low concentrations. You have to decide which one is most appropriate. It depends on how the model is intended to be used and how your structural model compares to what you think the "true" model might be. Warm regards, Douglas Eleveld
Quoted reply history
From: [email protected] [mailto:[email protected]] On Behalf Of Singla, Sumeet K Sent: woensdag 13 februari 2019 07:28 To: [email protected] Subject: [NMusers] OFV or Diagnostic Plot ?? Which one rules... Hi Everyone, I am fitting two compartment PK model to Marijuana (THC) concentrations. When I apply proportional error (or proportional plus additive) residual model, I get pretty good fits (except 15% of subjects) at all time points. However, when I apply only additive error residual model, I get perfect fits in all subjects but objective functional value is increased by about 20 units. DV vs IPRED reveal all concentrations on line of unity. My question is: should I go with additive error model which gives me perfect fit but higher OFV or should I go with proportional error model which gives me lower OFV but not so good fit in couple of subjects? Regards, Sumeet Singla Graduate Student Dpt. of Pharmaceutics & Translational Therapeutics College of Pharmacy- University of Iowa ________________________________
Feb 13, 2019 Sumeet K Singla OFV or Diagnostic Plot ?? Which one rules...
Feb 13, 2019 Nick Holford RE: OFV or Diagnostic Plot ?? Which one rules...
Feb 13, 2019 Leonid Gibiansky Re: OFV or Diagnostic Plot ?? Which one rules...
Feb 13, 2019 Justin Wilkins RE: OFV or Diagnostic Plot ?? Which one rules...
Feb 13, 2019 DJ Eleveld-Ufkes RE: OFV or Diagnostic Plot ?? Which one rules...