Re: Minimization Terminated in Bootstrapping

From: Jan-Stefan van der Walt Date: October 31, 2014 technical Source: mail-archive.com
Dear Siwei, Your experience is not uncommon (well, for me at least). My approach has been to: 1. Check the percentage of runs that terminate due to rounding errors 2. Rerun the bootstrap with PsN (in the same folder!) and specify that the runs without successful minimization should be included in the calculations (use the "-no-skip_minimization_terminated" option in PsN) 3. Compare the results with and without the terminated runs to identify the problematic parameters 4. Stratify appropriately 5. Prepare a defense that your model has appropriately robustness Hope this will be helpful, Jan-Stefan
Quoted reply history
On 30 October 2014 21:17, siwei Dai <[email protected]> wrote: > Hi, Dr. Bonate: > > Thank you very much for your comments. There are some more sparse data in > the data set and I wasn't aware that I should do stratification for > bootstrapping, so thank you for pointing it out. > > Best regards, > > Siwei > > On Wed, Oct 29, 2014 at 11:58 AM, Bonate, Peter <[email protected] > > wrote: > >> Not just yet. I’ve seen many people just naively bootstrap their >> dataset. It may be that your bootstrap datasets do not adequately >> represent model development dataset. For example suppose you had 75% >> sparse data and 25% rich data in your model development set. It is >> imperative that your bootstrap dataset maintain this ratio so you need to >> stratify by data richness. Otherwise you could get a bootstrap dataset that >> is predominantly sparse data which would not support such a complicated >> absorption model. The same holds true if there are important covariates in >> your model. >> >> >> >> pete >> >> >> >> >> >> Peter L. Bonate, PhD >> >> Senior Director >> >> Global Head - Pharmacokinetics, Modeling, and Simulation >> >> Global Clinical Pharmacology & Exploratory Development >> >> >> >> Astellas >> >> 1 Astellas Way, 2N.184 >> >> Northbrook, Il 60062 >> >> phone: 224-205-5855 >> >> fax: 224-205-5914 >> >> email: [email protected] >> >> >> >> >> >> *From:* [email protected] [mailto:[email protected]] >> *On Behalf Of *siwei Dai >> *Sent:* Tuesday, October 28, 2014 9:00 AM >> *To:* [email protected] >> *Subject:* [NMusers] Minimization Terminated in Bootstrapping >> >> >> >> Dear NM users: >> >> >> >> I have a data set where the absorption phase is highly variable. A >> complicated absorption model (the TRANSIT model) significantly improve the >> model fit (OFV drops over 250) compared to a 1st-order absorption model >> with lag time. The complicated final model converged and the covariance >> step was successful. The condition number is low (less than 10), although >> there were many runs with rounding errors during model development. >> >> >> >> However, in the bootstrap analysis,about 600 out of 1000 iterations had >> minimization terminated which leads to a successful rate of only 40%. >> >> >> >> My question is: is there any consensus regarding the acceptable >> successful rate for bootstrap analysis? I understand 40% is very low. >> Should I reject this model then? >> >> >> >> Any suggestions will be greatly appreciated. >> >> >> Thanks, >> >> >> >> Siwei >> > >
Oct 29, 2014 Siwei Dai Minimization Terminated in Bootstrapping
Oct 29, 2014 Peter Bonate RE: Minimization Terminated in Bootstrapping
Oct 30, 2014 Siwei Dai Re: Minimization Terminated in Bootstrapping
Oct 31, 2014 Jan-Stefan van der Walt Re: Minimization Terminated in Bootstrapping