Humongous log file with parallel NONMEM
Hi all,
I'm running NONMEM (METHOD = BAYES) in parallel on 32 cores and it
generates a humongous log file with repeated entries like the following:
ITERATION -577
STARTING SUBJECTS 1 TO 4 ON MANAGER: OK
STARTING SUBJECTS 5 TO 8 ON WORKER1: OK
STARTING SUBJECTS 9 TO 11 ON WORKER2: OK
STARTING SUBJECTS 12 TO 15 ON WORKER3: OK
STARTING SUBJECTS 16 TO 18 ON WORKER4: OK
STARTING SUBJECTS 19 TO 20 ON WORKER5: OK
STARTING SUBJECTS 21 TO 24 ON WORKER6: OK
STARTING SUBJECTS 25 TO 27 ON WORKER7: OK
STARTING SUBJECTS 28 TO 29 ON WORKER8: OK
STARTING SUBJECTS 30 TO 32 ON WORKER9: OK
STARTING SUBJECTS 33 TO 35 ON WORKER10: OK
STARTING SUBJECTS 36 TO 39 ON WORKER11: OK
STARTING SUBJECTS 40 TO 42 ON WORKER12: OK
STARTING SUBJECTS 43 TO 46 ON WORKER13: OK
STARTING SUBJECTS 47 TO 50 ON WORKER14: OK
STARTING SUBJECTS 51 TO 53 ON WORKER15: OK
STARTING SUBJECTS 54 TO 58 ON WORKER16: OK
STARTING SUBJECTS 59 TO 62 ON WORKER17: OK
STARTING SUBJECTS 63 TO 66 ON WORKER18: OK
STARTING SUBJECTS 67 TO 70 ON WORKER19: OK
STARTING SUBJECTS 71 TO 71 ON WORKER20: OK
STARTING SUBJECTS 72 TO 74 ON WORKER21: OK
STARTING SUBJECTS 75 TO 77 ON WORKER22: OK
STARTING SUBJECTS 78 TO 80 ON WORKER23: OK
STARTING SUBJECTS 81 TO 84 ON WORKER24: OK
STARTING SUBJECTS 85 TO 86 ON WORKER25: OK
STARTING SUBJECTS 87 TO 88 ON WORKER26: OK
STARTING SUBJECTS 89 TO 90 ON WORKER27: OK
STARTING SUBJECTS 91 TO 93 ON WORKER28: OK
STARTING SUBJECTS 94 TO 96 ON WORKER29: OK
STARTING SUBJECTS 97 TO 99 ON WORKER30: OK
STARTING SUBJECTS 100 TO 103 ON WORKER31: OK
COLLECTING SUBJECTS 1 TO 4 ON MANAGER
COLLECTING SUBJECTS 5 TO 8 ON WORKER1
COLLECTING SUBJECTS 9 TO 11 ON WORKER2
COLLECTING SUBJECTS 12 TO 15 ON WORKER3
COLLECTING SUBJECTS 16 TO 18 ON WORKER4
COLLECTING SUBJECTS 19 TO 20 ON WORKER5
COLLECTING SUBJECTS 21 TO 24 ON WORKER6
COLLECTING SUBJECTS 25 TO 27 ON WORKER7
COLLECTING SUBJECTS 28 TO 29 ON WORKER8
COLLECTING SUBJECTS 30 TO 32 ON WORKER9
COLLECTING SUBJECTS 33 TO 35 ON WORKER10
COLLECTING SUBJECTS 36 TO 39 ON WORKER11
COLLECTING SUBJECTS 40 TO 42 ON WORKER12
COLLECTING SUBJECTS 43 TO 46 ON WORKER13
COLLECTING SUBJECTS 47 TO 50 ON WORKER14
COLLECTING SUBJECTS 51 TO 53 ON WORKER15
COLLECTING SUBJECTS 54 TO 58 ON WORKER16
COLLECTING SUBJECTS 59 TO 62 ON WORKER17
COLLECTING SUBJECTS 63 TO 66 ON WORKER18
COLLECTING SUBJECTS 67 TO 70 ON WORKER19
COLLECTING SUBJECTS 71 TO 71 ON WORKER20
COLLECTING SUBJECTS 72 TO 74 ON WORKER21
COLLECTING SUBJECTS 75 TO 77 ON WORKER22
COLLECTING SUBJECTS 78 TO 80 ON WORKER23
COLLECTING SUBJECTS 81 TO 84 ON WORKER24
COLLECTING SUBJECTS 85 TO 86 ON WORKER25
COLLECTING SUBJECTS 87 TO 88 ON WORKER26
COLLECTING SUBJECTS 89 TO 90 ON WORKER27
COLLECTING SUBJECTS 91 TO 93 ON WORKER28
COLLECTING SUBJECTS 94 TO 96 ON WORKER29
COLLECTING SUBJECTS 97 TO 99 ON WORKER30
COLLECTING SUBJECTS 100 TO 103 ON WORKER31
The result is a lot of disk I/O and a file in the GB+ range. It dwarfs the
file containing the MCMC samples. Is there some way to suppress that file
or reduce what gets written to it?
Thanks,
Bill
William R Gillespie, VP Strategic Modeling & Simulation
Metrum Research Group LLC
2 Tunxis Road, Tariffville, CT 06081
Direct & FAX: 919-371-2786, Main: 860-735-7043
[email protected]
www.metrumrg.com