Author Topic: Bayesian Calibration -identical params in workdirs-  (Read 22266 times)

ala

  • Newbie
  • *
  • Posts: 6
    • View Profile
Bayesian Calibration -identical params in workdirs-
« on: June 01, 2022, 07:36:50 AM »
Hi,
I am trying to calibrate an openseespy model, I have defined all the needs, the procedure ends but i see parameters in the various run are all the same, all the params in the workdirs are the same, the dakotaTab.out contains all identical parameters and results for the various runs, would you please help me solve it.
Thanks in advance for the help

fmk

  • Administrator
  • Full Member
  • *****
  • Posts: 233
    • View Profile
Re: Bayesian Calibration -identical params in workdirs-
« Reply #1 on: June 01, 2022, 07:51:48 AM »
we will need to see the input file to start solving this one. If running locally it will be in ~/Documents/quoFEM/LocalWorkDir/tmp.SimCebter/templatedir. It is either dakota.json or scInput.json depending on version of quoFEM. We will probably need more, but if you can post this we can see what else is needed/

ala

  • Newbie
  • *
  • Posts: 6
    • View Profile
Re: Bayesian Calibration -identical params in workdirs-
« Reply #2 on: June 01, 2022, 11:32:25 AM »
Thank you for your fast answer, here I append the file

AakashBS

  • Global Moderator
  • Newbie
  • *****
  • Posts: 38
    • View Profile
Re: Bayesian Calibration -identical params in workdirs-
« Reply #3 on: June 02, 2022, 02:59:02 AM »
Hello,

Can you please share the "logFileTMCMC.txt" located in "~/Documents/quoFEM/LocalWorkDir/tmp.SimCenter"?

Best regards,
Aakash

ala

  • Newbie
  • *
  • Posts: 6
    • View Profile
Re: Bayesian Calibration -identical params in workdirs-
« Reply #4 on: June 02, 2022, 01:12:29 PM »
Hi, here is the file.
Best regards


AakashBS

  • Global Moderator
  • Newbie
  • *****
  • Posts: 38
    • View Profile
Re: Bayesian Calibration -identical params in workdirs-
« Reply #5 on: June 02, 2022, 03:20:21 PM »
Thank you for sharing the file. Please increase the number of samples requested to 100 and try again.

ala

  • Newbie
  • *
  • Posts: 6
    • View Profile
Re: Bayesian Calibration -identical params in workdirs-
« Reply #6 on: June 02, 2022, 04:41:16 PM »
I have already done a test varing the number of samples, it does not matter.

AakashBS

  • Global Moderator
  • Newbie
  • *****
  • Posts: 38
    • View Profile
Re: Bayesian Calibration -identical params in workdirs-
« Reply #7 on: June 02, 2022, 07:53:52 PM »
Can you please share your model script, in a private message if you would prefer, so that I can reproduce the issue and try a few solutions?
« Last Edit: June 02, 2022, 08:29:47 PM by AakashBS »

ala

  • Newbie
  • *
  • Posts: 6
    • View Profile
Re: Bayesian Calibration -identical params in workdirs-
« Reply #8 on: June 03, 2022, 09:57:31 AM »
I am afraid I should send the whole ambient. The matter is that I don't read any warning or error and the output files are produced but the params files (params.in) the procedure produces in each of the directories (workdir.#) are exactly the same. The problem generates before the model script is executed. It sems to me the procedure dedicated to produce random values input  params file (different for each workdir) does not work properly in this case, I don't know, pheraps due to an ambient configuration variable, although I have tryed to set everything at my best (not sufficient).

fmk

  • Administrator
  • Full Member
  • *****
  • Posts: 233
    • View Profile
Re: Bayesian Calibration -identical params in workdirs-
« Reply #9 on: June 06, 2022, 07:07:33 PM »
Aakash, what are the circumstances for which the params.in is going to be the same in each workdir.

AakashBS

  • Global Moderator
  • Newbie
  • *****
  • Posts: 38
    • View Profile
Re: Bayesian Calibration -identical params in workdirs-
« Reply #10 on: June 08, 2022, 10:11:17 PM »
The most common reason for this to happen is that the number of requested samples is small in comparison to the number of parameters to be estimated. This can make the sample covariance matrix ill-conditioned, which causes difficulties when generating new sample points. As a result, during subsequent stages of the TMCMC algorithm, new sample points might not be accepted and each workdir will end up with the same parameter value.

However, since increasing the sample size to a larger number did not resolve the problem, I am not sure what could be the cause of the issue.. It would help if I can reproduce the issue, to diagnose the source of the problem. Sharing the model script or the contents of one of the workdirs will let me recreate the analysis on my machine and help identify the cause.

AakashBS

  • Global Moderator
  • Newbie
  • *****
  • Posts: 38
    • View Profile
Re: Bayesian Calibration -identical params in workdirs-
« Reply #11 on: June 09, 2022, 09:08:19 PM »
You can also try increasing the standard deviation to have a wider prior, as 10% coefficient of variation results in a narrow, informative prior. If the predictions from the model evaluated at the samples drawn from the prior are all too far away from the data, this can cause numerical difficulties during the algorithm run.

Using a log-normal prior instead of a normal prior will ensure that the input parameter values are admissible, if the parameters should always have positive values.

ala

  • Newbie
  • *
  • Posts: 6
    • View Profile
Re: Bayesian Calibration -identical params in workdirs-
« Reply #12 on: June 19, 2022, 10:57:13 AM »
Thank very much you for the helpful suggestions, I will let you know