Nonlinear model approximation3 months ago
A small toy problem | Latent Gaussian predictor version | Introducing a latent Gaussian variable $u\sim\pN(0,1)$, the model can bereformulated as$$\begin{aligned}\lambda(u) &=-\ln{1-\Phi(u)}/\gamma \(y_i|u) &\sim \pPo(\lambda(u))\end{aligned}$$We will need some derivatives of $\lambda$ with respect to $u$:$$\begin{aligned}\frac{\partial\lambda(u)}{\partial u} &= \frac{1}{\gamma}\frac{\phi(u)}{1-\Phi(u)}= \lambda'(u) \\frac{\partial^2\lambda(u)}{\partial u^2} &= | \frac{1}{\gamma}\frac{\phi(u)}{1-\Phi(u)}\left(u + \frac{\phi(u)}{1-\Phi(u)}\right) | Latent Gaussian posterior approximations | n\frac | n\frac{\lambda'(u)^2}{\lambda(u)}\end{aligned}$$At the mode $u_0$, the first order derivative is zero, and$$\begin{aligned}\left.\frac{\partial^2\ln p(u|{y_i})}{\partial u^2}\right|_{u=u_0}&=-1 | \left{u_0 - \gamma\lambda'(u_0) + \frac{\lambda'(u_0)}{\lambda(u_0)}\right}u_0 | n\frac{\lambda'(u_0)^2}{\lambda(u_0)} .\end{aligned}$$The quadratic approximation of the log-posterior density at the mode $u_0$ is then$$\ln \breve{p}(u|{y_i}) = \text{const} - \frac{(u-u_0)^2}{2}\left[ | \left.\frac{\partial^2\ln p(u|{y_i})}{\partial u^2}\right|{u=u_0}\right]$$In inlabru, the approximation first linearises $\ln \lambda(u)$ at $u_0$ before applyingthe Taylor approximation of $\ln p(u|{y_i})$. The linearised log-predictor is$$\ln \ol{\lambda}(u) = \ln \lambda(u_0) + \frac{\lambda'(u_0)}{\lambda(u_0)}(u - u_0)$$so that$$\ol{\lambda}'(u) = \frac{\lambda'(u_0)}{\lambda(u_0)} \ol{\lambda}(u)$$and the second order derivative of the linearised log-posterior density is$$\begin{aligned}\left.\frac{\partial^2\ln \ol{p}(u|{y_i})}{\partial u^2}\right|{u=u_0}&=-1 | Posterior densities | Posterior CDFs
