# Logit and Expit

Logit, or log-odds, is a sometimes useful function for dealing with probabilities in a more intuitive fashion. Expit is its inverse. This was kind of a tricky algebraic proof for me, but I am out of practice... For the following, assume I'm using log() function in base 2, because I'm a programmer.[math]logit(p) = log(odds(p)) = log(\frac{p}{1-p}) \\

expit(p) = \frac{exp(p)}{1+exp(p)} = \frac{2^p}{1+2^p}

[/math]

In order to prove these are inverses, I am going to prove that

[math]\begin{eqnarray}

p &=& logit(expit(p)) \\

&=& log(\frac{expit(p)}{1-expit(p)}) \\

&=& log\Big[\frac{\frac{exp(p)}{1+exp(p)}}{1-\frac{exp(p)}{1+exp(p)}}\Big] \\

&=& log(\frac{exp(p)}{1+exp(p)}) - log(1-\frac{exp(p)}{1+exp(p)}) \\

&=& log(exp(p)) - log(1+exp(p)) - log(1-\frac{exp(p)}{1+exp(p)}) \\

&=& p - log(1+exp(p)) - log(1-\frac{exp(p)}{1+exp(p)}) \\

&=& p - log(1+exp(p)) - log(1-(\frac{exp(p)+1-1}{1+exp(p)})) \\

&=& p - log(1+exp(p)) - log(1-(\frac{exp(p)+1}{1+exp(p)}-\frac{1}{1+exp(p)})) \\

&=& p - log(1+exp(p)) - log(1-(1-\frac{1}{1+exp(p)})) \\

&=& p - log(1+exp(p)) - log(\frac{1}{1+exp(p)}) \\

&=& p - log(1+exp(p)) - (log(1)-log(1+exp(p))) \\

&=& p - log(1+exp(p)) - log(1) + log(1+exp(p)) \\

&=& p - 0 + (0 - 0) \\

&=& p \\

QED

\end{eqnarray}

[/math]

So not strictly that hard from number of reductions, the hardest part for me was the x/(1+x) to 1-1/(1+x) step which wasn't obvious. Anyway I think I should prove the other way too, p = expit(logit(p)), to be done, but not now. Maybe in a future edit.

As a preview for where this is going, I want to write a post justifying from proofs that bayes' theorem can be rewritten as Belief(subject x after evidence e) = Belief(x prior) + Evidence(e about x), where Belief(x) = logit(x) and Evidence(e about x) = log(P(e|x)/P(e|!x)). But right now I'm struggling to find how that shouldn't be a proportional symbol, even though in some test calculations with the fully expanded Bayes theorem vs this, the results are equal...

#### Posted on 2017-11-19 by Jach

**Permalink:** https://www.thejach.com/view/id/350

**Trackback URL:** https://www.thejach.com/view/2017/11/logit_and_expit

## Recent Posts

2019-05-122019-04-262019-04-202019-04-102019-02-09