Lowerbound on expectation of log sum of Bernoulli random variables?

714 Views Asked by At

I'm looking for a lower-bound on $E\left[\log \left(B + \sum_i a_i X_i\right)\right]$ where $X_i$ are Bernoulli random variables with $p(X_i = 1) = q_i$ and $a_i > 0, B > 0$.

Because $X_i$ is 0 or 1, it's hard to use Jensen inequality as it results in $\log(X_i)$ which maybe $-\infty$ and the lower-bound is meaningless.

Thank you very much for any help.

2

There are 2 best solutions below

1
On

Since your function is concave instead of convex, you can only use Jensen's inequality to get an upper bound instead of a lower bound. The upper bound you get is $\log(E(B + \sum_i a_i X_i)) = \log(B + \sum_i a_i / 2)$. I'm not sure how to derive a lower bound when you have a concave function.

0
On

If the number of $X_i$ and $a_i$ is some large $n$ then you can use a large deviation inequality to upper bound the probability $P$ that the number of $X_i = 1$ is below a certain threshold $k$ which is less than the expected count which is $n/2$. Then the expected value of your function is at least equal to $(1-P)Y$ where $Y$ is the average value of $\log(B + \sum_{i \in S} a_i)$ where $S$ ranges over all subsets of size $k$.