If powerful forces consistently push us toward premature exploitation, we should almost always be biased towards exploring more. The Embarrassing Problem of Premature Exploitation - LessWrong 2.0