On pivoting: "If you're not stubborn, you'll give up on experiments too soon. And if you're not flexible, you'll pound your head against the wall and you won't see a different solution to a problem you're trying to solve."
"A key insight in computational learning theory is that the complexity of a learning problem is determined by the complexity of the hypothesis space and the amount of data available."