Anybody who has been seriously engaged in scientific work of any kind realizes that over the entrance to the gates of the temple of science are written the words: Ye must have faith.
In the context of computational learning, the concept of 'probably approximately correct' (PAC) learning provides a framework for understanding the efficiency and feasibility of learning algorithms.