An agent is learning if it improves its performance LEARNING on future tasks after making observations about the world. Learning can range from the trivial, as exhibited by jotting down a phone number, to the profound, as exhibited by Albert Einstein, who inferred a new theory of the universe. In this chapter, we will concentrate on one class of learning problem, which seems restricted but actually has vast applicability: from…