We will explore some connections between probability and number theory. In particular, we will discuss the Erdos-Kac theorem, an analogue of the central limit theorem for the number of prime factors of an integer. We will also sketch an ergodic-theoretic proof of Szemeredi's theorem, a result concerning arithmetic progressions that is closely related to the celebrated Green-Tao theorem.