Babies are learning vital things about the world when they explore with their mouths. They are unable to use their fingers as tools to explore, so they substitute them with their mouth. When something is placed in their mouth, your baby is learning about texture, temperature, shape and size.
