Calcium in milk?

Milk has both Ca(2+) and PO4(3-). What characteristics of milk prevent these two ions from forming calcium phosphate