Probably the easiest thing to do is start with the desired molar concentration of the more acidic form of phosphate (i.e., KH2PO4), and then adjust it to the desired pH using KOH.