Any process that modulates the frequency, rate or extent of xanthophore differentiation.
Comment:
Note that this term refers to xanthophores in the sense of specialized pigment-producing cells, and should not be confused with the cellular component term 'xanthophore ; GO:0031633', which refers to a subcellular structure.