Binding to a FFAT motif, a short motif containing diphenylalanine in an acidic tract that targets proteins to the cytosolic surface of the ER and to the nuclear membrane by binding directly to members of the VAP (VAMP-associated protein) protein family.