The new couple has been vacationing in NYC.