The two formed a duo called “Pat and Olivia” and toured