The couple is also registered in-store at Bailey's Fine Jewelry in Rocky Mount, NC