There's no button to delete a co-op, but if all the members leave, it will be deleted automatically.