As mentioned in "Select columns to use" section, click "Modify" button on the outline table at the top of the document. You will see another dialogue to select "Delete" or "Modify". If you choose either of them, the previous graph will disappear forever.