The U.S. government used to issue paper bonds, which you could keep in a safety deposit box or home vault.
If you purchase gold and you want to keep it in your personal possession you may think about storing it in your safety deposit box.
The records should be stored in a secure place, such as a safety deposit box or a fire-resistant safe or filing cabinet.