The chance is greater that a cylinder will fail at 2650 than 500psi as well, where do you draw the line?
As for the burst disk, there's several accounts on TDS where people have posted about it, a quick search will reveal them.
Well the lines are drawn at different levels for different type of designs depending on many factors including: predictability, risk, etc.
For example for steel construction based on AISC (American Institute of Steel Construction) codes it would be 60% of yield (for allowable working stress), but that is a very short answer since it can vary to 66% depending on a number of factors.
For life support equipment it is often taken as a 5 to 1 safety factor
again depending on types of materials and how predictable is the material and geometry.
For DOT 3AA cylinders (per CFR49section 178.37) it is a specified 70,000 psi max stress based on a specific equation per the code. Pressure vessels built under this particular section of the code use a well specified family of materials.
There are also codes from ASME (American Society of Mechanical Engineers) also have a different criteria for stationary pressure vessels.
How conservative a safety factor is will depend on risk and predictability among other factors. At times it may seem as it is arbitrary, but it is not intended to be.
Believe or not, this is just a short answer to give you just an idea that these criterias are not just trivial.
There is a lot of work behind the codes, regulations, and even just good engineering practices. And yes there are some errors and mistakes
they are all written by humans.
Do you just Google Scuba burst disk failure or is there a particular place or words that will get me there faster?