I brought it up because Delrin, aka “plastic bottle” , seems like a better material choice for a scrubber housing than say aluminum. The heat transfer rates are several orders of magnitude different.
Actually, you can not build a scrubber using aluminium. The reason is, that small amounts of NaOH within the sorbent will in presence of water protonize same to NaAlO2 and H2- with other words- it wont be there for long... Neither would be you under certain circumstances mixing H2 and O2

In my opinion POM (more precisely POM-C) is a fairly good choice- given the requirement of form stability and high PH it offers a good cost-benefit ratio.
Why are you concerned about the thermal conductivity per se?
If this was a major concern in material choice GFRPs offer much better thermal insulation capabilities at higher strenghts and durability. This has however noch much advantage as the scrubber itself is usually sufficiently insulated by an air layer.