The scrubber is probably safe in there, but for checklist purposes it might be a good habit to take it out, put it in a clean plastic bag, and then just redo the whole build checklist again, step by step but with the scrubber already packed (check it again though)
Disclaimer this is for a fairly small (70kg) diver with very relaxed trim, good buoyancy, and very little exertion (often DPV dives), but:
Have on several occasions put 6+ cumulative hours on a 2.5kg scrubber spanned over multiple days and lower-consequence (shallower/easier) dives (up to five) spanned over up to a month, with the intact canister always removed, wiped dry, checked/snugged up, and stored intact (never repacked) in a plastic bag between dives. A well-rehearsed BOV routine and shallower dives as the duration steps up, but no signs of hypercarbia thus far. Sudden exertion and breakthrough on an old scrubber is an important risk factor, pre-emptive bailout might be advisable in that case.
Most scrubber material has a nominal use rating of 150 L CO2 per kg, which is about 4 to 8 hours at a steady (lower exertion) O2 metabolic rate of 1 to 2 L/min. But you could overexert or panic and overwhelm the scrubber at any point during a dive, even if it's under 3 hrs of cumulative use.