Wittenoom was an asbestos mining town, it was the whole reason for the towns existence. They believed at the time that not only was asbestos safe but they would spread blue asbestos out on the ground around their houses and paths on purpose (for some reason, i forget why exactly, might have been as an insect deterrent or something).
So this wouldnt be that weird for them, like a coal mining town digging buckets of coal.