The only time you need the mask around dust is if you are breathing.
If you are not breathing you probably needed the mask, but it is already too late. I wear mine (with the proper filter cartridges) whenever I am breathing air with something in it besides air. Lungs are hard to replace .