Yes. It is a good practice to wash all produce. For mushrooms, it is best to wash the mushrooms just before use.  This will extend the shelf-life.