Handle cleanup when remounting rw after mounting read-only