I assume that you mean that it does not stop monitoring the window titles of the incognito windows? The browser domains certainly should be stopped to be monitored if you disabled that in incognito.
There are two ways to solve this, manually (which is possible today, you just need to temporarily disabled aw-watcher-window from the tray icon) or automatically (which there is a feature request for here Add an "Exclude" list)