Most likely setting is to not scan test sources, make that the default.
Or it should be taken from a project initial value, or from another project window.
When opening a project where pmd is not used on, yet, with another project open, it takes the ruleset from the other project but not the Skip Test Sources setting.