wayland: accept active modifiers even if they aren't physically held

We don't care about the physical state of keys, only if they are
effective or not and whether they should affect key processing.