sikuli-driver team mailing list archive

[Devin <1995401@xxxxxxxxxxxxxxxxxx>]

Public bug reported:

Hello,

I recently upgrade a macOS computer to macOS Monterey. I'm working on
porting some Sikuli automated test scripts to work with Monterey.

The first issue I encountered is a weird one where it seems like the Fn
key is being held down somehow with Sikuli scripts but nothing else.

I've tried connecting a Dell USB keyboard and an Apple USB keyboard with
no differences.

If I do this with either USB keyboard, it works as expected:
- Open Finder
- Shift + Command + G, to open "Go to" window with an "address bar"
- type in "e"
- see the character "e" in the address bar

If using the macOS keyboard I type in Fn+e then I get an Emoji popup
window.

When running a Sikuli script, I see the following:
- Open Finder
- Shift + Command + G, to open "Go to" window with an "address bar"
- type in "e", via type("e")
- I see the Emoji popup window instead of the character "e" being typed in the address bar

I've tried the following with no luck (although it does change the behavior with the Apple keyboard, but no Sikuli):
- Settings -> Keyboard -> Modifier Keys... -> Function (fn) Key: No Action

It doesn't help. I still get the Emoji window with Sikuli scripts.

Other keys do other things. I normally don't use macOS myself so I don't
know how to describe these things properly. But when trying to type in a
path in the address bar using Sikuli, I'll see various popups for
various keys while other keys will move Windows around on the screen,
etc depending on which key is being pressed. I suspect that all of them
are Fn+<some key> that is activating some keyboard shortcut.

I am using Java 14 at the moment.

Also, we did a time machine restore from the original macOS machine, so
I'm not sure if that's related somehow.

For now, I am thinking to just remap the shortcuts to some key combination that the scripts should never press, as per the following:
https://discussions.apple.com/thread/253297084

However, I'll need to manually find each key typed by the scripts, and
manually add a shortcut to override the default one and it will be very
time consuming.

I have not yet tried a fresh Monterey install (without the Time Machine
restore) or with a newer version of Java.

I wanted to first check if there's a setting/option for the Fn key
related to this in Sikuli that I couldn't find online.

Sorry if this is a known issue, I didn't find anything when searching
for "Fn" in the Sikuli bug tracker. Also, searching for Monterey only
found bug 1976241.

Thanks,
Devin

** Affects: sikuli
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Sikuli
Drivers, which is subscribed to SikuliX.
https://bugs.launchpad.net/bugs/1995401

Title:
  Fn key appears to be held down in macOS Monterey

Status in SikuliX:
  New

Bug description:
  Hello,

  I recently upgrade a macOS computer to macOS Monterey. I'm working on
  porting some Sikuli automated test scripts to work with Monterey.

  The first issue I encountered is a weird one where it seems like the
  Fn key is being held down somehow with Sikuli scripts but nothing
  else.

  I've tried connecting a Dell USB keyboard and an Apple USB keyboard
  with no differences.

  If I do this with either USB keyboard, it works as expected:
  - Open Finder
  - Shift + Command + G, to open "Go to" window with an "address bar"
  - type in "e"
  - see the character "e" in the address bar

  If using the macOS keyboard I type in Fn+e then I get an Emoji popup
  window.

  When running a Sikuli script, I see the following:
  - Open Finder
  - Shift + Command + G, to open "Go to" window with an "address bar"
  - type in "e", via type("e")
  - I see the Emoji popup window instead of the character "e" being typed in the address bar

  I've tried the following with no luck (although it does change the behavior with the Apple keyboard, but no Sikuli):
  - Settings -> Keyboard -> Modifier Keys... -> Function (fn) Key: No Action

  It doesn't help. I still get the Emoji window with Sikuli scripts.

  Other keys do other things. I normally don't use macOS myself so I
  don't know how to describe these things properly. But when trying to
  type in a path in the address bar using Sikuli, I'll see various
  popups for various keys while other keys will move Windows around on
  the screen, etc depending on which key is being pressed. I suspect
  that all of them are Fn+<some key> that is activating some keyboard
  shortcut.

  I am using Java 14 at the moment.

  Also, we did a time machine restore from the original macOS machine,
  so I'm not sure if that's related somehow.

  For now, I am thinking to just remap the shortcuts to some key combination that the scripts should never press, as per the following:
  https://discussions.apple.com/thread/253297084

  However, I'll need to manually find each key typed by the scripts, and
  manually add a shortcut to override the default one and it will be
  very time consuming.

  I have not yet tried a fresh Monterey install (without the Time
  Machine restore) or with a newer version of Java.

  I wanted to first check if there's a setting/option for the Fn key
  related to this in Sikuli that I couldn't find online.

  Sorry if this is a known issue, I didn't find anything when searching
  for "Fn" in the Sikuli bug tracker. Also, searching for Monterey only
  found bug 1976241.

  Thanks,
  Devin

To manage notifications about this bug go to:
https://bugs.launchpad.net/sikuli/+bug/1995401/+subscriptions