sikuli-driver team mailing list archive

[Gilles Carry <1856719@xxxxxxxxxxxxxxxxxx>]

Public bug reported:

Hello,

I'm using SikuliX-2.0.1 on Windows 7, Java 8.

I'm trying to setup an "answer all" machine to get rid of unexpected popups in the middle of a procedure rollout.
To reproduce the issue, consider the following simple example:
(get image files in attachements)
(use this program to match images rdp_connect_anyway.png and rdp_connection.png)

def clickNoHandler(event):
    event.match.click("1576165706268.png") # "No" button
    event.repeat()

def clickYesHandler(event):
    event.match.click("1576166585508.png") # "Yes" button
    event.repeat()

def clickConnectHandler(event):
    event.match.below().click("1576589919586.png") # "Connect" button
    event.repeat()


def answerAll():
    onAppear(Pattern("1576166492962.png").exact(), clickYesHandler) # Image without a mask
    onAppear("1576589851448.png", clickConnectHandler) # Image without a mask
    onAppear(Pattern("1573829195078.png").exact().targetOffset(2,6), clickNoHandler) # Image WITH an automask
    observeInBackground()

answerAll()
popup("Terminate")


When started from the IDE, popup "Terminate" appears and nothing happens. After having stopped the program (clicking on the popup), message pan shows:
Exception in thread "Thread-37" CvException [org.opencv.core.CvException: cv::Exception: OpenCV(3.4.2) C:\build\3_4_winpack-bindings-win64-vc14-static\opencv\modules\core\src\arithm.cpp:659: error: (-209:Sizes of input arguments do not match) The operation is neither 'array op array' (where arrays have the same size and the same number of channels), nor 'array op scalar', nor 'scalar op array' in function 'cv::arithm_op'
]
        at org.opencv.core.Core.multiply_2(Native Method)
        at org.opencv.core.Core.multiply(Core.java:1831)
        at org.sikuli.script.Finder$FindInput2.setAttributes(Finder.java:1419)
        at org.sikuli.script.Finder$Finder2.find(Finder.java:614)
        at org.sikuli.script.Finder.find(Finder.java:280)
        at org.sikuli.script.support.Observer.checkPatterns(Observer.java:217)
        at org.sikuli.script.support.Observer.update(Observer.java:366)
        at org.sikuli.script.Region.observeDo(Region.java:3809)
        at org.sikuli.script.Region.access$700(Region.java:23)
        at org.sikuli.script.Region$ObserverThread.run(Region
.java:3876)
        at java.lang.Thread.run(Unknown Source)

I even tried with Sikulix-2.1.0 (built from commit 696314e322a07cc47319e9cf5a4a500ca838f0fc) and got roughly the same thing. (with opencv 4.1.1, obiously)
Exception in thread "Thread-35" CvException [org.opencv.core.CvException: cv::Exception: OpenCV(4.1.1) C:\build\master_winpack-bindings-win64-vc14-static\opencv\modules\core\src\arithm.cpp:663: error: (-209:Sizes of input arguments do not match) The operation is neither 'array op array' (where arrays have the same size and the same number of channels), nor 'array op scalar', nor 'scalar op array' in function 'cv::arithm_op'
]
        at org.opencv.core.Core.multiply_2(Native Method)
        at org.opencv.core.Core.multiply(Core.java:4382)
        at org.sikuli.script.Finder$FindInput2.setAttributes(Finder.java:1444)
        at org.sikuli.script.Finder$Finder2.find(Finder.java:628)
        at org.sikuli.script.Finder.find(Finder.java:280)
        at org.sikuli.script.support.Observer.checkPatterns(Observer.java:217)
        at org.sikuli.script.support.Observer.update(Observer.java:366)
        at org.sikuli.script.Region.observeDo(Region.java:3807)
        at org.sikuli.script.Region.access$600(Region.java:22)
        at org.sikuli.script.Region$ObserverThread.run(Reg
ion.java:3874)
        at java.lang.Thread.run(Unknown Source)


Commenting out third onAppear() line (the one with masked image) everything works perfectly. (though sometimes it is necessary the restart the IDE to recover from previous errors)

Masked image was created by deleting part of the picture. Note that
using pattern matching outside of the observeInBackground context works
perfectly with this image.

Thank-you for reading.

** Affects: sikuli
     Importance: Undecided
         Status: New

** Attachment added: "All needed pictures"
   https://bugs.launchpad.net/bugs/1856719/+attachment/5313415/+files/report_bug.sikuli.pics.zip

-- 
You received this bug notification because you are a member of Sikuli
Drivers, which is subscribed to Sikuli.
https://bugs.launchpad.net/bugs/1856719

Title:
  CvException "Sizes of input arguments do not match" with
  observeInBackground and automasked images

Status in Sikuli:
  New

Bug description:
  Hello,

  I'm using SikuliX-2.0.1 on Windows 7, Java 8.

  I'm trying to setup an "answer all" machine to get rid of unexpected popups in the middle of a procedure rollout.
  To reproduce the issue, consider the following simple example:
  (get image files in attachements)
  (use this program to match images rdp_connect_anyway.png and rdp_connection.png)

  def clickNoHandler(event):
      event.match.click("1576165706268.png") # "No" button
      event.repeat()

  def clickYesHandler(event):
      event.match.click("1576166585508.png") # "Yes" button
      event.repeat()

  def clickConnectHandler(event):
      event.match.below().click("1576589919586.png") # "Connect" button
      event.repeat()

  
  def answerAll():
      onAppear(Pattern("1576166492962.png").exact(), clickYesHandler) # Image without a mask
      onAppear("1576589851448.png", clickConnectHandler) # Image without a mask
      onAppear(Pattern("1573829195078.png").exact().targetOffset(2,6), clickNoHandler) # Image WITH an automask
      observeInBackground()

  answerAll()
  popup("Terminate")

  
  When started from the IDE, popup "Terminate" appears and nothing happens. After having stopped the program (clicking on the popup), message pan shows:
  Exception in thread "Thread-37" CvException [org.opencv.core.CvException: cv::Exception: OpenCV(3.4.2) C:\build\3_4_winpack-bindings-win64-vc14-static\opencv\modules\core\src\arithm.cpp:659: error: (-209:Sizes of input arguments do not match) The operation is neither 'array op array' (where arrays have the same size and the same number of channels), nor 'array op scalar', nor 'scalar op array' in function 'cv::arithm_op'
  ]
          at org.opencv.core.Core.multiply_2(Native Method)
          at org.opencv.core.Core.multiply(Core.java:1831)
          at org.sikuli.script.Finder$FindInput2.setAttributes(Finder.java:1419)
          at org.sikuli.script.Finder$Finder2.find(Finder.java:614)
          at org.sikuli.script.Finder.find(Finder.java:280)
          at org.sikuli.script.support.Observer.checkPatterns(Observer.java:217)
          at org.sikuli.script.support.Observer.update(Observer.java:366)
          at org.sikuli.script.Region.observeDo(Region.java:3809)
          at org.sikuli.script.Region.access$700(Region.java:23)
          at org.sikuli.script.Region$ObserverThread.run(Region
  .java:3876)
          at java.lang.Thread.run(Unknown Source)

  I even tried with Sikulix-2.1.0 (built from commit 696314e322a07cc47319e9cf5a4a500ca838f0fc) and got roughly the same thing. (with opencv 4.1.1, obiously)
  Exception in thread "Thread-35" CvException [org.opencv.core.CvException: cv::Exception: OpenCV(4.1.1) C:\build\master_winpack-bindings-win64-vc14-static\opencv\modules\core\src\arithm.cpp:663: error: (-209:Sizes of input arguments do not match) The operation is neither 'array op array' (where arrays have the same size and the same number of channels), nor 'array op scalar', nor 'scalar op array' in function 'cv::arithm_op'
  ]
          at org.opencv.core.Core.multiply_2(Native Method)
          at org.opencv.core.Core.multiply(Core.java:4382)
          at org.sikuli.script.Finder$FindInput2.setAttributes(Finder.java:1444)
          at org.sikuli.script.Finder$Finder2.find(Finder.java:628)
          at org.sikuli.script.Finder.find(Finder.java:280)
          at org.sikuli.script.support.Observer.checkPatterns(Observer.java:217)
          at org.sikuli.script.support.Observer.update(Observer.java:366)
          at org.sikuli.script.Region.observeDo(Region.java:3807)
          at org.sikuli.script.Region.access$600(Region.java:22)
          at org.sikuli.script.Region$ObserverThread.run(Reg
  ion.java:3874)
          at java.lang.Thread.run(Unknown Source)

  
  Commenting out third onAppear() line (the one with masked image) everything works perfectly. (though sometimes it is necessary the restart the IDE to recover from previous errors)

  Masked image was created by deleting part of the picture. Note that
  using pattern matching outside of the observeInBackground context
  works perfectly with this image.

  Thank-you for reading.

To manage notifications about this bug go to:
https://bugs.launchpad.net/sikuli/+bug/1856719/+subscriptions