sikuli-driver team mailing list archive

[RaiMan <sikulix@xxxxxxxxxxx>]

@Anatoly (welcome back ;-)
I principally understand what you are saying and your suggested approach.
But I have to admit, that this is far beyond what I can invest (both knowledge and time) into the further development of SikuliX.

SikuliX in the first place is a tool, to setup visual workflows basically doing this repeatedly:
wait for some visual to appear on the screen
... and then act on some point on the screen (mouse or keyboard)

... but often complained about:
1. Currently it has no knowledge about what the visual might mean to the human, just a bunch of pixels.
2. No support for moving a workflow to a different environment that shows the visuals differently on the screen in terms of pixels or with a different timing/animation. 

With version 2 I will (besides improving the implementation of the API in many aspects) address these 2 areas:
at 1: allow to add more information to a visual, that allows to handle it in different situations (other rendering or background, color variants)
at 2: allow to work with image sets for different environments and support for the setup of these different sets based on an existing workflow

I think this will increase the usability of SikuliX, while staying
manageable for me.

Nevertheless: Any ideas or contributions are always welcome.

-- 
You received this bug notification because you are a member of Sikuli
Drivers, which is subscribed to Sikuli.
https://bugs.launchpad.net/bugs/1408937

Title:
  [request] Self learning: Should be possible to recapture a not found
  image on the fly and retry

Status in Sikuli:
  In Progress

Bug description:
  Hi,

  I was thinking of how machine learning can be used to improve the automated scripts and how we can make the script learn.
  I automate SAP PC resolutions and no matter what logic you write, there will be some day that an unexpected error will come.
  We can not control that.
  But I was thinking, what if we can write a logic so that if suppose a screenshot for error is not recognized and an exception occurs:
  1) A screen pop ups asking you to maybe take a screenshot of the new error.
  2) It saves that screenshot and then asks for you to select some options which will be predefined..like 1)repeat 2)wait ...so on
  3)next time when the script runs it won't ask you for this type of error.

  Although I can keep on updating the code when the error occurs,but I
  would like to implement this so that any other non programmer is also
  able to easily update the steps and update the script.

  please suggest if someone know any idea to implement it ,or any other
  idea that is actually self learning.

To manage notifications about this bug go to:
https://bugs.launchpad.net/sikuli/+bug/1408937/+subscriptions