← Back to team overview

sikuli-driver team mailing list archive

[Bug 1203989] Re: [request] use a saved image the same way as a screen (virtual screen)

 

This is principally not possible with the current implementation: you
can only use one level of find operations with a Finder() and you cannot
restrict the Finders find operation to a subregion of the given image.

With this sequence of primary and secondary find operations on a real
screen, with every find, there will be made a new screenshot and
internally a new Finder(screenshot) for the respective area/subarea.

This does not happen in your Finder based solution with
current_match.find( field1 ) (which should be current_match.exists( field1 ), to make the if work ;-)

current_match is a region in the image, relative to its top left corner,
but with current_match.find( field1 ) it is used as coordinates relative
to the screen (the match currently does not "know", that it was made
from a Finder(image).find() operation).

So if you want to solve this with a captured image, then you have to use
Finder().findAll() for all objects and compare their coordinates, to
find out, wether one match lies inside of another match (version 1.0.0
has the respective functions like region.contains(another_region) )

I think your approach is very interesting and Sikuli should have the possibility, to use a stored image the same way it uses a screen.
I put it on the request list: use image as a virtual screen

-- 
You received this bug notification because you are a member of Sikuli
Drivers, which is subscribed to Sikuli.
https://bugs.launchpad.net/bugs/1203989

Title:
  [request] use a saved image the same way as a screen (virtual screen)

Status in Sikuli:
  New

Bug description:
  Attempting to scan a previously saved screen capture.  The screen
  capture contains multiple (similar) blocks of data.  Each block
  contains three fields. Field 1 is a unique identifier, Field 2 will
  vary and must be ignored, Field 3 contains the content that will
  pass/fail this test step, but that content can also appear in other
  blocks of data.

  Desired Algorithm Pseudo Code:
  full_block = Pattern( "image1.png" ).similar(0.70) # image of block to find
  field1 = Pattern("subimage1.png").similar(0.95) # a sub-image of image1.png, can uniquely identify the block
  field2 = Pattern("subimage2.png") # sub-image of image1.png, a field to ignore, we won't do anything with it
  field3 = Pattern("subimage3.png").similar(0.95) # sub-image of image1.png, important field (can exist in multiple blocks, but we're checking to see if it exists in this block)

  f = Finder( "path\previouslyCapturedImage.png" )
  f.findAll(full_block) # search previouslyCapturedImage.png, will return multiple matches 
  while f.hasNext():
        current_match = f.next() 
        if current_match.find( field1 ):
              # We've uniquely the block, check unique identifier field1
              if current_match.find(field3):
                     print "Correct information found!"
              else:
                     print "Incorrect information found!"
              # We can exit now because we found unique identifier field1
              break
        else:
              # no match on unique identifier field 1, this means current_match is a different block, so skip to the next one
              continue

  This style of code works when using the Screen as the target of the
  find commands, but doesn't appear to work when using a previously
  saved image of the screen as the target. Any ideas on how to
  accomplish something similar? If my example isn't clear enough please
  let me know.

To manage notifications about this bug go to:
https://bugs.launchpad.net/sikuli/+bug/1203989/+subscriptions


References