← Back to team overview

sikuli-driver team mailing list archive

[Bug 1852613] [NEW] [2.0.0] Region.findText() does not work reliably (upper/lowercase, special characters, ...)

 

Public bug reported:

pre-reqs:
selenium 3.141 in Java
sikulixapi 2.0.0 jar
tess4j-4.4.1 jar

background: 
Step1:  get a screenshot of element from selenium, store it as png 
Output: image is captured good

Step2: read text from captured png using bufferedimage and textrecognizer class 
Output: Texts are read correctly from captured image

Step3: perform action on text using sikuli. consider two texts with same characters 'Password' and 'password' (notice p here)
Expected: perform action on 'Password'
Actual: performs action on 'password' (incorrect element clicked)

//sikuli instantiated as below
 Region s = new Screen(0);
 Settings.OcrTextRead=true;
 Settings.OcrTextSearch=true;
 Settings.MinSimilarity = 0.9;

String text = callScanImageocr(); //method to read text from a png file as mentioned in step 2 and it returns 'Password' correctly.
s.findText(text).click();

Please suggest and correct me if anything is wrong.

** Affects: sikuli
     Importance: Medium
         Status: In Progress

** Changed in: sikuli
       Status: New => In Progress

** Changed in: sikuli
   Importance: Undecided => Medium

** Changed in: sikuli
    Milestone: None => 2.1.0

-- 
You received this bug notification because you are a member of Sikuli
Drivers, which is subscribed to Sikuli.
https://bugs.launchpad.net/bugs/1852613

Title:
  [2.0.0] Region.findText() does not work reliably (upper/lowercase,
  special characters, ...)

Status in Sikuli:
  In Progress

Bug description:
  pre-reqs:
  selenium 3.141 in Java
  sikulixapi 2.0.0 jar
  tess4j-4.4.1 jar

  background: 
  Step1:  get a screenshot of element from selenium, store it as png 
  Output: image is captured good

  Step2: read text from captured png using bufferedimage and textrecognizer class 
  Output: Texts are read correctly from captured image

  Step3: perform action on text using sikuli. consider two texts with same characters 'Password' and 'password' (notice p here)
  Expected: perform action on 'Password'
  Actual: performs action on 'password' (incorrect element clicked)

  //sikuli instantiated as below
   Region s = new Screen(0);
   Settings.OcrTextRead=true;
   Settings.OcrTextSearch=true;
   Settings.MinSimilarity = 0.9;

  String text = callScanImageocr(); //method to read text from a png file as mentioned in step 2 and it returns 'Password' correctly.
  s.findText(text).click();

  Please suggest and correct me if anything is wrong.

To manage notifications about this bug go to:
https://bugs.launchpad.net/sikuli/+bug/1852613/+subscriptions


Follow ups