sikuli-driver team mailing list archive

[joseytw <question235137@xxxxxxxxxxxxxxxxxxxxx>]

New question #235137 on Sikuli:
https://answers.launchpad.net/sikuli/+question/235137

Hello,

I am a relative newcomer to Java coding and Sikuli both so please keep that in mind as you try to guide me on my way!  Also, before coming here, I searched through existing questions on this site and many others, but have been unable to find something that explains a solution in a way that I understand.

Using Eclipse, I am attempting to write stand alone executable in Java that searches for images and clicks on them using org.sikuli.script classes but I cannot seem to get either an executable jar or exe version of my code to match images on-screen.  In Eclipse, when I create a pattern using relative path names the script matches the image on-screen.  For example, if I do:

Pattern imagePattern = new Pattern("src/Images/PizzleField.PNG");	 
or
Pattern imagePattern = new Pattern("bin/Images/PizzleField.PNG");

Then run my script within Eclipse, the script will find the above image without a problem.  But, if I right click my project and Export as a runnable JAR file then attempt to run that JAR file, the image is no longer found.  If I unzip the executable JAR, I can see that the Images directory with all of the images is there so the image are definitely being added to the JAR file.  My research has led to look at using something along the lines of:

this.getClass().getClassLoader().getResource("Images/PizzleField.PNG");
 
to handle resources that are stored in a JAR file.  Since it looks like I can create a Pattern using a BufferedImage, I have tried to use that to access and manipulate the images in my executable JAR file.  Here is the code I am currently toying with to try and get this to work in Eclipse:

public boolean test() throws Exception {		
			
		URL imageURL = this.getClass().getClassLoader().getResource("Images/PizzleField.PNG");
		String imageString = imageURL.toString();
		BufferedImage imageBuffered = ImageIO.read(imageURL);		
		
		System.out.println("imageURL is: " + imageURL);
		System.out.println("imageString is: " + imageString);
		System.out.println("imageBuffered is: " + imageBuffered);		
		
		Pattern imagePattern	= new Pattern(imageBuffered);    //("bin/Images/PizzleField.PNG");		
		
		Screen newScreen = new Screen();
		float floatPercentage = convertIntMatchToFloatMatch(80);
		System.out.println("=====Searching for image: " + imageBuffered);    //"bin/Images/PizzleField.PNG");
		if(newScreen.exists(imagePattern.similar(floatPercentage), 3) != null){
			System.out.println("+++++Found image        : " + imagePattern);
		}
		else{
			System.out.println("ERROR: Could not find an onscreen match for the following image ----> " + imagePattern);
		}
}

When I run that code in Eclipse, the output I get is:

imageURL is: file:/C:/eclipseprojects/ffauto/ffauto/bin/Images/PizzleField.PNG
imageString is: file:/C:/eclipseprojects/ffauto/ffauto/bin/Images/PizzleField.PNG
imageBuffered is: BufferedImage@7646bb9f: type = 6 ColorModel: #pixelBits = 32 numComponents = 4 color space = java.awt.color.ICC_ColorSpace@1dc80063 transparency = 3 has alpha = true isAlphaPre = false ByteInterleavedRaster: width = 326 height = 22 #numDataElements 4 dataOff[0] = 3
=====Searching for image: BufferedImage@7646bb9f: type = 6 ColorModel: #pixelBits = 32 numComponents = 4 color space = java.awt.color.ICC_ColorSpace@1dc80063 transparency = 3 has alpha = true isAlphaPre = false ByteInterleavedRaster: width = 326 height = 22 #numDataElements 4 dataOff[0] = 3
ERROR: Could not find an onscreen match for the following image ----> P(-- BufferedImage --) S: 0.8

It looks like the imagePattern using the buffered image displays the contents of the image in the console log, but it never finds a match.  If I change:

Pattern imagePattern = new Pattern(imageBuffered);
to
Pattern imagePattern = new Pattern("bin/Images/PizzleField.PNG");

so that the pattern is based on a String instead of a BufferedImage, then a match is found on-screen.  

What am I doing wrong in the code above that is preventing my BufferedImage based Pattern to fail to find a match? 

My Project Heirarchy is:

FFAuto
|
|-------src
|            |
|            |-------(default package)
|            |
|            |-------Images

Thanks in advance for any help.  If any additional details are needed please let me know!

-- 
You received this question notification because you are a member of
Sikuli Drivers, which is an answer contact for Sikuli.