Xavier Hinault recently released a new computer vision library for Processing, based on JavaCV and OpenCV 2: JavacvPro. This is a great contribution to the community, since it appears that the development of the original OpenCV library for Processing has stalled, without moving beyond OpenCV 1.0 support. JavacvPro is based on the very solid JavaCV wrappers by Samuel Audet, which provide access to the latest version of OpenCV (2.3.1 at the time of writing this), and in fact also allows to use other computer vision frameworks like OpenKinect, and ARToolKit. I did some testing of JavacvPro (version 0.3) on Windows, Mac and Linux, and the results are very promising as I was able to use the library on the three platforms. Xavier has also included many examples in the library package that show how to use it various features.
The basic requirement to use JavacvPro is to install OpenCV 2.3.1. The installation process depends on the platform, fortunately there are several online resources to figure this out. What I found is the following:
- Windows installation from pre-compiled binaries: http://code.google.com/p/javacv/wiki/Windows7AndOpenCV
- Linux install from source: http://www.mon-club-elec.fr/mes_docs/docs_opencv/ma_doc_opencv_install_opencv_ubuntu.pdf
- MacOSX (also from source): http://opencv.willowgarage.com/wiki/MacosxInstallGuide
On Windows and Linux, I used the latest stable version of Processing, 1.5.1. However, on MacOSX the library only works with Java in 64-bit mode, which is supported in the latest alphas of Processing 2.0. I tested it on 2.0.a4, changing the “Launch programs in” option to 64-bit in the Preferences menu:
The homepage of JavacvPro also has several videos (in French) demonstrating different use examples, like this one for finger detection:
codeanticode 
Hi Andres… have you by chance tested if OpenCV 2.3.1 is backwards compatible with the OpenCV 1.0, and/or the original OpenCV library (and the various blobDetection libraries, jMyron, etc.) ?? Interested to know this, as I have a few sketches that use these, and it might be extremely difficult ro regress…
Thanks!
~ Jesse
Answered my own question… no, the older OpenCV or BlobDetection libraries will not work on 2.0… but will still work on 1.5.1
I think that most older computer vision libraries that only depend on general PGraphics functionality without making reference to more specific renderers should work on Processing 2.0
hi Andrés,
I tested the javaCvPro it’s really promising unlike the openCv for processing from ubaa.net which is stopped in time. I have one question, I didn’t find any way to contact Xavier Hinault he even hasn’t an email on the website nor twitter… have you his contact?
For issues concerning JavaCvPro use this email address: support@mon-club-elec.fr
Pingback: The pest of having a 64 bit Linux laptop and OpenCV | In my humble opinion…
Pingback: The pain of having a 64 bit Linux laptop and OpenCV | In my humble opinion…
i would like to thank xavier for all his effort to produce javacvpro
i just request him not to abandon it like the earlier opencv processing library.
Xavier just put the source code of javacvPro in a github repository:
https://github.com/sensor56/javacvPro
Hi, I tryed to follow your example and installed everything. But Processing still says things like
Exception in thread “Animation Thread” java.lang.UnsatisfiedLinkError: /private/var/folders/cc/7vz5qp4x1ls4h2xcdsbtm1n80000gp/T/libjniopencv_core6456595444068223362.dylib: Library not loaded: lib/libopencv_core.2.3.dylib Referenced from: /private/var/folders/cc/7vz5qp4x1ls4h2xcdsbtm1n80000gp/T/libjniopencv_core6456595444068223362.dylib Reason: image not found
But the library is installed with Port correctly.
I’m using latest beta of Processing, on Lion. Any suggestion?
Are you installing opencv using MacPorts?
Yes,
Installed successfully (in line of theory…).
Use the installation “from source” instead of macports. The problem with the latter is that it puts the opencv libraries in a location where javacvpro don’t look at.
i use opencv2.3.1 under visual studio 2008. I want to know how I can use JavacvPro so in this case??
please help me
JavacvPro is a Processing (Java-based) library, so you can either use it from the PDE (the Processing environment) or from a full fledged Java IDE such as Eclipse or Netbeans. I don’t think you can use it from Visual Studio.
I also installed OpenCV 2.3 successfully through MacPorts but am having trouble using this library. Which directory should OpenCV2.3 be installed into? Mine is located in /opt/local/lib/
thanks
Update: The newest version of JavaCVPro should work. Macports installs into /opt/local instead of /usr/local (brew installs here) and I *think the older versions weren’t looking there.
Ok, I install it from source, and the default location is /usr/local/lib/
Pingback: OpenCV mit Processing Installation auf Ubuntu 12.04 « processing – tutorial
javacvpro on mac mountan lion / processing 2.0a8:
I installed
– opencv 2x using brew (correctly linked libs ->/usr/local/lib)
– processing 2.0a8 (set to 64bit)
– created a local folder and installed javacv (binaries from http://code.google.com/p/javacv/downloads/detail?name=javacv-0.2-bin.zip&can=2&q=)
– added the classpath to it (export CLASSPATH=$CLASSPATH:~/tinkering/java/lib/javacv-bin)
– installed javacvpro to the local libraries folder of processing.
When I try to start a sample from the javacvpro package, I receive the following error:
Exception in thread “Animation Thread” java.lang.UnsatisfiedLinkError: /private/var/folders/dd/h2g1lb2d10b5vmd320lmscgr0000gn/T/libjniopencv_core3440981410919750257.dylib: Library not loaded: /opt/local/lib/libopencv_core.2.3.dylib Referenced from: /private/var/folders/dd/h2g1lb2d10b5vmd320lmscgr0000gn/T/libjniopencv_core3440981410919750257.dylib Reason: image not found
I don’t understand, why it’s searching in /opt/local/lib and why it seaches 2.3. There are only libopencv_core.dylib and a libopencv_core.2.4.dylib there..
I am not a java guru and I hope, someone with more skills can help :-).
I found the problem… brew installed the wrong version of the lib..
cd /usr/local
git checkout 071c3eb Library/Formula/opencv.rb
brew unlink opencv
brew install opencv
brew versions opencv
displays all the possible versions – I used 2.3.1a
that’s it :-)!
Great to know it worked, thanks a lot for sharing the solution!
No such Gstreamer factory v412src. All code runs fine except the video processing ones give this error.
Using windows 64/processing 1.5.1/openCV 2.4.1
What version of GSVideo are you using?
Hi! I’m trying to use opencvpro in a Mountain Lion OSX with OpenCV 2.4.2 installed. As I see, the compiled version of the library searches for libopencv_core.2.3.dylib and not the libopencv_core.2.4.dylib that is the one I got from macports. Is there any workaround for this?
Thanks, F.
I made a port to OpenCV 2.4. Does anybody has the Samuel Audet’s email? It will be good to send him the updated files.
Just make a posting on the JavaCV discussion forum, Samuel Audet is very responsive there.
Hello Federico, it is probably best to report issues about the javacvPro library directly on the Processing forum, or by emailing the author, Xavier Hinault, at the address listed in the library webpage (support_at_mon-club-elec_point_fr). However, this seems more like an issue with JavaCV itself…
Pingback: Proyecto e instalación de la librería OpenCV 2 para Processing | Laboratori de programació creativa
There seems to be a major memory leak/usage with javacvPro, especially with large resolution captures. I can increase the memory to slow it down, but the sketch will eventually crash. Any ideas on how to fix? Also would love to know how to port to OpenCV 2.4!
Thanks!
Hello, have you tried to contact the author of JavacvPro? What version gives produces the memory leak? I just checked the homepage of the lib and a recent 0.5 release is mentioned.
Did you try the compiled version I made? Is here: http://www.ludic.cc/dwn/javacvPro_4_javacv_02_beta.zip
Please, let me know if it doesn’t work.
Ah, that works great with openCV 2.4, but I’m still getting a major memory hit. When I open the Activity Monitor the memory used by the sketch goes up 100MB a second until it runs out. Any idea how to stop that?
hey need urgent help……………
on site
http://ubaa.net/shared/process…
http://opencvlibrary.sourcefor…
linux installation guidelines are missing ….Will u please guide me..x
Hello, I’m not using that opencv library so unfortunately cannot give you much help. You should check the processing forum, where other people can answer to your question.
Hi All,
i tried to improve the memory management of javacvPro and managed to reduce a lot the memory leaks.
you can download javacvPro-0.5b from here: http://www.imal.org/yves/download/javacvPro0.5b.zip
In the 3 supplied Processing 2.0b examples (simple video capture/display, face detect and blob), there is no memory leaks at all.
(tested on OSX 10.8.2, openCV 2.4.3 and Processing 2.0b7)
best,
Yves, Nice work! Memory consumption starts for me around 350MB and creeps up to 405MB and then hovers there nicely. Performance even seems better- much appreciated!
Hello Yves, this is great, thanks so much for your contribution! A couple of months ago I took Xavier Hinault’s original 0.5 package and bundled it with the 64bit binaries of the OpenCV libs (this requires some modifications to the dylib files using install_name_tool), and then I put the modified package here. The advantage of this package is that it doesn’t require additional installs of the OpenCV libraries. It would be nice if the same could be done with our patched version, I will try if I get some time to work on it. Another interesting thing to note in relation to OpenCV and Java is that the developers of OpenCV now officially include/support Java bindings. This might be relevant for the future development of OpenCV libraries for Processing.
Andreas, i am not an expert developer such as you. Yes of course, your bundle is really smart and would help a lot!
Can’t we just replace the javacvPro.jar with my javacvPro.jar?
Anyway, the only mods i made are in the original src file openCV.java are clearly marked with ‘// YVES’.
There is stil something that a java expert may easily solve:
why do i have to write this imageP(PImage imgOut) method? or in other words, why in the line 337 which creates the PImage, this PImage is not garbage collected ?
Hi Andreas and all,
i’ve updated my javacvPro-0.5b here: http://www.imal.org/yves/download/javacvPro0.5b.zip
In OpenCV.java (v0.5), i corrected various opencv memory management errors after studying the exemple code of Samuel Audet, the author of javacv. All my mods are marked with comments ‘// YVES’
But the main memory leak is indeed a bug in Processing itself, the well known PImage memory leak, see for instance https://github.com/processing/processing/issues/1391
(usually solved by calling g.removeCache() )
Xavier’s original code in javacvPro-0.5 heavily uses the new PImage(), mainly in his method toPImage( ) (see line 337 of my code)
toPImage is called by all his opencv.image(), opencv.getBuffer*(), opencv.getMemory*(), so the leaks are huge mainly in a Processing draw loop.
You could can get rid of these leaks by calling in your draw loop:
g.removeCache()
Or you can use the new opencv methods i created:
alternative method opencv.imageP(PImage p), opencv.getBuffer*P(PImage p), opencv.getMemory*P(PImage p) where the parameter is a PImage already allocated by your Processing code. The returned PImage is indeed this PImage parameter where the pixels array has been updated.
This is of course particularly efficient if you can allocate the PImage just once, globally.
See the Processing examples.
To use this version with Andreas bundle (http://sourceforge.net/projects/gsvideo/files/opencv/) , just replace the javacvPro.jar with mine.
Pingback: SEN, Processing and Experiments in OpenCV | opensen