The override of tests.jvms in benchamrk mpodule never worked, so after 2 years of permanent testing with multiple JVMs, the tests are safe. The override must be placed *before* the inclusion of module-build/common-build.xml, otherwise its to late to redefine the property.
lucene/dev/trunk/lucene/benchmark/build.xml