Evolutionary Algorithm Study

This webpage contains the experimental material used for the paper titled: “An Empirical Evaluation of Evolutionary Algorithms for Test Suite Generation“, accepted for publication at the international research Symposium on Search-Based Software Engineering (SSBSE) 2017, and an extended version under revision at Information and Software Technology (IST) journal.

Abstract

Context: Evolutionary algorithms have been shown to be effective at generating unit test suites optimised for code coverage. While many specific aspects of these algorithms have been evaluated in detail (e.g., test length and different kinds of techniques aimed at improving performance, like seeding), the influence of the choice of evolutionary algorithm has to date seen less attention in the literature.

Objective: Since it is theoretically impossible to design an algorithm that is the best on all possible problems, a common approach in software engineering problems is to first try the most common algorithm, a Genetic Algorithm, and only afterwards try to refine it or compare it with other algorithms to see if any of them is more suited for the addressed problem. The objective of this paper is to perform this analysis, in order to shed light on the influence of the search algorithm applied for unit test generation.

Method: We empirically evaluate thirteen different evolutionary algorithms and two random approaches on a selection of non-trivial open source classes. All algorithms are implemented in the EvoSuite test generation tool, which includes recent optimisations such as the use of an archive during the search and optimisation for multiple coverage criteria.

Results: Our study shows that the use of a test archive makes evolutionary algorithms clearly better than random testing, and it confirms that the DynaMOSA many-objective search algorithm is the most effective algorithm for unit test generation.

Conclusions: Our results show that the choice of algorithm can have a substantial influence on the performance of whole test suite optimisation. Although we can make a recommendation on which algorithm to use in practice, no algorithm is clearly superior in all cases, suggesting future work on improved search algorithms for unit test generation.

Available Files:

How to cite?

Conference paper

@incollection{CamposSSBSE2017,
  author = {Campos, Jos{\'e} and Ge, Yan and Fraser, Gordon and Eler, Marcelo and Arcuri, Andrea},
  title = {{An Empirical Evaluation of Evolutionary Algorithms for Test Suite Generation}},
  series = {},
  year = {2017},
  isbn = {978-3-319-66299-2},
  booktitle = {Proceedings of the 9th International Symposium Search-Based Software Engineering (SSBSE)},
  volume = {},
  editor = {Menzies, Tim and Petke, Justyna},
  doi = {10.1007/978-3-319-66299-2_3},
  url = {https://doi.org/10.1007/978-3-319-66299-2_3},
  publisher = {Springer International Publishing},
  address = {Cham},
  keywords = {},
  pages = {33--48},
}

Journal extension

TBD

Extra data analysis:

The following Table reports the rank of each algorithm (where Rank 1 represents the algorithm that achieved the highest coverage) per class under test and on average, and it also reports the χ2 and p-value of the Friedman test for both single and multiple criteria. Overall, DynaMOSA is ranked first for both single and multiple criteria with χ2 = 1444.49, p-value < 0.0001, and χ2 = 1761.77, p-value = 0, respectively.

CUT Random Search Random Testing Standard GA Monotonic GA Steady-State GA 1 + (λ, λ) EA (μ + λ) EA (μ, λ) EA Breeder GA Cellular GA CRO MOSA DynaMOSA LIPS MIO
Search budget of 60 seconds – Single-criteria
t.TederFrame 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
f.Fps370Panel 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
o.j.j.a.c.p.DefaultPhdReadTag 10 13 6 1.5 11 12 3 1.5 8 14 9 5 4 15 7
o.j.j.a.c.f.Distance 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
m.u.DisplayableListPanel 13.5 7 1 11 3 8 10 2 9 13.5 15 4 5 12 6
m.p.MacawWorkBench 2.5 2.5 14.5 7 10 10 12 1 14.5 7 13 7 5 4 10
n.s.l.LagoonCLI 5 9 8 6 12 4 1 2 13 15 11 7 3 14 10
n.s.l.LagoonGUI 7 10 2 1 4 3 6 8 12 14 13 9 11 15 5
i.BinaryCalculate 11 14 4 3 12 10 5 6 8 13 7 2 1 15 9
i.WhoIS 12 8 1 2 3 6 4 9 7 14 5 11 13 15 10
b.c.DefaultSettingsController 14 13 3 4 1 12 6 2 10 11 15 7.5 5 9 7.5
b.m.Drink 8 11 12 13 6 7 4 3 10 15 9 1 2 14 5
o.p.g.b.t.c.JPodThmbnailCallable 14 12 4 7 2 11 6 5 8 13 15 1 3 9 10
o.a.DefaultRepositoryManager 10 10 1 10 2 10 10 3 10 10 10 10 10 4 10
c.h.s.c.Base64 7 11 12 4 2 8 4 4 9 1 10 13 14 6 15
o.p.s.l.DefaultLuceneDocumentFactory 10 14 5 8 3 4 1 2 13 15 11 7 6 12 9
o.p.o.CreditCardInfo 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
c.i.s.HTMLFilter 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
v.h.m.a.CreateMovePdfAction 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
v.h.m.x.HandballModelReader 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
j.p.PlotAxis 4 11.5 11.5 2 2 15 7 10 5.5 8 2 13 5.5 9 14
d.t.u.w.a.CycleHandler 15 11 3 4 2 8 7 1 12 13 14 9 10 5 6
d.t.u.w.a.CategoryDescendantsIterator 14 13 6 7 11 10 8 9 5 12 15 2 2 4 2
d.t.u.w.a.WikipediaInfo 12 14 2 7 9 10 1 3 11 15 8 6 5 13 4
d.t.u.w.a.Title 13.5 4.5 4.5 10 4.5 4.5 4.5 10 4.5 15 13.5 10 12 4.5 4.5
o.j.c.p.XYPlot 2 12 9 4 8 15 3 6 13 7 11 5 1 14 10
o.j.c.r.c.AbstractCategoryItemRenderer 4 11 9 8 10 15 6 5 12 13 7 2 1 14 3
o.j.c.r.GrayPaintScale 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
o.j.c.p.MultiplePiePlot 10 13 4 6 12 14 5 3 8 11 7 2 1 15 9
o.j.c.p.ValueMarker 1 9.5 9.5 9.5 2 9.5 9.5 9.5 9.5 9.5 9.5 9.5 3.5 3.5 15
o.j.d.c.DefaultIntervalCategoryDataset 5 12 4 6 10 15 8 2 11 13 9 3 1 14 7
o.j.c.r.c.MinMaxCategoryRenderer 14 13 2 7 3 12 6 10 11 9 1 4 5 15 8
o.j.c.a.Axis 4 11 5 12 6 15 10 7 13 8 9 2 1 14 3
o.j.d.t.TimeSeries 9 12 6 5 11 15 7 3 10 13 8 2 1 14 4
o.j.c.r.c.StatisticalBarRenderer 14 13 6 5 4 11 8 7 12 9 3 2 1 15 10
o.j.d.t.TimePeriodValues 12 14 3 4 11 15 9 5 7 13 6 2 1 10 8
o.j.d.g.DatasetUtilities 1 12 10 8 6 15 7 5 13 11 9 3 2 14 4
c.b.e.c.t.MessageList 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
c.g.c.b.Joiner 14 15 3 8 4.5 13 2 11 12 10 9 1 4.5 7 6
c.g.c.m.BigIntegerMath 9 11 1 7 3 15 2 14 10 13 6 4 8 12 5
c.g.c.b.Utf8 13 14 6 5 11 12 3 4 9 10 8 1 2 15 7
c.g.c.b.Splitter 13 15 2 6 11 10 5 4 9 14 7 1 3 12 8
c.g.c.b.Suppliers 8 11 12 3 7 9 4 5 15 6 13 2 1 10 14
c.g.c.b.CharMatcher 6 14 11 12 7 15 4 3 13 10 5 2 1 9 8
c.g.c.c.CacheBuilderSpec 9 12 4 5 10 15 2 1 11 14 8 6 7 13 3
c.g.c.b.Predicates 9 15 10 3 8 12 6 7 13 5 11 2 1 4 14
c.g.c.b.SmallCharMatcher 12 13 8 5 9 5 7 2 5 10 11 2 2 14 15
c.g.c.u.c.Monitor 1 5 7 8 12 15 6 4 13 11 10 3 2 14 9
s.C.g.ConsumerGUI 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
s.C.ConsumerAgent 4 12 6 5 10 13 2 11 9 14 8 3 1 15 7
c.a.i.u.MainMenu 8.5 8.5 8.5 8.5 8.5 8.5 8.5 1 8.5 8.5 8.5 8.5 8.5 8.5 8.5
c.a.i.u.XmlElement 2 3 11 8 9 15 7 5 10 12 6 4 1 14 13
c.w.s.XPathLexer 2 14 6 7 8 15 5 3 11 12 10 4 1 13 9
o.s.Axis 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
Menu 5.5 5.5 5.5 12.5 12.5 5.5 5.5 5.5 5.5 14 11 5.5 5.5 15 5.5
Convert 5 5 5 5 13 5 11 11 5 15 5 5 5 14 11
Capture 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
o.j.l.UserManagement 5 11 7 6 9 15 3 2 12 13 10 8 4 14 1
o.j.l.Login 3 6 7 10 11 14 8 4 12 13 9 2 1 15 5
o.j.l.p.FromClient 14 15 7 9 12 4 8 5 3 13 10 1 2 11 6
j.Main 12 10 7 13 14 15 8 3 11 6 5 4 1 9 2
j.Variable 2 12 5 1 6 9 8 10 4 3 7 14 15 13 11
f.u.StringUtils 10 12 1.5 4 8 15 6 9 11 14 5 1.5 3 13 7
f.u.j.JDBCUtils 8 12 2 5 3 14 1 10 6 13 4 11 9 15 7
o.j.t.MutablePeriod 13 4 2.5 6 2.5 15 7 1 5 10 14 8 9 12 11
o.j.t.c.BasicMonthOfYearDateTimeField 4 11 2 7 9 14 3 1 12 13 8 6 5 15 10
o.j.t.MutableDateTime 6 9 2 8 4 15 3 1 12 10 5 11 7 14 13
o.j.t.b.BaseSingleFieldPeriod 8 13 2 6 11 15 3 5 9 12 7 1 4 14 10
o.j.t.DateTimeZone 3 11 9 6 8 15 5 4 13 12 10 2 1 14 7
o.j.t.f.DateTimeFormatterBuilder 2 12 11 8 4 15 6 5 13 7 10 3 1 14 9
o.j.t.Period 9 10 2 5 3 15 4 1 12 13 8 7 6 14 11
o.j.t.t.ZoneInfoCompiler 8 12 7 2 6 15 1 3 13 11 9 5 10 14 4
o.j.t.c.LimitChronology 5 9 11 4 10 14 7 3 13 12 6 2 1 15 8
o.j.t.f.PeriodFormatterBuilder 3 13 10 7 8 15 6 5 12 9 11 2 1 14 4
o.j.t.f.DateTimeFormatter 1 7 6 9 11 15 8 5 12 13 10 2 3 14 4
o.j.t.Partial 4 13 7 5 10 15 8 6 12 11 9 2 1 14 3
o.j.t.b.BasePeriod 7 11 5 4 12 15 6 3 8 13 9 1 2 14 10
o.f.j.FBProcedureCall 6 10 3 5 11 13 7 4 12 14 8 1 2 15 9
o.f.e.EncodingFactory 3 9 7 7 11 15 7 3 12.5 14 10 3 3 12.5 3
o.m.j.Parser 3 13 9 8 10 15 6 5 14 12 7 2 1 4 11
c.y.p.y.c.ScriptOrFnScope 3 1.5 4 8 8 8 8 1.5 8 8 13 12 8 15 14
c.s.m.s.a.s.J2EEApplicationAlias 12 11 4 2.5 10 15 1 6 2.5 13 5 7 8 14 9
c.s.m.s.a.s.HeapInfo 12 11 1 10 4 14 7 2 8 13 6 5 3 15 9
d.c.g.InternalChatFrame 11 11 2 11 3 11 5 1 11 11 11 11 6 4 11
d.s.Handler 2 4 6 10 9 14 8 5 12 13 11 3 1 15 7
b.u.Queue 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
b.o.Verse 6.5 6.5 6.5 6.5 6.5 13 6.5 6.5 6.5 6.5 6.5 6.5 6.5 15 14
c.n.ForwardingObserver 9 10 4 8 13 7 1 5 12 15 11 6 3 14 2
s.ServerGameModel 3 2 13.5 10 13.5 7 9 5 11 13.5 13.5 4 8 6 1
c.l.s.c.SimpleComboBox 9 11 4 7 3 10 8 5 15 12 6 1.5 1.5 13 14
c.l.i.DirectoryScanner 8 12 5 6 11 14 4 3 10 13 9 2 1 15 7
c.l.e.SimpleKeyListenerHelper 6.5 6.5 3 9.5 8 12 3 3 11 15 14 3 3 13 9.5
u.c.s.JSJshop 13 14 2 6 7 9 5 1 3 8 4 10 12 15 11
u.c.s.JSTerm 12 13 5 3 11 15 7 4 9 2 6 1 8 14 10
u.c.s.JSPredicateForm 11 13 6 8 12 14 10 3 4 9 7 1 2 15 5
u.c.s.JSState 14 15 1 6 8 10 4 7 9 12 5 2 3 11 13
n.s.l.d.TimeOfDay 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
o.j.Expression 7 14 2 4 8 15 3 1 5 10 11 9 6 13 12
d.o.f.s.BattleStatistics 12 13 4 5 10 15 6 2 9 11 7 1 3 14 8
d.o.f.m.i.SimpleSector 11 13 5 1 12 10 2.5 2.5 9 14 8 4 7 15 6
b.battlecryGUI 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
b.bcGenerator 6 8 13 4 9 7 1 5 12 14 10 2 3 15 11
e.m.c.j.JCLO 1 10 6 8 12 15 4 3 11 14 9 2 7 13 5
c.l.p.k.s.f.i.FilterMapping 9 11 6 5 13 15 4 3 10 14 8 1 2 12 7
c.l.p.d.m.DLSyncWrapper 3 7.5 12 3 3 11 7.5 9 13 6 14 3 10 3 15
d.p.e.e.ExplorerFrameEventConverter 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
d.p.e.m.AttributeModelComparator 13 15 2 2 6 11 10 4.5 12 14 2 7 4.5 8 9
c.f.TucsonSimple 12 13 6 1 7 8 2 3 11 14 9 5 4 15 10
c.p.j.t.JVCParserTokenManager 1 6 5 3 10 15 8 2 9 11 7 12 4 14 13
c.p.j.t.JVCParser 4 7 3 5 12 14 2 9 11 13 10 1 8 15 6
c.p.j.t.TokenMgrError 13.5 15 3 5 6 10 2 1 4 9 7 12 11 8 13.5
w.a.ClassWriter 10 12 5 6 11 15 8 4 9 13 7 2 1 14 3
w.a.FieldWriter 12 14 2.5 2.5 10 15 6.5 2.5 6.5 11 5 8 2.5 13 9
w.a.ClassReader 13 14 4 5 9 12 8 7 3 10 6 2 1 15 11
f.v.n.t.o.f.DaikonFormatter 5 12 7 4 13 9 6 8 10 14 11 2 1 15 3
J.F.FoxHuntFrame 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
J.F.HuntDisplay 11 13 9 3 4 2 1 6 12 14 15 7 10 5 8
n.s.x.b.c.MessageHandler 13 12 1 6 2 11 5 3 9 15 4 7 8 10 14
n.s.x.b.c.r.XBUSClassLoader 9 10 11 3 5 7 2 1 12 15 13 8 4 14 6
o.t.Region 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 15
m.s.SSHSCPGUIThread 3 9 6 7 12 14 8 5 11 13 10 2 1 15 4
d.p.c.DefaultChart 9 11 4 6.5 10 1.5 13 5 3 15 6.5 1.5 8 14 12
d.p.c.CoordSystemUtilities 10 12 4 7 8 15 6 5 11 13 9 2 1 14 3
n.s.s.c.p.GlobalPreferencesSheet 15 14 6.5 6.5 6.5 13 6.5 6.5 6.5 6.5 6.5 6.5 6.5 6.5 6.5
n.s.s.f.g.CascadeInternalFramePositioner 12 14 3 5 4 10 2 1 11 13 15 7 6 9 8
d.d.p.ArgsParser 11 12 7 6 13 10 1 4 9 14 8 5 2 15 3
n.s.s.m.Table 14 15 1 9 5 10 2 3 4 11 6 7 8 12 13
n.s.s.m.x.TableMeta 14 12 8 7 2 11 5 1 9 15 10 3 4 6 13
a.p.t.JDayChooser 3 10 5 4 12 15 9 11 8 13 6 2 1 14 7
h.HttpAnalyzerView 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
h.Password 9 3.5 3.5 9 3.5 15 9 12.5 9 3.5 9 14 12.5 3.5 3.5
f.p.j.g.a.IndexFileAction 7.5 7.5 1 7.5 7.5 7.5 7.5 7.5 14 7.5 7.5 7.5 7.5 15 7.5
f.p.j.g.v.JTailPanel 13 12 2 5 9 3 6 1 8 14 15 4 10 11 7
o.t.s.e.turkishStemmer 8 12 6 3 11 9 5 2 7 13 4 10 1 15 14
o.t.s.e.englishStemmer 11 12 5 6 10 15 3 1 8 13 7 4 2 14 9
o.t.s.e.italianStemmer 8 11 5 3 12 13 2 4 9 15 7 6 1 14 10
J.m.s.ExpressionParser 13 14 7 3 12 15 6 9 4 5 8 2 1 11 10
J.m.s.SimpleCharStream 10 11 7 8 12 15 4 5 9 14 6 3 1 13 2
J.m.SpecialMath 7 12 3 6 4 14 2 1 9 10 5 13 11 15 8
n.v.a.g.r.RobotRenderer 13 15 1 7 4.5 12 4.5 3 10 14 8 6 2 9 11
n.v.a.r.Robot 4.5 9 3 7 4.5 15 1 2 10 13 11.5 8 6 14 11.5
o.e.j.n.s.SocketRequestInfo 13 10 3 3 3 15 6 3 9 11.5 7 8 3 14 11.5
o.e.j.n.c.DefaultConnectionPool 1 2 7 9 12 14 11 8 6 13 10 3 5 15 4
o.j.Verifier 8 12 6 5 9 15 7 3 11 13 10 2 1 14 4
o.j.t.JDOMResult 2 8 8 1 8 13 8 8 8 14 8 8 8 15 3
o.j.u.NamespaceStack 11 13 5 4 10 14 1 2 9 12 6 3 7 15 8
o.j.o.XMLOutputter 7.5 7.5 10 3.5 9 15 2 3.5 13 11 12 5 1 14 6
o.j.o.SAXOutputter 10 11 3.5 3.5 8 15 3.5 3.5 12 13 3.5 3.5 7 14 9
c.s.C.J.J.JavaCharStream 4 8 7 6 12 15 5 10 11 13 9 1 2 14 3
c.s.C.J.JMCAAnalyzer 13 15 2 5 11 1 4 3 6 12 9 8 7 14 10
o.f.m.Library 10 5 11 13 8 3 9 2 6 15 12 4 7 14 1
o.f.m.v.TreeView 12 9 7 8 13 2 11 4 6 15 10 1 3 14 5
c.m.r.i.AbstractResources 11 8 1 6 13 12 5 2 3 14.5 4 7 9 14.5 10
c.d.r.s.t.WebServiceDescriptor 14 15 7 7 7 7 7 7 7 7 7 7 7 7 7
i.s.n.ClientGroup 12 13 1 7 11 14 5 3 8 10 4 9 2 15 6
s.Purchase 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 15 7.5
s.VassalRebellion 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 15 7.5
s.Battle 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
o.j.w.f.a.BasicHttpAuthenticationFilter 7.5 7.5 7.5 7.5 15 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5
o.j.u.AntPathMatcher 8 11 6 4 12 15 2 3 9 13 7 5 1 14 10
o.a.c.c.l.DoubleMetaphone 1 11 7 6 10 15 5 3 13 12 9 4 2 14 8
g.t.m.h.TByteObjectHashMap 9 12 10 5 11 15 4 3 13 8 6 1 2 14 7
g.t.m.h.TFloatObjectHashMap 8 13 11 5 9 15 4 3 12 10 6 2 1 14 7
g.t.m.h.TByteFloatHashMap 7 12 9 5 10 15 6 3 13 4 11 1 2 14 8
g.t.i.h.TFloatDoubleHash 12 13 6 1 10 14 7 2 9 3 4 8 5 15 11
g.t.d.TDoubleShortMapDecorator 9 13 2.5 2.5 7 14 11 1 8 5 10 6 4 15 12
g.t.l.l.TDoubleLinkedList 7 13 8 5 11 15 9 10 12 3 6 2 1 14 4
g.t.i.h.TFloatCharHash 8 13 7 4 11 14 9 2 10 6 5 1 3 15 12
g.t.i.h.TShortHash 11 13 2 9 12 14 8 5 4 10 7 1 3 15 6
g.t.d.TShortByteMapDecorator 3.5 5 1.5 8.5 7 14 1.5 11 3.5 8.5 12 6 10 15 13
o.a.c.m.o.u.BrentOptimizer 9 10 13 3 2 4 1 6 11 14 12 8 6 15 6
o.a.c.m.o.d.CMAESOptimizer 2 8 10 11 6 14 5 4 13 12 9 3 1 15 7
o.a.c.m.a.FunctionUtils 7 12 11 9 6 10 8 5 15 4 14 2 1 3 13
o.a.c.m.o.l.SimplexTableau 10 13 8.5 6 11 15 7 3 4 12 5 2 1 14 8.5
o.a.c.m.g.e.t.Rotation 2 9 6 3 7 15 4 1 13 11 10 5 8 14 12
o.a.c.m.l.MatrixUtils 12 13 6 4 10 15 3 8 11 9 7 2 1 14 5
o.a.c.m.g.e.o.IntervalsSet 11 15 7.5 4 1 14 5 6 10 13 7.5 2 3 12 9
o.a.c.m.d.HypergeometricDistribution 6.5 6.5 6.5 6.5 6.5 6.5 6.5 6.5 14 6.5 6.5 14 6.5 14 6.5
o.a.c.m.a.i.TricubicSplineInterpolatingFunction 3 8 13 4 9 10 5 7 14 12 11 2 1 15 6
o.a.c.m.o.n.EmbeddedRungeKuttaIntegrator 1 4 10 9 5 7 3 12 15 11 13 6 2 14 8
o.a.c.m.u.MultidimensionalCounter 5.5 5.5 5.5 5.5 5.5 12.5 5.5 5.5 15 5.5 11 5.5 14 12.5 5.5
o.a.c.m.o.g.LevenbergMarquardtOptimizer 8 12 7 4 3 11 1 5 13 15 14 10 6 2 9
o.a.c.m.f.ProperFractionFormat 12 14 5 7 10 6 2 1 9 15 8 4 3 11 13
o.a.c.m.l.SchurTransformer 12 15 6 3 9 14 7 10 13 1 8 4 2 5 11
o.a.c.m.d.f.MultivariateNormalMixtureExpectationMaximization 8 12 3 6 7 11 4 1 15 14 10 9 2 5 13
o.a.c.m.f.Fraction 13 5 4 3 7 9 1 2 6 10 8 12 15 11 14
o.a.c.m.o.AbstractIntegrator 14 10 1 2 13 9 8 4 3 12 11 5 6 15 7
o.a.c.m.l.RectangularCholeskyDecomposition 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 15 7.5 7.5 7.5 7.5 7.5 7.5
c.b.o.h.i.r.ExpressionImpl 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
c.b.a.User 7 10 9 5 12 15 11 3 8 4 13 2 1 14 6
o.h.m.s.AdvSearchDAO 3 11 6 9 8 14 4 7 12 13 10 2 1 15 5
o.h.u.InterfaceUtilitiesBean 10.5 8.5 4 4 4 13 4 4 14 12 10.5 4 4 15 8.5
g.b.Block 12 14 11 3 7.5 10 3 6 9 13 3 3 3 15 7.5
g.a.GroupAgent 11 14 4 6 9 15 5 3 13 12 8 2 1 7 10
o.q.n.s.i.NonBlockingClientHandler 2 8 7 9 11 15 4 6 12 13 10 5 1 14 3
o.q.n.s.i.BlockingClientHandler 10 12 4 2 11 13 3 1 5 14 6 8 9 15 7
o.q.u.x.QuickServerConfig 5.5 5.5 5.5 5.5 11 15 12 5.5 5.5 5.5 13 5.5 5.5 14 5.5
c.a.a.u.s.s.SWTSkinObjectContainer 4 8 5 6 11 12 10 7 9 13 14 2 1 15 3
c.a.a.u.s.f.FeatureManagerUIListener 1 3 10 13 12 7 8 6 9 14 11 4 5 15 2
jgaapGUI 3 4.5 10 12 13 7 9 6 14 15 8 1 4.5 11 2
c.j.v.ClassInfo 2 11 6 9 12 15 5 1 10 13 8 3 4 14 7
c.j.v.ClassViewer 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
n.s.x.i.OperationsHelperImpl 12 15 2 8 1 13.5 9 4 10 11 5 3 7 6 13.5
j.i.l.LevelSetNudge 1 2 13 5 12 4 8 9 10 14 11 6 3 15 7
j.i.o.ConnectedComponents 10 13 9 3 8 5 4 6 11 15 7 1 2 14 12
j.i.o.l.Clip 12.5 15 5 5 5 5 12.5 5 11 5 5 10 5 14 5
j.i.o.Shift 11 13 6 7 12 10 9 5 4 14 8 1 2 15 3
Scanner 14.5 14.5 8 1 5 11 2 4 10 13 12 6 3 9 7
c.p.t.c.a.FileText 12 15 10 8 6 7 5 2 9 14 11 3 1 13 4
c.p.t.c.u.ScopeUtils 13 15 6.5 6.5 5 11 1 2 9 12 8 3 4 14 10
c.p.t.c.a.AbstractLoader 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 15 7.5
c.p.t.c.a.AutomaticBean 15 13 5 11 11 5 3 7 5 14 11 1 2 8.5 8.5
c.p.t.c.a.FileContents 10 13 8 1 9 7 3 5 11 14 12 4 2 15 6
c.p.t.c.u.AnnotationUtility 14 15 3 3 3 10 6 3 9 11 3 8 7 13 12
o.o.a.j.c.LocalVariablesSorter 13 15 5 1 11 9 4 2 7 12 10 3 6 14 8
c.m.t.p.r.Profile 11 14 3 4 10 12 6 1 8 13 7 5 2 15 9
o.o.a.j.ClassReader 13 14 4 7 10 12 8 3 5 9 6 1 2 15 11
o.o.a.j.MethodWriter 8 13 5 4 12 15 6 3 11 9 10 2 1 14 7
o.s.m.OAuthConfig 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
o.s.m.Response 6 13 10.5 14 10.5 3 8.5 4.5 12 15 8.5 1 2 7 4.5
o.s.m.Request 14 6 8 12 8 4 15 4 10.5 13 8 4 10.5 1.5 1.5
o.s.m.Token 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
o.s.m.Verifier 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
o.s.m.OAuthRequest 6.5 14 6.5 14 6.5 6.5 6.5 6.5 6.5 14 6.5 6.5 6.5 6.5 6.5
g.g.m.AddressToUsAddressFunctor 14 15 5 10 3 11 9 8 12 13 7 2 4 1 6
g.g.d.GeoStatusCode 3 1 11 13 10 4 6 7 12 15 9 5 8 14 2
t.GeoQuery 14 15 5 3 11 13 9 7.5 7.5 12 5 1 2 10 5
t.TwitterBaseImpl 12 13 3 4 10 14 5 7 8 9 6 2 1 15 11
t.OEmbedRequest 14 15 2 7 10 11 6 3 9 13 8 1 5 12 4
t.TwitterImpl 6 13 2 5 10 15 1 7 8 12 9 3 4 14 11
t.TwitterException 8 12 6 9 11 15 4 3 10 13 7 1 2 14 5
t.ExceptionDiagnosis 6 15 6 6 6 13 6 13 6 6 6 6 13 6 6
t.Paging 14 13 5.5 5.5 5.5 12 5.5 5.5 11 5.5 5.5 5.5 5.5 15 5.5
o.a.c.c.l.TreeList 13 14 5 4 12 15 8 3 6 11 7 2 1 10 9
o.a.c.c.s.SequencesComparator 14 15 9 6 1 11 7 3 10 13 4 8 2 5 12
o.a.c.c.p.ArrayByteList 11 13 6.5 3 10 8 1 4 5 12 6.5 2 9 15 14
o.a.l.s.e.c.NamedCollatorComparator 8 10 4.5 2 4.5 14 1 3 7 11 9 12 6 15 13
o.a.l.s.e.ExposedTimSort 14 15 5 2 10 7 4 6 9 13 8 1 3 12 11
d.s.s.s.h.InteractionAdjuster 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
d.b.s.h.IndexedString 12 8.5 12 4 4 8.5 2 1 8.5 8.5 12 4 6 15 14
d.b.s.StringIncrementor 14 15 3 5 11 9 7 2 4 13 6 1 8 10 12
n.s.b.r.MethodReflectionCriteria 14 15 6 3.5 13 3.5 10 6 8 9 6 1.5 1.5 11 12
n.s.b.r.ReflectionSearch 13 14 10 11 8.5 4 4 12 4 8.5 4 4 4 15 4
n.k.a.D.Product 6 12 2.5 1 6 6 10 14 6 6 13 2.5 10 10 15
f.u.g.i.ModifTableStockage 6 11 5 1 12 14 8 4 10 13 9 7 3 15 2
n.s.e.t.b.Request 3 10 1 7 9 15 5 2 12 13 8 6 4 14 11
n.s.e.l.l.ExtrasPatternParser 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
c.g.d.u.DBEHelper 7 12 8 11 6 14 5 3 13 10 9 2 1 15 4
o.h.s.u.l.i.LoggerFactory 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
MP3 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 15 7.5
c.e.s.SweetHome3D 2 10 6 7 11 13 8 5 12 14 9 4 1 15 3
c.e.s.j.Room3D 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
c.e.s.v.HomeController 6 11 9 7 5 15 10 3 12 13 8 1 2 14 4
c.e.s.v.RoomController 7 5 10 4 6 12 1 3 11 13 15 2 9 14 8
n.s.j.c.AbstractInstance 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
n.s.j.c.DenseInstance 7 7 7 7 7 15 7 7 7 7 7 7 7 14 7
n.s.j.c.DefaultDataset 7 11 6 8 10 13 3 3 12 14 9 1 5 15 3
n.s.j.c.Fold 12 6 6 6 6 15 6 6 6 6 6 13 14 6 6
n.s.j.c.Complex 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
n.s.j.t.d.ARFFHandler 15 14 6 4 11 2.5 1 7 8 12 9 2.5 5 10 13
o.z.x.XMLEncoder 10 12 5 2 11 15 6 1 4 13 9 7 3 14 8
m.w.AvailableJobsResponse 8 14 1 3 6 12.5 12.5 7 4 5 2 10 11 15 9
m.w.Fail 12 5 2.5 1 6 11 7 8 10 4 2.5 9 14 15 13
g.AudioManager 8 11 10 6 7 9 3 2 14 15 13 5 1 12 4
g.f.g.TabbedPane 7 12 9 6 11 9 4 3 13.5 13.5 9 2 1 15 5
o.o.s.c.u.u.FontChooserDialog 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 15 7.5
n.s.s.f.c.FSPathExplorer 2 1 10 13 8 6 4 7 14 12 11 3 5 15 9
n.s.s.f.FSPathResult 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
w.c.FindWithCapabilities 4 11 7 1 8 14 10 2 12 13 6 9 5 15 3
w.c.b.n.s.c.ICSSearchAlgorithm 13 14 2 7 11 10 4 3 5 15 8 6 1 12 9
w.c.Evaluation 11 14 6 7 9 15 4 3 5 10 8 2 1 13 12
n.s.j.m.a.e.MovePage 12.5 12.5 1 4 2 12.5 3 5 6 8 9 12.5 12.5 7 12.5
n.s.j.m.a.q.TemplateUserTitles 11 13 1 3 2 8 4 5 7 14.5 14.5 9 10 6 12
N.BatchDriver 10 13 1 5 11 9 2 6 12 15 14 4 3 8 7
Newzgrabber 4.5 11 9 8 12 4.5 3 6 13 14 10 2 1 15 7
o.a.c.l.BooleanUtils 5 10 8 7 9 15 6 4 12 13 11 2 1 14 3
o.a.c.l.LocaleUtils 10 11 1 6 12 15 3 2 9 13 7 5 4 14 8
o.a.c.l.t.DateUtils 3 11 8 7 10 15 6 4 12 13 9 2 1 14 5
o.a.c.l.t.DurationFormatUtils 1 2 9 10 4 3 5 7 13 14 6 12 8 15 11
o.a.c.l.ArrayUtils 3 12 10 9 4 15 6 8 14 5 11 2 1 13 7
o.a.c.l.Conversion 1 13 10 7 5 15 8 6 14 9 12 3 2 11 4
o.a.c.l.t.ExtendedMessageFormat 4 11 8 5 13 10 6 1 12 14 9 3 2 15 7
o.a.c.l.t.FastDateFormat 12 13 7 6 10 5 11 14 3 4 15 2 1 9 8
o.a.c.l.ClassUtils 12 14 5 6 9 15 4 3 11 10 8 2 1 13 7
o.a.c.l.Validate 11 13 6 8 1 15 2 3 12 10 9 7 4 14 5
o.a.c.l.b.CompareToBuilder 1 9 7 8 11 15 6 2 13 12 10 3 4 14 5
o.a.c.l.t.t.NumericEntityUnescaper 13 15 4 3 11 7 8 5 9 12 10 2 1 14 6
o.a.c.l.b.HashCodeBuilder 2 1 7 5 6 13 3 4 9 8 10 12 14 15 11
o.a.c.l.t.StrBuilder 2 12 10 9 5 15 4 7 13 8 11 3 1 14 6
c.g.j.j.ExploitAssigns 10 14 6 4 2 11 3 5 13 12 8 7 9 15 1
c.g.j.j.CheckGlobalThis 10 13 3 5 6 14 4 7 15 9 8 1 2 11 12
c.g.j.j.CollapseProperties 1 8 11 7 4 14 6 10 13 12 9 5 3 15 2
c.g.j.j.p.JsDocInfoParser 1 9 10 7 8 15 6 3 13 11 5 4 2 14 12
c.g.j.r.j.RecordType 14 13 4 5 10 15 7 3 9 12 6 2 1 11 8
c.g.j.j.ControlFlowAnalysis 10 13 6.5 5 8 15 4 3 11 12 9 2 1 14 6.5
c.g.j.j.PeepholeSubstituteAlternateSyntax 9 14 10 7 6 15 5 4 11 12 8 3 1 13 2
j.e.Salvar 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
j.e.Abrir 8 8 8 8 8 8 8 8 8 8 8 8 8 8 8
l.c.Game 5.5 5.5 12.5 5.5 5.5 1 10 5.5 11 5.5 12.5 5.5 5.5 15 14
l.c.p.Phase 6 6 13.5 6 6 6 6 6 13.5 13.5 13.5 6 6 6 6
u.m.j.j.s.Transition 4.5 4.5 9.5 4.5 4.5 4.5 4.5 4.5 15 12 4.5 12 14 9.5 12
c.i.c.ComboLeg 9 5.5 9 12.5 9 15 9 1.5 9 1.5 12.5 4 5.5 3 14
c.i.c.ExecutionFilter 10 11 13 7 7 7 4 9 14 12 15 4 1.5 4 1.5
o.d.j.DBUtil 11 14 7 8 6 15 4 3 12 10 9 2 1 13 5
o.d.j.SQLUtil 3 12 6 9 8 15 7 5 13 11 10 1 2 14 4
c.b.e.n.c.AuswertungGrafik 10.5 12 5 3 4 10.5 2 9 13 7 8 6 1 14 15
c.b.e.n.s.f.NaOpNuDaoService 14 15 4 6 9 10 8 5 11 12 7 3 1 13 2
o.s.i.b.IFXObject 8 12 6 2 5 9.5 4 1 11 14 9.5 7 3 15 13
Average 8.3 10.5 6.3 6.2 8.1 11.0 5.9 5.1 9.5 10.8 8.6 5.1 4.8 11.9 7.9
χ2=1444.49, p-value < 0.0001
CUT Random Search Random Testing Standard GA Monotonic GA Steady-State GA 1 + (λ, λ) EA (μ + λ) EA (μ, λ) EA Breeder GA Cellular GA CRO MOSA DynaMOSA LIPS MIO
Search budget of 60 seconds – Multiple-criteria
t.TederFrame 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 — 7.5
f.Fps370Panel 1 8 8 8 8 8 8 8 8 8 8 8 8 — 8
o.j.j.a.c.p.DefaultPhdReadTag 9 13 6 4 12 14 8 7 10 11 5 2 1 — 3
o.j.j.a.c.f.Distance 13 14 3.5 3.5 8 12 7 3.5 3.5 11 3.5 9 3.5 — 10
m.u.DisplayableListPanel 11 14 6 5 10 7 2 3 8 13 9 4 1 — 12
m.p.MacawWorkBench 11 14 5 3 8 10 2 1 9 12 7 6 4 — 13
n.s.l.LagoonCLI 4 10 6 5 12 13 8 7 9 14 11 2 1 — 3
n.s.l.LagoonGUI 1 6 7 3 13 5 2 8 12 14 10 11 9 — 4
i.BinaryCalculate 3 14 8 9 11 13 7 5 10 12 6 2 1 — 4
i.WhoIS 11 14 5 6 13 4 8 2 3 12 1 10 7 — 9
b.c.DefaultSettingsController 12 8 6 7 3 9 4 5 10 14 11 1 2 — 13
b.m.Drink 12 14 3 5 6 13 2 4 8 9 7 10 1 — 11
o.p.g.b.t.c.JPodThmbnailCallable 13 11 2 3 8 9 7 6 4 12 14 5 1 — 10
o.a.DefaultRepositoryManager 4 3 10 10 10 10 2 1 10 10 10 10 10 — 5
c.h.s.c.Base64 13 14 7 11 12 2 10 8 9 6 5 3 4 — 1
o.p.s.l.DefaultLuceneDocumentFactory 2 14 9 7 12 10 6 4 11 13 8 3 1 — 5
o.p.o.CreditCardInfo 14 6.5 6.5 6.5 6.5 6.5 6.5 6.5 6.5 13 6.5 6.5 6.5 — 6.5
c.i.s.HTMLFilter 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 — 7.5
v.h.m.a.CreateMovePdfAction 7 7 7 7 7 7 7 7 7 7 7 7 7 — 14
v.h.m.x.HandballModelReader 14 8 6 3 5 12 7 2 1 9 4 13 10.5 — 10.5
j.p.PlotAxis 14 13 3 4 6 12 1 2 8 7 5 11 10 — 9
d.t.u.w.a.CycleHandler 13 14 5 2 4 10 1 6 11 12 7 9 3 — 8
d.t.u.w.a.CategoryDescendantsIterator 12 14 7 10 11 8 9 4 5 13 6 1.5 1.5 — 3
d.t.u.w.a.WikipediaInfo 7 13 5 6 10 14 4 3 9 11 8 2 1 — 12
d.t.u.w.a.Title 12 13 8 4 10 5 3 6 9 14 11 1.5 1.5 — 7
o.j.c.p.XYPlot 1 13 3 4 7 14 8 10 6 2 5 11 9 — 12
o.j.c.r.c.AbstractCategoryItemRenderer 3 13 5 8 10 14 4 6 11 12 9 2 1 — 7
o.j.c.r.GrayPaintScale 14 13 2.5 2.5 7 10 2.5 5 9 11 2.5 7 7 — 12
o.j.c.p.MultiplePiePlot 11 13 8 5 10 14 4 3 9 12 7 2 1 — 6
o.j.c.p.ValueMarker 13 14 6 6 10 11 2 2 6 9 6 6 2 — 12
o.j.d.c.DefaultIntervalCategoryDataset 12 13 4 5 9 14 3 6 11 10 7 2 1 — 8
o.j.c.r.c.MinMaxCategoryRenderer 12 14 7 8 10 11 4 3 9 13 5 1 2 — 6
o.j.c.a.Axis 12 13 3 2 9 14 5 10 7 8 6 4 1 — 11
o.j.d.t.TimeSeries 3 13 5 7 11 14 6 4 10 12 9 2 1 — 8
o.j.c.r.c.StatisticalBarRenderer 8 13 5 6 10 14 4 3 9 11 7 1 2 — 12
o.j.d.t.TimePeriodValues 12 14 5 4 9 13 3 6 8 11 7 2 1 — 10
o.j.d.g.DatasetUtilities 3 13 5 6 8 14 4 7 9 10 11 2 1 — 12
c.b.e.c.t.MessageList 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 — 7.5
c.g.c.b.Joiner 14 13 4 7 5 12 2 3 10 9 6 1 11 — 8
c.g.c.m.BigIntegerMath 12 14 8 3 2 13 5 10 7 9 6 4 1 — 11
c.g.c.b.Utf8 12 14 4 3 9 13 5 7 8 10 6 2 1 — 11
c.g.c.b.Splitter 7 14 8 6 10 13 4 5 11 12 9 2 1 — 3
c.g.c.b.Suppliers 8 14 4 5 7 13 6 12 10 11 9 1 2 — 3
c.g.c.b.CharMatcher 3 14 4 5 9 13 6 11 8 10 7 2 1 — 12
c.g.c.c.CacheBuilderSpec 5 13 7 8 10 14 4 6 11 12 9 2 1 — 3
c.g.c.b.Predicates 3 14 2 6 10 13 5 11 8 9 7 1 4 — 12
c.g.c.b.SmallCharMatcher 13 14 8 3 10 11 7 5 4 9 6 2 1 — 12
c.g.c.u.c.Monitor 8 9 6 7 12 14 3 5 10 11 13 2 1 — 4
s.C.g.ConsumerGUI 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 — 7.5
s.C.ConsumerAgent 1 9 8 7 13 14 5 4 11 10 12 3 2 — 6
c.a.i.u.MainMenu 6.5 14 1 6.5 6.5 6.5 11 2.5 6.5 10 2.5 12 6.5 — 13
c.a.i.u.XmlElement 12 13 3 5 7 14 10 11 8 6 4 2 1 — 9
c.w.s.XPathLexer 3 14 4 6 9 13 5 10 7 11 8 2 1 — 12
o.s.Axis 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 — 7.5
Menu 13 3.5 10 7.5 12 7.5 9 5.5 11 14 5.5 1.5 1.5 — 3.5
Convert 6 14 7 9 11 10 4 5 13 12 8 2 1 — 3
Capture 14 7 7 7 7 7 7 7 7 7 7 7 7 — 7
o.j.l.UserManagement 3 13 7 8 11 14 5 6 9 10 12 2 1 — 4
o.j.l.Login 4 13 3 6 9 14 5 7 10 11 8 2 1 — 12
o.j.l.p.FromClient 8 14 10 5 13 6 7 11 9 12 4 2 1 — 3
j.Main 2 14 5 11 9 13 8 12 7 4 6 10 1 — 3
j.Variable 1 14 2 9 5 6 10 4 8 7 3 12 11 — 13
f.u.StringUtils 14 13 6 7 5 12 2 3 9 10 8 4 1 — 11
f.u.j.JDBCUtils 5 13 7 8 11 14 3 4 10 12 9 2 1 — 6
o.j.t.MutablePeriod 12 13 1 5 3 14 2 4 8 7 6 11 9 — 10
o.j.t.c.BasicMonthOfYearDateTimeField 12 13 5 6 8 14 3 4 9 10 7 2 1 — 11
o.j.t.MutableDateTime 12 13 5 7 8 14 2 4 10 11 9 3 1 — 6
o.j.t.b.BaseSingleFieldPeriod 13 12 4 8 3 14 2 5 11 10 9 1 6 — 7
o.j.t.DateTimeZone 11 13 4 6 7 14 3 5 9 10 8 2 1 — 12
o.j.t.f.DateTimeFormatterBuilder 1 13 3 4 8 14 5 10 6 9 7 11 2 — 12
o.j.t.Period 12 13 4 6 7 14 3 5 9 10 8 2 1 — 11
o.j.t.t.ZoneInfoCompiler 8 14 7 6 10 13 2 4 9 12 5 3 1 — 11
o.j.t.c.LimitChronology 12 13 6 5 10 14 3 4 9 11 8 2 1 — 7
o.j.t.f.PeriodFormatterBuilder 2 13 3 6 9 14 5 11 7 10 8 4 1 — 12
o.j.t.f.DateTimeFormatter 12 13 5 7 8 14 4 3 9 11 10 2 1 — 6
o.j.t.Partial 11 13 3 4 9 14 5 7 6 10 8 2 1 — 12
o.j.t.b.BasePeriod 13 12 4 8 9 14 3 6 11 10 7 1 2 — 5
o.f.j.FBProcedureCall 12 14 5 6 10 13 7 3 8 11 4 2 1 — 9
o.f.e.EncodingFactory 3 13 5 6 9 14 4 7 10 12 8 2 1 — 11
o.m.j.Parser 3 13 4 6 10 14 5 11 9 8 7 2 1 — 12
c.y.p.y.c.ScriptOrFnScope 13 14 4 3 8 11 2 1 7 9 5 10 6 — 12
c.s.m.s.a.s.J2EEApplicationAlias 14 12 6 5 11 13 3 7 9 10 8 1 2 — 4
c.s.m.s.a.s.HeapInfo 14 13 6 4 11 12 9 2 8 10 5 7 3 — 1
d.c.g.InternalChatFrame 11 12 2 3 10 8 5 4 7 13 6 9 1 — 14
d.s.Handler 1 5 8 9 11 14 4 6 10 12 13 3 2 — 7
b.u.Queue 14 9 10 13 4 11 7 12 1.5 8 6 3 5 — 1.5
b.o.Verse 14 10 6 5 7 13 2 4 9 12 8 3 1 — 11
c.n.ForwardingObserver 6 5 12 11 14 4 8 7 9 13 10 2 1 — 3
s.ServerGameModel 1 2 7 11 11 14 7 7 11 11 11 4 5 — 3
c.l.s.c.SimpleComboBox 11 14 5 8 6 9 2 4 10 12 7 1 3 — 13
c.l.i.DirectoryScanner 3 13 6 5 10 14 4 7 9 12 8 2 1 — 11
c.l.e.SimpleKeyListenerHelper 13 14 5 7 10 9 6 4 11 12 8 2.5 1 — 2.5
u.c.s.JSJshop 7 8 14 12.5 12.5 6 3 2 9 10 11 5 1 — 4
u.c.s.JSTerm 11 13 2 4 7 14 10 9 1 5 6 8 3 — 12
u.c.s.JSPredicateForm 12 13 4 5 9 14 10 11 8 7 6 2 1 — 3
u.c.s.JSState 13 14 8 10 5 12 4 3 6 9 7 1 2 — 11
n.s.l.d.TimeOfDay 13 14 4 4 4 11 4 4 4 10 8 9 4 — 12
o.j.Expression 2 13 6 7 12 14 3 4 11 9 10 5 1 — 8
d.o.f.s.BattleStatistics 10 13 5 7 12 14 4 3 9 11 8 2 1 — 6
d.o.f.m.i.SimpleSector 10 14 8 7 12 13 4 5 9 11 6 1 2 — 3
b.battlecryGUI 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 — 7.5
b.bcGenerator 2 12 8 6 14 11 5 4 9 13 10 7 1 — 3
e.m.c.j.JCLO 4 13 7 8 11 14 6 5 9 12 10 2 1 — 3
c.l.p.k.s.f.i.FilterMapping 4 14 7 9 11 13 6 5 10 12 8 2 1 — 3
c.l.p.d.m.DLSyncWrapper 13 14 4 1 2 11 10 5 6 8 7 3 9 — 12
d.p.e.e.ExplorerFrameEventConverter 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 — 7.5
d.p.e.m.AttributeModelComparator 12 14 3 5 8 13 4 2 10 11 1 6 7 — 9
c.f.TucsonSimple 11 14 5 4 12 6 10 9 8 13 3 2 1 — 7
c.p.j.t.JVCParserTokenManager 1 9 7 8 12 14 5 4 11 10 13 3 2 — 6
c.p.j.t.JVCParser 10 13 7 6 12 14 5 3 9 11 8 1 2 — 4
c.p.j.t.TokenMgrError 13 14 3 1 11 7 9 6 8 12 5 10 4 — 2
w.a.ClassWriter 11 14 3 4 9 13 8 5 7 10 6 2 1 — 12
w.a.FieldWriter 12 14 6 5 11 13 9 4 7 10 8 3 1 — 2
w.a.ClassReader 4 14 7 5 12 13 8 3 9 11 10 2 1 — 6
f.v.n.t.o.f.DaikonFormatter 5 14 7 8 12 13 10 3 9 11 6 2 1 — 4
J.F.FoxHuntFrame 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 7.5 — 7.5
J.F.HuntDisplay 13 14 4 6 1 12 5 2 8 7 3 10 9 — 11
n.s.x.b.c.MessageHandler 7 13 3 6 9 10 2 1 8 14 5 11 4 — 12
n.s.x.b.c.r.XBUSClassLoader 11 12 2 4 13 3 1 7 6 14 9 8 5 — 10
o.t.Region 14 13 5.5 5.5 5.5 11 5.5 5.5 5.5 5.5 5.5 5.5 5.5 — 12
m.s.SSHSCPGUIThread 4 10 7 8 9 14 6 5 11 12 13 2 1 — 3
d.p.c.DefaultChart 7 13 9 3 11 12 8 5 10 14 6 4 2 — 1
d.p.c.CoordSystemUtilities 7 13 5 6 11 14 4 3 10 12 9 2 1 — 8
n.s.s.c.p.GlobalPreferencesSheet 13 14 6.5 6.5 6.5 6.5 6.5 6.5 6.5 6.5 6.5 6.5 6.5 — 6.5
n.s.s.f.g.CascadeInternalFramePositioner 7 13 6 8 9 11 5 4 10 12 2 1 3 — 14
d.d.p.ArgsParser 3 14 9 8 12 10 7 5 11 13 6 2 1 — 4
n.s.s.m.Table 7 9 5 6 11 13 4 3 10 14 8 2 1 — 12
n.s.s.m.x.TableMeta 11 10 2 6 5 9 1 3 12 14 4 7 8 — 13
a.p.t.JDayChooser 10 13 4 3 5 14 7 8 1 2 6 11 9 — 12
h.HttpAnalyzerView 1 14 5.5 9 11 2.5 2.5 5.5 5.5 5.5 9 12 9 — 13
h.Password 13 14 9.5 9.5 3 6 9.5 6 3 9.5 6 1 3 — 12
f.p.j.g.a.IndexFileAction 12 14 9 6 11 10 3 7 4 13 5 2 1 — 8
f.p.j.g.v.JTailPanel 11 9 6 1 14 3 4 2 10 13 5 8 7 — 12
o.t.s.e.turkishStemmer 2 14 5 6 9 13 4 10 7 11 8 3 1 — 12
o.t.s.e.englishStemmer 3 13 4 6 9 14 5 12 8 11 7 2 1 — 10
o.t.s.e.italianStemmer 2 14 4 6 12 13 5 9 8 11 10 3 1 — 7
J.m.s.ExpressionParser 14 13 4 5 9 12 2 7 8 11 6 3 1 — 10
J.m.s.SimpleCharStream 14 12 5 8 10 13 3 4 7 9 6 1 2 — 11
J.m.SpecialMath 14 12 6 7 9 13 1 2 10 11 8 4 3 — 5
n.v.a.g.r.RobotRenderer 11 13 6 7 10 12 4 3 8 14 5 2 1 — 9
n.v.a.r.Robot 8 13 5 6 9 14 2 4 12 11 10 3 1 — 7
o.e.j.n.s.SocketRequestInfo 14 13 1 4 8 12 9 2 7 11 3 5 6 — 10
o.e.j.n.c.DefaultConnectionPool 3 10 7 9 11 14 4 5 12 13 8 6 1 — 2
o.j.Verifier 8 13 4 6 9 14 3 5 10 11 7 2 1 — 12
o.j.t.JDOMResult 13 14 2 4 11 12 1 5 3 10 8 7 6 — 9
o.j.u.NamespaceStack 8 14 6 9 11 13 4 3 10 12 7 2 1 — 5
o.j.o.XMLOutputter 12 13 5 8 7 14 4 6 11 10 9 2 1 — 3
o.j.o.SAXOutputter 10 13 5 7 8 14 3 4 11 12 9 2 1 — 6
c.s.C.J.J.JavaCharStream 12 13 4 6 10 14 5 7 9 11 8 2 1 — 3
c.s.C.J.JMCAAnalyzer 3 13 7 4 14 11 9 5 6 10 12 2 1 — 8
o.f.m.Library 3 6 10.5 13 10.5 5 8 7 10.5 14 10.5 4 2 — 1
o.f.m.v.TreeView 2 14 11.5 11.5 11.5 6 5 7 8 9 11.5 3 1 — 4
c.m.r.i.AbstractResources 5 14 3 4 9 7 2 6 1 11.5 11.5 11.5 11.5 — 8
c.d.r.s.t.WebServiceDescriptor 13 14 5.5 5.5 11 5.5 5.5 5.5 5.5 12 5.5 5.5 5.5 — 5.5
i.s.n.ClientGroup 12 13 5 7 11 14 10 2 6 8 3 4 1 — 9
s.Purchase 10