Online Appendix for Heterogeneous Defect Prediction

Online Appendix for Heterogeneous Defect Prediction (HDP)

A. Matched Metrics in HDP

Matched Metrics by KSAnalyzer, cutoff=0.05, and Gain Ratio feature selection

[Download]

Format
[source : target]
sourceMetricX-targetMetricY(matching score)

All matched metrics

The following files contain matching scores for all combination of metric matching by three matching analyzers: KSAnalyzer, PAnalyzer, and SCoAnalyzer. For Kolmogorov-Smirnov test and Spearmans Correlation, we used Apache Commons Math3 3.3 version. This raw matching scores can be used for finding the best metric matching by the cutoff of a matching score.

Line format: [source]_[target]_[Analyzer]:([# of source metrics including a class]):[source metric index]-[target metric index]|[matching score],...
* Note that attribute index starts from 0.

Matching Scores by KSAnalyzer: [Download]
Matching Scores by PAnalyzer: [Download]
Matching Scores by SCoAnalyzer: [Download]

B. Common Metrics among Data Groups

Matched Groups	# of Common Metrics	Common Metrics
AEEEM : ReLink	1	ck_oo_numberOfLinesOfCode : CountLineCode
AEEEM : MORPH	7	ck_oo_numberOfLinesOfCode : loc ck_oo_wmc : wmc ck_oo_dit : dit ck_oo_noc : noc ck_oo_cbo : cbo ck_oo_rfc : rfc ck_oo_lcom : lcom
AEEEM : NASA	1	ck_oo_numberOfLinesOfCode : LOC_CODE_AND_COMMENT
AEEEM : NASA2 (jm1)	1	ck_oo_numberOfLinesOfCode : LOC_CODE_AND_COMMENT
AEEEM : NASA3 (pc2)	1	ck_oo_numberOfLinesOfCode : LOC_CODE_AND_COMMENT
AEEEM : NASA4 (pc5, mc1)	1	ck_oo_numberOfLinesOfCode : LOC_CODE_AND_COMMENT
AEEEM : NASA5 (mc2, kc3)	1	ck_oo_numberOfLinesOfCode : LOC_CODE_AND_COMMENT
AEEEM : SOFTLAB	1	ck_oo_numberOfLinesOfCode : code_and_comment_loc
ReLink : MORPH	3	CountLineCode : loc AvgCyclomatic : avg_cc MaxCyclomatic : max_cc
ReLink : NASA	5	CountLine : LOC_TOTAL CountLineBlank : LOC_BLANK CountLineComment : LOC_COMMENTS CountLineCode : LOC_CODE_AND_COMMENT CountStmtExe : LOC_EXECUTABLE
ReLink : NASA2 (jm1)	5	CountLine : LOC_TOTAL CountLineBlank : LOC_BLANK CountLineComment : LOC_COMMENTS CountLineCode : LOC_CODE_AND_COMMENT CountStmtExe : LOC_EXECUTABLE
ReLink : NASA3 (pc2)	4	CountLine : LOC_TOTAL CountLineComment : LOC_COMMENTS CountLineCode : LOC_CODE_AND_COMMENT CountStmtExe : LOC_EXECUTABLE
ReLink : NASA4 (pc5, mc1)	5	CountLine : LOC_TOTAL CountLineBlank : LOC_BLANK CountLineComment : LOC_COMMENTS CountLineCode : LOC_CODE_AND_COMMENT CountStmtExe : LOC_EXECUTABLE
ReLink : NASA5 (mc2, kc3)	7	CountLine : LOC_TOTAL CountLineBlank : LOC_BLANK CountLineComment : LOC_COMMENTS CountLineCode : LOC_CODE_AND_COMMENT CountStmtExe : LOC_EXECUTABLE SumCyclomatic : CYCLOMATIC_COMPLEXITY RatioCommentToCode : PERCENT_COMMENTS
ReLink : SOFTLAB	6	CountLine : total_loc CountLineBlank : blank_loc CountLineComment : comment_loc CountLineCode : code_and_comment_loc CountStmtExe : executable_loc SumCyclomatic : cyclomatic_complexity
MORPH : SOFTLAB	1	loc : code_and_comment_loc
MORPH : NASA	1	loc : LOC_CODE_AND_COMMENT
MORPH : NASA2 (jm1)	1	loc : LOC_CODE_AND_COMMENT
MORPH : NASA3 (pc2)	1	loc : LOC_CODE_AND_COMMENT
MORPH : NASA4 (pc5, mc1)	1	loc : LOC_CODE_AND_COMMENT
MORPH : NASA5 (mc2, kc3)	1	loc : LOC_CODE_AND_COMMENT
MORPH : SOFTLAB	1	loc : LOC_CODE_AND_COMMENT
NASA : NASA2 (jm1)	21	LOC_BLANK : LOC_BLANK BRANCH_COUNT : BRANCH_COUNT LOC_CODE_AND_COMMENT : LOC_CODE_AND_COMMENT LOC_COMMENTS : LOC_COMMENTS CYCLOMATIC_COMPLEXITY : CYCLOMATIC_COMPLEXITY DESIGN_COMPLEXITY : DESIGN_COMPLEXITY ESSENTIAL_COMPLEXITY : ESSENTIAL_COMPLEXITY LOC_EXECUTABLE : LOC_EXECUTABLE HALSTEAD_CONTENT : HALSTEAD_CONTENT HALSTEAD_DIFFICULTY : HALSTEAD_DIFFICULTY HALSTEAD_EFFORT : HALSTEAD_EFFORT HALSTEAD_ERROR_EST : HALSTEAD_ERROR_EST HALSTEAD_LENGTH : HALSTEAD_LENGTH HALSTEAD_LEVEL : HALSTEAD_LEVEL HALSTEAD_PROG_TIME : HALSTEAD_PROG_TIME HALSTEAD_VOLUME : HALSTEAD_VOLUME NUM_OPERANDS : NUM_OPERANDS NUM_OPERATORS : NUM_OPERATORS NUM_UNIQUE_OPERANDS : NUM_UNIQUE_OPERANDS NUM_UNIQUE_OPERATORS : NUM_UNIQUE_OPERATORS LOC_TOTAL : LOC_TOTAL
NASA : NASA3 (pc2)	36	BRANCH_COUNT : BRANCH_COUNT CALL_PAIRS : CALL_PAIRS LOC_CODE_AND_COMMENT : LOC_CODE_AND_COMMENT LOC_COMMENTS : LOC_COMMENTS CONDITION_COUNT : CONDITION_COUNT CYCLOMATIC_COMPLEXITY : CYCLOMATIC_COMPLEXITY CYCLOMATIC_DENSITY : CYCLOMATIC_DENSITY DECISION_COUNT : DECISION_COUNT DECISION_DENSITY : DECISION_DENSITY DESIGN_COMPLEXITY : DESIGN_COMPLEXITY DESIGN_DENSITY : DESIGN_DENSITY EDGE_COUNT : EDGE_COUNT ESSENTIAL_COMPLEXITY : ESSENTIAL_COMPLEXITY ESSENTIAL_DENSITY : ESSENTIAL_DENSITY LOC_EXECUTABLE : LOC_EXECUTABLE PARAMETER_COUNT : PARAMETER_COUNT HALSTEAD_CONTENT : HALSTEAD_CONTENT HALSTEAD_DIFFICULTY : HALSTEAD_DIFFICULTY HALSTEAD_EFFORT : HALSTEAD_EFFORT HALSTEAD_ERROR_EST : HALSTEAD_ERROR_EST HALSTEAD_LENGTH : HALSTEAD_LENGTH HALSTEAD_LEVEL : HALSTEAD_LEVEL HALSTEAD_PROG_TIME : HALSTEAD_PROG_TIME HALSTEAD_VOLUME : HALSTEAD_VOLUME MAINTENANCE_SEVERITY : MAINTENANCE_SEVERITY MODIFIED_CONDITION_COUNT : MODIFIED_CONDITION_COUNT MULTIPLE_CONDITION_COUNT : MULTIPLE_CONDITION_COUNT NODE_COUNT : NODE_COUNT NORMALIZED_CYLOMATIC_COMPLEXITY : NORMALIZED_CYLOMATIC_COMPLEXITY NUM_OPERANDS : NUM_OPERANDS NUM_OPERATORS : NUM_OPERATORS NUM_UNIQUE_OPERANDS : NUM_UNIQUE_OPERANDS NUM_UNIQUE_OPERATORS : NUM_UNIQUE_OPERATORS NUMBER_OF_LINES : NUMBER_OF_LINES PERCENT_COMMENTS : PERCENT_COMMENTS LOC_TOTAL : LOC_TOTAL
NASA : NASA4 (pc5, mc1)	36	LOC_BLANK : LOC_BLANK BRANCH_COUNT : BRANCH_COUNT CALL_PAIRS : CALL_PAIRS LOC_CODE_AND_COMMENT : LOC_CODE_AND_COMMENT LOC_COMMENTS : LOC_COMMENTS CONDITION_COUNT : CONDITION_COUNT CYCLOMATIC_COMPLEXITY : CYCLOMATIC_COMPLEXITY CYCLOMATIC_DENSITY : CYCLOMATIC_DENSITY DECISION_COUNT : DECISION_COUNT DESIGN_COMPLEXITY : DESIGN_COMPLEXITY DESIGN_DENSITY : DESIGN_DENSITY EDGE_COUNT : EDGE_COUNT ESSENTIAL_COMPLEXITY : ESSENTIAL_COMPLEXITY ESSENTIAL_DENSITY : ESSENTIAL_DENSITY LOC_EXECUTABLE : LOC_EXECUTABLE PARAMETER_COUNT : PARAMETER_COUNT HALSTEAD_CONTENT : HALSTEAD_CONTENT HALSTEAD_DIFFICULTY : HALSTEAD_DIFFICULTY HALSTEAD_EFFORT : HALSTEAD_EFFORT HALSTEAD_ERROR_EST : HALSTEAD_ERROR_EST HALSTEAD_LENGTH : HALSTEAD_LENGTH HALSTEAD_LEVEL : HALSTEAD_LEVEL HALSTEAD_PROG_TIME : HALSTEAD_PROG_TIME HALSTEAD_VOLUME : HALSTEAD_VOLUME MAINTENANCE_SEVERITY : MAINTENANCE_SEVERITY MODIFIED_CONDITION_COUNT : MODIFIED_CONDITION_COUNT MULTIPLE_CONDITION_COUNT : MULTIPLE_CONDITION_COUNT NODE_COUNT : NODE_COUNT NORMALIZED_CYLOMATIC_COMPLEXITY : NORMALIZED_CYLOMATIC_COMPLEXITY NUM_OPERANDS : NUM_OPERANDS NUM_OPERATORS : NUM_OPERATORS NUM_UNIQUE_OPERANDS : NUM_UNIQUE_OPERANDS NUM_UNIQUE_OPERATORS : NUM_UNIQUE_OPERATORS NUMBER_OF_LINES : NUMBER_OF_LINES PERCENT_COMMENTS : PERCENT_COMMENTS LOC_TOTAL : LOC_TOTAL
NASA : NASA5 (mc2, kc3)	37	LOC_BLANK : LOC_BLANK BRANCH_COUNT : BRANCH_COUNT CALL_PAIRS : CALL_PAIRS LOC_CODE_AND_COMMENT : LOC_CODE_AND_COMMENT LOC_COMMENTS : LOC_COMMENTS CONDITION_COUNT : CONDITION_COUNT CYCLOMATIC_COMPLEXITY : CYCLOMATIC_COMPLEXITY CYCLOMATIC_DENSITY : CYCLOMATIC_DENSITY DECISION_COUNT : DECISION_COUNT DECISION_DENSITY : DECISION_DENSITY DESIGN_COMPLEXITY : DESIGN_COMPLEXITY DESIGN_DENSITY : DESIGN_DENSITY EDGE_COUNT : EDGE_COUNT ESSENTIAL_COMPLEXITY : ESSENTIAL_COMPLEXITY ESSENTIAL_DENSITY : ESSENTIAL_DENSITY LOC_EXECUTABLE : LOC_EXECUTABLE PARAMETER_COUNT : PARAMETER_COUNT HALSTEAD_CONTENT : HALSTEAD_CONTENT HALSTEAD_DIFFICULTY : HALSTEAD_DIFFICULTY HALSTEAD_EFFORT : HALSTEAD_EFFORT HALSTEAD_ERROR_EST : HALSTEAD_ERROR_EST HALSTEAD_LENGTH : HALSTEAD_LENGTH HALSTEAD_LEVEL : HALSTEAD_LEVEL HALSTEAD_PROG_TIME : HALSTEAD_PROG_TIME HALSTEAD_VOLUME : HALSTEAD_VOLUME MAINTENANCE_SEVERITY : MAINTENANCE_SEVERITY MODIFIED_CONDITION_COUNT : MODIFIED_CONDITION_COUNT MULTIPLE_CONDITION_COUNT : MULTIPLE_CONDITION_COUNT NODE_COUNT : NODE_COUNT NORMALIZED_CYLOMATIC_COMPLEXITY : NORMALIZED_CYLOMATIC_COMPLEXITY NUM_OPERANDS : NUM_OPERANDS NUM_OPERATORS : NUM_OPERATORS NUM_UNIQUE_OPERANDS : NUM_UNIQUE_OPERANDS NUM_UNIQUE_OPERATORS : NUM_UNIQUE_OPERATORS NUMBER_OF_LINES : NUMBER_OF_LINES PERCENT_COMMENTS : PERCENT_COMMENTS LOC_TOTAL : LOC_TOTAL
NASA : SOFTLAB	28	LOC_TOTAL : total_loc LOC_BLANK : blank_loc LOC_COMMENTS : comment_loc LOC_CODE_AND_COMMENT : code_and_comment_loc LOC_EXECUTABLE : executable_loc NUM_UNIQUE_OPERANDS : unique_operands NUM_UNIQUE_OPERATORS : unique_operators NUM_OPERANDS : total_operands NUM_OPERATORS : total_operators HALSTEAD_CONTENT : halstead_vocabulary HALSTEAD_LENGTH : halstead_length HALSTEAD_VOLUME : halstead_volume HALSTEAD_LEVEL : halstead_level HALSTEAD_DIFFICULTY : halstead_difficulty HALSTEAD_EFFORT : halstead_effort HALSTEAD_ERROR_EST : halstead_error HALSTEAD_PROG_TIME : halstead_time BRANCH_COUNT : branch_count DECISION_COUNT : decision_count CALL_PAIRS : call_pairs CONDITION_COUNT : condition_count MULTIPLE_CONDITION_COUNT : multiple_condition_count CYCLOMATIC_COMPLEXITY : cyclomatic_complexity CYCLOMATIC_DENSITY : cyclomatic_density DECISION_DENSITY : decision_density DESIGN_COMPLEXITY : design_complexity DESIGN_DENSITY : design_density NORMALIZED_CYLOMATIC_COMPLEXITY : normalized_cyclomatic_complexity
NASA2 : NASA3 (pc2)	21	BRANCH_COUNT : BRANCH_COUNT LOC_CODE_AND_COMMENT : LOC_CODE_AND_COMMENT LOC_COMMENTS : LOC_COMMENTS CYCLOMATIC_COMPLEXITY : CYCLOMATIC_COMPLEXITY DESIGN_COMPLEXITY : DESIGN_COMPLEXITY ESSENTIAL_COMPLEXITY : ESSENTIAL_COMPLEXITY LOC_EXECUTABLE : LOC_EXECUTABLE HALSTEAD_CONTENT : HALSTEAD_CONTENT HALSTEAD_DIFFICULTY : HALSTEAD_DIFFICULTY HALSTEAD_EFFORT : HALSTEAD_EFFORT HALSTEAD_ERROR_EST : HALSTEAD_ERROR_EST HALSTEAD_LENGTH : HALSTEAD_LENGTH HALSTEAD_LEVEL : HALSTEAD_LEVEL HALSTEAD_PROG_TIME : HALSTEAD_PROG_TIME HALSTEAD_VOLUME : HALSTEAD_VOLUME NUM_OPERANDS : NUM_OPERANDS NUM_OPERATORS : NUM_OPERATORS NUM_UNIQUE_OPERANDS : NUM_UNIQUE_OPERANDS NUM_UNIQUE_OPERATORS : NUM_UNIQUE_OPERATORS LOC_TOTAL : LOC_TOTAL
NASA2 : NASA4 (pc5, mc1)	21	LOC_BLANK : LOC_BLANK BRANCH_COUNT : BRANCH_COUNT LOC_CODE_AND_COMMENT : LOC_CODE_AND_COMMENT LOC_COMMENTS : LOC_COMMENTS CYCLOMATIC_COMPLEXITY : CYCLOMATIC_COMPLEXITY DESIGN_COMPLEXITY : DESIGN_COMPLEXITY ESSENTIAL_COMPLEXITY : ESSENTIAL_COMPLEXITY LOC_EXECUTABLE : LOC_EXECUTABLE HALSTEAD_CONTENT : HALSTEAD_CONTENT HALSTEAD_DIFFICULTY : HALSTEAD_DIFFICULTY HALSTEAD_EFFORT : HALSTEAD_EFFORT HALSTEAD_ERROR_EST : HALSTEAD_ERROR_EST HALSTEAD_LENGTH : HALSTEAD_LENGTH HALSTEAD_LEVEL : HALSTEAD_LEVEL HALSTEAD_PROG_TIME : HALSTEAD_PROG_TIME HALSTEAD_VOLUME : HALSTEAD_VOLUME NUM_OPERANDS : NUM_OPERANDS NUM_OPERATORS : NUM_OPERATORS NUM_UNIQUE_OPERANDS : NUM_UNIQUE_OPERANDS NUM_UNIQUE_OPERATORS : NUM_UNIQUE_OPERATORS LOC_TOTAL : LOC_TOTAL
NASA2 : NASA5 (mc2, kc3)	21	LOC_BLANK : LOC_BLANK BRANCH_COUNT : BRANCH_COUNT LOC_CODE_AND_COMMENT : LOC_CODE_AND_COMMENT LOC_COMMENTS : LOC_COMMENTS CYCLOMATIC_COMPLEXITY : CYCLOMATIC_COMPLEXITY DESIGN_COMPLEXITY : DESIGN_COMPLEXITY ESSENTIAL_COMPLEXITY : ESSENTIAL_COMPLEXITY LOC_EXECUTABLE : LOC_EXECUTABLE HALSTEAD_CONTENT : HALSTEAD_CONTENT HALSTEAD_DIFFICULTY : HALSTEAD_DIFFICULTY HALSTEAD_EFFORT : HALSTEAD_EFFORT HALSTEAD_ERROR_EST : HALSTEAD_ERROR_EST HALSTEAD_LENGTH : HALSTEAD_LENGTH HALSTEAD_LEVEL : HALSTEAD_LEVEL HALSTEAD_PROG_TIME : HALSTEAD_PROG_TIME HALSTEAD_VOLUME : HALSTEAD_VOLUME NUM_OPERANDS : NUM_OPERANDS NUM_OPERATORS : NUM_OPERATORS NUM_UNIQUE_OPERANDS : NUM_UNIQUE_OPERANDS NUM_UNIQUE_OPERATORS : NUM_UNIQUE_OPERATORS LOC_TOTAL : LOC_TOTAL
SOFTLAB : NASA2	20	total_loc : LOC_TOTAL blank_loc : LOC_BLANK comment_loc : LOC_COMMENTS code_and_comment_loc : LOC_CODE_AND_COMMENT executable_loc : LOC_EXECUTABLE unique_operands : NUM_UNIQUE_OPERANDS unique_operators : NUM_UNIQUE_OPERATORS total_operands : NUM_OPERANDS total_operators : NUM_OPERATORS halstead_vocabulary : HALSTEAD_CONTENT halstead_length : HALSTEAD_LENGTH halstead_volume : HALSTEAD_VOLUME halstead_level : HALSTEAD_LEVEL halstead_difficulty : HALSTEAD_DIFFICULTY halstead_effort : HALSTEAD_EFFORT halstead_error : HALSTEAD_ERROR_EST halstead_time : HALSTEAD_PROG_TIME branch_count : BRANCH_COUNT cyclomatic_complexity : CYCLOMATIC_COMPLEXITY design_complexity : DESIGN_COMPLEXITY
NASA3 : NASA4 (pc5, mc1)	35	BRANCH_COUNT : BRANCH_COUNT CALL_PAIRS : CALL_PAIRS LOC_CODE_AND_COMMENT : LOC_CODE_AND_COMMENT LOC_COMMENTS : LOC_COMMENTS CONDITION_COUNT : CONDITION_COUNT CYCLOMATIC_COMPLEXITY : CYCLOMATIC_COMPLEXITY CYCLOMATIC_DENSITY : CYCLOMATIC_DENSITY DECISION_COUNT : DECISION_COUNT DESIGN_COMPLEXITY : DESIGN_COMPLEXITY DESIGN_DENSITY : DESIGN_DENSITY EDGE_COUNT : EDGE_COUNT ESSENTIAL_COMPLEXITY : ESSENTIAL_COMPLEXITY ESSENTIAL_DENSITY : ESSENTIAL_DENSITY LOC_EXECUTABLE : LOC_EXECUTABLE PARAMETER_COUNT : PARAMETER_COUNT HALSTEAD_CONTENT : HALSTEAD_CONTENT HALSTEAD_DIFFICULTY : HALSTEAD_DIFFICULTY HALSTEAD_EFFORT : HALSTEAD_EFFORT HALSTEAD_ERROR_EST : HALSTEAD_ERROR_EST HALSTEAD_LENGTH : HALSTEAD_LENGTH HALSTEAD_LEVEL : HALSTEAD_LEVEL HALSTEAD_PROG_TIME : HALSTEAD_PROG_TIME HALSTEAD_VOLUME : HALSTEAD_VOLUME MAINTENANCE_SEVERITY : MAINTENANCE_SEVERITY MODIFIED_CONDITION_COUNT : MODIFIED_CONDITION_COUNT MULTIPLE_CONDITION_COUNT : MULTIPLE_CONDITION_COUNT NODE_COUNT : NODE_COUNT NORMALIZED_CYLOMATIC_COMPLEXITY : NORMALIZED_CYLOMATIC_COMPLEXITY NUM_OPERANDS : NUM_OPERANDS NUM_OPERATORS : NUM_OPERATORS NUM_UNIQUE_OPERANDS : NUM_UNIQUE_OPERANDS NUM_UNIQUE_OPERATORS : NUM_UNIQUE_OPERATORS NUMBER_OF_LINES : NUMBER_OF_LINES PERCENT_COMMENTS : PERCENT_COMMENTS LOC_TOTAL : LOC_TOTAL
NASA3 : NASA5 (mc2, kc3)	36	BRANCH_COUNT : BRANCH_COUNT CALL_PAIRS : CALL_PAIRS LOC_CODE_AND_COMMENT : LOC_CODE_AND_COMMENT LOC_COMMENTS : LOC_COMMENTS CONDITION_COUNT : CONDITION_COUNT CYCLOMATIC_COMPLEXITY : CYCLOMATIC_COMPLEXITY CYCLOMATIC_DENSITY : CYCLOMATIC_DENSITY DECISION_COUNT : DECISION_COUNT DECISION_DENSITY : DECISION_DENSITY DESIGN_COMPLEXITY : DESIGN_COMPLEXITY DESIGN_DENSITY : DESIGN_DENSITY EDGE_COUNT : EDGE_COUNT ESSENTIAL_COMPLEXITY : ESSENTIAL_COMPLEXITY ESSENTIAL_DENSITY : ESSENTIAL_DENSITY LOC_EXECUTABLE : LOC_EXECUTABLE PARAMETER_COUNT : PARAMETER_COUNT HALSTEAD_CONTENT : HALSTEAD_CONTENT HALSTEAD_DIFFICULTY : HALSTEAD_DIFFICULTY HALSTEAD_EFFORT : HALSTEAD_EFFORT HALSTEAD_ERROR_EST : HALSTEAD_ERROR_EST HALSTEAD_LENGTH : HALSTEAD_LENGTH HALSTEAD_LEVEL : HALSTEAD_LEVEL HALSTEAD_PROG_TIME : HALSTEAD_PROG_TIME HALSTEAD_VOLUME : HALSTEAD_VOLUME MAINTENANCE_SEVERITY : MAINTENANCE_SEVERITY MODIFIED_CONDITION_COUNT : MODIFIED_CONDITION_COUNT MULTIPLE_CONDITION_COUNT : MULTIPLE_CONDITION_COUNT NODE_COUNT : NODE_COUNT NORMALIZED_CYLOMATIC_COMPLEXITY : NORMALIZED_CYLOMATIC_COMPLEXITY NUM_OPERANDS : NUM_OPERANDS NUM_OPERATORS : NUM_OPERATORS NUM_UNIQUE_OPERANDS : NUM_UNIQUE_OPERANDS NUM_UNIQUE_OPERATORS : NUM_UNIQUE_OPERATORS NUMBER_OF_LINES : NUMBER_OF_LINES PERCENT_COMMENTS : PERCENT_COMMENTS LOC_TOTAL : LOC_TOTAL
SOFTLAB : NASA3	27	total_loc : LOC_TOTAL comment_loc : LOC_COMMENTS code_and_comment_loc : LOC_CODE_AND_COMMENT executable_loc : LOC_EXECUTABLE unique_operands : NUM_UNIQUE_OPERANDS unique_operators : NUM_UNIQUE_OPERATORS total_operands : NUM_OPERANDS total_operators : NUM_OPERATORS halstead_vocabulary : HALSTEAD_CONTENT halstead_length : HALSTEAD_LENGTH halstead_volume : HALSTEAD_VOLUME halstead_level : HALSTEAD_LEVEL halstead_difficulty : HALSTEAD_DIFFICULTY halstead_effort : HALSTEAD_EFFORT halstead_error : HALSTEAD_ERROR_EST halstead_time : HALSTEAD_PROG_TIME branch_count : BRANCH_COUNT decision_count : DECISION_COUNT call_pairs : CALL_PAIRS condition_count : CONDITION_COUNT multiple_condition_count : MULTIPLE_CONDITION_COUNT cyclomatic_complexity : CYCLOMATIC_COMPLEXITY cyclomatic_density : CYCLOMATIC_DENSITY decision_density : DECISION_DENSITY design_complexity : DESIGN_COMPLEXITY design_density : DESIGN_DENSITY normalized_cyclomatic_complexity : NORMALIZED_CYLOMATIC_COMPLEXITY
NASA4 : NASA5 (mc2, kc3)	38	LOC_BLANK : LOC_BLANK BRANCH_COUNT : BRANCH_COUNT CALL_PAIRS : CALL_PAIRS LOC_CODE_AND_COMMENT : LOC_CODE_AND_COMMENT LOC_COMMENTS : LOC_COMMENTS CONDITION_COUNT : CONDITION_COUNT CYCLOMATIC_COMPLEXITY : CYCLOMATIC_COMPLEXITY CYCLOMATIC_DENSITY : CYCLOMATIC_DENSITY DECISION_COUNT : DECISION_COUNT DESIGN_COMPLEXITY : DESIGN_COMPLEXITY DESIGN_DENSITY : DESIGN_DENSITY EDGE_COUNT : EDGE_COUNT ESSENTIAL_COMPLEXITY : ESSENTIAL_COMPLEXITY ESSENTIAL_DENSITY : ESSENTIAL_DENSITY LOC_EXECUTABLE : LOC_EXECUTABLE PARAMETER_COUNT : PARAMETER_COUNT GLOBAL_DATA_COMPLEXITY : GLOBAL_DATA_COMPLEXITY GLOBAL_DATA_DENSITY : GLOBAL_DATA_DENSITY HALSTEAD_CONTENT : HALSTEAD_CONTENT HALSTEAD_DIFFICULTY : HALSTEAD_DIFFICULTY HALSTEAD_EFFORT : HALSTEAD_EFFORT HALSTEAD_ERROR_EST : HALSTEAD_ERROR_EST HALSTEAD_LENGTH : HALSTEAD_LENGTH HALSTEAD_LEVEL : HALSTEAD_LEVEL HALSTEAD_PROG_TIME : HALSTEAD_PROG_TIME HALSTEAD_VOLUME : HALSTEAD_VOLUME MAINTENANCE_SEVERITY : MAINTENANCE_SEVERITY MODIFIED_CONDITION_COUNT : MODIFIED_CONDITION_COUNT MULTIPLE_CONDITION_COUNT : MULTIPLE_CONDITION_COUNT NODE_COUNT : NODE_COUNT NORMALIZED_CYLOMATIC_COMPLEXITY : NORMALIZED_CYLOMATIC_COMPLEXITY NUM_OPERANDS : NUM_OPERANDS NUM_OPERATORS : NUM_OPERATORS NUM_UNIQUE_OPERANDS : NUM_UNIQUE_OPERANDS NUM_UNIQUE_OPERATORS : NUM_UNIQUE_OPERATORS NUMBER_OF_LINES : NUMBER_OF_LINES PERCENT_COMMENTS : PERCENT_COMMENTS LOC_TOTAL : LOC_TOTAL
SOFTLAB : NASA4	27	total_loc : LOC_TOTAL blank_loc : LOC_BLANK comment_loc : LOC_COMMENTS code_and_comment_loc : LOC_CODE_AND_COMMENT executable_loc : LOC_EXECUTABLE unique_operands : NUM_UNIQUE_OPERANDS unique_operators : NUM_UNIQUE_OPERATORS total_operands : NUM_OPERANDS total_operators : NUM_OPERATORS halstead_vocabulary : HALSTEAD_CONTENT halstead_length : HALSTEAD_LENGTH halstead_volume : HALSTEAD_VOLUME halstead_level : HALSTEAD_LEVEL halstead_difficulty : HALSTEAD_DIFFICULTY halstead_effort : HALSTEAD_EFFORT halstead_error : HALSTEAD_ERROR_EST halstead_time : HALSTEAD_PROG_TIME branch_count : BRANCH_COUNT decision_count : DECISION_COUNT call_pairs : CALL_PAIRS condition_count : CONDITION_COUNT multiple_condition_count : MULTIPLE_CONDITION_COUNT cyclomatic_complexity : CYCLOMATIC_COMPLEXITY cyclomatic_density : CYCLOMATIC_DENSITY design_complexity : DESIGN_COMPLEXITY design_density : DESIGN_DENSITY normalized_cyclomatic_complexity : NORMALIZED_CYLOMATIC_COMPLEXITY
NASA5 : SOFTLAB	28	total_loc : LOC_TOTAL blank_loc : LOC_BLANK comment_loc : LOC_COMMENTS code_and_comment_loc : LOC_CODE_AND_COMMENT executable_loc : LOC_EXECUTABLE unique_operands : NUM_UNIQUE_OPERANDS unique_operators : NUM_UNIQUE_OPERATORS total_operands : NUM_OPERANDS total_operators : NUM_OPERATORS halstead_vocabulary : HALSTEAD_CONTENT halstead_length : HALSTEAD_LENGTH halstead_volume : HALSTEAD_VOLUME halstead_level : HALSTEAD_LEVEL halstead_difficulty : HALSTEAD_DIFFICULTY halstead_effort : HALSTEAD_EFFORT halstead_error : HALSTEAD_ERROR_EST halstead_time : HALSTEAD_PROG_TIME branch_count : BRANCH_COUNT decision_count : DECISION_COUNT call_pairs : CALL_PAIRS condition_count : CONDITION_COUNT multiple_condition_count : MULTIPLE_CONDITION_COUNT cyclomatic_complexity : CYCLOMATIC_COMPLEXITY cyclomatic_density : CYCLOMATIC_DENSITY decision_density : DECISION_DENSITY design_complexity : DESIGN_COMPLEXITY design_density : DESIGN_DENSITY normalized_cyclomatic_complexity : NORMALIZED_CYLOMATIC_COMPLEXITY

C. CPDP-CM and CPDP-RL vs. HDP

There might be bias in prediction results when defect ratio is very high. Thus, we conducted an additional experiment for CPDP-CM with random labels, i.e., CPDP-RL, by preserving defect ratios. To make sure, HDP performance in terms of AUC works well by the metric matchings that follows the defect-proneness tendency (the higher metric values, the more defect-proneness) but not affected by defect ratio of a dataset. As the following table shows, AUC values in CPDP-RL are consistent, about 0.500. The AUC of 0.500 represents random prediction results so that random labeling clearly leads those like random prediction models. This results show that defect ratios do not affect prediction results in terms of AUC in our experimental setting. If an AUC value of HDP is better than CPDP-CM and CPDP-RL, the AUC value is underlined or with asterisk (*) respectively in the table.

Targets	CPDP-CM	CPDP-RL	HDP
EQ	0.776 (-0.128,N)	0.502 (0.962,L)	0.776*
JDT	0.781 (0.153,S)	0.500 (1.000,L)	0.767*
LC	0.636 (0.059,N)	0.500 (0.695,L)	0.655
ML	0.651 (0.642,L)	0.500 (1.000,L)	0.692*
PDE	0.681 (0.064,S)	0.500 (0.996,L)	0.692*
Apache	0.697 (0.228,S)	0.500 (0.987,L)	0.720*
Safe	0.749 (0.409,M)	0.500 (0.891,L)	0.837*
ZXing	0.618 (0.481,L)	0.501 (0.994,L)	0.650*
ant-1.3	0.781 (0.163,S)	0.503 (0.778,L)	0.800*
arc	0.626 (0.523,L)	0.503 (0.941,L)	0.701
camel-1.0	0.590 (0.324,M)	0.502 (0.471,L)	0.639
poi-1.5	0.675 (0.230,S)	0.502 (0.979,L)	0.706*
redaktor	0.496 (0.067,N)	0.500 (0.133,S)	0.528
skarbonka	0.744 (-0.083,N)	0.500 (0.752,L)	0.694*
tomcat	0.675 (0.961,L)	0.503 (0.999,L)	0.737*
velocity-1.4	0.412 (-0.142,N)	0.500 (-0.543,L)	0.391
xalan-2.4	0.658 (-0.997,L)	0.500 (0.792,L)	0.560*
xerces-1.2	0.462 (0.446,M)	0.501 (-0.033,N)	0.497
cm1	0.597 (0.497,L)	0.500 (0.787,L)	0.720*
mw1	0.518 (0.482,L)	0.501 (0.695,L)	0.745
pc1	0.666 (0.814,L)	0.500 (1.000,L)	0.754*
pc3	0.665 (0.810,L)	0.499 (1.000,L)	0.738*
pc4	0.624 (0.204,S)	0.500 (0.995,L)	0.681*
jm1	0.571 (0.662,L)	0.500 (1.000,L)	0.688*
pc2	0.634 (0.795,L)	0.498 (1.000,L)	0.893*
pc5	0.841 (0.999,L)	0.500 (0.999,L)	0.950*
mc1	0.832 (0.970,L)	0.500 (0.999,L)	0.893*
mc2	0.536 (0.675,L)	0.501 (0.842,L)	0.682*
kc3	0.636 (0.254,S)	0.499 (0.746,L)	0.678*
ar1	0.464 (0.647,L)	0.482 (0.699,L)	0.735*
ar3	0.839 (0.243,S)	0.500 (0.881,L)	0.830*
ar4	0.588 (0.725,L)	0.498 (0.947,L)	0.805*
ar5	0.875 (0.287,S)	0.500 (0.743,L)	0.911*
ar6	0.613 (0.377,M)	0.493 (0.761,L)	0.676*
All	0.632	0.500	0.711*

Prediction Combination (source >> target)	WPDP (AUC)	HDP (AUC)	Win/Tie/Loss	# of matched metrics	Matched Metrics
ant-1.3 >> Apache	0.757	0.639	Loss	2	rfc:AvgLine loc:CountStmt
ant-1.3 >> ar1	0.614	0.732	Win	1	rfc:total_operators
ant-1.3 >> ar3	0.732	0.852	Win	2	rfc:unique_operands loc:halstead_length
ant-1.3 >> ar4	0.816	0.830	Win	3	rfc:executable_loc loc:halstead_time lcom:branch_count
ant-1.3 >> ar5	0.875	0.946	Win	3	rfc:unique_operands loc:halstead_length lcom:cyclomatic_complexity
ant-1.3 >> ar6	0.696	0.681	Loss	1	rfc:total_operators
ant-1.3 >> cm1	0.741	0.722	Loss	1	rfc:LOC_TOTAL
ant-1.3 >> kc3	0.647	0.691	Win	1	rfc:NUMBER_OF_LINES
ant-1.3 >> mc2	0.675	0.612	Loss	1	rfc:HALSTEAD_CONTENT
ant-1.3 >> mw1	0.726	0.745	Win	1	rfc:NUMBER_OF_LINES
ant-1.3 >> pc1	0.814	0.809	Loss	1	rfc:NUMBER_OF_LINES
ant-1.3 >> pc2	0.878	0.899	Win	1	rfc:HALSTEAD_LENGTH
ant-1.3 >> pc3	0.790	0.769	Loss	1	rfc:NUMBER_OF_LINES
ant-1.3 >> pc4	0.850	0.727	Loss	1	rfc:NUMBER_OF_LINES
ant-1.3 >> PDE	0.731	0.719	Loss	1	rfc:ck_oo_rfc
ant-1.3 >> Safe	0.829	0.877	Win	2	rfc:CountLineCodeDecl lcom:SumCyclomaticModified
Apache >> ar1	0.614	0.764	Win	1	SumCyclomaticModified:halstead_time
Apache >> ar3	0.732	0.843	Win	2	CountLine:halstead_volume SumCyclomaticModified:total_loc
Apache >> ar4	0.816	0.798	Loss	2	CountLineCode:halstead_time SumCyclomaticModified:total_operands
Apache >> ar5	0.875	0.911	Win	2	CountLine:halstead_volume SumCyclomaticModified:executable_loc
Apache >> ar6	0.696	0.538	Loss	1	SumCyclomaticModified:halstead_time
Apache >> cm1	0.741	0.720	Loss	1	CountLine:HALSTEAD_VOLUME
Apache >> EQ	0.801	0.782	Loss	1	SumCyclomaticModified:ck_oo_numberOfLinesOfCode
Apache >> JDT	0.817	0.767	Loss	1	SumCyclomaticModified:ck_oo_rfc
Apache >> jm1	0.705	0.691	Loss	1	CountLineCode:HALSTEAD_VOLUME
Apache >> LC	0.764	0.655	Loss	1	SumCyclomaticModified:ck_oo_numberOfLinesOfCode
Apache >> mc2	0.675	0.688	Win	2	CountLine:HALSTEAD_VOLUME SumCyclomaticModified:NUM_OPERANDS
Apache >> ML	0.719	0.692	Loss	1	SumCyclomaticModified:ck_oo_numberOfLinesOfCode
Apache >> mw1	0.726	0.710	Loss	2	CountLine:HALSTEAD_VOLUME CountLineCode:HALSTEAD_PROG_TIME
Apache >> pc1	0.814	0.751	Loss	1	CountLine:HALSTEAD_VOLUME
Apache >> pc3	0.790	0.740	Loss	1	CountLine:HALSTEAD_VOLUME
Apache >> pc4	0.850	0.684	Loss	1	CountLineCode:HALSTEAD_VOLUME
Apache >> skarbonka	0.589	0.694	Win	1	SumCyclomaticModified:amc
ar1 >> camel-1.0	0.722	0.485	Loss	1	unique_operators:amc
ar1 >> cm1	0.741	0.280	Loss	1	halstead_level:HALSTEAD_ERROR_EST
ar1 >> kc3	0.647	0.320	Loss	1	halstead_level:HALSTEAD_ERROR_EST
ar3 >> Apache	0.757	0.783	Win	1	halstead_volume:CountLine
ar3 >> cm1	0.741	0.720	Loss	2	halstead_volume:HALSTEAD_VOLUME halstead_error:HALSTEAD_ERROR_EST
ar3 >> EQ	0.801	0.785	Loss	1	cyclomatic_complexity:ck_oo_cbo
ar3 >> JDT	0.817	0.770	Loss	1	cyclomatic_complexity:ck_oo_fanOut
ar3 >> kc3	0.647	0.660	Win	1	halstead_volume:HALSTEAD_PROG_TIME
ar3 >> mc2	0.675	0.689	Win	2	halstead_volume:HALSTEAD_VOLUME halstead_error:HALSTEAD_ERROR_EST
ar3 >> mw1	0.726	0.746	Win	2	halstead_volume:HALSTEAD_VOLUME halstead_error:HALSTEAD_ERROR_EST
ar3 >> pc1	0.814	0.751	Loss	2	halstead_volume:HALSTEAD_VOLUME halstead_error:HALSTEAD_ERROR_EST
ar3 >> pc3	0.790	0.740	Loss	2	halstead_volume:HALSTEAD_VOLUME halstead_error:HALSTEAD_ERROR_EST
ar3 >> Safe	0.829	0.694	Loss	3	comment_loc:SumCyclomaticStrict halstead_error:RatioCommentToCode cyclomatic_complexity:SumCyclomaticModified
ar3 >> skarbonka	0.589	0.688	Win	2	comment_loc:lcom cyclomatic_complexity:wmc
ar4 >> Apache	0.757	0.734	Loss	2	total_operators:CountLineCodeDecl total_operands:CountStmtDecl
ar4 >> camel-1.0	0.722	0.639	Loss	1	total_operators:loc
ar4 >> cm1	0.741	0.732	Loss	3	halstead_length:HALSTEAD_LENGTH total_operators:NUM_OPERATORS total_operands:NUM_OPERANDS
ar4 >> jm1	0.705	0.685	Loss	3	total_operators:HALSTEAD_LENGTH total_operands:NUM_OPERATORS unique_operators:NUM_UNIQUE_OPERATORS
ar4 >> kc3	0.647	0.687	Win	3	halstead_length:HALSTEAD_LENGTH total_operators:NUM_OPERATORS total_operands:NUM_OPERANDS
ar4 >> LC	0.764	0.655	Loss	1	total_operands:ck_oo_numberOfLinesOfCode
ar4 >> mc2	0.675	0.624	Loss	3	halstead_length:HALSTEAD_LENGTH total_operators:NUM_OPERANDS total_operands:NUMBER_OF_LINES
ar4 >> ML	0.719	0.692	Loss	1	total_operands:ck_oo_numberOfLinesOfCode
ar4 >> mw1	0.726	0.660	Loss	3	total_operators:HALSTEAD_LENGTH total_operands:NUM_OPERATORS unique_operators:HALSTEAD_DIFFICULTY
ar4 >> pc1	0.814	0.754	Loss	3	halstead_length:HALSTEAD_LENGTH total_operators:NUM_OPERATORS total_operands:NUM_OPERANDS
ar4 >> pc3	0.790	0.738	Loss	1	total_operands:NUM_OPERANDS
ar4 >> pc4	0.850	0.663	Loss	3	total_operators:HALSTEAD_LENGTH total_operands:NUM_OPERATORS unique_operators:NUM_UNIQUE_OPERATORS
ar4 >> PDE	0.731	0.717	Loss	1	total_operators:ck_oo_numberOfLinesOfCode
ar4 >> poi-1.5	0.717	0.615	Loss	1	unique_operators:amc
ar4 >> redaktor	0.719	0.556	Loss	1	unique_operators:cbo
ar4 >> Safe	0.829	0.834	Win	3	halstead_length:CountLine total_operators:CountLineCode total_operands:CountSemicolon
ar4 >> velocity-1.4	0.714	0.391	Loss	1	halstead_length:loc
ar4 >> ZXing	0.626	0.643	Win	2	total_operators:CountLine total_operands:CountLineCode
ar5 >> ant-1.3	0.800	0.840	Win	2	halstead_vocabulary:rfc halstead_difficulty:wmc
ar5 >> Apache	0.757	0.690	Loss	3	halstead_vocabulary:AvgLine unique_operators:MaxCyclomaticModified halstead_difficulty:MaxCyclomatic
ar5 >> arc	0.726	0.701	Loss	1	halstead_difficulty:rfc
ar5 >> camel-1.0	0.722	0.333	Loss	2	unique_operators:amc halstead_difficulty:rfc
ar5 >> cm1	0.741	0.655	Loss	3	halstead_vocabulary:HALSTEAD_CONTENT unique_operators:CONDITION_COUNT halstead_difficulty:LOC_BLANK
ar5 >> JDT	0.817	0.763	Loss	2	halstead_vocabulary:ck_oo_rfc unique_operators:ck_oo_numberOfMethods
ar5 >> jm1	0.705	0.608	Loss	4	halstead_vocabulary:NUM_OPERATORS unique_operators:NUM_UNIQUE_OPERATORS halstead_difficulty:NUM_UNIQUE_OPERANDS halstead_level:HALSTEAD_LEVEL
ar5 >> kc3	0.647	0.684	Win	2	halstead_vocabulary:HALSTEAD_CONTENT halstead_difficulty:CONDITION_COUNT
ar5 >> LC	0.764	0.221	Loss	4	halstead_vocabulary:ck_oo_numberOfLinesOfCode unique_operators:ck_oo_wmc halstead_difficulty:ck_oo_rfc halstead_level:CvsLogEntropy
ar5 >> mc1	0.885	0.893	Win	1	halstead_difficulty:HALSTEAD_CONTENT
ar5 >> mc2	0.675	0.705	Win	3	halstead_vocabulary:NUMBER_OF_LINES unique_operators:BRANCH_COUNT halstead_difficulty:CONDITION_COUNT
ar5 >> ML	0.719	0.692	Loss	2	halstead_vocabulary:ck_oo_numberOfLinesOfCode halstead_difficulty:ck_oo_rfc
ar5 >> mw1	0.726	0.276	Loss	4	halstead_vocabulary:HALSTEAD_CONTENT unique_operators:HALSTEAD_DIFFICULTY halstead_difficulty:PERCENT_COMMENTS halstead_level:HALSTEAD_ERROR_EST
ar5 >> pc1	0.814	0.727	Loss	3	halstead_vocabulary:NUM_OPERANDS unique_operators:BRANCH_COUNT halstead_difficulty:CONDITION_COUNT
ar5 >> pc2	0.878	0.882	Win	2	unique_operators:NUMBER_OF_LINES halstead_difficulty:NUM_OPERANDS
ar5 >> pc3	0.790	0.714	Loss	4	halstead_vocabulary:NUM_OPERANDS unique_operators:CONDITION_COUNT halstead_difficulty:HALSTEAD_DIFFICULTY halstead_level:HALSTEAD_LEVEL
ar5 >> pc4	0.850	0.579	Loss	4	halstead_vocabulary:NUM_OPERATORS unique_operators:NUM_UNIQUE_OPERANDS halstead_difficulty:LOC_EXECUTABLE halstead_level:HALSTEAD_LEVEL
ar5 >> pc5	0.932	0.950	Win	1	halstead_difficulty:HALSTEAD_VOLUME
ar5 >> PDE	0.731	0.692	Loss	1	halstead_difficulty:ck_oo_wmc
ar5 >> poi-1.5	0.717	0.689	Loss	2	unique_operators:wmc halstead_difficulty:amc
ar5 >> redaktor	0.719	0.378	Loss	2	unique_operators:wmc halstead_difficulty:cbo
ar5 >> Safe	0.829	0.813	Loss	3	halstead_vocabulary:CountSemicolon unique_operators:AvgLineCode halstead_difficulty:AvgLine
ar5 >> skarbonka	0.589	0.789	Win	1	halstead_difficulty:rfc
ar5 >> tomcat	0.814	0.737	Loss	1	halstead_difficulty:amc
ar5 >> velocity-1.4	0.714	0.316	Loss	1	halstead_difficulty:amc
ar5 >> xalan-2.4	0.772	0.560	Loss	2	unique_operators:cbo halstead_difficulty:amc
ar5 >> xerces-1.2	0.504	0.489	Loss	1	halstead_difficulty:rfc
ar5 >> ZXing	0.626	0.650	Win	3	halstead_vocabulary:CountLineCode unique_operators:CountStmtDecl halstead_difficulty:CountLineCodeDecl
ar6 >> ant-1.3	0.800	0.656	Loss	1	halstead_vocabulary:amc
ar6 >> cm1	0.741	0.740	Tie	1	halstead_vocabulary:NUM_UNIQUE_OPERANDS
ar6 >> kc3	0.647	0.678	Win	1	halstead_vocabulary:NUM_UNIQUE_OPERANDS
ar6 >> mc2	0.675	0.709	Win	1	halstead_vocabulary:HALSTEAD_DIFFICULTY
ar6 >> mw1	0.726	0.747	Win	1	halstead_vocabulary:EDGE_COUNT
ar6 >> pc1	0.814	0.757	Loss	1	halstead_vocabulary:LOC_EXECUTABLE
ar6 >> pc2	0.878	0.893	Win	1	halstead_vocabulary:NUM_OPERATORS
ar6 >> pc3	0.790	0.723	Loss	1	halstead_vocabulary:LOC_TOTAL
ar6 >> Safe	0.829	0.874	Win	1	halstead_vocabulary:CountStmtDecl
arc >> Apache	0.757	0.681	Loss	2	rfc:MaxCyclomaticModified loc:SumCyclomaticStrict
arc >> ar1	0.614	0.460	Loss	2	rfc:total_loc loc:halstead_time
arc >> ar3	0.732	0.696	Loss	3	ce:design_complexity rfc:blank_loc loc:total_loc
arc >> ar4	0.816	0.798	Loss	1	rfc:halstead_difficulty
arc >> ar5	0.875	0.661	Loss	3	ce:call_pairs rfc:blank_loc loc:total_loc
arc >> ar6	0.696	0.672	Loss	2	rfc:executable_loc loc:halstead_time
arc >> Safe	0.829	0.428	Loss	2	rfc:AvgLine loc:CountStmt
arc >> ZXing	0.626	0.647	Win	1	rfc:CountStmtExe
camel-1.0 >> ar5	0.875	0.911	Win	2	ca:design_complexity cbo:cyclomatic_complexity
camel-1.0 >> kc3	0.647	0.694	Win	1	cbo:CALL_PAIRS
cm1 >> ant-1.3	0.800	0.292	Loss	2	LOC_EXECUTABLE:amc LOC_TOTAL:rfc
cm1 >> ar3	0.732	0.518	Loss	3	LOC_EXECUTABLE:unique_operands LOC_TOTAL:executable_loc HALSTEAD_CONTENT:halstead_vocabulary
cm1 >> ar4	0.816	0.807	Loss	3	LOC_EXECUTABLE:executable_loc LOC_COMMENTS:branch_count HALSTEAD_CONTENT:total_operands
cm1 >> ar5	0.875	0.214	Loss	5	LOC_EXECUTABLE:executable_loc LOC_TOTAL:total_loc LOC_COMMENTS:cyclomatic_complexity HALSTEAD_CONTENT:halstead_vocabulary PERCENT_COMMENTS:unique_operands
cm1 >> ar6	0.696	0.630	Loss	1	HALSTEAD_CONTENT:halstead_length
cm1 >> kc3	0.647	0.566	Loss	3	LOC_EXECUTABLE:EDGE_COUNT LOC_TOTAL:NUMBER_OF_LINES HALSTEAD_CONTENT:HALSTEAD_CONTENT
cm1 >> mc2	0.675	0.697	Win	2	LOC_TOTAL:HALSTEAD_CONTENT HALSTEAD_CONTENT:NUMBER_OF_LINES
cm1 >> Safe	0.829	0.856	Win	2	LOC_COMMENTS:SumCyclomaticModified PERCENT_COMMENTS:CountLineCodeDecl
cm1 >> skarbonka	0.589	0.764	Win	2	LOC_COMMENTS:lcom PERCENT_COMMENTS:rfc
EQ >> ar3	0.732	0.823	Win	1	ck_oo_numberOfMethods:cyclomatic_complexity
EQ >> ar4	0.816	0.794	Loss	1	ck_oo_numberOfMethods:cyclomatic_complexity
EQ >> ar5	0.875	0.911	Win	2	ck_oo_numberOfAttributes:design_complexity ck_oo_numberOfMethods:cyclomatic_complexity
EQ >> Safe	0.829	0.770	Loss	2	ck_oo_numberOfMethods:SumEssential ck_oo_lcom:SumCyclomaticStrict
EQ >> skarbonka	0.589	0.733	Win	2	ck_oo_numberOfMethods:wmc ck_oo_lcom:lcom
JDT >> Apache	0.757	0.776	Win	1	ck_oo_rfc:SumCyclomaticModified
JDT >> ar1	0.614	0.736	Win	1	ck_oo_rfc:halstead_length
JDT >> ar3	0.732	0.833	Win	2	ck_oo_rfc:executable_loc ck_oo_numberOfLinesOfCode:total_operators
JDT >> ar4	0.816	0.791	Loss	1	numberOfBugsFoundUntil::decision_count
JDT >> ar5	0.875	0.911	Win	3	ck_oo_rfc:executable_loc ck_oo_numberOfLinesOfCode:total_operators numberOfBugsFoundUntil::cyclomatic_complexity
JDT >> ar6	0.696	0.681	Loss	1	ck_oo_rfc:total_operators
JDT >> mc2	0.675	0.678	Tie	2	ck_oo_rfc:LOC_TOTAL ck_oo_numberOfLinesOfCode:NUM_OPERATORS
JDT >> Safe	0.829	0.791	Loss	3	ck_oo_rfc:CountLineCodeDecl ck_oo_numberOfLinesOfCode:CountLineCode numberOfBugsFoundUntil::SumEssential
JDT >> skarbonka	0.589	0.681	Win	2	ck_oo_rfc:rfc numberOfBugsFoundUntil::npm
JDT >> velocity-1.4	0.714	0.391	Loss	1	ck_oo_numberOfLinesOfCode:loc
jm1 >> ant-1.3	0.800	0.656	Loss	1	LOC_TOTAL:amc
jm1 >> Apache	0.757	0.736	Loss	2	HALSTEAD_VOLUME:CountLineCode HALSTEAD_LENGTH:CountLineCodeDecl
jm1 >> ar3	0.732	0.848	Win	2	LOC_TOTAL:unique_operands HALSTEAD_LENGTH:total_operands
jm1 >> ar4	0.816	0.521	Loss	3	LOC_TOTAL:blank_loc HALSTEAD_VOLUME:halstead_time HALSTEAD_LENGTH:total_loc
jm1 >> ar5	0.875	0.571	Loss	3	LOC_TOTAL:unique_operands HALSTEAD_VOLUME:halstead_volume HALSTEAD_LENGTH:total_operands
jm1 >> ar6	0.696	0.681	Loss	1	LOC_TOTAL:total_operators
jm1 >> mc2	0.675	0.675	Tie	2	LOC_TOTAL:LOC_EXECUTABLE HALSTEAD_LENGTH:NUM_OPERATORS
jm1 >> Safe	0.829	0.877	Win	2	LOC_TOTAL:CountLineCodeDecl HALSTEAD_LENGTH:CountLineCode
kc3 >> ant-1.3	0.800	0.800	Tie	1	CALL_PAIRS:wmc
kc3 >> ar5	0.875	0.688	Loss	1	LOC_BLANK:call_pairs
kc3 >> camel-1.0	0.722	0.771	Win	1	CALL_PAIRS:cbo
kc3 >> skarbonka	0.589	0.689	Win	1	CYCLOMATIC_COMPLEXITY:cbo
kc3 >> velocity-1.4	0.714	0.589	Loss	1	CALL_PAIRS:cbo
LC >> ar5	0.875	0.688	Loss	1	CvsEntropy:design_complexity
LC >> skarbonka	0.589	0.660	Win	1	CvsEntropy:npm
mc1 >> ar3	0.732	0.830	Win	1	HALSTEAD_VOLUME:executable_loc
mc1 >> ar5	0.875	0.911	Win	1	HALSTEAD_VOLUME:executable_loc
mc1 >> Safe	0.829	0.856	Win	1	HALSTEAD_VOLUME:CountSemicolon
mc2 >> ant-1.3	0.800	0.656	Loss	1	HALSTEAD_DIFFICULTY:amc
mc2 >> Apache	0.757	0.630	Loss	2	GLOBAL_DATA_COMPLEXITY:AvgCyclomaticModified HALSTEAD_DIFFICULTY:AvgLineCode
mc2 >> ar1	0.614	0.750	Win	2	HALSTEAD_PROG_TIME:halstead_effort NODE_COUNT:halstead_vocabulary
mc2 >> ar3	0.732	0.852	Win	3	HALSTEAD_DIFFICULTY:unique_operands HALSTEAD_EFFORT:halstead_effort HALSTEAD_PROG_TIME:halstead_time
mc2 >> ar4	0.816	0.805	Loss	3	GLOBAL_DATA_COMPLEXITY:cyclomatic_complexity HALSTEAD_DIFFICULTY:unique_operands NODE_COUNT:blank_loc
mc2 >> ar5	0.875	0.946	Win	4	HALSTEAD_DIFFICULTY:unique_operands HALSTEAD_EFFORT:halstead_effort HALSTEAD_PROG_TIME:halstead_time NODE_COUNT:halstead_difficulty
mc2 >> ar6	0.696	0.724	Win	3	HALSTEAD_DIFFICULTY:halstead_vocabulary HALSTEAD_PROG_TIME:halstead_effort NODE_COUNT:total_loc
mc2 >> camel-1.0	0.722	0.765	Win	1	GLOBAL_DATA_COMPLEXITY:npm
mc2 >> cm1	0.741	0.723	Loss	2	HALSTEAD_DIFFICULTY:NUM_UNIQUE_OPERANDS NODE_COUNT:EDGE_COUNT
mc2 >> jm1	0.705	0.709	Win	1	HALSTEAD_DIFFICULTY:LOC_TOTAL
mc2 >> mw1	0.726	0.767	Win	3	GLOBAL_DATA_COMPLEXITY:CALL_PAIRS HALSTEAD_DIFFICULTY:NUM_UNIQUE_OPERANDS NODE_COUNT:NODE_COUNT
mc2 >> pc1	0.814	0.779	Loss	2	HALSTEAD_DIFFICULTY:LOC_TOTAL NODE_COUNT:NUM_UNIQUE_OPERANDS
mc2 >> pc2	0.878	0.893	Win	1	NODE_COUNT:NUM_OPERATORS
mc2 >> pc3	0.790	0.716	Loss	2	HALSTEAD_DIFFICULTY:LOC_TOTAL NODE_COUNT:EDGE_COUNT
mc2 >> pc4	0.850	0.680	Loss	1	HALSTEAD_DIFFICULTY:HALSTEAD_CONTENT
mc2 >> poi-1.5	0.717	0.727	Win	1	HALSTEAD_DIFFICULTY:rfc
mc2 >> redaktor	0.719	0.499	Loss	1	HALSTEAD_DIFFICULTY:rfc
mc2 >> Safe	0.829	0.882	Win	2	HALSTEAD_DIFFICULTY:CountLineCodeDecl NODE_COUNT:CountStmtDecl
mc2 >> skarbonka	0.589	0.789	Win	2	GLOBAL_DATA_COMPLEXITY:npm HALSTEAD_DIFFICULTY:rfc
mc2 >> velocity-1.4	0.714	0.444	Loss	1	HALSTEAD_DIFFICULTY:rfc
ML >> ar4	0.816	0.794	Loss	1	numberOfBugsFoundUntil::cyclomatic_complexity
ML >> mc2	0.675	0.714	Win	1	numberOfBugsFoundUntil::MODIFIED_CONDITION_COUNT
ML >> skarbonka	0.589	0.660	Win	1	numberOfBugsFoundUntil::npm
mw1 >> ant-1.3	0.800	0.844	Win	2	NUMBER_OF_LINES:rfc LOC_BLANK:ce
mw1 >> Apache	0.757	0.637	Loss	1	NUMBER_OF_LINES:AvgLine
mw1 >> ar1	0.614	0.734	Win	1	EDGE_COUNT:halstead_vocabulary
mw1 >> ar3	0.732	0.852	Win	1	NUMBER_OF_LINES:unique_operands
mw1 >> ar4	0.816	0.827	Win	3	EDGE_COUNT:unique_operands NUMBER_OF_LINES:halstead_vocabulary LOC_BLANK:cyclomatic_complexity
mw1 >> ar5	0.875	0.946	Win	2	EDGE_COUNT:unique_operands NUMBER_OF_LINES:halstead_vocabulary
mw1 >> ar6	0.696	0.708	Win	1	EDGE_COUNT:halstead_vocabulary
mw1 >> kc3	0.647	0.663	Win	1	EDGE_COUNT:LOC_EXECUTABLE
mw1 >> mc2	0.675	0.634	Loss	4	NODE_COUNT:NODE_COUNT EDGE_COUNT:HALSTEAD_DIFFICULTY NUMBER_OF_LINES:HALSTEAD_CONTENT LOC_BLANK:MODIFIED_CONDITION_COUNT
mw1 >> ML	0.719	0.702	Loss	1	LOC_BLANK:ck_oo_cbo
mw1 >> redaktor	0.719	0.633	Loss	1	LOC_BLANK:ce
mw1 >> Safe	0.829	0.861	Win	2	NODE_COUNT:CountStmtDecl EDGE_COUNT:CountLineCodeDecl
mw1 >> skarbonka	0.589	0.710	Win	2	LOC_BLANK:wmc DESIGN_COMPLEXITY:npm
pc1 >> ant-1.3	0.800	0.823	Win	2	HALSTEAD_CONTENT:rfc LOC_TOTAL:amc
pc1 >> ar1	0.614	0.734	Win	1	NUM_UNIQUE_OPERANDS:halstead_vocabulary
pc1 >> ar3	0.732	0.833	Win	2	HALSTEAD_CONTENT:executable_loc LOC_TOTAL:unique_operands
pc1 >> ar4	0.816	0.844	Win	2	HALSTEAD_CONTENT:halstead_vocabulary LOC_TOTAL:unique_operands
pc1 >> ar5	0.875	0.286	Loss	4	HALSTEAD_CONTENT:halstead_vocabulary NUM_UNIQUE_OPERANDS:halstead_difficulty LOC_TOTAL:unique_operands LOC_EXECUTABLE:executable_loc
pc1 >> ar6	0.696	0.708	Win	1	LOC_EXECUTABLE:halstead_vocabulary
pc1 >> kc3	0.647	0.685	Win	2	LOC_TOTAL:LOC_TOTAL LOC_EXECUTABLE:LOC_EXECUTABLE
pc1 >> mc2	0.675	0.398	Loss	4	HALSTEAD_CONTENT:HALSTEAD_CONTENT NUM_UNIQUE_OPERANDS:NUM_UNIQUE_OPERANDS LOC_TOTAL:HALSTEAD_DIFFICULTY LOC_EXECUTABLE:EDGE_COUNT
pc1 >> Safe	0.829	0.872	Win	2	NUM_UNIQUE_OPERANDS:CountStmtDecl LOC_EXECUTABLE:CountLineCodeDecl
pc2 >> ant-1.3	0.800	0.822	Win	1	CYCLOMATIC_DENSITY:cam
pc2 >> ar5	0.875	0.893	Win	1	HALSTEAD_CONTENT:halstead_difficulty
pc2 >> skarbonka	0.589	0.733	Win	2	CYCLOMATIC_DENSITY:cam NUM_UNIQUE_OPERANDS:cbo
pc3 >> ant-1.3	0.800	0.840	Win	1	HALSTEAD_CONTENT:rfc
pc3 >> ar1	0.614	0.734	Win	1	NUM_UNIQUE_OPERANDS:halstead_vocabulary
pc3 >> ar3	0.732	0.852	Win	1	HALSTEAD_CONTENT:unique_operands
pc3 >> ar4	0.816	0.812	Tie	1	NUM_UNIQUE_OPERANDS:unique_operands
pc3 >> ar5	0.875	0.911	Win	3	LOC_BLANK:cyclomatic_complexity HALSTEAD_CONTENT:unique_operands NUM_UNIQUE_OPERANDS:halstead_difficulty
pc3 >> ar6	0.696	0.708	Win	1	NUM_UNIQUE_OPERANDS:halstead_vocabulary
pc3 >> mc2	0.675	0.671	Tie	2	HALSTEAD_CONTENT:HALSTEAD_CONTENT NUM_UNIQUE_OPERANDS:NUM_UNIQUE_OPERANDS
pc3 >> Safe	0.829	0.786	Loss	2	LOC_BLANK:SumEssential NUM_UNIQUE_OPERANDS:CountStmtDecl
pc3 >> skarbonka	0.589	0.660	Win	1	LOC_BLANK:npm
poi-1.5 >> ar1	0.614	0.700	Win	1	wmc:unique_operands
poi-1.5 >> ar3	0.732	0.805	Win	2	wmc:unique_operators loc:halstead_length
poi-1.5 >> ar4	0.816	0.798	Loss	1	wmc:halstead_difficulty
poi-1.5 >> ar5	0.875	0.929	Win	2	wmc:unique_operators loc:halstead_length
poi-1.5 >> ar6	0.696	0.724	Win	2	wmc:unique_operands loc:halstead_volume
poi-1.5 >> Safe	0.829	0.626	Loss	2	wmc:AvgLineCode loc:CountLine
Safe >> ar1	0.614	0.250	Loss	2	CountLineCodeExe:halstead_time CountStmt:halstead_length
Safe >> ar3	0.732	0.824	Win	3	CountLineCodeExe:branch_count CountStmtExe:executable_loc CountStmt:total_loc
Safe >> ar4	0.816	0.841	Win	1	CountStmt:total_loc
Safe >> ar5	0.875	0.929	Win	3	CountLineCodeExe:executable_loc CountStmtExe:branch_count CountStmt:total_loc
Safe >> ar6	0.696	0.532	Loss	2	CountLineCodeExe:halstead_time CountStmt:halstead_length
Safe >> arc	0.726	0.670	Loss	1	CountStmt:loc
Safe >> camel-1.0	0.722	0.639	Loss	1	CountStmt:loc
Safe >> cm1	0.741	0.704	Loss	1	CountStmt:NUM_OPERANDS
Safe >> EQ	0.801	0.585	Loss	3	CountLineCodeExe:ck_oo_rfc CountStmtExe:ck_oo_lcom CountStmt:ck_oo_numberOfLinesOfCode
Safe >> JDT	0.817	0.693	Loss	1	CountStmtExe:ck_oo_lcom
Safe >> jm1	0.705	0.689	Loss	1	CountStmt:HALSTEAD_LENGTH
Safe >> kc3	0.647	0.665	Win	1	CountStmt:NUM_OPERANDS
Safe >> LC	0.764	0.655	Loss	1	CountStmt:ck_oo_numberOfLinesOfCode
Safe >> mc2	0.675	0.686	Win	1	CountStmt:NUM_OPERANDS
Safe >> ML	0.719	0.692	Loss	1	CountStmt:ck_oo_numberOfLinesOfCode
Safe >> pc2	0.878	0.872	Loss	1	CountStmt:HALSTEAD_PROG_TIME
Safe >> pc4	0.850	0.682	Loss	1	CountStmt:HALSTEAD_LENGTH
Safe >> PDE	0.731	0.591	Loss	2	CountStmtExe:ck_oo_lcom CountStmt:ck_oo_numberOfLinesOfCode
Safe >> poi-1.5	0.717	0.723	Win	1	CountStmtExe:lcom
Safe >> skarbonka	0.589	0.694	Win	1	CountLineCodeExe:amc
Safe >> velocity-1.4	0.714	0.391	Loss	1	CountStmt:loc
Safe >> xerces-1.2	0.504	0.505	Win	2	CountLineCodeExe:lcom CountStmt:loc
skarbonka >> Apache	0.757	0.706	Loss	1	rfc:MaxCyclomaticStrict
skarbonka >> ar1	0.614	0.739	Win	1	rfc:total_operands
skarbonka >> ar3	0.732	0.821	Win	1	rfc:blank_loc
skarbonka >> ar4	0.816	0.820	Win	1	rfc:blank_loc
skarbonka >> ar5	0.875	0.911	Win	1	rfc:executable_loc
skarbonka >> ar6	0.696	0.615	Loss	1	rfc:total_operands
skarbonka >> cm1	0.741	0.645	Loss	1	rfc:PERCENT_COMMENTS
skarbonka >> EQ	0.801	0.771	Loss	1	rfc:ck_oo_rfc
skarbonka >> JDT	0.817	0.785	Loss	1	rfc:ck_oo_wmc
skarbonka >> jm1	0.705	0.688	Loss	1	rfc:NUM_OPERANDS
skarbonka >> LC	0.764	0.641	Loss	1	rfc:ck_oo_rfc
skarbonka >> mc2	0.675	0.660	Loss	1	rfc:NUM_UNIQUE_OPERANDS
skarbonka >> ML	0.719	0.692	Loss	1	rfc:ck_oo_rfc
skarbonka >> pc4	0.850	0.678	Loss	1	rfc:NUM_OPERANDS
skarbonka >> PDE	0.731	0.667	Loss	1	rfc:ck_oo_lcom
skarbonka >> Safe	0.829	0.837	Win	1	rfc:CountLineBlank
skarbonka >> ZXing	0.626	0.650	Win	1	rfc:CountSemicolon
tomcat >> Apache	0.757	0.762	Win	1	loc:CountSemicolon
tomcat >> ar1	0.614	0.739	Win	2	rfc:total_operands loc:halstead_volume
tomcat >> ar4	0.816	0.820	Win	1	rfc:blank_loc
tomcat >> ar5	0.875	0.964	Win	2	rfc:blank_loc loc:halstead_length
tomcat >> ar6	0.696	0.615	Loss	1	rfc:total_operands
tomcat >> LC	0.764	0.641	Loss	1	rfc:ck_oo_rfc
tomcat >> mc2	0.675	0.660	Loss	1	rfc:NUM_UNIQUE_OPERANDS
tomcat >> Safe	0.829	0.872	Win	2	rfc:CountStmtDecl loc:CountLine
tomcat >> ZXing	0.626	0.650	Win	1	rfc:CountSemicolon
xalan-2.4 >> Apache	0.757	0.762	Win	1	loc:CountStmt
xalan-2.4 >> ar1	0.614	0.736	Win	1	loc:halstead_volume
xalan-2.4 >> ar3	0.732	0.830	Win	1	loc:halstead_length
xalan-2.4 >> ar5	0.875	0.839	Loss	2	loc:halstead_length max_cc:design_complexity
xalan-2.4 >> ar6	0.696	0.653	Loss	1	loc:halstead_volume
xalan-2.4 >> mc2	0.675	0.688	Win	1	loc:HALSTEAD_LENGTH
xalan-2.4 >> Safe	0.829	0.829	Tie	1	loc:CountLine
ZXing >> ant-1.3	0.800	0.704	Loss	1	CountLineBlank:npm
ZXing >> ar1	0.614	0.764	Win	3	CountLineBlank:halstead_difficulty CountLineCodeDecl:total_loc CountLineCode:halstead_length
ZXing >> ar3	0.732	0.821	Win	2	CountLineCodeDecl:halstead_difficulty CountLineCode:executable_loc
ZXing >> ar4	0.816	0.774	Loss	2	CountLineCodeDecl:halstead_difficulty CountLineCode:total_operands
ZXing >> ar5	0.875	0.929	Win	3	CountLineBlank:cyclomatic_complexity CountLineCodeDecl:halstead_difficulty CountLineCode:total_loc
ZXing >> ar6	0.696	0.654	Loss	3	CountLineBlank:halstead_difficulty CountLineCodeDecl:total_operands CountLineCode:halstead_length
ZXing >> arc	0.726	0.710	Loss	2	CountLineBlank:wmc CountLineCodeDecl:rfc
ZXing >> camel-1.0	0.722	0.694	Loss	1	CountLineCodeDecl:rfc
ZXing >> LC	0.764	0.655	Loss	1	CountLineCode:ck_oo_numberOfLinesOfCode
ZXing >> mc2	0.675	0.701	Win	1	CountLineCode:NUMBER_OF_LINES
ZXing >> pc4	0.850	0.685	Loss	1	CountLineCode:NUM_OPERATORS
ZXing >> skarbonka	0.589	0.717	Win	1	CountLineBlank:wmc

Prediction Combination
(source >> target)

WPDP (AUC)

HDP (AUC)

Win/Tie/Loss

# of matched metrics

Matched Metrics

ant-1.3 >> Apache

0.757

0.639

Loss

rfc:AvgLine
loc:CountStmt

ant-1.3 >> ar1

0.614

0.732

Win

rfc:total_operators

ant-1.3 >> ar3

0.732

0.852

Win

rfc:unique_operands
loc:halstead_length

ant-1.3 >> ar4

0.816

0.830

Win

rfc:executable_loc
loc:halstead_time
lcom:branch_count

ant-1.3 >> ar5

0.875

0.946

Win

rfc:unique_operands
loc:halstead_length
lcom:cyclomatic_complexity

ant-1.3 >> ar6

0.696

0.681

Loss

rfc:total_operators

ant-1.3 >> cm1

0.741

0.722

Loss

rfc:LOC_TOTAL

ant-1.3 >> kc3

0.647

0.691

Win

rfc:NUMBER_OF_LINES

ant-1.3 >> mc2

0.675

0.612

Loss

rfc:HALSTEAD_CONTENT

ant-1.3 >> mw1

0.726

0.745

Win

rfc:NUMBER_OF_LINES

ant-1.3 >> pc1

0.814

0.809

Loss

rfc:NUMBER_OF_LINES

ant-1.3 >> pc2

0.878

0.899

Win

rfc:HALSTEAD_LENGTH

ant-1.3 >> pc3

0.790

0.769

Loss

rfc:NUMBER_OF_LINES

ant-1.3 >> pc4

0.850

0.727

Loss

rfc:NUMBER_OF_LINES

ant-1.3 >> PDE

0.731

0.719

Loss

rfc:ck_oo_rfc

ant-1.3 >> Safe

0.829

0.877

Win

rfc:CountLineCodeDecl
lcom:SumCyclomaticModified

Apache >> ar1

0.614

0.764

Win

SumCyclomaticModified:halstead_time

Apache >> ar3

0.732

0.843

Win

CountLine:halstead_volume
SumCyclomaticModified:total_loc

Apache >> ar4

0.816

0.798

Loss

CountLineCode:halstead_time
SumCyclomaticModified:total_operands

Apache >> ar5

0.875

0.911

Win

CountLine:halstead_volume
SumCyclomaticModified:executable_loc

Apache >> ar6

0.696

0.538

Loss

SumCyclomaticModified:halstead_time

Apache >> cm1

0.741

0.720

Loss

CountLine:HALSTEAD_VOLUME

Apache >> EQ

0.801

0.782

Loss

SumCyclomaticModified:ck_oo_numberOfLinesOfCode

Apache >> JDT

0.817

0.767

Loss

SumCyclomaticModified:ck_oo_rfc

Apache >> jm1

0.705

0.691

Loss

CountLineCode:HALSTEAD_VOLUME

Apache >> LC

0.764

0.655

Loss

SumCyclomaticModified:ck_oo_numberOfLinesOfCode

Apache >> mc2

0.675

0.688

Win

CountLine:HALSTEAD_VOLUME
SumCyclomaticModified:NUM_OPERANDS

Apache >> ML

0.719

0.692

Loss

SumCyclomaticModified:ck_oo_numberOfLinesOfCode

Apache >> mw1

0.726

0.710

Loss

CountLine:HALSTEAD_VOLUME
CountLineCode:HALSTEAD_PROG_TIME

Apache >> pc1

0.814

0.751

Loss

CountLine:HALSTEAD_VOLUME

Apache >> pc3

0.790

0.740

Loss

CountLine:HALSTEAD_VOLUME

Apache >> pc4

0.850

0.684

Loss

CountLineCode:HALSTEAD_VOLUME

Apache >> skarbonka

0.589

0.694

Win

SumCyclomaticModified:amc

ar1 >> camel-1.0

0.722

0.485

Loss

unique_operators:amc

ar1 >> cm1

0.741

0.280

Loss

halstead_level:HALSTEAD_ERROR_EST

ar1 >> kc3

0.647

0.320

Loss

halstead_level:HALSTEAD_ERROR_EST

ar3 >> Apache

0.757

0.783

Win

halstead_volume:CountLine

ar3 >> cm1

0.741

0.720

Loss

halstead_volume:HALSTEAD_VOLUME
halstead_error:HALSTEAD_ERROR_EST

ar3 >> EQ

0.801

0.785

Loss

cyclomatic_complexity:ck_oo_cbo

ar3 >> JDT

0.817

0.770

Loss

cyclomatic_complexity:ck_oo_fanOut

ar3 >> kc3

0.647

0.660

Win

halstead_volume:HALSTEAD_PROG_TIME

ar3 >> mc2

0.675

0.689

Win

halstead_volume:HALSTEAD_VOLUME
halstead_error:HALSTEAD_ERROR_EST

ar3 >> mw1

0.726

0.746

Win

halstead_volume:HALSTEAD_VOLUME
halstead_error:HALSTEAD_ERROR_EST

ar3 >> pc1

0.814

0.751

Loss

halstead_volume:HALSTEAD_VOLUME
halstead_error:HALSTEAD_ERROR_EST

ar3 >> pc3

0.790

0.740

Loss

halstead_volume:HALSTEAD_VOLUME
halstead_error:HALSTEAD_ERROR_EST

ar3 >> Safe

0.829

0.694

Loss

comment_loc:SumCyclomaticStrict
halstead_error:RatioCommentToCode
cyclomatic_complexity:SumCyclomaticModified

ar3 >> skarbonka

0.589

0.688

Win

comment_loc:lcom
cyclomatic_complexity:wmc

ar4 >> Apache

0.757

0.734

Loss

total_operators:CountLineCodeDecl
total_operands:CountStmtDecl

ar4 >> camel-1.0

0.722

0.639

Loss

total_operators:loc

ar4 >> cm1

0.741

0.732

Loss

halstead_length:HALSTEAD_LENGTH
total_operators:NUM_OPERATORS
total_operands:NUM_OPERANDS

ar4 >> jm1

0.705

0.685

Loss

total_operators:HALSTEAD_LENGTH
total_operands:NUM_OPERATORS
unique_operators:NUM_UNIQUE_OPERATORS

ar4 >> kc3

0.647

0.687

Win

halstead_length:HALSTEAD_LENGTH
total_operators:NUM_OPERATORS
total_operands:NUM_OPERANDS

ar4 >> LC

0.764

0.655

Loss

total_operands:ck_oo_numberOfLinesOfCode

ar4 >> mc2

0.675

0.624

Loss

halstead_length:HALSTEAD_LENGTH
total_operators:NUM_OPERANDS
total_operands:NUMBER_OF_LINES

ar4 >> ML

0.719

0.692

Loss

total_operands:ck_oo_numberOfLinesOfCode

ar4 >> mw1

0.726

0.660

Loss

total_operators:HALSTEAD_LENGTH
total_operands:NUM_OPERATORS
unique_operators:HALSTEAD_DIFFICULTY

ar4 >> pc1

0.814

0.754

Loss

halstead_length:HALSTEAD_LENGTH
total_operators:NUM_OPERATORS
total_operands:NUM_OPERANDS

ar4 >> pc3

0.790

0.738

Loss

total_operands:NUM_OPERANDS

ar4 >> pc4

0.850

0.663

Loss

total_operators:HALSTEAD_LENGTH
total_operands:NUM_OPERATORS
unique_operators:NUM_UNIQUE_OPERATORS

ar4 >> PDE

0.731

0.717

Loss

total_operators:ck_oo_numberOfLinesOfCode

ar4 >> poi-1.5

0.717

0.615

Loss

unique_operators:amc

ar4 >> redaktor

0.719

0.556

Loss

unique_operators:cbo

ar4 >> Safe

0.829

0.834

Win

halstead_length:CountLine
total_operators:CountLineCode
total_operands:CountSemicolon

ar4 >> velocity-1.4

0.714

0.391

Loss

halstead_length:loc

ar4 >> ZXing

0.626

0.643

Win

total_operators:CountLine
total_operands:CountLineCode

ar5 >> ant-1.3

0.800

0.840

Win

halstead_vocabulary:rfc
halstead_difficulty:wmc

ar5 >> Apache

0.757

0.690

Loss

halstead_vocabulary:AvgLine
unique_operators:MaxCyclomaticModified
halstead_difficulty:MaxCyclomatic

ar5 >> arc

0.726

0.701

Loss

halstead_difficulty:rfc

ar5 >> camel-1.0

0.722

0.333

Loss

unique_operators:amc
halstead_difficulty:rfc

ar5 >> cm1

0.741

0.655

Loss

halstead_vocabulary:HALSTEAD_CONTENT
unique_operators:CONDITION_COUNT
halstead_difficulty:LOC_BLANK

ar5 >> JDT

0.817

0.763

Loss

halstead_vocabulary:ck_oo_rfc
unique_operators:ck_oo_numberOfMethods

ar5 >> jm1

0.705

0.608

Loss

halstead_vocabulary:NUM_OPERATORS
unique_operators:NUM_UNIQUE_OPERATORS
halstead_difficulty:NUM_UNIQUE_OPERANDS
halstead_level:HALSTEAD_LEVEL

ar5 >> kc3

0.647

0.684

Win

halstead_vocabulary:HALSTEAD_CONTENT
halstead_difficulty:CONDITION_COUNT

ar5 >> LC

0.764

0.221

Loss

halstead_vocabulary:ck_oo_numberOfLinesOfCode
unique_operators:ck_oo_wmc
halstead_difficulty:ck_oo_rfc
halstead_level:CvsLogEntropy

ar5 >> mc1

0.885

0.893

Win

halstead_difficulty:HALSTEAD_CONTENT

ar5 >> mc2

0.675

0.705

Win

halstead_vocabulary:NUMBER_OF_LINES
unique_operators:BRANCH_COUNT
halstead_difficulty:CONDITION_COUNT

ar5 >> ML

0.719

0.692

Loss

halstead_vocabulary:ck_oo_numberOfLinesOfCode
halstead_difficulty:ck_oo_rfc

ar5 >> mw1

0.726

0.276

Loss

halstead_vocabulary:HALSTEAD_CONTENT
unique_operators:HALSTEAD_DIFFICULTY
halstead_difficulty:PERCENT_COMMENTS
halstead_level:HALSTEAD_ERROR_EST

ar5 >> pc1

0.814

0.727

Loss

halstead_vocabulary:NUM_OPERANDS
unique_operators:BRANCH_COUNT
halstead_difficulty:CONDITION_COUNT

ar5 >> pc2

0.878

0.882

Win

unique_operators:NUMBER_OF_LINES
halstead_difficulty:NUM_OPERANDS

ar5 >> pc3

0.790

0.714

Loss

halstead_vocabulary:NUM_OPERANDS
unique_operators:CONDITION_COUNT
halstead_difficulty:HALSTEAD_DIFFICULTY
halstead_level:HALSTEAD_LEVEL

ar5 >> pc4

0.850

0.579

Loss

halstead_vocabulary:NUM_OPERATORS
unique_operators:NUM_UNIQUE_OPERANDS
halstead_difficulty:LOC_EXECUTABLE
halstead_level:HALSTEAD_LEVEL

ar5 >> pc5

0.932

0.950

Win

halstead_difficulty:HALSTEAD_VOLUME

ar5 >> PDE

0.731

0.692

Loss

halstead_difficulty:ck_oo_wmc

ar5 >> poi-1.5

0.717

0.689

Loss

unique_operators:wmc
halstead_difficulty:amc

ar5 >> redaktor

0.719

0.378

Loss

unique_operators:wmc
halstead_difficulty:cbo

ar5 >> Safe

0.829

0.813

Loss

halstead_vocabulary:CountSemicolon
unique_operators:AvgLineCode
halstead_difficulty:AvgLine

ar5 >> skarbonka

0.589

0.789

Win

halstead_difficulty:rfc

ar5 >> tomcat

0.814

0.737

Loss

halstead_difficulty:amc

ar5 >> velocity-1.4

0.714

0.316

Loss

halstead_difficulty:amc

ar5 >> xalan-2.4

0.772

0.560

Loss

unique_operators:cbo
halstead_difficulty:amc

ar5 >> xerces-1.2

0.504

0.489

Loss

halstead_difficulty:rfc

ar5 >> ZXing

0.626

0.650

Win

halstead_vocabulary:CountLineCode
unique_operators:CountStmtDecl
halstead_difficulty:CountLineCodeDecl

ar6 >> ant-1.3

0.800

0.656

Loss

halstead_vocabulary:amc

ar6 >> cm1

0.741

0.740

Tie

halstead_vocabulary:NUM_UNIQUE_OPERANDS

ar6 >> kc3

0.647

0.678

Win

halstead_vocabulary:NUM_UNIQUE_OPERANDS

ar6 >> mc2

0.675

0.709

Win

halstead_vocabulary:HALSTEAD_DIFFICULTY

ar6 >> mw1

0.726

0.747

Win

halstead_vocabulary:EDGE_COUNT

ar6 >> pc1

0.814

0.757

Loss

halstead_vocabulary:LOC_EXECUTABLE

ar6 >> pc2

0.878

0.893

Win

halstead_vocabulary:NUM_OPERATORS

ar6 >> pc3

0.790

0.723

Loss

halstead_vocabulary:LOC_TOTAL

ar6 >> Safe

0.829

0.874

Win

halstead_vocabulary:CountStmtDecl

arc >> Apache

0.757

0.681

Loss

rfc:MaxCyclomaticModified
loc:SumCyclomaticStrict

arc >> ar1

0.614

0.460

Loss

rfc:total_loc
loc:halstead_time

arc >> ar3

0.732

0.696

Loss

ce:design_complexity
rfc:blank_loc
loc:total_loc

arc >> ar4

0.816

0.798

Loss

rfc:halstead_difficulty

arc >> ar5

0.875

0.661

Loss

ce:call_pairs
rfc:blank_loc
loc:total_loc

arc >> ar6

0.696

0.672

Loss

rfc:executable_loc
loc:halstead_time

arc >> Safe

0.829

0.428

Loss

rfc:AvgLine
loc:CountStmt

arc >> ZXing

0.626

0.647

Win

rfc:CountStmtExe

camel-1.0 >> ar5

0.875

0.911

Win

ca:design_complexity
cbo:cyclomatic_complexity

camel-1.0 >> kc3

0.647

0.694

Win

cbo:CALL_PAIRS

cm1 >> ant-1.3

0.800

0.292

Loss

LOC_EXECUTABLE:amc
LOC_TOTAL:rfc

cm1 >> ar3

0.732

0.518

Loss

LOC_EXECUTABLE:unique_operands
LOC_TOTAL:executable_loc
HALSTEAD_CONTENT:halstead_vocabulary

cm1 >> ar4

0.816

0.807

Loss

LOC_EXECUTABLE:executable_loc
LOC_COMMENTS:branch_count
HALSTEAD_CONTENT:total_operands

cm1 >> ar5

0.875

0.214

Loss

LOC_EXECUTABLE:executable_loc
LOC_TOTAL:total_loc
LOC_COMMENTS:cyclomatic_complexity
HALSTEAD_CONTENT:halstead_vocabulary
PERCENT_COMMENTS:unique_operands

cm1 >> ar6

0.696

0.630

Loss

HALSTEAD_CONTENT:halstead_length

cm1 >> kc3

0.647

0.566

Loss

LOC_EXECUTABLE:EDGE_COUNT
LOC_TOTAL:NUMBER_OF_LINES
HALSTEAD_CONTENT:HALSTEAD_CONTENT

cm1 >> mc2

0.675

0.697

Win

LOC_TOTAL:HALSTEAD_CONTENT
HALSTEAD_CONTENT:NUMBER_OF_LINES

cm1 >> Safe

0.829

0.856

Win

LOC_COMMENTS:SumCyclomaticModified
PERCENT_COMMENTS:CountLineCodeDecl

cm1 >> skarbonka

0.589

0.764

Win

LOC_COMMENTS:lcom
PERCENT_COMMENTS:rfc

EQ >> ar3

0.732

0.823

Win

ck_oo_numberOfMethods:cyclomatic_complexity

EQ >> ar4

0.816

0.794

Loss

ck_oo_numberOfMethods:cyclomatic_complexity

EQ >> ar5

0.875

0.911

Win

ck_oo_numberOfAttributes:design_complexity
ck_oo_numberOfMethods:cyclomatic_complexity

EQ >> Safe

0.829

0.770

Loss

ck_oo_numberOfMethods:SumEssential
ck_oo_lcom:SumCyclomaticStrict

EQ >> skarbonka

0.589

0.733

Win

ck_oo_numberOfMethods:wmc
ck_oo_lcom:lcom

JDT >> Apache

0.757

0.776

Win

ck_oo_rfc:SumCyclomaticModified

JDT >> ar1

0.614

0.736

Win

ck_oo_rfc:halstead_length

JDT >> ar3

0.732

0.833

Win

ck_oo_rfc:executable_loc
ck_oo_numberOfLinesOfCode:total_operators

JDT >> ar4

0.816

0.791

Loss

numberOfBugsFoundUntil::decision_count

JDT >> ar5

0.875

0.911

Win

ck_oo_rfc:executable_loc
ck_oo_numberOfLinesOfCode:total_operators
numberOfBugsFoundUntil::cyclomatic_complexity

JDT >> ar6

0.696

0.681

Loss

ck_oo_rfc:total_operators

JDT >> mc2

0.675

0.678

Tie

ck_oo_rfc:LOC_TOTAL
ck_oo_numberOfLinesOfCode:NUM_OPERATORS

JDT >> Safe

0.829

0.791

Loss

ck_oo_rfc:CountLineCodeDecl
ck_oo_numberOfLinesOfCode:CountLineCode
numberOfBugsFoundUntil::SumEssential

JDT >> skarbonka

0.589

0.681

Win

ck_oo_rfc:rfc
numberOfBugsFoundUntil::npm

JDT >> velocity-1.4

0.714

0.391

Loss

ck_oo_numberOfLinesOfCode:loc

jm1 >> ant-1.3

0.800

0.656

Loss

LOC_TOTAL:amc

jm1 >> Apache

0.757

0.736

Loss

HALSTEAD_VOLUME:CountLineCode
HALSTEAD_LENGTH:CountLineCodeDecl

jm1 >> ar3

0.732

0.848

Win

LOC_TOTAL:unique_operands
HALSTEAD_LENGTH:total_operands

jm1 >> ar4

0.816

0.521

Loss

LOC_TOTAL:blank_loc
HALSTEAD_VOLUME:halstead_time
HALSTEAD_LENGTH:total_loc

jm1 >> ar5

0.875

0.571

Loss

LOC_TOTAL:unique_operands
HALSTEAD_VOLUME:halstead_volume
HALSTEAD_LENGTH:total_operands

jm1 >> ar6

0.696

0.681

Loss

LOC_TOTAL:total_operators

jm1 >> mc2

0.675

Tie

LOC_TOTAL:LOC_EXECUTABLE
HALSTEAD_LENGTH:NUM_OPERATORS

jm1 >> Safe

0.829

0.877

Win

LOC_TOTAL:CountLineCodeDecl
HALSTEAD_LENGTH:CountLineCode

kc3 >> ant-1.3

0.800

Tie

CALL_PAIRS:wmc

kc3 >> ar5

0.875

0.688

Loss

LOC_BLANK:call_pairs

kc3 >> camel-1.0

0.722

0.771

Win

CALL_PAIRS:cbo

kc3 >> skarbonka

0.589

0.689

Win

CYCLOMATIC_COMPLEXITY:cbo

kc3 >> velocity-1.4

0.714

0.589

Loss

CALL_PAIRS:cbo

LC >> ar5

0.875

0.688

Loss

CvsEntropy:design_complexity

LC >> skarbonka

0.589

0.660

Win

CvsEntropy:npm

mc1 >> ar3

0.732

0.830

Win

HALSTEAD_VOLUME:executable_loc

mc1 >> ar5

0.875

0.911

Win

HALSTEAD_VOLUME:executable_loc

mc1 >> Safe

0.829

0.856

Win

HALSTEAD_VOLUME:CountSemicolon

mc2 >> ant-1.3

0.800

0.656

Loss

HALSTEAD_DIFFICULTY:amc

mc2 >> Apache

0.757

0.630

Loss

GLOBAL_DATA_COMPLEXITY:AvgCyclomaticModified
HALSTEAD_DIFFICULTY:AvgLineCode

mc2 >> ar1

0.614

0.750

Win

HALSTEAD_PROG_TIME:halstead_effort
NODE_COUNT:halstead_vocabulary

mc2 >> ar3

0.732

0.852

Win

HALSTEAD_DIFFICULTY:unique_operands
HALSTEAD_EFFORT:halstead_effort
HALSTEAD_PROG_TIME:halstead_time

mc2 >> ar4

0.816

0.805

Loss

GLOBAL_DATA_COMPLEXITY:cyclomatic_complexity
HALSTEAD_DIFFICULTY:unique_operands
NODE_COUNT:blank_loc

mc2 >> ar5

0.875

0.946

Win

HALSTEAD_DIFFICULTY:unique_operands
HALSTEAD_EFFORT:halstead_effort
HALSTEAD_PROG_TIME:halstead_time
NODE_COUNT:halstead_difficulty

mc2 >> ar6

0.696

0.724

Win

HALSTEAD_DIFFICULTY:halstead_vocabulary
HALSTEAD_PROG_TIME:halstead_effort
NODE_COUNT:total_loc

mc2 >> camel-1.0

0.722

0.765

Win

GLOBAL_DATA_COMPLEXITY:npm

mc2 >> cm1

0.741

0.723

Loss

HALSTEAD_DIFFICULTY:NUM_UNIQUE_OPERANDS
NODE_COUNT:EDGE_COUNT

mc2 >> jm1

0.705

0.709

Win

HALSTEAD_DIFFICULTY:LOC_TOTAL

mc2 >> mw1

0.726

0.767

Win

GLOBAL_DATA_COMPLEXITY:CALL_PAIRS
HALSTEAD_DIFFICULTY:NUM_UNIQUE_OPERANDS
NODE_COUNT:NODE_COUNT

mc2 >> pc1

0.814

0.779

Loss

HALSTEAD_DIFFICULTY:LOC_TOTAL
NODE_COUNT:NUM_UNIQUE_OPERANDS

mc2 >> pc2

0.878

0.893

Win

NODE_COUNT:NUM_OPERATORS

mc2 >> pc3

0.790

0.716

Loss

HALSTEAD_DIFFICULTY:LOC_TOTAL
NODE_COUNT:EDGE_COUNT

mc2 >> pc4

0.850

0.680

Loss

HALSTEAD_DIFFICULTY:HALSTEAD_CONTENT

mc2 >> poi-1.5

0.717

0.727

Win

HALSTEAD_DIFFICULTY:rfc

mc2 >> redaktor

0.719

0.499

Loss

HALSTEAD_DIFFICULTY:rfc

mc2 >> Safe

0.829

0.882

Win

HALSTEAD_DIFFICULTY:CountLineCodeDecl
NODE_COUNT:CountStmtDecl

mc2 >> skarbonka

0.589

0.789

Win

GLOBAL_DATA_COMPLEXITY:npm
HALSTEAD_DIFFICULTY:rfc

mc2 >> velocity-1.4

0.714

0.444

Loss

HALSTEAD_DIFFICULTY:rfc

ML >> ar4

0.816

0.794

Loss

numberOfBugsFoundUntil::cyclomatic_complexity

ML >> mc2

0.675

0.714

Win

numberOfBugsFoundUntil::MODIFIED_CONDITION_COUNT

ML >> skarbonka

0.589

0.660

Win

numberOfBugsFoundUntil::npm

mw1 >> ant-1.3

0.800

0.844

Win

NUMBER_OF_LINES:rfc
LOC_BLANK:ce

mw1 >> Apache

0.757

0.637

Loss

NUMBER_OF_LINES:AvgLine

mw1 >> ar1

0.614

0.734

Win

EDGE_COUNT:halstead_vocabulary

mw1 >> ar3

0.732

0.852

Win

NUMBER_OF_LINES:unique_operands

mw1 >> ar4

0.816

0.827

Win

EDGE_COUNT:unique_operands
NUMBER_OF_LINES:halstead_vocabulary
LOC_BLANK:cyclomatic_complexity

mw1 >> ar5

0.875

0.946

Win

EDGE_COUNT:unique_operands
NUMBER_OF_LINES:halstead_vocabulary

mw1 >> ar6

0.696

0.708

Win

EDGE_COUNT:halstead_vocabulary

mw1 >> kc3

0.647

0.663

Win

EDGE_COUNT:LOC_EXECUTABLE

mw1 >> mc2

0.675

0.634

Loss

NODE_COUNT:NODE_COUNT
EDGE_COUNT:HALSTEAD_DIFFICULTY
NUMBER_OF_LINES:HALSTEAD_CONTENT
LOC_BLANK:MODIFIED_CONDITION_COUNT

mw1 >> ML

0.719

0.702

Loss

LOC_BLANK:ck_oo_cbo

mw1 >> redaktor

0.719

0.633

Loss

LOC_BLANK:ce

mw1 >> Safe

0.829

0.861

Win

NODE_COUNT:CountStmtDecl
EDGE_COUNT:CountLineCodeDecl

mw1 >> skarbonka

0.589

0.710

Win

LOC_BLANK:wmc
DESIGN_COMPLEXITY:npm

pc1 >> ant-1.3

0.800

0.823

Win

HALSTEAD_CONTENT:rfc
LOC_TOTAL:amc

pc1 >> ar1

0.614

0.734

Win

NUM_UNIQUE_OPERANDS:halstead_vocabulary

pc1 >> ar3

0.732

0.833

Win

HALSTEAD_CONTENT:executable_loc
LOC_TOTAL:unique_operands

pc1 >> ar4

0.816

0.844

Win

HALSTEAD_CONTENT:halstead_vocabulary
LOC_TOTAL:unique_operands

pc1 >> ar5

0.875

0.286

Loss

HALSTEAD_CONTENT:halstead_vocabulary
NUM_UNIQUE_OPERANDS:halstead_difficulty
LOC_TOTAL:unique_operands
LOC_EXECUTABLE:executable_loc

pc1 >> ar6

0.696

0.708

Win

LOC_EXECUTABLE:halstead_vocabulary

pc1 >> kc3

0.647

0.685

Win

LOC_TOTAL:LOC_TOTAL
LOC_EXECUTABLE:LOC_EXECUTABLE

pc1 >> mc2

0.675

0.398

Loss

HALSTEAD_CONTENT:HALSTEAD_CONTENT
NUM_UNIQUE_OPERANDS:NUM_UNIQUE_OPERANDS
LOC_TOTAL:HALSTEAD_DIFFICULTY
LOC_EXECUTABLE:EDGE_COUNT

pc1 >> Safe

0.829

0.872

Win

NUM_UNIQUE_OPERANDS:CountStmtDecl
LOC_EXECUTABLE:CountLineCodeDecl

pc2 >> ant-1.3

0.800

0.822

Win

CYCLOMATIC_DENSITY:cam

pc2 >> ar5

0.875

0.893

Win

HALSTEAD_CONTENT:halstead_difficulty

pc2 >> skarbonka

0.589

0.733

Win

CYCLOMATIC_DENSITY:cam
NUM_UNIQUE_OPERANDS:cbo

pc3 >> ant-1.3

0.800

0.840

Win

HALSTEAD_CONTENT:rfc

pc3 >> ar1

0.614

0.734

Win

NUM_UNIQUE_OPERANDS:halstead_vocabulary

pc3 >> ar3

0.732

0.852

Win

HALSTEAD_CONTENT:unique_operands

pc3 >> ar4

0.816

0.812

Tie

NUM_UNIQUE_OPERANDS:unique_operands

pc3 >> ar5

0.875

0.911

Win

LOC_BLANK:cyclomatic_complexity
HALSTEAD_CONTENT:unique_operands
NUM_UNIQUE_OPERANDS:halstead_difficulty

pc3 >> ar6

0.696

0.708

Win

NUM_UNIQUE_OPERANDS:halstead_vocabulary

pc3 >> mc2

0.675

0.671

Tie

HALSTEAD_CONTENT:HALSTEAD_CONTENT
NUM_UNIQUE_OPERANDS:NUM_UNIQUE_OPERANDS

pc3 >> Safe

0.829

0.786

Loss

LOC_BLANK:SumEssential
NUM_UNIQUE_OPERANDS:CountStmtDecl

pc3 >> skarbonka

0.589

0.660

Win

LOC_BLANK:npm

poi-1.5 >> ar1

0.614

0.700

Win

wmc:unique_operands

poi-1.5 >> ar3

0.732

0.805

Win

wmc:unique_operators
loc:halstead_length

poi-1.5 >> ar4

0.816

0.798

Loss

wmc:halstead_difficulty

poi-1.5 >> ar5

0.875

0.929

Win

wmc:unique_operators
loc:halstead_length

poi-1.5 >> ar6

0.696

0.724

Win

wmc:unique_operands
loc:halstead_volume

poi-1.5 >> Safe

0.829

0.626

Loss

wmc:AvgLineCode
loc:CountLine

Safe >> ar1

0.614

0.250

Loss

CountLineCodeExe:halstead_time
CountStmt:halstead_length

Safe >> ar3

0.732

0.824

Win

CountLineCodeExe:branch_count
CountStmtExe:executable_loc
CountStmt:total_loc

Safe >> ar4

0.816

0.841

Win

CountStmt:total_loc

Safe >> ar5

0.875

0.929

Win

CountLineCodeExe:executable_loc
CountStmtExe:branch_count
CountStmt:total_loc

Safe >> ar6

0.696

0.532

Loss

CountLineCodeExe:halstead_time
CountStmt:halstead_length

Safe >> arc

0.726

0.670

Loss

CountStmt:loc

Safe >> camel-1.0

0.722

0.639

Loss

CountStmt:loc

Safe >> cm1

0.741

0.704

Loss

CountStmt:NUM_OPERANDS

Safe >> EQ

0.801

0.585

Loss

CountLineCodeExe:ck_oo_rfc
CountStmtExe:ck_oo_lcom
CountStmt:ck_oo_numberOfLinesOfCode

Safe >> JDT

0.817

0.693

Loss

CountStmtExe:ck_oo_lcom

Safe >> jm1

0.705

0.689

Loss

CountStmt:HALSTEAD_LENGTH

Safe >> kc3

0.647

0.665

Win

CountStmt:NUM_OPERANDS

Safe >> LC

0.764

0.655

Loss

CountStmt:ck_oo_numberOfLinesOfCode

Safe >> mc2

0.675

0.686

Win

CountStmt:NUM_OPERANDS

Safe >> ML

0.719

0.692

Loss

CountStmt:ck_oo_numberOfLinesOfCode

Safe >> pc2

0.878

0.872

Loss

CountStmt:HALSTEAD_PROG_TIME

Safe >> pc4

0.850

0.682

Loss

CountStmt:HALSTEAD_LENGTH

Safe >> PDE

0.731

0.591

Loss

CountStmtExe:ck_oo_lcom
CountStmt:ck_oo_numberOfLinesOfCode

Safe >> poi-1.5

0.717

0.723

Win

CountStmtExe:lcom

Safe >> skarbonka

0.589

0.694

Win

CountLineCodeExe:amc

Safe >> velocity-1.4

0.714

0.391

Loss

CountStmt:loc

Safe >> xerces-1.2

0.504

0.505

Win

CountLineCodeExe:lcom
CountStmt:loc

skarbonka >> Apache

0.757

0.706

Loss

rfc:MaxCyclomaticStrict

skarbonka >> ar1

0.614

0.739

Win

rfc:total_operands

skarbonka >> ar3

0.732

0.821

Win

rfc:blank_loc

skarbonka >> ar4

0.816

0.820

Win

rfc:blank_loc

skarbonka >> ar5

0.875

0.911

Win

rfc:executable_loc

skarbonka >> ar6

0.696

0.615

Loss

rfc:total_operands

skarbonka >> cm1

0.741

0.645

Loss

rfc:PERCENT_COMMENTS

skarbonka >> EQ

0.801

0.771

Loss

rfc:ck_oo_rfc

skarbonka >> JDT

0.817

0.785

Loss

rfc:ck_oo_wmc

skarbonka >> jm1

0.705

0.688

Loss

rfc:NUM_OPERANDS

skarbonka >> LC

0.764

0.641

Loss

rfc:ck_oo_rfc

skarbonka >> mc2

0.675

0.660

Loss

rfc:NUM_UNIQUE_OPERANDS

skarbonka >> ML

0.719

0.692

Loss

rfc:ck_oo_rfc

skarbonka >> pc4

0.850

0.678

Loss

rfc:NUM_OPERANDS

skarbonka >> PDE

0.731

0.667

Loss

rfc:ck_oo_lcom

skarbonka >> Safe

0.829

0.837

Win

rfc:CountLineBlank

skarbonka >> ZXing

0.626

0.650

Win

rfc:CountSemicolon

tomcat >> Apache

0.757

0.762

Win

loc:CountSemicolon

tomcat >> ar1

0.614

0.739

Win

rfc:total_operands
loc:halstead_volume

tomcat >> ar4

0.816

0.820

Win

rfc:blank_loc

tomcat >> ar5

0.875

0.964

Win

rfc:blank_loc
loc:halstead_length

tomcat >> ar6

0.696

0.615

Loss

rfc:total_operands

tomcat >> LC

0.764

0.641

Loss

rfc:ck_oo_rfc

tomcat >> mc2

0.675

0.660

Loss

rfc:NUM_UNIQUE_OPERANDS

tomcat >> Safe

0.829

0.872

Win

rfc:CountStmtDecl
loc:CountLine

tomcat >> ZXing

0.626

0.650

Win

rfc:CountSemicolon

xalan-2.4 >> Apache

0.757

0.762

Win

loc:CountStmt

xalan-2.4 >> ar1

0.614

0.736

Win

loc:halstead_volume

xalan-2.4 >> ar3

0.732

0.830

Win

loc:halstead_length

xalan-2.4 >> ar5

0.875

0.839

Loss

loc:halstead_length
max_cc:design_complexity

xalan-2.4 >> ar6

0.696

0.653

Loss

loc:halstead_volume

xalan-2.4 >> mc2

0.675

0.688

Win

loc:HALSTEAD_LENGTH

xalan-2.4 >> Safe

0.829

Tie

loc:CountLine

ZXing >> ant-1.3

0.800

0.704

Loss

CountLineBlank:npm

ZXing >> ar1

0.614

0.764

Win

CountLineBlank:halstead_difficulty
CountLineCodeDecl:total_loc
CountLineCode:halstead_length

ZXing >> ar3

0.732

0.821

Win

CountLineCodeDecl:halstead_difficulty
CountLineCode:executable_loc

ZXing >> ar4

0.816

0.774

Loss

CountLineCodeDecl:halstead_difficulty
CountLineCode:total_operands

ZXing >> ar5

0.875

0.929

Win

CountLineBlank:cyclomatic_complexity
CountLineCodeDecl:halstead_difficulty
CountLineCode:total_loc

ZXing >> ar6

0.696

0.654

Loss

CountLineBlank:halstead_difficulty
CountLineCodeDecl:total_operands
CountLineCode:halstead_length

ZXing >> arc

0.726

0.710

Loss

CountLineBlank:wmc
CountLineCodeDecl:rfc

ZXing >> camel-1.0

0.722

0.694

Loss

CountLineCodeDecl:rfc

ZXing >> LC

0.764

0.655

Loss

CountLineCode:ck_oo_numberOfLinesOfCode

ZXing >> mc2

0.675

0.701

Win

CountLineCode:NUMBER_OF_LINES

ZXing >> pc4

0.850

0.685

Loss

CountLineCode:NUM_OPERATORS

ZXing >> skarbonka

0.589

0.717

Win

CountLineBlank:wmc

E. Various analyzers and cutoffs

Analyzer	Cutoff	WPDP	CPDP-CM	CPDP-IFS	UDP	HDP	Target Coverage
KSAnalyzer	0.01	0.732	0.629	0.552	0.683	0.694*	34(100%)
KSAnalyzer	0.05	0.732	0.632	0.558	0.702	0.711*&	34(100%)
KSAnalyzer	0.1	0.732	0.629	0.566	0.693	0.720*&	33(97%)
KSAnalyzer	0.2	0.732	0.637	0.571	0.712	0.731*&	32(94%)
KSAnalyzer	0.3	0.732	0.649	0.568	0.693	0.731*&	29(85%)
KSAnalyzer	0.4	0.732	0.641	0.562	0.693	0.721*&	28(82%)
KSAnalyzer	0.5	0.732	0.660	0.566	0.750&	0.740*	23(68%)
KSAnalyzer	0.6	0.732	0.669	0.566	0.750&	0.717*	19(56%)
KSAnalyzer	0.7	0.741	0.679	0.575	0.750	0.790*&	18(53%)
KSAnalyzer	0.8	0.741	0.696	0.585	0.750	0.833*	11(32%)
KSAnalyzer	0.9	0.816	0.588	0.585	0.786	0.831*	7(21%)
PAnalyzer	0.01	0.741	0.655	0.520	0.693&	0.638*	34(100%)
PAnalyzer	0.05	0.741	0.655	0.520	0.693&	0.642*	34(100%)
PAnalyzer	0.1	0.741	0.655	0.520	0.693&	0.644*	34(100%)
PAnalyzer	0.2	0.741	0.654	0.520	0.688&	0.650*	34(100%)
PAnalyzer	0.3	0.741	0.654	0.528	0.693&	0.653*	34(100%)
PAnalyzer	0.4	0.741	0.654	0.528	0.693&	0.661*	34(100%)
PAnalyzer	0.5	0741	0.654	0.531	0.683&	0.667*	34(100%)
PAnalyzer	0.6	0.741	0.654	0.535	0.683&	0.675*	34(100%)
PAnalyzer	0.7	0.741	0.650	0.541	0.681&	0.673*	34(100%)
PAnalyzer	0.8	0.732	0.639	0.544	0.681	0.674*	34(100%)
PAnalyzer	0.9	0.732	0.629	0.558	0.680	0.693*	34(100%)
SCoAnalyzer	0.01	0.741	0.655	0.520	0.693&	0.609*	34(100%)
SCoAnalyzer	0.05	0.741	0.655	0.520	0.693&	0.609*	34(100%)
SCoAnalyzer	0.1	0.741	0.655	0.520	0.693&	0.609*	34(100%)
SCoAnalyzer	0.2	0.741	0.655	0.520	0.693&	0.609*	34(100%)
SCoAnalyzer	0.3	0.741	0.655	0.520	0.693&	0.603*	34(100%)
SCoAnalyzer	0.4	0.741	0.655	0.520	0.693&	0.603*	34(100%)
SCoAnalyzer	0.5	0.741	0.655	0.520	0.693&	0.604*	34(100%)
SCoAnalyzer	0.6	0.741	0.655	0.520	0.693&	0.603*	34(100%)
SCoAnalyzer	0.7	0.741	0.655	0.520	0.693&	0.605*	34(100%)
SCoAnalyzer	0.8	0.741	0.654	0.520	0.693&	0.613*	34(100%)
SCoAnalyzer	0.9	0.741	0.654	0.520	0.693&	0.614*	34(100%)

Analyzer

Cutoff

WPDP

CPDP-CM

CPDP-IFS

UDP

HDP

Target Coverage

KSAnalyzer

0.01

0.732

0.629

0.552

0.683

0.694*

34(100%)

KSAnalyzer

0.05

0.732

0.632

0.558

0.702

0.711*&

34(100%)

KSAnalyzer

0.1

0.732

0.629

0.566

0.693

0.720*&

33(97%)

KSAnalyzer

0.2

0.732

0.637

0.571

0.712

0.731*&

32(94%)

KSAnalyzer

0.3

0.732

0.649

0.568

0.693

0.731*&

29(85%)

KSAnalyzer

0.4

0.732

0.641

0.562

0.693

0.721*&

28(82%)

KSAnalyzer

0.5

0.732

0.660

0.566

0.750&

0.740*

23(68%)

KSAnalyzer

0.6

0.732

0.669

0.566

0.750&

0.717*

19(56%)

KSAnalyzer

0.7

0.741

0.679

0.575

0.750

0.790*&

18(53%)

KSAnalyzer

0.8

0.741

0.696

0.585

0.750

0.833*

11(32%)

KSAnalyzer

0.9

0.816

0.588

0.585

0.786

0.831*

7(21%)

PAnalyzer

0.01

0.741

0.655

0.520

0.693&

0.638*

34(100%)

PAnalyzer

0.05

0.741

0.655

0.520

0.693&

0.642*

34(100%)

PAnalyzer

0.1

0.741

0.655

0.520

0.693&

0.644*

34(100%)

PAnalyzer

0.2

0.741

0.654

0.520

0.688&

0.650*

34(100%)

PAnalyzer

0.3

0.741

0.654

0.528

0.693&

0.653*

34(100%)

PAnalyzer

0.4

0.741

0.654

0.528

0.693&

0.661*

34(100%)

PAnalyzer

0.5

0741

0.654

0.531

0.683&

0.667*

34(100%)

PAnalyzer

0.6

0.741

0.654

0.535

0.683&

0.675*

34(100%)

PAnalyzer

0.7

0.741

0.650

0.541

0.681&

0.673*

34(100%)

PAnalyzer

0.8

0.732

0.639

0.544

0.681

0.674*

34(100%)

PAnalyzer

0.9

0.732

0.629

0.558

0.680

0.693*

34(100%)

SCoAnalyzer

0.01

0.741

0.655

0.520

0.693&

0.609*

34(100%)

SCoAnalyzer

0.05

0.741

0.655

0.520

0.693&

0.609*

34(100%)

SCoAnalyzer

0.1

0.741

0.655

0.520

0.693&

0.609*

34(100%)

SCoAnalyzer

0.2

0.741

0.655

0.520

0.693&

0.609*

34(100%)

SCoAnalyzer

0.3

0.741

0.655

0.520

0.693&

0.603*

34(100%)

SCoAnalyzer

0.4

0.741

0.655

0.520

0.693&

0.603*

34(100%)

SCoAnalyzer

0.5

0.741

0.655

0.520

0.693&

0.604*

34(100%)

SCoAnalyzer

0.6

0.741

0.655

0.520

0.693&

0.603*

34(100%)

SCoAnalyzer

0.7

0.741

0.655

0.520

0.693&

0.605*

34(100%)

SCoAnalyzer

0.8

0.741

0.654

0.520

0.693&

0.613*

34(100%)

SCoAnalyzer

0.9

0.741

0.654

0.520

0.693&

0.614*

34(100%)

Online Appendix for Heterogeneous Defect Prediction (HDP)

A. Matched Metrics in HDP

Matched Metrics by KSAnalyzer, cutoff=0.05, and Gain Ratio feature selection

All matched metrics

B. Common Metrics among Data Groups

C. CPDP-CM and CPDP-RL vs. HDP

D. Detailed Prediction Results by Source (WPDP vs. HDP, KSAnalyzer, cutoff=0.05, Gain Ratio)

E. Various analyzers and cutoffs