Combinatorial Interaction Testing Portal

Covering Arrays by Simulated Annealing (CASA)

Evaluation Artifacts: EMSE2010, Table 7

Sizes for unconstrained t-way problems
t	Model	Best		Best by SA		All	Diff.

2	3⁴	9	Lei and Tai, 1998	9	Cohen et al., 2003b	9	0
2	5¹3⁸2²	15	Cohen et al., 2003b	15	Cohen et al., 2003b	15	0
2	3¹³	15	Lei and Tai, 1998	16	Cohen et al., 2003b	15	1
2	4¹3³⁹2³⁵	21	Cohen et al., 2003b	21	Cohen et al., 2003b	22	-1
2	5¹4⁴3¹¹2⁵	21	Cohen et al., 2003b	21	Cohen et al., 2003b	23	-2
2	4¹⁵3¹⁷2²⁹	30	Cohen et al., 2003b	30	Cohen et al., 2003b	30	0
2	6¹5¹4⁶3⁸2³	30	Cohen et al., 2003b	30	Cohen et al., 2003b	30	0
2	7¹6¹5¹4⁵3⁸2³	42	Cohen et al., 2003b	42	Cohen et al., 2003b	42	0
2	4¹⁰⁰	45	Cohen et al., 2003b	45	Cohen et al., 2003b	46	-1
2	6¹⁶	62	Cohen et al., 2003b	62	Cohen et al., 2003b	64	-2
2	7¹⁶	84	Colbourn, 2009	87	Cohen et al., 2003b	86	1
2	8¹⁶	110	Colbourn, 2009	112	Cohen et al., 2003b	112	0
2	8¹⁷	111	Colbourn, 2009	114	Cohen et al., 2003b	114	0
2	10²⁰	162	Colbourn, 2009	183	Cohen et al., 2003b	185	-2

3	3⁶	33	Chateauneuf and Kreher, 2002	33	Cohen et al., 2003b	33	0
3	4⁶	64	Chateauneuf and Kreher, 2002	64	Cohen et al., 2003b	96	-32
3	5²4²3²	100	Cohen et al., 2003b	100	Cohen et al., 2003b	100	0
3	5⁶	125	Chateauneuf and Kreher, 2002	152	Cohen et al., 2003b	185	-33
3	5⁷	180	Colbourn, 2009	201	Cohen et al., 2003b	213	-12
3	6⁶	258	Colbourn, 2009	300	Cohen et al., 2003b	318	-18
3	6⁶4²2²	272	Cohen et al., 2003a	317	Cohen et al., 2003a	383	-66
3	10¹6²4³3¹	360	Cohen et al., 2003b	360	Cohen et al., 2003b	360	0
3	8⁸	512	Chateauneuf and Kreher, 2002	918	Cohen et al., 2003a	942	-24
3	7⁷	545	Cohen et al., 2003a	552	Cohen et al., 2003a	573	-21
3	9⁹	729	Chateauneuf and Kreher, 2002	1,490	Cohen et al., 2003a	1,422	68
3	10⁶	1,100	Colbourn, 2009	1,426	Cohen et al., 2003b	1,462	-36
3	10¹⁰	1,219	Chateauneuf and Kreher, 2002	2,163	Cohen et al., 2003a	2,175	-12
3	12¹²	2,190	Chateauneuf and Kreher, 2002	4,422	Cohen et al., 2003a	4,262	160
3	14¹⁴	3,654	Chateauneuf and Kreher, 2002	8,092	Cohen et al., 2003a	8,103	-11

	Sum	12,098		21,377		21,420	-43