[1] Nie Changhai, Xu Baowen, , et al. Generating test cases for software configuration testing [J]. Journal of Southeast University (English Edition), 2004, 20 (1): 26-30. [doi:10.3969/j.issn.1003-7985.2004.01.006]

Copy

Generating test cases for software configuration testing()

软件配置测试的测试数据生成

Share：

Journal of Southeast University (English Edition)[ISSN:1003-7985/CN:32-1325/N]

Volumn:

20

Issue:

2004 1

Page:

26-30

Research Field:

Computer Science and Engineering

Publishing date:

2004-03-30

Info

Title:

Generating test cases for software configuration testing

软件配置测试的测试数据生成

Author(s):

Nie Changhai^{1, 3}, Xu Baowen^{1, 2, 3, 4}

¹Department of Computer Science and Engineering, Southeast University, Nanjing 210096, China
²School of Computer Science, National University of Defense Technology, Changsha 410073, China
³Jiangsu Institute of Software Quality, Nanjing 210096, China
⁴State Key Laboratory of Software Engineering, Wuhan University, Wuhan 430072, China

聂长海^{1, 3}, 徐宝文^{1, 2, 3, 4}

¹东南大学计算机科学与工程系, 南京 210096; ²国防科技大学计算机学院, 长沙 410073; ³江苏省软件质量研究所, 南京 210096; ⁴武汉大学软件工程国家重点实验室, 南京 210096

Keywords:

software testing;  configuration testing;  test case;  combination cover

软件测试;  配置测试;  测试用例;  组合覆盖

PACS:

TP311

DOI:

10.3969/j.issn.1003-7985.2004.01.006

Abstract:

Software configuration testing is used to test a piece of software with all kinds of hardware to ensure that it can run properly on them. This paper generates test cases for configuration testing with several common methods, such as multiple single-factor experiments, uniform design, and orthogonal experiment design used in other fields. This paper analyzes their merits and improves the orthogonal experiment design method with pairwise testing, and decrease the testing risk caused by incomplete testing with a method of multiple-factors-covering. It also presents a simple factor cover method which can cover all the factors and pairwise combinations to the greatest degree. Finally some comparisons of these methods are made on the aspects of test suite scale, coverage, and usability, etc.

本文提出利用多次单因素试验、正交实验设计和均匀设计等常用方法为软件的配置测试产生测试数据, 以确保待测软件可以在不同的配置上正确运行, 并分析比较了这些方法的优缺点.在此基础上提出使用两两组合覆盖方法来改善正交试验设计方法的不足、使用多因素组合覆盖方法来降低因不完全测试而带来的风险, 并提出一种单因素覆盖方法, 该方法可以产生最少的测试数据, 在覆盖各个系统因素的同时, 尽可能多地覆盖各个因素间的两两组合.最后, 对这些测试数据生成方法从测试数据集的规模、组合覆盖率、可用性等方面进行了比较.

References:

[1] Patton Ron. Software testing [M]. Indianapolis: Sams Publishing, 2001.
[2] Cohen D M, Dalal S R, Fredman M L, et al. The AETG system: an approach to testing based on combinatorial design [J]. IEEE Trans on Software Engineering, 1997, 23(7): 437-444.
[3] Cohen D M, Dalal S R, Parelius J, et al. The combinatorial design approach to automatic test generation [J]. IEEE Software, 1996, 13(5): 83-87.
[4] Lei Y, Tai K C. In_parameter_oder: a test gene￣ration strategy for pairwise testing [R]. Technical Report TR-2001-03. Raleigh, North Carolina: Department of Computer Science, North Carolina State University, 2001.
[5] Tai K C, Lei Y. A test generation strategy for pairwise testing [J]. IEEE Trans on Software Engineering, 2002, 28(1): 109-111.
[6] Kobayashi N, Tsuchiya T, Kikuno T. A new method for constructing pairwise covering designs for software testing [J]. Information Processing Letters, 2002, 81(2): 85-91.
[7] Heller E. Using design of experiment structures to generate test cases [A]. In: Proc 12th Int’l Conf Testing Computer Software, ACM [C]. New York, 1995. 33-41.
[8] Mandl R. Orthogonal Latin squares: an application of experimental design to compiler testing [J]. Communications of the ACM, 1985, 28(10): 1054-1058.
[9] Brownlie R, Prowse J, Phadke M. Robust testing of AT&T PMX/StarMail using OATS [J]. AT&T Technical Journal, 1992, 71(3): 41-47.
[10] Cohen D M, Fredman M L. New techniques for designing qualitatively independent systems [J]. J Combin Designs, 1998, 6(6): 411-416.
[11] Williams A W, Probert R L. A practical strategy for testing pairwise coverage of network interfaces [A]. In: Proc 7th International Symp Software Reliability Engineer [C]. 1997. 246-254.
[12] Fang K T, Wang Y. Number-theoretic methods in statistics [M]. London: Chapman & Hall, 1993.

Memo

Memo:

Biographies: Nie Changhai(1971—), male, graduate; Xu Baowen(corresponding author), male, professor, bwxu@seu.edu.cn.

Common functions