Empirical Studies of Software Engineering Expertise

May 22, 2005

Handbook Section

Here's what Justin and I came up with so far for the handbook. Task B is still up in the air because we discovered that the task is harder than we initially thought and need a new task.

Handbook
Task A
- Provide subject with Program Description, Task Description, and CCB Form
- Inform the subject that he or she will have access to the following resources:
o Program Description
o Overall Task Description
o Source Code of VTSurvey
 Located under the “webapps” folder in the Apache Tomcat folder (still need to get exact URL)
o VTSurvey website (http://vtsurvey.sourceforge.net)
o Running version of the code
o Any resource on the Internet.
o Paper
o Pen/Pencil
o Eclipse IDE
o TextPad
- Inform them Java source files located in C:\Program Files\Apache Software Foundation\Tomcat 5.5\webapps\survey\WEB-INF\src\edu\vt\ward\survey
- Inform them JSP source files located in C:\Program Files\Apache Software Foundation\Tomcat 5.5\webapps\survey\WEB-INF
- Inform them that they can access a running version of the program by entering this URL into a web browser: http://localhost:8080/survey/index.jsp
- Inform them they have ___ hours to complete the task
- Explain to subject that their task is to go through and understand the program so they can fill in the CCB proposal form detailing the changes that need to be done.
- Ask the user to think aloud. Provide positive cues to keep the subject talking
- Once they have an understanding of the task and the program ask them to fill in the CCB form. Ask them to provide as much detail as possible.
Interaction (Optional)
- While Subject B is outside of the room have them, read the initial Program Description and Task Description.
- Inform Subject B that Subject A is going to provide him or her with a document which will further explain the task. Subject A will also give an explanation of the changes needed for the task. Finally, inform Subject B that he or she will be able to ask Subject A questions about the task once Subject A has finished his or her explanation
- With Subject A still in the room, bring in Subject B.
- Inform them that they can use paper/whiteboard to support explanations and questions
- Inform them they will have ___ hours to explain/ask questions
- Subject A explains task and changes needed
- Subject B asks questions
- Subject A leaves the room.
Task B
- Provide subject with Program Description, Task Description, and CCB Form
- Inform the subject that he or she will have access to the following resources:
o Program Description
o Overall Task Description
o Source Code of VTSurvey
 Located under the “webapps” folder in the Apache Tomcat folder (still need to get exact URL)
o VTSurvey website (http://vtsurvey.sourceforge.net)
o Running version of the code
o Any resource on the Internet.
o Paper
o Pen/Pencil
o Eclipse IDE
o TextPad
- Inform them they have ___ hours to complete the task
- Inform them Java source files located in C:\Program Files\Apache Software Foundation\Tomcat 5.5\webapps\survey\WEB-INF\src\edu\vt\ward\survey
- Inform them JSP source files located in C:\Program Files\Apache Software Foundation\Tomcat 5.5\webapps\survey\WEB-INF
- Inform them that they can access a running version of the program by entering this URL into a web browser: http://localhost:8080/survey/index.jsp
- Ask the subject to review the CCB proposal received from subject A
- Ask the subject to read the through the code and verify that the changes describe by subject A is correct and feasible.
- Ask the subject to make corrections to the CCB in a new CCB if corrections are needed.
- Ask the subject to explain whether the CCB written by subject A is feasible or not
Appendix:

Posted by Teerawat at 11:27 PM | Comments (0)

April 24, 2005

Frequently Abused Words

In the various write-ups that I've read in the last couple of weeks, I've found a couple terms that are frequently misuse, not just by the students on this project, but in general.

Methodology is the study of methods, e.g., research methods, research designs, and software development methods. Unfortunately, this word is often used as a drop-in replacement for "method," which is incorrect.

Case study is a term multiple meanings. In the context of research methods, it's an analytic method, suitable for building explanations and theories. In medicine and law, cases or patient/client histories are studied for lessons learned. This definition often leaks over into software engineering. Worse yet, sometimes these two terms are conflated into a shoddy empirical study.

I'm sure there are others, but these are the ones that have cropped up so far.

Susan

Posted by ses at 6:51 PM | Comments (0)

What is a "popular" book?

A popular book is not an academic book. It's usually written for a general audience, i.e. the average software developer. The author is typically somebody with a lot of industry experience, rather than a professor or researcher. You can usually find popular books on Amazon. Some publishers include Addison-Wesley, Microsoft Press, Dorset House. Conference proceedings and other works by IEEE and ACM are not considered popular books.

Susan

Posted by ses at 6:46 PM | Comments (0)