what makes a good bug report?

What makes agood bug report?

Thomas ZimmermannSaarland University

Sascha JustSaarland University

Adrian SchröterSaarland University

Nicolas BettenburgSaarland University

Cathrin WeissSaarland University

Rahul PremrajSaarland University

1


Thomas ZimmermannUniversity of Calgary


Adrian SchröterUniversity of Victoria

Nicolas BettenburgQueen’s University

Cathrin WeissUniversity of Zurich

Rahul PremrajFree Uni. Amsterdam


Thomas ZimmermannMicrosoft Research


Adrian SchröterUniversity of Victoria

Nicolas BettenburgQueen’s University

Cathrin WeissUniversity of Zurich

Rahul PremrajFree Uni. Amsterdam

Bug 31021

Summary: Tree - Selection listener stops default expansion

Product: [Eclipse] Platform Reporter: Veronika Irvine <[email protected]>

Component: SWT Assignee: Steve Northover <[email protected]>

Status: RESOLVED WONTFIX QA Contact:

Severity: normal

Priority: P3

Version: 2.1

Target Milestone: ---

Hardware: PC

OS: Windows XP

Whiteboard:

Description: Opened: 2003-02-05 14:52 -0400

I20030205

Run the following example. Double click on a tree item and notice that it does

not expand.

Comment out the Selection listener and now double click on any tree item and

notice that it expands.

public static void main(String[] args) {

Display display = new Display();

Shell shell = new Shell(display);

shell.setLayout(new FillLayout());

Tree tree = new Tree(shell, SWT.BORDER);

for (int i = 0; i < 4; i++) {

TreeItem item = new TreeItem(tree, SWT.NONE);

item.setText("item " + i);

for (int j = 0; j < 4; j++) {

TreeItem subItem = new TreeItem(item, SWT.NONE);

subItem.setText("item " + j);

for (int k = 0; k < 4; k++) {

TreeItem subsubItem = new TreeItem(subItem,

SWT.NONE);

subsubItem.setText("item " + k);

}

}

}

tree.addSelectionListener(new SelectionAdapter() {});

shell.setSize(200, 200);

shell.open();

while (!shell.isDisposed()) {

if (!display.readAndDispatch())

display.sleep();

}

display.dispose();

}

------- Comment #1 From Steve Northover 2004-10-07 19:39:16 -0400 -------

This behavior can't be changed now because application code now relies on it.

Sorry.

4

Bug 31021





Severity: normal

Priority: P3

Version: 2.1


Hardware: PC

OS: Windows XP

Whiteboard:


I20030205


not expand.








for (int i = 0; i < 4; i++) {



for (int j = 0; j < 4; j++) {



for (int k = 0; k < 4; k++) {


SWT.NONE);


}

}

}



shell.open();



display.sleep();

}

display.dispose();

}



Sorry.

CONTACT LEGAL

Bugzilla – Full Text Bug Listing

Home | New | Search | Find | Reports | Requests | New Account | Log In | Terms of Use

Bug 31021





Severity: normal

Priority: P3

Version: 2.1


Hardware: PC

OS: Windows XP

Whiteboard:


I20030205


not expand.








for (int i = 0; i < 4; i++) {



for (int j = 0; j < 4; j++) {



for (int k = 0; k < 4; k++) {


SWT.NONE);


}

}

}



shell.open();



display.sleep();

}

display.dispose();

}



Sorry.

Actions:Home | New | Search | Find | Reports | Requests | New Account | Log In | Terms of Use

4

Bug 31021





Severity: normal

Priority: P3

Version: 2.1


Hardware: PC

OS: Windows XP

Whiteboard:


I20030205


not expand.








for (int i = 0; i < 4; i++) {



for (int j = 0; j < 4; j++) {



for (int k = 0; k < 4; k++) {


SWT.NONE);


}

}

}



shell.open();



display.sleep();

}

display.dispose();

}



Sorry.


I20030205


not expand.








for (int i = 0; i < 4; i++) {



for (int j = 0; j < 4; j++) {



for (int k = 0; k < 4; k++) {


SWT.NONE);


}

}

}



shell.open();



display.sleep();

}

display.dispose();

}

CONTACT LEGAL



Bug 31021





Severity: normal

Priority: P3

Version: 2.1


Hardware: PC

OS: Windows XP

Whiteboard:


I20030205


not expand.








for (int i = 0; i < 4; i++) {



for (int j = 0; j < 4; j++) {



for (int k = 0; k < 4; k++) {


SWT.NONE);


}

}

}



shell.open();



display.sleep();

}

display.dispose();

}



Sorry.


4


I wand to create a new plugin in Eclipse using CDT. Shall it possible. I had

made a R&D in eclipse documentation. I had get an idea about create a plugin

using Java. But i wand to create a new plugin ( user defined plugin ) using

CDT. After that I wand to impliment it in my programe. If it possible?. Any

one can help me please...

Bug 175222

Summary: Create a new plugin using CDT.

Product: [Tools] CDT Reporter: Sabeesh C.S. <[email protected]>

Component: cdt-build Assignee: [email protected] <cdt-build-

[email protected]>

Status: RESOLVED

INVALID

QA Contact:

Severity: normal

Priority: P3 CC: [email protected]

Version: 3.1.1


Hardware: PC

OS: Linux

Whiteboard:







------- Comment #1 From Norbert Plött 2007-02-23 01:55:42 -0400 -------

Saabeesh,

the way I understand it you want to create a plug-in and do the code

implementation in C/C++ using the CDT. Eclipse supports only Java

implementations. In theory you could probably call into your C/C++ library via

the Java native interface but this is probably not what you want to do.

In any case you would need to create at least a Java wrapper around your

implementation.

Do I read you right?

------- Comment #2 From Chris Recoskie 2007-02-23 08:14:04 -0400 -------

I don't see a bug or enhancement described here... this question belongs on the

newsgroup.

CONTACT LEGAL



Bug 175222

Summary: Create a new plugin using CDT.

Product: [Tools] CDT Reporter: Sabeesh C.S. <[email protected]>

Component: cdt-build Assignee: [email protected] <cdt-build-

[email protected]>

Status: RESOLVED

INVALID

QA Contact:

Severity: normal

Priority: P3 CC: [email protected]

Version: 3.1.1


Hardware: PC

OS: Linux

Whiteboard:







------- Comment #1 From Norbert Plött 2007-02-23 01:55:42 -0400 -------

Saabeesh,

the way I understand it you want to create a plug-in and do the code

implementation in C/C++ using the CDT. Eclipse supports only Java

implementations. In theory you could probably call into your C/C++ library via

the Java native interface but this is probably not what you want to do.

In any case you would need to create at least a Java wrapper around your

implementation.

Do I read you right?

------- Comment #2 From Chris Recoskie 2007-02-23 08:14:04 -0400 -------

I don't see a bug or enhancement described here... this question belongs on the

newsgroup.


5

2

Cuezilla

1

Survey

6

Survey the users

872 developers 1,354 reporterswith at least 50 bugs

assigned to them.who have reported at least 30 bugs.

7

Survey the users

872 developers 1,354 reporters156 responses (19%) 310 responses (26%)

8

Survey’s aim

9

Survey’s aim

Learn developers’ problems and information needs—and

what reporters provide.

9

product namecomponent nameoperating systemobserved behaviourexpected behaviour

You were given wrongcode examplessteps to reproducetest casesstack traces

There were errors inbad grammarunstructured textprose texttoo long textno spell check

The reporter usedduplicatesspamincomplete info.viruses/worms

Others

Problems faced

10

Question 1Which of the following problems have your encountered when fixing bugs?(select as many as you wish)





Others

Problems faced

10

Question 1Which of the following problems have your encountered when fixing bugs?(select as many as you wish)

Question 2Which three caused you the most delay in fixing bugs?(select at most three items)





Others

Problems faced

10

ResponsesM

ost d

elay

cau

sed

Encountered when fixing a bug11

ResponsesM

ost d

elay

cau

sed

Encountered when fixing a bug viruses/spam

wrong system information

11

ResponsesM

ost d

elay

cau

sed



errors in test casesduplicates

bad grammar

11

ResponsesM

ost d

elay

cau

sed




bad grammar

wrong observed behaviourwrong expected behaviour

wrong product information

11

ResponsesM

ost d

elay

cau

sed




bad grammar

wrong observed behaviourwrong expected behaviour

wrong product information

erroneous steps to reproduce

incomplete information

11

productcomponentversionseverity

hardwareoperating systemsummarybuild information

observed behaviourexpected behavioursteps to reproducestack traces

screen shotscode exampleserror reportstest cases

Information needs

12





Question 1Question 3Which of the following items have you previously used when fixing bugs?(select as many as you wish)

Information needs

12





Question 1Question 3Which of the following items have you previously used when fixing bugs?(select as many as you wish)

Which three items helped you the most?(select at most three items)

Question 4

Information needs

12

ResponsesHe

lped

mos

t

Used when fixing a bug13

ResponsesHe

lped

mos

t

Used when fixing a bughardware severity

version

13

ResponsesHe

lped

mos

t


version

expected behavior

test cases/examples

observed behavior

screenshots

13

ResponsesHe

lped

mos

t


version

expected behavior

test cases/examples

observed behavior

screenshots

steps to reproduce

stack traces

13





Same options as for developers

Questions to reporters

14





Same options as for developers

Question 1What information have you previously provided in bug reports?(select as many as you wish)


14

Question 2What of the above information was most difficult to provide?(select at most three items)

Question 3In your opinion, what information is most relevant to developers?(select at most three items)

Question 1What information have you previously provided in bug reports?(select as many as you wish)


15

Rated most helpfulby developers

steps to reproduce

stack traces

test cases

observed behaviour

screenshots

code examples

summary

version

steps to reproduce

test cases

observed behaviour

stack traces

expected behaviour

version

code examples

error reports

expected behaviour

error reports

build information

summary

steps to reproduce

product

observed behaviour

expected behaviour

version

operating system

component

summary

severity

build information16

Provided bymost reporters


steps to reproduce

stack traces

test cases

observed behaviour

screenshots

code examples

summary

version

steps to reproduce

test cases

observed behaviour

stack traces

expected behaviour

version

code examples

error reports

expected behaviour

error reports

build information

summary

steps to reproduce

product

observed behaviour

expected behaviour

version

operating system

component

summary

severity

build information16



Rated most helpfulby reporters

steps to reproduce

stack traces

test cases

observed behaviour

screenshots

code examples

summary

version

steps to reproduce

test cases

observed behaviour

stack traces

expected behaviour

version

code examples

error reports

expected behaviour

error reports

build information

summary

steps to reproduce

product

observed behaviour

expected behaviour

version

operating system

component

summary

severity

build information16



Rated helpfulby most reporters

steps to reproduce

stack traces

test cases

observed behaviour

screenshots

code examples

summary

version

steps to reproduce

test cases

observed behaviour

stack traces

expected behaviour

version

code examples

error reports

expected behaviour

error reports

build information

summary

steps to reproduce

product

observed behaviour

expected behaviour

version

operating system

component

summary

severity

build information17




steps to reproduce

stack traces

test cases

observed behaviour

screenshots

code examples

summary

version

steps to reproduce

test cases

observed behaviour

stack traces

expected behaviour

version

code examples

error reports

expected behaviour

error reports

build information

summary

steps to reproduce

product

observed behaviour

expected behaviour

version

operating system

component

summary

severity

build information17

Reporters need bettertool assistance.




steps to reproduce

stack traces

test cases

observed behaviour

screenshots

code examples

summary

version

steps to reproduce

test cases

observed behaviour

stack traces

expected behaviour

version

code examples

error reports

expected behaviour

error reports

build information

summary

steps to reproduce

product

observed behaviour

expected behaviour

version

operating system

component

summary

severity

build information18

2

Cuezilla

1

Survey

19

Assist reporters

20

I wand to create a new plugin in Eclipse using CDT. Shall it possible. I had made a R&D in eclipse documentation. I had get an idea about create a plugin using Java. But i wand to create a new plugin ( user defined plugin ) using CDT. After that I wand to impliment it in my programe. If it possible?. Any one can help me please...

Create a new plugin using CDT.

Rating bug reports

21



Poor Average Good

Rating bug reports

21



Poor Average Good

Rating bug reportsTotal votes received: 1,186Total reports voted: 289

21

Bug 31021





Severity: normal

Priority: P3

Version: 2.1


Hardware: PC

OS: Windows XP

Whiteboard:


I20030205


not expand.








for (int i = 0; i < 4; i++) {



for (int j = 0; j < 4; j++) {



for (int k = 0; k < 4; k++) {


SWT.NONE);


}

}

}



shell.open();



display.sleep();

}

display.dispose();

}



Sorry.

CUEZILLA

22

CUEZILLA

detects Itemisations

Keywords

Code samples

Stack traces

Patches

Screenshots

computes Readability23

Build and evaluate Cuezillabuild

CUEZILLA

24

Build and evaluate Cuezilla

CUEZILLA

evaluate

build

CUEZILLA

24

Within projects

Evaluation Setup

25

Within projects

Evaluation Setup

48% agreement91% off by one

25

Make recommendations

CUEZILLA

+ Stack trace

26

Incentives to reporters

27

• Bug reports containing stack traces get fixed sooner.

• Bug reports that are easier to read have lower lifetimes.

• Code samples in your bug report increase chances of it getting fixed.

Incentives to reporters

28

Duplicates

Duplicates often add useful information. That this information is filed under a new report is not ideal.

Apache Developer

“”

29

Future of bug tracking

30

lies in thinkingoutside the box!

SummaryProvided by

most reporters

Rated most helpful

by developers

Rated helpful

by most reporters

steps to reproduce

stack traces

test cases

observed behaviour

screenshots

code examples

summary

version

steps to reproduce

test cases

observed behaviour

stack traces

expected behaviour

version

code examples

error reports

expected behaviour

error reports

build information

summary

steps to reproduce

product

observed behaviour

expected behaviour

version

operating system

component

summary

severity

build information

Assist reporters

Responses

Help

ed

most

Used when fixing a bug

hardware severity

version

expected behavior

test cases/examples

observed behavior

screenshots

steps to reproduce

stack traces

14

31

Future of bug tracking

29

lies in thinking

outside the box!

what makes a good bug report?

Technology