Bug #10281

Document how we deal with tests expected to fail

Added by anonym 2015-09-26 09:12:35 . Updated 2015-12-01 09:22:39 .

Status:
Resolved
Priority:
Elevated
Assignee:
Category:
Test suite
Target version:
Tails_1.8
Start date:
2015-09-26
Due date:
% Done:

100%

Feature Branch:
kytv/feature/10281-expected-test-failures
Type of work:
Contributors documentation
Blueprint:

Starter:
Affected tool:
Deliverable for:

Description

Document the procedure mentioned Bug #7233#note-26. Note that when Feature #10198 is done, and the Suites feature has landed in in Cucumber, we will have a better way to implement this, so this procedure will just be a temporary solution until then.

Subtasks

History

#1 Updated by anonym 2015-09-26 09:12:42

#2 Updated by anonym 2015-09-26 09:12:53

  • related to Feature #10198: Wait for the cucumber Suites feature added

#3 Updated by intrigeri 2015-09-28 02:23:35

  • blocks #8538 added

#4 Updated by intrigeri 2015-09-28 02:25:12

  • related to deleted (Feature #10198: Wait for the cucumber Suites feature)

#5 Updated by anonym 2015-10-12 10:00:06

  • QA Check set to Dev Needed

#6 Updated by anonym 2015-10-15 07:10:34

  • Status changed from Confirmed to In Progress

Applied in changeset commit:13a6948f1a571b0dd689577f1eb9f116ec7f70a6.

#7 Updated by anonym 2015-10-15 07:18:10

  • Assignee changed from anonym to kytv
  • % Done changed from 0 to 50
  • QA Check changed from Dev Needed to Ready for QA
  • Feature Branch set to feature/10281-expected-test-failures

Does the instructions in commit commit:13a6948 make sense to you?

Just a thought: What about commenting out the scenarios instead of deleting them Git? We could also reference the ticket tracking them being disabled. That should make it harder to forget about disabled scenarios, and easier to fix them if step name’s changes (i.e. we alter the commented out version and deal with the trivial conflict resolution when reverting).

#8 Updated by kytv 2015-10-26 03:18:22

  • Assignee changed from kytv to intrigeri

#9 Updated by intrigeri 2015-10-27 14:33:21

  • Assignee changed from intrigeri to kytv

Just reassigning to me doesn’t communicate very clearly what review you’ve done (if any). Please clarify :)

#10 Updated by intrigeri 2015-11-06 02:57:13

  • Priority changed from Normal to Elevated
  • Target version changed from Tails_1.7 to Tails_1.8

Postponing and thus raising priority a bit.

#11 Updated by kytv 2015-11-07 14:46:10

  • Assignee changed from kytv to intrigeri
  • Feature Branch changed from feature/10281-expected-test-failures to kytv/feature/10281-expected-test-failures

Sorry, I reviewed the steps defined and those were good. Rereading tonight I spotted typos that for whatever reason I missed the first time. I corrected these and I pushed them to my branch.

#12 Updated by intrigeri 2015-12-01 09:21:13

  • Status changed from In Progress to Resolved
  • % Done changed from 50 to 100

Applied in changeset commit:a0b6e251c2e786ee564e0f0492fc139c2f8c7cad.

#13 Updated by intrigeri 2015-12-01 09:22:40

  • Assignee deleted (intrigeri)
  • QA Check changed from Ready for QA to Pass