Feature #13241

Core work: Test suite maintenance

Added by intrigeri 2017-06-29 13:05:27 . Updated 2019-03-20 14:51:25 .

Status:
Rejected
Priority:
Normal
Assignee:
Category:
Test suite
Target version:
Start date:
2017-06-29
Due date:
% Done:

0%

Feature Branch:
Type of work:
Code
Blueprint:

Starter:
Affected tool:
Deliverable for:

Description

This is about the critical maintenance: “Maintaining the test suite across technical migrations”.


Subtasks


Related issues

Related to Tails - Feature #13240: Core work 2017Q4: Test suite maintenance Resolved 2017-06-29
Related to Tails - Feature #13239: Core work 2017Q3: Test suite maintenance Resolved 2017-06-29
Blocked by Tails - Bug #14935: Future-proof the test suite vs future fundraising campaign headers Resolved 2017-11-08
Blocked by Tails - Feature #15379: Adjust test suite to Python tails-upgrade-frontend-wrapper Resolved 2018-03-05
Blocked by Tails - Feature #8514: Replace WhisperBack.mail_appended_info with a dictionary Resolved 2015-01-02
Blocked by Tails - Feature #15701: Adapt and run our test suite for Tor Browser 8 Resolved 2018-07-03
Blocked by Tails - Bug #15762: Automated tests for adding a certificate to Pidgin stopped working Resolved 2018-08-01
Blocked by Tails - Bug #15771: OpenPGP key fetch tests started failing Resolved 2018-08-08
Blocked by Tails - Bug #15791: Update test suite for Thunderbird 60 Resolved 2018-08-15
Blocked by Tails - Bug #15799: "Additional software packages are installed even without network" test always fail in my environment Resolved 2018-08-17
Blocked by Tails - Bug #16237: Pidgin test failure since the move to redmine.tails.boum.org Resolved 2018-12-22
Blocked by Tails - Bug #16269: Improve doc for the automated test suite Resolved 2019-01-04
Blocked by Tails - Bug #16351: "Anti test: Detecting UDP leaks of DNS lookups with the firewall leak detector" fails on Jenkins Resolved 2019-01-13
Blocked by Tails - Bug #16555: Thunderbird "my Thunderbird inbox is non-empty" test consistently fails Resolved 2019-03-14

History

#1 Updated by intrigeri 2017-06-29 13:06:06

  • related to Feature #13240: Core work 2017Q4: Test suite maintenance added

#2 Updated by intrigeri 2017-06-29 13:06:10

  • related to Feature #13239: Core work 2017Q3: Test suite maintenance added

#3 Updated by intrigeri 2017-06-29 13:26:23

#4 Updated by intrigeri 2017-10-07 12:07:25

  • Target version changed from Tails_4.0 to Tails_3.7

#5 Updated by anonym 2017-12-07 16:10:57

  • blocked by Feature #15020: Support running multiple instances of the automated test suite on the same system added

#6 Updated by intrigeri 2018-01-01 16:57:48

  • blocked by Bug #14935: Future-proof the test suite vs future fundraising campaign headers added

#7 Updated by intrigeri 2018-01-01 16:59:02

  • blocked by Bug #15006: Test suite regression: "I successfully start the Unsafe Browser" fails since Tails 3.3 added

#8 Updated by intrigeri 2018-01-01 17:00:04

  • blocked by Bug #11890: Checking credentials in Thunderbird autoconfig wizard sometimes fails in the test suite added

#9 Updated by intrigeri 2018-01-19 14:33:32

  • blocks deleted (Feature #15020: Support running multiple instances of the automated test suite on the same system)

#10 Updated by anonym 2018-01-22 12:02:07

#11 Updated by intrigeri 2018-04-08 14:01:30

  • blocks deleted (Bug #11890: Checking credentials in Thunderbird autoconfig wizard sometimes fails in the test suite)

#12 Updated by intrigeri 2018-04-08 14:06:53

  • Subject changed from Core work 2018Q1: Test suite maintenance to Core work 2018Q2 → 20189Q1: Test suite maintenance
  • Target version changed from Tails_3.7 to Tails_3.12
  • Parent task changed from Feature #13250 to Feature #13246

Repurposing this ticket: none of the blocking tickets were completed in 2018Q1 so we’re not losing any info, and let’s make the overhead lighter by using a single ticket to track this work over the whole year.

#13 Updated by intrigeri 2018-04-08 14:07:05

  • Subject changed from Core work 2018Q2 → 20189Q1: Test suite maintenance to Core work 2018Q2 → 2019Q1: Test suite maintenance

#14 Updated by intrigeri 2018-04-08 14:08:37

  • Description updated

#15 Updated by intrigeri 2018-04-13 11:33:42

  • blocked by Feature #15379: Adjust test suite to Python tails-upgrade-frontend-wrapper added

#16 Updated by intrigeri 2018-04-13 11:36:06

  • blocked by Bug #15460: Test suite broken with Java 9+ so we need to replace Sikuli added

#17 Updated by intrigeri 2018-04-13 11:39:10

  • Subject changed from Core work 2018Q2 → 2019Q1: Test suite maintenance to Core work 2018Q2 → 2019Q2: Test suite maintenance

#18 Updated by intrigeri 2018-06-30 11:05:37

  • blocked by Feature #8514: Replace WhisperBack.mail_appended_info with a dictionary added

#19 Updated by intrigeri 2018-07-03 12:53:39

  • blocked by Feature #15701: Adapt and run our test suite for Tor Browser 8 added

#20 Updated by intrigeri 2018-07-27 08:52:21

#21 Updated by intrigeri 2018-08-01 08:59:29

  • blocked by Bug #15762: Automated tests for adding a certificate to Pidgin stopped working added

#22 Updated by intrigeri 2018-08-08 05:47:23

  • blocked by Bug #15771: OpenPGP key fetch tests started failing added

#23 Updated by intrigeri 2018-08-15 16:56:03

  • blocked by Bug #15791: Update test suite for Thunderbird 60 added

#24 Updated by intrigeri 2018-08-19 13:52:46

  • blocked by Bug #15799: "Additional software packages are installed even without network" test always fail in my environment added

#25 Updated by intrigeri 2018-09-05 11:40:31

  • blocked by Bug #15914: Update (or remove) some manual Thunderbird tests added

#26 Updated by intrigeri 2018-09-12 06:29:10

  • blocked by Feature #15286: Adapt automated test suite for the "one single SquashFS diff" upgrade scheme added

#27 Updated by intrigeri 2018-09-12 06:48:36

#28 Updated by intrigeri 2018-11-06 15:44:41

  • blocked by Bug #16069: "Only the expected addons are installed" Thunderbird test is buggy added

#29 Updated by intrigeri 2019-01-02 18:02:43

  • blocked by Bug #16237: Pidgin test failure since the move to redmine.tails.boum.org added

#30 Updated by intrigeri 2019-01-05 07:59:51

  • blocked by Bug #16269: Improve doc for the automated test suite added

#31 Updated by intrigeri 2019-01-05 10:39:30

  • blocked by Bug #16281: Update the test suite for Buster added

#32 Updated by intrigeri 2019-01-13 07:52:12

  • blocked by Bug #16351: "Anti test: Detecting UDP leaks of DNS lookups with the firewall leak detector" fails on Jenkins added

#33 Updated by intrigeri 2019-01-25 08:38:55

  • Assignee changed from anonym to intrigeri
  • Target version changed from Tails_3.12 to Tails_3.15

#34 Updated by intrigeri 2019-03-08 15:24:59

  • blocked by Bug #13541: Tor still sometimes fails to bootstrap in the test suite added

#35 Updated by intrigeri 2019-03-08 15:36:50

  • blocked by Bug #10495: The 'the time has synced' step is fragile added

#36 Updated by intrigeri 2019-03-08 15:39:13

  • blocked by Bug #10442: Totem "Watching a WebM video over HTTPS" test never passes on Jenkins added

#37 Updated by intrigeri 2019-03-14 13:56:02

  • blocked by Bug #16555: Thunderbird "my Thunderbird inbox is non-empty" test consistently fails added

#38 Updated by intrigeri 2019-03-20 14:39:49

  • Subject changed from Core work 2018Q2 → 2019Q2: Test suite maintenance to Core work: Test suite maintenance

#39 Updated by intrigeri 2019-03-20 14:40:01

  • Assignee deleted (intrigeri)
  • Target version deleted (Tails_3.15)

#40 Updated by intrigeri 2019-03-20 14:48:29

  • blocks deleted (Bug #10442: Totem "Watching a WebM video over HTTPS" test never passes on Jenkins)

#41 Updated by intrigeri 2019-03-20 14:48:37

  • blocks deleted (Bug #10495: The 'the time has synced' step is fragile)

#42 Updated by intrigeri 2019-03-20 14:49:34

  • blocks deleted (Bug #13541: Tor still sometimes fails to bootstrap in the test suite)

#43 Updated by intrigeri 2019-03-20 14:49:38

  • blocks deleted (Bug #15006: Test suite regression: "I successfully start the Unsafe Browser" fails since Tails 3.3)

#44 Updated by intrigeri 2019-03-20 14:49:58

#45 Updated by intrigeri 2019-03-20 14:50:01

  • blocks deleted (Bug #16069: "Only the expected addons are installed" Thunderbird test is buggy)

#46 Updated by intrigeri 2019-03-20 14:50:25

  • blocks deleted (Feature #15286: Adapt automated test suite for the "one single SquashFS diff" upgrade scheme)

#47 Updated by intrigeri 2019-03-20 14:50:28

  • blocks deleted (Bug #16281: Update the test suite for Buster)

#48 Updated by intrigeri 2019-03-20 14:50:49

  • blocks deleted (Bug #15460: Test suite broken with Java 9+ so we need to replace Sikuli)

#49 Updated by intrigeri 2019-03-20 14:50:52

  • blocks deleted (Bug #15914: Update (or remove) some manual Thunderbird tests)

#50 Updated by intrigeri 2019-03-20 14:51:25

  • Status changed from Confirmed to Rejected

Merged with Foundations Team, see you on https://redmine.tails.boum.org/code/projects/tails/issues?query_id=307.