Bug #12565

Test failures on Jenkins due to lack of disk space

Added by intrigeri 2017-05-19 07:22:42 . Updated 2017-05-23 17:35:48 .

Status:
Resolved
Priority:
Elevated
Assignee:
Category:
Continuous Integration
Target version:
Tails_3.0
Start date:
2017-05-19
Due date:
% Done:

100%

Feature Branch:
bugfix/12565-reorder-features
Type of work:
Sysadmin
Blueprint:

Starter:
Affected tool:
Deliverable for:
289

Description

The branches based on the reproducible builds one fail some tests: https://jenkins.tails.boum.org/job/test_Tails_ISO_bugfix-11971-fontconfig-cache-in-iso/3/cucumberTestReport/. I think I got the snapshots (re-)ordering wrong when working on Bug #12354. anonym, could you please take a look and fix it? The same tests pass on feature/stretch.

Subtasks

Related issues

Blocks Tails - Feature #13232: Core work 2017Q2: Sysadmin (Maintain our already existing services) Resolved 2017-06-29

History

#1 Updated by intrigeri 2017-05-19 07:23:02

  • blocks Feature #11983: Check if the test suite has more failures on the reproducible ISO added

#2 Updated by intrigeri 2017-05-19 09:29:10

  • Status changed from Confirmed to In Progress
  • Assignee changed from anonym to intrigeri
  • % Done changed from 0 to 10
  • Type of work changed from Code to Sysadmin

When the first failure happens (Scenario: Tails erases memory and shuts down on USB boot medium removal: persistent data), ~14G are used, mostly due to:

  • no-network-logged-in-snapshot.memstate: 1.9G
  • tails-greeter-snapshot.memstate: 1.5G
  • with-network-logged-in-snapshot.memstate: 2.0G
  • __internal disk: 8.1G

And there’s only 1.2G free in /tmp/TailsToaster, which is not enough to dump the memory. Reordering features might help other scenarios pass but the scenario I’m discussing here will always require all these snapshots and disks to be available, so it cannot be fixed by reordering => I see no other choice than giving isotesters a bit more space in /tmp/TailsToaster. I’ll do it right away.

#3 Updated by intrigeri 2017-05-19 10:05:38

  • % Done changed from 10 to 20

intrigeri wrote:
> I see no other choice than giving isotesters a bit more space in /tmp/TailsToaster. I’ll do it right away.

Done, let’s see how it goes.

#4 Updated by intrigeri 2017-05-19 14:21:14

It’s still not enough, and actually tests fail on feature/stretch as well (only a bit later).

#5 Updated by intrigeri 2017-05-19 16:15:18

  • Feature Branch changed from feature/5630-deterministic-builds to bugfix/12565-reorder-features

#6 Updated by intrigeri 2017-05-19 16:58:41

  • % Done changed from 20 to 30

Grown the ramdisk to 18G: I’ve just realized that we have no tests (on feature/stretch) that use a VM with 8GB of RAM, so we can give more space to TailsToaster without allocating more RAM to isotesters. Hopefully that’ll be enough!

#7 Updated by intrigeri 2017-05-19 19:07:18

  • Status changed from In Progress to Resolved
  • Assignee deleted (intrigeri)
  • % Done changed from 30 to 100

https://jenkins.tails.boum.org/job/test_Tails_ISO_feature-stretch/4/console has passed the features I would expect to fail due to disk space reasons. Let’s reopen if the problem reappears, and forget about the topic branch.

#8 Updated by intrigeri 2017-05-22 06:52:49

  • Status changed from Resolved to In Progress
  • Assignee set to intrigeri
  • Target version changed from Tails_3.0~rc1 to Tails_3.0
  • % Done changed from 100 to 50

Seen it again: https://jenkins.tails.boum.org/view/RM/job/test_Tails_ISO_feature-stretch/11/

#9 Updated by intrigeri 2017-05-23 08:53:34

If https://jenkins.tails.boum.org/job/test_Tails_ISO_bugfix-12565-reorder-features/1/console fixes this problem I’ll merge that branch, otherwise I’ll grow the tmpfs again.

#10 Updated by intrigeri 2017-05-23 09:09:35

  • blocked by deleted (Feature #11983: Check if the test suite has more failures on the reproducible ISO)

#11 Updated by intrigeri 2017-05-23 17:35:27

  • Status changed from In Progress to Resolved
  • % Done changed from 50 to 100

Applied in changeset commit:41e3ba232462865d34e048f745fd2eceb0dee997.

#12 Updated by intrigeri 2017-05-23 17:35:48

  • Assignee deleted (intrigeri)

Merged!

#13 Updated by intrigeri 2017-06-29 10:01:52

  • blocks Feature #13232: Core work 2017Q2: Sysadmin (Maintain our already existing services) added