Bug #9748

apt.feature fails in the 1.5 devel branch with "No space left on device"

Added by kytv 2015-07-16 16:27:30 . Updated 2015-08-11 10:42:02 .

Status:
Resolved
Priority:
Elevated
Assignee:
Category:
Target version:
Start date:
2015-07-16
Due date:
% Done:

100%

Feature Branch:
bugfix/9748-revert-apt-amd64
Type of work:
Code
Blueprint:

Starter:
0
Affected tool:
Deliverable for:

Description

The command to reproduce: # ./run_test_suite --view --iso ../isos/tails-i386-devel-1.5-20150716.iso --log-to-file apt.log --debug -- features/apt.feature:25

The ISO was built from revision 5be4ca9.

 @check_tor_leaks
  Scenario: Install packages using apt-get                               # features/apt.feature:25
calling as amnesia: echo asdf | sudo -S apt-get update
call returned: [0, "Get:1 tor+http://security.debian.org wheezy/updates Release.gpg [1,554 B]\nGet:2 tor+http://deb.torproject.org obfs4proxy Release.gpg [490 B]\nGet:3 tor+http://security.debian.org jessie/updates Release.gpg [1,554 B]\nGet:4 tor+http://deb.torproject.org wheezy Release.gpg [490 B]\nGet:5 tor+http://security.debian.org wheezy/updates Release [102 kB]\nGet:6 tor+http://deb.torproject.org sid Release.gpg [490 B]\nGet:7 tor+http://deb.torproject.org obfs4proxy Release [2,266 B]\nGet:8 tor+http://deb.tails.boum.org devel Release.gpg [819 B]\nGet:9 tor+http://security.debian.org jessie/updates Release [61.5 kB]\nGet:10 tor+http://deb.torproject.org wheezy Release [3,710 B]\nGet:11 tor+http://security.debian.org wheezy/updates/main amd64 Packages [312 kB]\nGet:12 tor+http://deb.tails.boum.org feature-9381-ship-amd64-syslinux Release.gpg [819 B]\nGet:13 tor+http://deb.torproject.org sid Release [3,712 B]\nGet:14 tor+http://security.debian.org wheezy/updates/contrib amd64 Packages [14 B]\nGet:15 tor+http://deb.torproject.org obfs4proxy/main amd64 Packages [642 B]\nGet:16 tor+http://deb.tails.boum.org devel Release [8,789 B]\nGet:17 tor+http://security.debian.org wheezy/updates/non-free amd64 Packages [14 B]\nGet:18 tor+http://deb.torproject.org obfs4proxy/main i386 Packages [642 B]\nGet:19 tor+http://security.debian.org wheezy/updates/main i386 Packages [315 kB]\nGet:20 tor+http://deb.torproject.org wheezy/main amd64 Packages [3,925 B]\nGet:21 tor+http://deb.tails.boum.org feature-9381-ship-amd64-syslinux Release [8,846 B]\nGet:22 tor+http://security.debian.org wheezy/updates/contrib i386 Packages [14 B]\nGet:23 tor+http://deb.torproject.org wheezy/main i386 Packages [3,921 B]\nGet:24 tor+http://security.debian.org wheezy/updates/non-free i386 Packages [14 B]\nGet:25 tor+http://security.debian.org wheezy/updates/contrib Translation-en [523 B]\nGet:26 tor+http://deb.tails.boum.org devel/main amd64 Packages [1,481 B]\nGet:27 tor+http://security.debian.org wheezy/updates/main Translation-en [178 kB]\nGet:28 tor+http://deb.tails.boum.org devel/main i386 Packages [19.5 kB]\nGet:29 tor+http://deb.torproject.org sid/main amd64 Packages [4,619 B]\nGet:30 tor+http://security.debian.org wheezy/updates/non-free Translation-en [14 B]\nGet:31 tor+http://security.debian.org jessie/updates/main amd64 Packages [110 kB]\nGet:32 tor+http://deb.torproject.org sid/main i386 Packages [4,617 B]\nGet:33 tor+http://security.debian.org jessie/updates/contrib amd64 Packages [2,488 B]\nGet:34 tor+http://security.debian.org jessie/updates/non-free amd64 Packages [14 B]\nGet:35 tor+http://security.debian.org jessie/updates/main i386 Packages [110 kB]\nGet:36 tor+http://deb.tails.boum.org feature-9381-ship-amd64-syslinux/main amd64 Packages [1,894 B]\nGet:37 tor+http://security.debian.org jessie/updates/contrib i386 Packages [2,500 B]\nGet:38 tor+http://security.debian.org jessie/updates/non-free i386 Packages [14 B]\nGet:39 tor+http://deb.tails.boum.org feature-9381-ship-amd64-syslinux/main i386 Packages [1,885 B]\nGet:40 tor+http://security.debian.org jessie/updates/contrib Translation-en [1,098 B]\nGet:41 tor+http://security.debian.org jessie/updates/main Translation-en [60.6 kB]\nGet:42 tor+http://security.debian.org jessie/updates/non-free Translation-en [14 B]\nIgn tor+http://deb.torproject.org obfs4proxy/main Translation-en\nIgn tor+http://deb.torproject.org wheezy/main Translation-en\nIgn tor+http://deb.torproject.org sid/main Translation-en\nGet:43 tor+http://ftp.us.debian.org wheezy Release.gpg [2,390 B]\nGet:44 tor+http://ftp.us.debian.org experimental Release.gpg [1,554 B]\nGet:45 tor+http://ftp.us.debian.org jessie Release.gpg [2,373 B]\nIgn tor+http://deb.tails.boum.org devel/main Translation-en\nGet:46 tor+http://ftp.us.debian.org unstable Release.gpg [1,554 B]\nGet:47 tor+http://ftp.us.debian.org testing Release.gpg [1,554 B]\nIgn tor+http://deb.tails.boum.org feature-9381-ship-amd64-syslinux/main Translation-en\nGet:48 tor+http://ftp.us.debian.org wheezy-backports Release.gpg [1,554 B]\nGet:49 tor+http://ftp.us.debian.org wheezy Release [168 kB]\nGet:50 tor+http://ftp.us.debian.org experimental Release [161 kB]\nGet:51 tor+http://ftp.us.debian.org jessie Release [133 kB]\nGet:52 tor+http://ftp.us.debian.org unstable Release [202 kB]\nGet:53 tor+http://ftp.us.debian.org testing Release [115 kB]\nGet:54 tor+http://ftp.us.debian.org wheezy-backports Release [147 kB]\nGet:55 tor+http://ftp.us.debian.org wheezy/main amd64 Packages [5,841 kB]\nGet:56 tor+http://ftp.us.debian.org wheezy/contrib amd64 Packages [42.0 kB]\nGet:57 tor+http://ftp.us.debian.org wheezy/non-free amd64 Packages [80.8 kB]\nGet:58 tor+http://ftp.us.debian.org wheezy/main i386 Packages [5,859 kB]\nGet:59 tor+http://ftp.us.debian.org wheezy/contrib i386 Packages [42.3 kB]\nGet:60 tor+http://ftp.us.debian.org wheezy/non-free i386 Packages [77.6 kB]\nGet:61 tor+http://ftp.us.debian.org wheezy/contrib Translation-en [34.8 kB]\nGet:62 tor+http://ftp.us.debian.org wheezy/main Translation-en [3,848 kB]\nGet:63 tor+http://ftp.us.debian.org wheezy/non-free Translation-en [66.1 kB]\nGet:64 tor+http://ftp.us.debian.org experimental/main Translation-en [333 kB]\nGet:65 tor+http://ftp.us.debian.org jessie/main amd64 Packages [6,768 kB]\nGet:66 tor+http://ftp.us.debian.org jessie/contrib amd64 Packages [50.1 kB]\nGet:67 tor+http://ftp.us.debian.org jessie/non-free amd64 Packages [83.6 kB]\nGet:68 tor+http://ftp.us.debian.org jessie/main i386 Packages [6,767 kB]\nGet:69 tor+http://ftp.us.debian.org jessie/contrib i386 Packages [49.6 kB]\nGet:70 tor+http://ftp.us.debian.org jessie/non-free i386 Packages [79.7 kB]\nGet:71 tor+http://ftp.us.debian.org jessie/contrib Translation-en [38.4 kB]\nGet:72 tor+http://ftp.us.debian.org jessie/main Translation-en [4,585 kB]\nGet:73 tor+http://ftp.us.debian.org jessie/non-free Translation-en [72.2 kB]\nGet:74 tor+http://ftp.us.debian.org unstable/contrib Translation-en [44.2 kB]\nGet:75 tor+http://ftp.us.debian.org unstable/main Translation-en [5,015 kB]\nGet:76 tor+http://ftp.us.debian.org unstable/non-free Translation-en [77.0 kB]\nGet:77 tor+http://ftp.us.debian.org testing/contrib Translation-en [40.5 kB]\nGet:78 tor+http://ftp.us.debian.org testing/main Translation-en [4,769 kB]\nGet:79 tor+http://ftp.us.debian.org testing/non-free Translation-en [74.5 kB]\nGet:80 tor+http://ftp.us.debian.org wheezy-backports/main amd64 Packages [564 kB]\nGet:81 tor+http://ftp.us.debian.org wheezy-backports/contrib amd64 Packages [8,714 B]\nGet:82 tor+http://ftp.us.debian.org wheezy-backports/non-free amd64 Packages [21.5 kB]\nGet:83 tor+http://ftp.us.debian.org wheezy-backports/main i386 Packages [564 kB]\nGet:84 tor+http://ftp.us.debian.org wheezy-backports/contrib i386 Packages [8,701 B]\nGet:85 tor+http://ftp.us.debian.org wheezy-backports/non-free i386 Packages [22.6 kB]\nGet:86 tor+http://ftp.us.debian.org wheezy-backports/contrib Translation-en [6,265 B]\nGet:87 tor+http://ftp.us.debian.org wheezy-backports/main Translation-en [359 kB]\nGet:88 tor+http://ftp.us.debian.org wheezy-backports/non-free Translation-en [21.5 kB]\nGet:89 tor+http://ftp.us.debian.org experimental/main amd64 Packages [591 kB]\nGet:90 tor+http://ftp.us.debian.org experimental/main i386 Packages [575 kB]\nGet:91 tor+http://ftp.us.debian.org unstable/main amd64 Packages [7,434 kB]\nGet:92 tor+http://ftp.us.debian.org unstable/contrib amd64 Packages [56.2 kB]\nGet:93 tor+http://ftp.us.debian.org unstable/non-free amd64 Packages [88.0 kB]\nGet:94 tor+http://ftp.us.debian.org unstable/main i386 Packages [7,433 kB]\nGet:95 tor+http://ftp.us.debian.org unstable/contrib i386 Packages [56.1 kB]\nGet:96 tor+http://ftp.us.debian.org unstable/non-free i386 Packages [83.6 kB]\nGet:97 tor+http://ftp.us.debian.org testing/main amd64 Packages [7,096 kB]\nGet:98 tor+http://ftp.us.debian.org testing/contrib amd64 Packages [51.2 kB]\nGet:99 tor+http://ftp.us.debian.org testing/non-free amd64 Packages [85.3 kB]\nGet:100 tor+http://ftp.us.debian.org testing/main i386 Packages [7,097 kB]\nGet:101 tor+http://ftp.us.debian.org testing/contrib i386 Packages [51.1 kB]\nGet:102 tor+http://ftp.us.debian.org testing/non-free i386 Packages [81.4 kB]\nFetched 79.4 MB in 1min 39s (794 kB/s)\nReading package lists...\n", "\nWe trust you have received the usual lecture from the local System\nAdministrator. It usually boils down to these three things:\n\n    #1) Respect the privacy of others.\n    #2) Think before you type.\n    #3) With great power comes great responsibility.\n\n[sudo] password for amnesia: W: Ignoring Provides line with DepCompareOp for package python-cffi-backend-api-max\nW: Ignoring Provides line with DepCompareOp for package python-cffi-backend-api-min\nW: Ignoring Provides line with DepCompareOp for package python3-cffi-backend-api-max\nW: Ignoring Provides line with DepCompareOp for package python3-cffi-backend-api-min\nW: Ignoring Provides line with DepCompareOp for package python-cffi-backend-api-max\nW: Ignoring Provides line with DepCompareOp for package python-cffi-backend-api-min\nW: Ignoring Provides line with DepCompareOp for package python3-cffi-backend-api-max\nW: Ignoring Provides line with DepCompareOp for package python3-cffi-backend-api-min\nW: Ignoring Provides line with DepCompareOp for package python-cffi-backend-api-max\nW: Ignoring Provides line with DepCompareOp for package python-cffi-backend-api-min\nW: Ignoring Provides line with DepCompareOp for package python3-cffi-backend-api-max\nW: Ignoring Provides line with DepCompareOp for package python3-cffi-backend-api-min\nW: Ignoring Provides line with DepCompareOp for package php-psr-http-message-implementation\nW: Ignoring Provides line with DepCompareOp for package php-psr-log-implementation\nW: Ignoring Provides line with DepCompareOp for package php-math-biginteger\nW: Ignoring Provides line with DepCompareOp for package python-cffi-backend-api-max\nW: Ignoring Provides line with DepCompareOp for package python-cffi-backend-api-min\nW: Ignoring Provides line with DepCompareOp for package python3-cffi-backend-api-max\nW: Ignoring Provides line with DepCompareOp for package python3-cffi-backend-api-min\nW: You may want to run apt-get update to correct these problems\n"]
    When I update APT using apt-get                                      # features/step_definitions/apt.rb:15
calling as amnesia: echo asdf | sudo -S apt-get install cowsay
call returned: [100, "Reading package lists...\nBuilding dependency tree...\nReading state information...\nSuggested packages:\n  filters\nThe following NEW packages will be installed:\n  cowsay\n0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.\nNeed to get 21.9 kB of archives.\nAfter this operation, 91.1 kB of additional disk space will be used.\nGet:1 tor+http://ftp.us.debian.org/debian/ wheezy/main cowsay all 3.03+dfsg1-4 [21.9 kB]\nFetched 21.9 kB in 0s (27.5 kB/s)\nSelecting previously unselected package cowsay.\n(Reading database ... 131971 files and directories currently installed.)\nUnpacking cowsay (from .../cowsay_3.03+dfsg1-4_all.deb) ...\nProcessing triggers for man-db ...\nSetting up cowsay (3.03+dfsg1-4) ...\n", "[sudo] password for amnesia: dpkg-preconfigure: unable to re-open stdin: No such file or directory\nE: IO Error to output - fwrite (28: No space left on device)\nE: IO Error to output - fwrite (28: No space left on device)\nE: IO Error to output - fwrite (28: No space left on device)\nE: IO Error to output - fwrite (28: No space left on device)\nE: IO Error to output - fwrite (28: No space left on device)\nE: IO Error to output - fwrite (28: No space left on device)\nE: IO Error to output - fwrite (28: No space left on device)\nE: IO Error to output - fwrite (28: No space left on device)\n"]
Command failed: echo asdf | sudo -S apt-get install cowsay
error code: 100
stderr: [sudo] password for amnesia: dpkg-preconfigure: unable to re-open stdin: No such file or directory
E: IO Error to output - fwrite (28: No space left on device)
E: IO Error to output - fwrite (28: No space left on device)
E: IO Error to output - fwrite (28: No space left on device)
E: IO Error to output - fwrite (28: No space left on device)
E: IO Error to output - fwrite (28: No space left on device)
E: IO Error to output - fwrite (28: No space left on device)
E: IO Error to output - fwrite (28: No space left on device)
E: IO Error to output - fwrite (28: No space left on device)
.
<false> is not true.
    Then I should be able to install a package using apt-get             # features/step_definitions/apt.rb:23
      ExecutionFailedInVM (ExecutionFailedInVM)
      ./features/support/helpers/vm_helper.rb:382:in `rescue in execute_successfully'
      ./features/support/helpers/vm_helper.rb:378:in `execute_successfully'
      ./features/step_definitions/apt.rb:27:in `block (2 levels) in <top (required)>'
      ./features/step_definitions/apt.rb:26:in `/^I should be able to install a package using apt-get$/'
      features/apt.feature:27:in `Then I should be able to install a package using apt-get'
Scenario failed at time 00:04:07
Took screenshot "/tmp/TailsToaster/apt-2015-07-16T23:13:14+00:00.png"

Failing Scenarios:
cucumber features/apt.feature:25 # Scenario: Install packages using apt-get

1 scenario (1 failed)
13 steps (1 failed, 12 passed)
4m8.101s

The package installation does succeed.

I can reproduce this outside of the test suite.

The 1.4.1 iso in the devel branch passes. Setting priority to elevated since this appears to be a regression somewhere.


Subtasks


Related issues

Related to Tails - Feature #9381: Ship an amd64 syslinux binary in the ISO Resolved 2015-06-18
Related to Tails - Bug #9594: Tails Installer should work as non-root outside of Tails Resolved 2015-06-16

History

#1 Updated by kytv 2015-07-16 16:29:08

kytv wrote:
> The command to reproduce: # ./run_test_suite --view --iso ../isos/tails-i386-devel-1.5-20150716.iso --log-to-file apt.log --debug -- features/apt.feature:25
>
> The ISO was built from revision 5be4ca9.
>
> […]
>
> The package installation does succeed.
>
> I can reproduce this outside of the test suite.
>
> The 1.4.1 iso in the devel branch passes. Setting priority to elevated since this appears to be a regression somewhere.

…that is, assuming nothing went wrong during my ISO building.

#2 Updated by kytv 2015-07-18 04:14:32

kytv wrote:
> kytv wrote:
> > The command to reproduce: # ./run_test_suite --view --iso ../isos/tails-i386-devel-1.5-20150716.iso --log-to-file apt.log --debug -- features/apt.feature:25
> >
> > The ISO was built from revision 5be4ca9.
> >
> > […]
> >
> > The package installation does succeed.
> >
> > I can reproduce this outside of the test suite.
> >
> > The 1.4.1 iso in the devel branch passes. Setting priority to elevated since this appears to be a regression somewhere.
>
> …that is, assuming nothing went wrong during my ISO building.

I don’t think my build set-up is at fault. The report was based on the results from an iso built on a new system. I built another copy on my “tried and true” set-up and it too results in the error in the description.

#3 Updated by bertagaz 2015-07-19 02:39:44

  • Status changed from New to Confirmed

I’ve seen it too on the lastest images I built based on 1.5 (devel from c3285bd for example).

I’ve tried to do this step manually in a VM with the same amount of memory than the TailsToaster one to debug that.

It seems that the ‘apt-get update’ phase is using more than 500M of disk space once completed, and then ‘apt-get install cowsay’ fails, no more room left for it.

Tried with a VM that has more memory, and the problem doesn’t appear. So that’s clearly a memory issue. Our TailsToaster VM doesn’t have enough at the moment to do that step.

#4 Updated by intrigeri 2015-07-19 02:50:39

> Tried with a VM that has more memory, and the problem doesn’t appear. So that’s clearly a memory issue.

I guess we can blame the addition of the amd64 architecture (Feature #9381). The good news is that we can perhaps revert those changes (see Bug #9594#note-7).

> Our TailsToaster VM doesn’t have enough at the moment to do that step.

If it was only that, I would be happy. The problem is that these new memory requirements apply not only to the test suite, but also to actual users.

#5 Updated by intrigeri 2015-07-29 02:02:19

  • Status changed from Confirmed to In Progress
  • Assignee set to intrigeri
  • % Done changed from 0 to 10
  • Feature Branch set to bugfix/9748-revert-apt-amd64

I introduced the bug and thus I am fixing it.

#6 Updated by intrigeri 2015-07-29 02:29:13

Applied in changeset commit:ac29b779c0f1976b33711689c686bb4a923c066f.

#7 Updated by intrigeri 2015-07-29 02:41:25

  • related to Feature #9381: Ship an amd64 syslinux binary in the ISO added

#8 Updated by intrigeri 2015-07-29 02:41:41

  • related to Bug #9594: Tails Installer should work as non-root outside of Tails added

#9 Updated by intrigeri 2015-07-29 03:04:16

  • Assignee deleted (intrigeri)
  • % Done changed from 10 to 50
  • QA Check set to Ready for QA

#10 Updated by kytv 2015-08-02 03:49:51

Code changes look good to me.

I’ll build an ISO with this branch merged into devel and start a full test suite run using it.

#11 Updated by kytv 2015-08-02 10:21:55

I’m completely happy with the changes and would merge. :)

#12 Updated by anonym 2015-08-03 15:23:54

  • Assignee set to anonym

#13 Updated by anonym 2015-08-05 10:47:55

  • Status changed from In Progress to Fix committed
  • % Done changed from 50 to 100

Applied in changeset commit:0a4dd67c9d879895bf0ced9228d602eac4b5db61.

#14 Updated by anonym 2015-08-05 10:52:45

  • Assignee deleted (anonym)
  • QA Check changed from Ready for QA to Pass

#15 Updated by BitingBird 2015-08-11 10:42:02

  • Status changed from Fix committed to Resolved