Bug #10994

"I can view and print a PDF file" scenarios are fragile

Added by intrigeri 2016-01-25 12:38:41 . Updated 2019-03-08 15:35:11 .

Status:
Confirmed
Priority:
Normal
Assignee:
Category:
Test suite
Target version:
Start date:
2016-01-25
Due date:
% Done:

30%

Feature Branch:
wip/test/10994-fragile-view-and-print-PDF
Type of work:
Code
Blueprint:

Starter:
Affected tool:
Deliverable for:

Description

I’ve seen “Scenario: I can view and print a PDF file stored in /usr/share” and “Scenario: I can view and print a PDF file stored in non-persistent /home/amnesia” fail on Jenkins with a screenshot that looks like it has succeeded, see e.g. the attached file (that comes from https://jenkins.tails.boum.org/job/test_Tails_ISO_experimental/117/).

Debug log:

  Scenario: I can view and print a PDF file stored in non-persistent /home/amnesia              # features/evince.feature:14
calling as root: echo 'hello?'
call returned: [0, "hello?\n", ""]
[log] CLICK on (1024,384)
calling as root: /sbin/ifconfig eth0 | grep -q 'inet addr'
call returned: [1, "", ""]
calling as root: date -s '@1451226453'
call returned: [0, "Sun Dec 27 14:27:33 UTC 2015\n", ""]
    Given I have started Tails from DVD without network and logged in                           # features/step_definitions/snapshots.rb:201
calling as amnesia: cp "/usr/share/cups/data/default-testpage.pdf" "/home/amnesia"
call returned: [0, "", ""]
    And I copy "/usr/share/cups/data/default-testpage.pdf" to "/home/amnesia" as user "amnesia" # features/step_definitions/common_steps.rb:633
calling as root: pidof -x -o '%PPID' gnome-terminal
call returned: [1, "", ""]
[log] CLICK on (51,16)
[log] CLICK on (58,431)
[log] CLICK on (264,470)
[log] TYPE "evince /home/amnesia/default-testpage.pdf
"
    When I open "/home/amnesia/default-testpage.pdf" with Evince                                # features/step_definitions/evince.rb:1
    Then I see "CupsTestPage.png" after at most 20 seconds                                      # features/step_definitions/common_steps.rb:441
      FindFailed: can not find CupsTestPage.png on the screen.
      Line ?, in File ? (RuntimeError)
      ./features/step_definitions/common_steps.rb:446:in `rescue in block in <top (required)>'
      ./features/step_definitions/common_steps.rb:442:in `/^I (do not )?see "([^"]*)" after at most (\d+) seconds$/'
      features/evince.feature:18:in `Then I see "CupsTestPage.png" after at most 20 seconds'
    And I can print the current document to "/home/amnesia/output.pdf"                          # features/step_definitions/evince.rb:5
      Scenario failed at time 00:19:35

      Screenshot: https://jenkins.tails.boum.org/job/test_Tails_ISO_test-10774-fragile-mac-address-spoofing-fails-and-macchanger-returns-false/11/artifact/build-artifacts/00:19:35_I_can_view_and_print_a_PDF_file_stored_in_non-persistent__home_amnesia.png

      Video: https://jenkins.tails.boum.org/job/test_Tails_ISO_test-10774-fragile-mac-address-spoofing-fails-and-macchanger-returns-false/11/artifact/build-artifacts/00:19:35_I_can_view_and_print_a_PDF_file_stored_in_non-persistent__home_amnesia.mkv

Note that this is a different problem from Bug #10775.

Files

00_32_47_I_can_view_and_print_a_PDF_file_stored_in_non-persistent__home_amnesia.png (54221 B) intrigeri, 2016-01-25 12:36:21
02_04_39_I_can_view_and_print_a_PDF_file_stored_in_persistent__home_amnesia_Persistent.mkv (219204 B) intrigeri, 2016-08-02 01:23:19
02_04_39_I_can_view_and_print_a_PDF_file_stored_in_persistent__home_amnesia_Persistent.png (61280 B) intrigeri, 2016-08-02 01:23:22

Subtasks

History

#1 Updated by intrigeri 2016-01-25 12:41:24

  • Feature Branch set to test/10994-fragile-view-and-print-PDF

#2 Updated by intrigeri 2016-02-20 13:45:31

  • Description updated

#3 Updated by intrigeri 2016-03-03 16:10:10

  • Assignee changed from kytv to intrigeri
  • Target version changed from Tails_2.5 to Tails_2.3

I’ll at least check if the problem can still be reproduced, by keeping the topic branch that re-enables these tests updated and running on Jenkins.

#4 Updated by anonym 2016-03-03 16:58:49

  • Target version changed from Tails_2.3 to Tails_2.4

I’ll take over this one.

#5 Updated by intrigeri 2016-03-03 18:13:59

  • Assignee changed from intrigeri to anonym

#6 Updated by anonym 2016-05-10 07:36:07

  • Deliverable for changed from 270 to SponsorS_Internal

#7 Updated by anonym 2016-05-26 16:24:48

  • Status changed from Confirmed to In Progress
  • % Done changed from 0 to 30

This commit (currently pushed to the testing branch) might fix it:

commit a8a8992d76cc950ae79cb2b9117ad30d8f7f4b80
Author: anonym <anonym@riseup.net>
Date:   Thu May 26 18:09:45 2016 +0200

    Bump the CupsTestPage.png test suite image.

    Compared to the old image the distance between some of the elements
    (e.g. the Debian logo and color gradient) is different so let's pick
    the title only which shouldn't have such issues.

#8 Updated by anonym 2016-06-08 01:35:01

  • Target version changed from Tails_2.4 to Tails_2.5

#9 Updated by intrigeri 2016-07-18 06:28:49

  • Target version changed from Tails_2.5 to Tails_2.7

#10 Updated by intrigeri 2016-08-02 01:24:18

anonym wrote:
> This commit (currently pushed to the testing branch) might fix it:
> […]

Sorry, it doesn’t — see attachments. Corresponding debug log:

    When I open "/home/amnesia/Persistent/default-testpage.pdf" with Evince                                       # features/step_definitions/evince.rb:1
[log] TYPE "evince /home/amnesia/Persistent/default-testpage.pdf
"
    Then I see "CupsTestPage.png" after at most 40 seconds                                                        # features/step_definitions/common_steps.rb:459
      FindFailed: can not find CupsTestPage.png on the screen.
      Line ?, in File ? (RuntimeError)
      ./features/step_definitions/common_steps.rb:464:in `rescue in block in <top (required)>'
      ./features/step_definitions/common_steps.rb:460:in `/^I (do not )?see "([^"]*)" after at most (\d+) seconds$/'
      features/evince.feature:52:in `Then I see "CupsTestPage.png" after at most 40 seconds'
    And I can print the current document to "/home/amnesia/Persistent/output.pdf"                                 # features/step_definitions/evince.rb:5

#11 Updated by intrigeri 2016-08-02 01:28:29

  • Feature Branch changed from test/10994-fragile-view-and-print-PDF to wip/test/10994-fragile-view-and-print-PDF

#12 Updated by intrigeri 2016-08-18 07:34:56

  • Assignee deleted (anonym)
  • Target version deleted (Tails_2.7)
  • Deliverable for deleted (SponsorS_Internal)

#13 Updated by Anonymous 2017-06-28 13:55:04

Dear anonym, what’s the status of this ticket? Could you please clarify? Thanks!

#14 Updated by Anonymous 2017-06-28 13:55:14

  • Assignee set to anonym

#15 Updated by intrigeri 2017-06-28 14:43:30

  • Assignee deleted (anonym)

The bug is still there, and “someone should do something about it”.

#16 Updated by intrigeri 2019-03-08 15:35:11

  • Status changed from In Progress to Confirmed