Feature #8947

Use the headless Ruby gem in the automated test suite

Added by anonym 2015-02-24 10:38:36 . Updated 2015-09-02 09:44:52 .

Status:
Rejected
Priority:
Normal
Assignee:
Category:
Test suite
Target version:
Start date:
2015-02-24
Due date:
% Done:

0%

Feature Branch:
Type of work:
Research
Blueprint:

Starter:
Affected tool:
Deliverable for:

Description

In our test suite the headless Ruby gem could replace our xvfb and video capturing stuff in run_test_suite. Moving that code “into Ruby” would give us more flexibility. For instance:

  • We would only run the xvfb server when we need it, i.e. only for @product features, and not for @source features where it’s just weird.
    * We’d probably get better cleaning up of the leftover sockets in /tmp/.X11-unix/ (Bug #8707).
  • We could capture per-scenario videos (and perhaps delete all but failing the ones?).

It’s also a step towards removing the run_test_suite shell wrapper to have the complete test suite in Ruby only.

Unfortunately it’s not packaged in Debian, but before we try making that happen we should investigate whether this gem truly suites our needs, so it’s not a wasted effort.

Subtasks

Related issues

Related to Tails - Bug #8707: The automated test suite does not clean up when it's finished Resolved 2015-01-16
Related to Tails - Feature #10148: Split test suite capture videos per-scenario Resolved 2015-09-02

History

#1 Updated by anonym 2015-02-24 10:41:52

  • Assignee set to anonym

#2 Updated by intrigeri 2015-02-24 15:17:06

  • related to Bug #8928: "unclutter" can cause spurious errors with some configurations added

#3 Updated by intrigeri 2015-02-24 15:17:23

  • related to deleted (Bug #8928: "unclutter" can cause spurious errors with some configurations)

#4 Updated by intrigeri 2015-02-24 15:17:50

  • related to Bug #8707: The automated test suite does not clean up when it's finished added

#5 Updated by intrigeri 2015-02-24 15:18:34

  • Target version set to Tails_1.4

If that’s one possible way to fix Bug #8707, then let’s set the same target version on it.

#6 Updated by anonym 2015-04-29 10:28:00

  • Description updated
  • Target version changed from Tails_1.4 to Hole in the Roof

intrigeri wrote:
> If that’s one possible way to fix Bug #8707, then let’s set the same target version on it.

With Bug #8707 fixed, I’ll make this into a Hole in the roof, suitable for procrastination at some point.

#7 Updated by intrigeri 2015-04-30 08:14:46

  • Target version deleted (Hole in the Roof)

With Bug #8707 out of the way, the current state of things doesn’t look that sad to me (it works fine and it’s not that ugly), so IMO this doesn’t qualify for the Hole in the Roof status.

#8 Updated by intrigeri 2015-09-02 04:25:17

  • related to Feature #10148: Split test suite capture videos per-scenario added

#9 Updated by anonym 2015-09-02 09:44:52

  • Status changed from Confirmed to Rejected
  • Assignee deleted (anonym)

I’m rejecting this ticket simply because we should waste time on it. Per-scenario video captures can of course be implemented without this, and has already been done for Feature #10148, and that’d be the biggest gain really. If we want to get rid of the shell wrapper, nothing really prevents us from moving the current xvfb shell stuff into ruby.