Tails

#1 Updated by Anonymous 2017-12-19 16:35:10

• blocks Feature #15078: Review staging website and resilient build added

#2 Updated by Anonymous 2017-12-19 16:37:25

• Parent task changed from Feature #10034 to Feature #15079

#4 Updated by Anonymous 2017-12-19 17:42:19

• blocks Feature #15084: Review & Rubberducking added

#5 Updated by Anonymous 2017-12-19 17:42:28

• blocked by deleted (Feature #15084: Review & Rubberducking)

#6 Updated by Anonymous 2017-12-19 17:42:42

• blocks Feature #15084: Review & Rubberducking added

#8 Updated by emmapeel 2018-01-17 19:49:56

• has duplicate Feature #12311: Create weblate staging wiki added

#12 Updated by groente 2018-03-26 11:45:40

• Assignee deleted (groente)
• QA Check set to Info Needed

Personally, I’m in favour of hosting the staging site on the same machine. It will make it easier to check if a staging-build is already running (so the setup doesn’t go beserk when a user is clicking ‘rebuild’ several times in a row) and it reduces resource overhead. What do you think?

#14 Updated by bertagaz 2018-05-10 11:09:08

• Target version changed from Tails_3.7 to Tails_3.8

#15 Updated by Anonymous 2018-05-29 13:01:11

• Assignee set to groente
• QA Check changed from Info Needed to Dev Needed

Hi groente!

In Bug #15568 respectively in the translate-server.git repository, under scripts/, you will find a Python script that can update a given Git clone (/var/lib/weblate/repositories/vcs/staging on the production machine) with uncommitted suggestions from Weblate. You can also find this script in /var/lib/weblate/repositories/home/save-suggestions.py. You need to execute this file as ‘weblate’ user.

This script should probably be run by cron once a day and when it’s done, the wiki should be built from this folder. This wiki needs their proper ikiwiki.setup file - which I will commit to master shortly.

Now, this build should also be run by a daily cronjob.

You will also need to make this accessible through a subdomain like https://staging.tails.boum.org

That’s it! :)

#18 Updated by intrigeri 2018-06-26 16:27:43

• Target version changed from Tails_3.8 to Tails_3.9

#19 Updated by groente 2018-06-28 14:12:05

• QA Check changed from Dev Needed to Info Needed

There’s a first peak on https://translate.tails.boum.org/staging , a dedicated domainname has been requested. Turning this into a cronjob is on the todo.

One question, though: do you want/need apache to serve the appropriate index.XX.html file based on user language settings or is it okay like this?

#20 Updated by groente 2018-06-28 14:12:18

• Assignee deleted (groente)

#23 Updated by Anonymous 2018-06-28 17:38:18

• Assignee set to groente
• QA Check deleted (Info Needed)

groente wrote:
> There’s a first peak on https://translate.tails.boum.org/staging , a dedicated domainname has been requested. Turning this into a cronjob is on the todo.

Wooohoo! :)

Great!

> One question, though: do you want/need apache to serve the appropriate index.XX.html file based on user language settings or is it okay like this?

Right now, there is no file selected, there is only the directory listing.
User language settings would be good, but if it’s too complicated, we don’t really need that.
But: I think it would be good to at least have the english version selected by default, i.e. point to index.en.html.

#24 Updated by groente 2018-06-28 20:59:52

• Assignee deleted (groente)
• QA Check set to Dev Needed

Okay, the default index is now set to english. The shellscript to build the staging site is now deployed through puppet and a daily cronjob has been set to run it at night.

Currently, the script breaks at the build-website part, where it fails a sanity check:

wiki/src/news/version_3.1.fr.po: ‘meta date’ msgstr contains non-rfc2822 date: Martes, 08 de agosto de 2017 12:34:56 +0000

Any chance you can fix that?

Apart from that, it’s now a matter of waiting for the domainname to be created and setting up the reverse proxy, shouldn’t take more than a week.

#25 Updated by groente 2018-06-30 19:49:13

• Assignee set to intrigeri
• QA Check changed from Dev Needed to Ready for QA
• Feature Branch set to feature/15077-add-staging-website

Hey intri, can you check if I guessed the right way to add a vhost to our nginx (commit 5c3af6dc24a807a2b2a1381ade13e8b8b1fe6883) ? Thanks!

#26 Updated by intrigeri 2018-06-30 20:42:47

• Assignee changed from intrigeri to groente
• QA Check deleted (Ready for QA)

> Hey intri, can you check if I guessed the right way to add a vhost to our nginx (commit 5c3af6dc24a807a2b2a1381ade13e8b8b1fe6883) ? Thanks!

• nginx::included { 'tails_weblate_reverse_proxy' will trigger a duplicate declaration error: it’s already declared in tails::weblate::reverse_proxy. You’ll need to give that resource a unique name.
• You’re lucky that tails/weblate/nginx/reverse_proxy.vhost.erb seems to be suitable here. But reusing it as-is will be confusing: someone might change that template, thinking it’s only used for weblate (“This file is managed by the `::tails::weblate::reverse_proxy` class”). So either duplicate or share, but if you share, find some way to make it clear. Same for tails/weblate/nginx/reverse_proxy.inc.erb. In both cases, for Feature #14588 I’ll need similar templates for reverse proxying to an ikiwiki website. So perhaps you can copy the stuff to tails/ikiwiki/nginx/reverse_proxy.{vhost,inc}.erb, which eliminates the confusion and paves the way for the work we’ll have to do soon anyway?

Other than that, LGTM!

#27 Updated by groente 2018-06-30 23:02:08

• Assignee changed from groente to intrigeri
• QA Check set to Ready for QA

hey, can you check commit 622a0de1542ff41ff75c2104450181b84a4444d8 ?

i’ve tried to re-use the template between limesurvey, translate, and staging in such a way that you can easily add your ikiwiki site aswell. i wouldn’t be surprised if i’m violating some puppet syntax, though, and i’m a bit unsure about the directory naming in the templates directory, so some feedback would be very welcome :)

#31 Updated by intrigeri 2018-07-04 07:40:49

• Status changed from Confirmed to In Progress
• Assignee changed from intrigeri to groente
• QA Check deleted (Ready for QA)

groente wrote:
> hey, can you check commit 622a0de1542ff41ff75c2104450181b84a4444d8 ?
>
> i’ve tried to re-use the template between limesurvey, translate, and staging in such a way that you can easily add your ikiwiki site aswell.

Good idea!

> i wouldn’t be surprised if i’m violating some puppet syntax, though, and i’m a bit unsure about the directory naming in the templates directory, so some feedback would be very welcome :)

It looks good! Two comments:

• I’m not very happy with the name of the $includename variable, but I think that’s mostly because it’s exposed as a parameter and thus becomes API. Maybe make it a non-parameter variable and be done with it?
• We now have 3 reverse proxy classes that are basically the same and I see we have 2 more that diverge in minor ways. Granted, I started the copy’n’paste dance but looking at the big picture now, I’ll want to refactor this at some point. You don’t have to do it and that’s not a blocker for this ticket, but in case you want to use this as a learning opportunity, here’s what I would do: I would create a tails::nginx::reverse_proxy defined resource and then most of the existing & future tails::*::reverse_proxy classes become thin wrappers around it, whose job is merely to 1. provide a higher level API; and 2. manage and pass parameters to tails::nginx::reverse_proxy. Maybe the one for reprepro is too special, would require to make t::n::reverse_proxy too complex, and should therefore remain ad hoc.

Finally, sooner or later you’ll need to set up things to be able to test this kind of work locally. This may be better done during a sprint.

#32 Updated by groente 2018-07-04 16:41:38

• Assignee changed from groente to intrigeri
• QA Check set to Ready for QA

Okay, thanks for the feedback!
Does commit a4191f27140ba2bb6bd6dfcbb6d8b0421f2754a6 look acceptable for merging?

Let’s work on getting local deploys for testing purposes in the next sprint and then I’ll continue refactoring a bit further.

#33 Updated by intrigeri 2018-07-04 17:03:50

• Assignee changed from intrigeri to groente
• QA Check changed from Ready for QA to Pass

> Okay, thanks for the feedback!

My pleasure.

> Does commit a4191f27140ba2bb6bd6dfcbb6d8b0421f2754a6 look acceptable for merging?

Absolutely.

#34 Updated by groente 2018-08-22 19:28:10

• Status changed from In Progress to Resolved

https://staging.tails.boum.org

#35 Updated by intrigeri 2019-06-27 17:16:43

• Assignee deleted (groente)