Feature #10851

Give lizard enough free storage to host our freezable APT repository

Added by intrigeri 2016-01-04 15:03:51 . Updated 2016-02-14 20:14:05 .

Status:
Resolved
Priority:
Elevated
Assignee:
Category:
Infrastructure
Target version:
Start date:
2016-01-04
Due date:
% Done:

100%

Feature Branch:
Type of work:
Sysadmin
Blueprint:

Starter:
Affected tool:
Deliverable for:
269

Description

  • Feature #6295#note-29 says we’ll need 620G in a year.
  • We don’t have that much available disk space.
  • Other stuff grows too, see Feature #9400 has estimates. Better take this into account.

Files


Subtasks


Related issues

Related to Tails - Feature #9264: Consider buying more server hardware to run our automated test suite Resolved 2015-12-15
Related to Tails - Bug #11680: Upgrade server hardware (2017-2019 edition) Resolved 2016-09-19
Related to Tails - Feature #11806: Update server storage planning needs for at least 2017 Resolved 2016-09-19

History

#1 Updated by intrigeri 2016-01-04 15:04:49

  • related to Feature #9264: Consider buying more server hardware to run our automated test suite added

#2 Updated by intrigeri 2016-01-04 15:08:04

  • Description updated

#3 Updated by intrigeri 2016-01-04 15:59:28

  • File 10851-storage.ods added
  • Status changed from Confirmed to In Progress
  • Assignee changed from intrigeri to bertagaz
  • % Done changed from 0 to 10

The attached spreadsheet says we need to get 300G more to host what we want to host until the end of the year => I propose buying two Samsung 850 EVO, 2.5-inc, 500GB SSDs ($160 each on Amazon).

We could maybe make it fit into 250GB SSDs, but:

  • the price difference is not that big;
  • storage density is important, and it doesn’t seem worth it to “sacrifice” 2 slots for 250 mere GB;
  • the bonus space won’t be wasted, and can allow us to postpone a little bit next time we have to think about this topic again.

bertagaz, can you please quickly review my figures and see if I forgot something, or got the maths wrong enough to make the conclusion bogus?

#4 Updated by intrigeri 2016-01-04 16:01:25

@bertagaz: ideally I would get your ACK this week. If this doesn’t seem realistic, let me know what is doable, and then I’ll see if I can wait.

#5 Updated by bertagaz 2016-01-05 17:34:17

  • Assignee changed from bertagaz to intrigeri
  • % Done changed from 10 to 20

intrigeri wrote:
> bertagaz, can you please quickly review my figures and see if I forgot something, or got the maths wrong enough to make the conclusion bogus?

Had a look, compared with Feature #9400, and it sounds fair to me. With 500G drives we have a little margin in case something grows more than expected, so it seems to be a reasonable option. Please purchase!

#6 Updated by intrigeri 2016-01-05 18:41:43

  • Subject changed from Give lizard enough free storage to host our freezable APT repository to Give lizard enough free storage to host our freezable APTrepository

#7 Updated by intrigeri 2016-01-05 18:41:52

  • Subject changed from Give lizard enough free storage to host our freezable APTrepository to Give lizard enough free storage to host our freezable APT repository

#8 Updated by intrigeri 2016-01-05 18:42:57

  • Assignee changed from intrigeri to sajolida

tl;dr: we need more storage on lizard, and the current state of things is blocking deployment of the freezable APT repo PoC. It was estimated that a pair of 500GB SSDs (2 * $160) would do the job until the end of the year. Shall we go ahead?

#9 Updated by intrigeri 2016-01-05 19:52:21

  • Assignee changed from sajolida to intrigeri

sajolida ack’ed the proposal on tails-dev (xmpp).

#10 Updated by intrigeri 2016-01-05 20:20:17

  • % Done changed from 20 to 30

Drives ordered, arrive on Thursday.

#11 Updated by intrigeri 2016-01-11 02:25:34

  • % Done changed from 30 to 40

Drives plugged, I’m running badblocks etc. on them.

#12 Updated by intrigeri 2016-01-11 17:09:42

  • Assignee changed from intrigeri to bertagaz
  • % Done changed from 40 to 50
  • QA Check set to Ready for QA

badblocks OK, reset drives with ATA “secure erase” (https://wiki.archlinux.org/index.php/SSD_memory_cell_clearing), set up RAID and LUKS, added to our VG, updated crypttab and mdadm.conf, updated initramfs. Gave almost all of the planned space to apt-snapshots LV:

ssh misc.lizard df -h /srv/apt-snapshots
Filesystem      Size  Used Avail Use% Mounted on
/dev/vdb        611G  327G  284G  54% /srv/apt-snapshots

So I think we’re good!

bertagaz, please check I didn’t forget anything :)

#13 Updated by bertagaz 2016-01-27 10:49:46

  • Target version changed from Tails_2.0 to Tails_2.2

#14 Updated by bertagaz 2016-02-14 20:14:05

  • Status changed from In Progress to Resolved
  • Assignee deleted (bertagaz)
  • % Done changed from 50 to 100
  • QA Check deleted (Ready for QA)

Sorry for the lag, a quick tour lead me to think all is fine. Congrats!

#15 Updated by intrigeri 2016-09-19 03:37:49

  • related to Bug #11680: Upgrade server hardware (2017-2019 edition) added

#16 Updated by intrigeri 2016-09-19 03:40:57

  • related to Feature #11806: Update server storage planning needs for at least 2017 added