Althea Development Update #70: Dueling scripts
Put on your night time sunglasses because I have a tale from our cyberpunk future, or present as it may be. How a poorly coded smart contract disrupted an ISP in rural Oregon.
Stories about DevOps.
3 postsPut on your night time sunglasses because I have a tale from our cyberpunk future, or present as it may be. How a poorly coded smart contract disrupted an ISP in rural Oregon.
Starting at 8pm Pacific time yesterday through 3am Pacific time today Althea’s exit servers were down. This is our first major (longer than a 15 minute) outage since June of 2018. The technical issue exposed is pretty minor, the real feedback here is about a series of failures in our incident recovery procedure. Primary Causes: * Incorrect configuration of per process file descriptor limits on the exits * Recovery failure of some client devices Failures in incident response procedure: *
C.O.R.E. may sound like the name of a 1980's superhero team, but it is actually a tool that simulates wired and wifi networks, right down to the radio waves. For this reason I am using it to test my modifications to Babel, an ad-hoc 'mesh' routing protocol.