Hi All,
The permisisoning server locked up yesterday after a few hours of operation. This revealed a flaw in the most recent update to node and gateway, which we released hot fixes for about an hour ago.
Server (Node) https://gitlab.com/elixxir/server/-/merge_requests/550
Made the server stop listening when the network setup fails so it can rebind on the retry
Removed a redundant mechanism to access the node’s gateway ID
Gateway https://gitlab.com/elixxir/gateway/-/merge_requests/136
Made the gateway stop listening when the network setup fails so it can rebind on the retry
We also have pushed a minor update to the permissioning server which fixes an edge case where a node can get stuck in the WAITING state and is never scheduled. The core scheduling thread has had more logging added to help uncover the source of the deadlock.
Clarification: This edit was pushed to nodes who accept automatic updates
4 Likes
Do you want us to pull the latest updates or will it get pushes later?
it was already pushed, sorry that wasn’t clear
Mash
July 4, 2020, 9:21am
4
On the node I still see
/opt/xxnetwork/bin/xxnetwork-node version
xx network Server v1.3.0 – 9605bee7 fixed a bad print
and on the gateway
bin/xxnetwork-gateway version
xx network Gateway v1.3.1 – 173f486 improved version print
I had to reboot both my node and gateway after the recent push – not sure if that is expected of us or it is meant to work w/o a restart?
rick
July 5, 2020, 2:42am
6
We had a hiccup in the update and not everyone got it. You should be running the latest now, if not please let us know.
1 Like
Roman
July 5, 2020, 8:37am
7
I have not received updates.
rick
July 5, 2020, 6:00pm
8
Can you please send both the gateway and node wrapper logs (located in the /opt/xxnetwork/node-logs and /opt/xxnetwork/gateway-logs folders) to me via direct message? I’ll take a look when I sign in tomorrow.
Roman
July 5, 2020, 9:23pm
9
update has already arrived … I’m glad.
xx network Server v1.3.1 – e98f4887 fixed a potential segfault
Dependencies:
module gitlab.com/elixxir/server
go 1.13
require (github.com/cznic/mathutil v0.0.0-20181122101859-297441e03548github.com/go-pg/pg v8.0.6+incompatiblegithub.com/golang/protobuf v1.4.2github.com/gopherjs/gopherjs v0.0.0-20200217142428-fce0ec30dd00 // indirectgithub.com/jinzhu/copier v0.0.0-20190924061706-b57f9002281agithub.com/jinzhu/inflection v1.0.0 // indirectgithub.com/mitchellh/mapstructure v1.3.0 // indirectgithub.com/onsi/ginkgo v1.12.0 // indirectgithub.com/onsi/gomega v1.9.0 // indirectgithub.com/pelletier/go-toml v1.7.0 // indirectgithub.com/pkg/errors v0.9.1github.com/remyoudompheng/bigfft v0.0.0-20200410134404-eec4a21b6bb0 // indirectgithub.com/smartystreets/assertions v1.1.0 // indirectgithub.com/spf13/afero v1.2.2 // indirectgithub.com/spf13/cast v1.3.1 // indirectgithub.com/spf13/cobra v1.0.0github.com/spf13/jwalterweatherman v1.1.0github.com/spf13/pflag v1.0.5 // indirectgithub.com/spf13/viper v1.6.3gitlab.com/elixxir/comms v0.0.0-20200702193057-ef6a968a6f39gitlab.com/elixxir/crypto v0.0.0-20200702010659-d5c5671893c7gitlab.com/elixxir/gpumathsgo v0.0.2-0.20200617001921-1de1fff56304gitlab.com/elixxir/primitives v0.0.0-20200702192904-3bbc4f945989golang.org/x/crypto v0.0.0-20200510223506-06a226fb4e37google.golang.org/grpc v1.29.1
2 Likes