Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Receives a panic leveldb: closed when Ctrl-C seid v5.5.2. #1704

Open
maoueh opened this issue May 27, 2024 · 3 comments
Open

[BUG] Receives a panic leveldb: closed when Ctrl-C seid v5.5.2. #1704

maoueh opened this issue May 27, 2024 · 3 comments
Labels
bug Something isn't working linear Created by Linear-GitHub Sync

Comments

@maoueh
Copy link
Contributor

maoueh commented May 27, 2024

Seid version

seid version --long
maoueh@sei-devnet-reader-0:~$ seid version --long
name: sei
server_name: <appd>
version: v5.5.2-fh3.0
commit: 16f73c4b9343cefae99ba56ab07b0ef233e68f42
build_tags: netgo ledger,
go: go version go1.22.2 linux/amd64
build_deps:
- cosmossdk.io/[email protected]
- filippo.io/[email protected]
- github.com/99designs/[email protected]
- github.com/CosmWasm/[email protected] => github.com/sei-protocol/[email protected]
- github.com/CosmWasm/[email protected]
- github.com/DataDog/[email protected]
- github.com/VictoriaMetrics/[email protected]
- github.com/alitto/[email protected]
- github.com/armon/[email protected]
- github.com/beorn7/[email protected]
- github.com/bgentry/[email protected]
- github.com/bits-and-blooms/[email protected]
- github.com/btcsuite/[email protected]
- github.com/cespare/xxhash/[email protected]
- github.com/cockroachdb/[email protected]
- github.com/cockroachdb/[email protected]
- github.com/cockroachdb/[email protected]
- github.com/cockroachdb/[email protected]
- github.com/cockroachdb/[email protected]
- github.com/cockroachdb/[email protected]
- github.com/coinbase/[email protected]
- github.com/confio/ics23/[email protected] => github.com/cosmos/cosmos-sdk/ics23/[email protected]
- github.com/consensys/[email protected]
- github.com/consensys/[email protected]
- github.com/cosmos/[email protected]
- github.com/cosmos/[email protected] => github.com/sei-protocol/[email protected]
- github.com/cosmos/[email protected]
- github.com/cosmos/[email protected] => github.com/sei-protocol/[email protected]
- github.com/cosmos/ibc-go/[email protected] => github.com/sei-protocol/sei-ibc-go/[email protected]
- github.com/cosmos/[email protected]
- github.com/cpuguy83/go-md2man/[email protected]
- github.com/crate-crypto/[email protected]
- github.com/crate-crypto/[email protected]
- github.com/creachadair/[email protected]
- github.com/davecgh/[email protected]
- github.com/deckarep/[email protected]
- github.com/deckarep/golang-set/[email protected]
- github.com/desertbit/[email protected]
- github.com/dvsekhvalnov/[email protected]
- github.com/ethereum/[email protected] => github.com/sei-protocol/[email protected]
- github.com/felixge/[email protected]
- github.com/fjl/[email protected]
- github.com/fsnotify/[email protected]
- github.com/gballet/[email protected]
- github.com/gballet/[email protected]
- github.com/go-kit/[email protected]
- github.com/go-kit/[email protected]
- github.com/go-logfmt/[email protected]
- github.com/go-logr/[email protected]
- github.com/go-logr/[email protected]
- github.com/godbus/[email protected]
- github.com/gofrs/[email protected]
- github.com/gogo/[email protected]
- github.com/gogo/[email protected] => github.com/regen-network/[email protected]
- github.com/golang-jwt/jwt/[email protected]
- github.com/golang/[email protected]
- github.com/golang/[email protected]
- github.com/google/[email protected]
- github.com/google/[email protected]
- github.com/google/[email protected]
- github.com/google/[email protected]
- github.com/gorilla/[email protected]
- github.com/gorilla/[email protected]
- github.com/gorilla/[email protected]
- github.com/grpc-ecosystem/[email protected]
- github.com/grpc-ecosystem/[email protected]
- github.com/grpc-ecosystem/[email protected]
- github.com/gsterjov/[email protected]
- github.com/hashicorp/[email protected]
- github.com/hashicorp/[email protected]
- github.com/hashicorp/[email protected]
- github.com/hashicorp/golang-lru/[email protected]
- github.com/hashicorp/[email protected]
- github.com/hdevalence/[email protected]
- github.com/holiman/[email protected]
- github.com/holiman/bloomfilter/[email protected]
- github.com/holiman/[email protected]
- github.com/huin/[email protected]
- github.com/improbable-eng/[email protected]
- github.com/jackpal/[email protected]
- github.com/klauspost/[email protected]
- github.com/kr/[email protected]
- github.com/kr/[email protected]
- github.com/ledgerwatch/[email protected]
- github.com/lib/[email protected]
- github.com/libp2p/[email protected]
- github.com/magiconair/[email protected]
- github.com/mattn/[email protected]
- github.com/mattn/[email protected]
- github.com/mattn/[email protected]
- github.com/matttproud/[email protected]
- github.com/mitchellh/[email protected]
- github.com/mitchellh/[email protected]
- github.com/mmcloughlin/[email protected]
- github.com/mtibben/[email protected]
- github.com/oasisprotocol/[email protected]
- github.com/olekukonko/[email protected]
- github.com/pelletier/go-toml/[email protected]
- github.com/pkg/[email protected]
- github.com/pmezard/[email protected]
- github.com/prometheus/[email protected]
- github.com/prometheus/[email protected]
- github.com/prometheus/[email protected]
- github.com/prometheus/[email protected]
- github.com/rakyll/[email protected]
- github.com/regen-network/[email protected]
- github.com/rivo/[email protected]
- github.com/rogpeppe/[email protected]
- github.com/rs/[email protected]
- github.com/rs/[email protected]
- github.com/russross/blackfriday/[email protected]
- github.com/savaki/[email protected]
- github.com/sei-protocol/[email protected]
- github.com/sei-protocol/[email protected] => github.com/sei-protocol/[email protected]
- github.com/sei-protocol/[email protected]
- github.com/shirou/[email protected]+incompatible
- github.com/spf13/[email protected]
- github.com/spf13/[email protected]
- github.com/spf13/[email protected]
- github.com/spf13/[email protected]
- github.com/spf13/[email protected]
- github.com/spf13/[email protected]
- github.com/status-im/[email protected]
- github.com/stretchr/[email protected]
- github.com/subosito/[email protected]
- github.com/syndtr/[email protected] => github.com/syndtr/[email protected]
- github.com/tendermint/[email protected]
- github.com/tendermint/[email protected]
- github.com/tendermint/[email protected]
- github.com/tendermint/[email protected] => github.com/sei-protocol/[email protected]
- github.com/tendermint/[email protected] => github.com/sei-protocol/[email protected]
- github.com/tidwall/[email protected]
- github.com/tidwall/[email protected]
- github.com/tidwall/[email protected]
- github.com/tidwall/[email protected]
- github.com/tidwall/[email protected]
- github.com/tklauser/[email protected]
- github.com/tklauser/[email protected]
- github.com/tyler-smith/[email protected]
- github.com/urfave/cli/[email protected]
- github.com/xrash/[email protected]
- github.com/yourbasic/[email protected]
- github.com/zbiljic/[email protected]
- github.com/zondax/[email protected]
- github.com/zondax/[email protected]
- go.opentelemetry.io/[email protected]
- go.opentelemetry.io/otel/exporters/[email protected]
- go.opentelemetry.io/otel/[email protected]
- go.opentelemetry.io/otel/[email protected]
- golang.org/x/[email protected]
- golang.org/x/[email protected]
- golang.org/x/[email protected]
- golang.org/x/[email protected]
- golang.org/x/[email protected]
- golang.org/x/[email protected]
- golang.org/x/[email protected]
- golang.org/x/[email protected]
- google.golang.org/[email protected]
- google.golang.org/genproto/googleapis/[email protected]
- google.golang.org/genproto/googleapis/[email protected]
- google.golang.org/[email protected] => google.golang.org/[email protected]
- google.golang.org/[email protected]
- gopkg.in/[email protected]
- gopkg.in/natefinch/[email protected]
- gopkg.in/[email protected]
- gopkg.in/[email protected]
- nhooyr.io/[email protected]
- rsc.io/[email protected]
cosmos_sdk_version: v0.45.10
**Chain ID** `pacific-1`, just after the `v5.5.2` upgrade

Describe the bug
Receives a panic leveldb: closed when Ctrl-C seid v5.5.2.

To Reproduce
Steps to reproduce the behavior:

  1. I ranseid via systemctl
  2. At some point I do systemctl stop <name>.
  3. Receive the following panic:
...
5:07PM ERR problem closing blockstore err="leveldb: closed"
5:07PM ERR problem closing statestore err="leveldb: closed"
5:07PM INF stopped service service=Node
5:07PM INF RPC HTTP server stopped err="accept tcp [::]:1317: use of closed network connection" module=api-server
5:07PM INF close any other open resource...
5:07PM INF committed state block_app_hash=F7D6B6CC5818F999C6816F89C3785927618B45A5E3CA6A9E9D39360753E9000E height=79124790 module=state num_txs=31
5:07PM INF transaction expired address= age=30126.250199 evm=false height=79124790 module=mempool nonce=0 priority=0 tx=5BF3DD1E0B0CF2D63E40089A54C255DFA3BEB5D53E907C7D06106FEB17E6EBAD tx_height=79124571 tx_timestamp=2024-05-27T17:07:25Z
panic: failed to process committed block (79124790:3F5FAD6845CC289554CE414176312D32E7B5D7344D9FE0A17AB98D97F1FE0A4C): leveldb: closed
goroutine 442 [running]:
github.com/tendermint/tendermint/internal/blocksync.(*Reactor).poolRoutine(0xc0064f18c8, {0x3655f40, 0xc000398050}, 0x0, 0xc019fff3e0)
	/home/sei/go/pkg/mod/github.com/sei-protocol/[email protected]/internal/blocksync/reactor.go:700 +0x1b9a
created by github.com/tendermint/tendermint/internal/blocksync.(*Reactor).OnStart in goroutine 1
	/home/sei/go/pkg/mod/github.com/sei-protocol/[email protected]/internal/blocksync/reactor.go:181 +0x5d7

Note that it's not impossible that multiple SIGTERM has been sent

Expected behavior
No panic

@maoueh maoueh added bug Something isn't working linear Created by Linear-GitHub Sync labels May 27, 2024
@maoueh
Copy link
Contributor Author

maoueh commented May 27, 2024

See full logs
5:07PM INF stopping service module=p2p peer={"Hostname":"144.76.108.94","NodeID":"63fc8dd6ea5c7afd63666cb75a35cc646988ae47","Path":"","Port":26656,"Protocol":"mconn"} service=MConnection
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=BlockSync
5:07PM INF stopping service service=Consensus
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service service=Consensus
5:07PM INF stopping service module=evidence service=Evidence
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=p2p peer={"Hostname":"144.76.108.94","NodeID":"63fc8dd6ea5c7afd63666cb75a35cc646988ae47","Path":"","Port":26656,"Protocol":"mconn"} service=MConnection
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=BlockPool
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=p2p peer={"Hostname":"213.190.31.21","NodeID":"99d8cd3e400284d907a09a70217f6eda236391eb","Path":"","Port":11956,"Protocol":"mconn"} service=MConnection
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=p2p peer={"Hostname":"135.181.238.250","NodeID":"d863f6a2e6cae0ec2146d89905af97b71c15b657","Path":"","Port":26656,"Protocol":"mconn"} service=MConnection
5:07PM ERR Subscription terminated err="context canceled" module=rpc
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=evidence service=Evidence
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=p2p peer={"Hostname":"135.181.238.250","NodeID":"d863f6a2e6cae0ec2146d89905af97b71c15b657","Path":"","Port":26656,"Protocol":"mconn"} service=MConnection
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service service=PEX
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service service=PEX
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=p2p peer={"Hostname":"52.195.241.204","NodeID":"9ebc2f815ef66ec895f8d766e927be69aae0c336","Path":"","Port":26656,"Protocol":"mconn"} service=MConnection
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=p2p peer={"Hostname":"167.235.117.26","NodeID":"03cec5f8ed2c7c16b3b285aeb952460c2122ed0e","Path":"","Port":11956,"Protocol":"mconn"} service=MConnection
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=p2p peer={"Hostname":"213.190.31.21","NodeID":"99d8cd3e400284d907a09a70217f6eda236391eb","Path":"","Port":11956,"Protocol":"mconn"} service=MConnection
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=p2p peer={"Hostname":"167.235.117.26","NodeID":"03cec5f8ed2c7c16b3b285aeb952460c2122ed0e","Path":"","Port":11956,"Protocol":"mconn"} service=MConnection
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=p2p peer={"Hostname":"5.9.102.218","NodeID":"7c1d748a557a52ceee8a94d0b1ee5e2dc708fe42","Path":"","Port":26656,"Protocol":"mconn"} service=MConnection
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=p2p peer={"Hostname":"5.9.102.218","NodeID":"7c1d748a557a52ceee8a94d0b1ee5e2dc708fe42","Path":"","Port":26656,"Protocol":"mconn"} service=MConnection
5:07PM INF stopping service module=p2p peer={"Hostname":"135.125.189.10","NodeID":"7c91f986605d4f68d94a4ecde7ffe0d8437257f2","Path":"","Port":51656,"Protocol":"mconn"} service=MConnection
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=p2p peer={"Hostname":"54.193.193.143","NodeID":"bbf11b8b91d79763624540ffa511dfdc5bcb4a2e","Path":"","Port":26656,"Protocol":"mconn"} service=MConnection
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=txindex service=IndexerService
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=p2p peer={"Hostname":"18.136.181.19","NodeID":"61c6035b61100f770b66cecf4dcf212b05dd3dfb","Path":"","Port":26656,"Protocol":"mconn"} service=MConnection
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=eventbus service=EventBus
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=p2p peer={"Hostname":"135.125.189.10","NodeID":"7c91f986605d4f68d94a4ecde7ffe0d8437257f2","Path":"","Port":51656,"Protocol":"mconn"} service=MConnection
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=eventbus service=EventBus
5:07PM INF stopping service service=Node
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=statesync service=StateSync
5:07PM INF stopped service module=statesync service=StateSync
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=p2p peer={"Hostname":"52.195.241.204","NodeID":"9ebc2f815ef66ec895f8d766e927be69aae0c336","Path":"","Port":26656,"Protocol":"mconn"} service=MConnection
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM ERR subscription was canceled, resubscribing err="subscription terminated by publisher" query="tm.event = 'NewBlockHeader'"
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM ERR Prometheus HTTP server ListenAndServe err="http: Server closed"
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF RPC HTTP server stopped err="http: Server closed" module=rpc-server
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=p2p peer={"Hostname":"18.136.181.19","NodeID":"61c6035b61100f770b66cecf4dcf212b05dd3dfb","Path":"","Port":26656,"Protocol":"mconn"} service=MConnection
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=mempool service=Mempool
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=mempool service=Mempool
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM ERR error serving server err="http: Server closed" module=rpc
5:07PM INF stopping service module=dbsync service=DBSync
5:07PM INF stopping service service=localClient
5:07PM INF stopped service module=dbsync service=DBSync
5:07PM INF stopped service service=localClient
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF Stopping Node
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF Closing rpc listener listener={"Listener":{}}
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM ERR error closing listener err="close tcp 127.0.0.1:26657: use of closed network connection" listener={"Listener":{}}
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM ERR failed to stop event sink err="leveldb: closed"
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=txindex service=IndexerService
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=events service=PubSub
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=events service=PubSub
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=proxy service=proxyClient
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=proxy service=proxyClient
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=p2p peer={"Hostname":"54.193.193.143","NodeID":"bbf11b8b91d79763624540ffa511dfdc5bcb4a2e","Path":"","Port":26656,"Protocol":"mconn"} service=MConnection
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=p2p service=router
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM ERR failed to close transport err="close tcp [::]:26656: use of closed network connection" module=p2p
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=p2p service=router
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM ERR peer failure endpoint={} err="context canceled" module=p2p peer=63fc8dd6ea5c7afd63666cb75a35cc646988ae47
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=BlockPool
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF peer disconnected endpoint={} module=p2p peer=99d8cd3e400284d907a09a70217f6eda236391eb
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF peer disconnected endpoint={} module=p2p peer=d863f6a2e6cae0ec2146d89905af97b71c15b657
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF peer disconnected endpoint={} module=p2p peer=03cec5f8ed2c7c16b3b285aeb952460c2122ed0e
5:07PM INF stopped service module=blockchain service=BlockSync
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF peer disconnected endpoint={} module=p2p peer=7c1d748a557a52ceee8a94d0b1ee5e2dc708fe42
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM ERR peer failure endpoint={} err="context canceled" module=p2p peer=7c91f986605d4f68d94a4ecde7ffe0d8437257f2
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM ERR peer failure endpoint={} err="context canceled" module=p2p peer=bbf11b8b91d79763624540ffa511dfdc5bcb4a2e
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM ERR peer failure endpoint={} err="context canceled" module=p2p peer=9ebc2f815ef66ec895f8d766e927be69aae0c336
5:07PM INF stopping service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM INF stopped service module=blockchain service=bpRequester
5:07PM ERR peer failure endpoint={} err="context canceled" module=p2p peer=61c6035b61100f770b66cecf4dcf212b05dd3dfb
5:07PM ERR problem closing blockstore err="leveldb: closed"
5:07PM ERR problem closing statestore err="leveldb: closed"
5:07PM INF stopped service service=Node
5:07PM INF RPC HTTP server stopped err="accept tcp [::]:1317: use of closed network connection" module=api-server
5:07PM INF close any other open resource...
5:07PM INF committed state block_app_hash=F7D6B6CC5818F999C6816F89C3785927618B45A5E3CA6A9E9D39360753E9000E height=79124790 module=state num_txs=31
5:07PM INF transaction expired address= age=30126.250199 evm=false height=79124790 module=mempool nonce=0 priority=0 tx=5BF3DD1E0B0CF2D63E40089A54C255DFA3BEB5D53E907C7D06106FEB17E6EBAD tx_height=79124571 tx_timestamp=2024-05-27T17:07:25Z
panic: failed to process committed block (79124790:3F5FAD6845CC289554CE414176312D32E7B5D7344D9FE0A17AB98D97F1FE0A4C): leveldb: closed
goroutine 442 [running]:
github.com/tendermint/tendermint/internal/blocksync.(*Reactor).poolRoutine(0xc0064f18c8, {0x3655f40, 0xc000398050}, 0x0, 0xc019fff3e0)
	/home/sei/go/pkg/mod/github.com/sei-protocol/[email protected]/internal/blocksync/reactor.go:700 +0x1b9a
created by github.com/tendermint/tendermint/internal/blocksync.(*Reactor).OnStart in goroutine 1
	/home/sei/go/pkg/mod/github.com/sei-protocol/[email protected]/internal/blocksync/reactor.go:181 +0x5d7

@philipsu522
Copy link
Contributor

@maoueh are you still running into issues here?

@maoueh
Copy link
Contributor Author

maoueh commented Jul 8, 2024

I haven't restarted my nodes recently. I'll try this week to perform some restart and check how it looks like.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working linear Created by Linear-GitHub Sync
Projects
None yet
Development

No branches or pull requests

2 participants