Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

pkg/backup/backuprand/backuprand_test: TestBackupRestoreRandomDataRoundtrips failed #138662

Open
github-actions bot opened this issue Jan 8, 2025 · 2 comments
Open

pkg/backup/backuprand/backuprand_test: TestBackupRestoreRandomDataRoundtrips failed #138662

github-actions bot opened this issue Jan 8, 2025 · 2 comments
Labels
A-disaster-recovery branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-disaster-recovery

Comments

@github-actions
Copy link

github-actions bot commented Jan 8, 2025 •
edited by cockroach-jira-scripts
Loading

pkg/backup/backuprand/backuprand_test.TestBackupRestoreRandomDataRoundtrips failed on master @ 84f79036876e4a89d54af295df335fd3cc99b504:

Fatal error:

panic: runtime error: slice bounds out of range [:1390072] with capacity 1408
	panic: Release called on a BufferPool with in-use buffers

Stack:

goroutine 22890 [running]:
github.com/cockroachdb/pebble/sstable/block.(*BufferPool).Release(0xc00648e0c8)
	external/com_github_cockroachdb_pebble/sstable/block/buffer_pool.go:182 +0xc5
panic({0x6cab640?, 0xc0017c90e0?})
	GOROOT/src/runtime/panic.go:770 +0x132
github.com/cockroachdb/pebble/sstable/rowblk.(*Iter).readEntry(0xc004a25700?)
	external/com_github_cockroachdb_pebble/sstable/rowblk/rowblk_iter.go:386 +0x446
github.com/cockroachdb/pebble/sstable/rowblk.(*Iter).Next(0xc00b7d5c18)
	external/com_github_cockroachdb_pebble/sstable/rowblk/rowblk_iter.go:1080 +0x105
github.com/cockroachdb/pebble/sstable/rowblk.(*Iter).SeekGE(0xc00b7d5c18, {0xc0061d4248, 0x4, 0x8}, 0x1?)
	external/com_github_cockroachdb_pebble/sstable/rowblk/rowblk_iter.go:696 +0x69e
github.com/cockroachdb/pebble/sstable.(*singleLevelIterator[...]).seekGEHelper(0x8b14e60, {0xc0061d4248, 0x4, 0x8}, 0x0, 0x0)
	external/com_github_cockroachdb_pebble/sstable/reader_iter_single_lvl.go:820 +0x24a
github.com/cockroachdb/pebble/sstable.(*singleLevelIterator[...]).SeekGE(0x8b14e60, {0xc0061d4248, 0x4?, 0x8?}, 0x0?)
	external/com_github_cockroachdb_pebble/sstable/reader_iter_single_lvl.go:725 +0x18b
github.com/cockroachdb/pebble/sstable.(*singleLevelIterator[...]).First(0x0?)
	external/com_github_cockroachdb_pebble/sstable/reader_iter_single_lvl.go:1153 +0x2e
github.com/cockroachdb/pebble.(*levelIter).skipEmptyFileForward(0xc004f2a808)
	external/com_github_cockroachdb_pebble/level_iter.go:830 +0x34
github.com/cockroachdb/pebble.(*levelIter).Next(0xc004f2a808)
	external/com_github_cockroachdb_pebble/level_iter.go:768 +0x9a
github.com/cockroachdb/pebble.(*mergingIter).nextEntry(0xc007528480, 0xc00be15e18, {0x0?, 0xf?, 0xf?})
	external/com_github_cockroachdb_pebble/merging_iter.go:541 +0x27b
github.com/cockroachdb/pebble.(*mergingIter).Next(0xc007528480)
	external/com_github_cockroachdb_pebble/merging_iter.go:1189 +0x51
github.com/cockroachdb/pebble/internal/keyspan.(*InterleavingIter).nextPos(0xc00be30210)
	external/com_github_cockroachdb_pebble/internal/keyspan/interleaving_iter.go:646 +0x8f
github.com/cockroachdb/pebble/internal/keyspan.(*InterleavingIter).Next(0xc00be30210)
	external/com_github_cockroachdb_pebble/internal/keyspan/interleaving_iter.go:478 +0xe5
github.com/cockroachdb/pebble/internal/compact.(*Iter).iterNext(0xc00be30008)
	external/com_github_cockroachdb_pebble/internal/compact/iterator.go:667 +0x2e
github.com/cockroachdb/pebble/internal/compact.(*Iter).nextInStripeHelper(0xc00be30008)
	external/com_github_cockroachdb_pebble/internal/compact/iterator.go:710 +0x3d
github.com/cockroachdb/pebble/internal/compact.(*Iter).nextInStripe(...)
	external/com_github_cockroachdb_pebble/internal/compact/iterator.go:701
github.com/cockroachdb/pebble/internal/compact.(*Iter).setNext(0xc00be30008)
	external/com_github_cockroachdb_pebble/internal/compact/iterator.go:798 +0x1c7
github.com/cockroachdb/pebble/internal/compact.(*Iter).Next(0xc00be30008)
	external/com_github_cockroachdb_pebble/internal/compact/iterator.go:575 +0xff7
github.com/cockroachdb/pebble/internal/compact.(*Runner).writeKeysToTable(0xc00864d6c0, {0x8a495a0, 0xc006496a88})
	external/com_github_cockroachdb_pebble/internal/compact/run.go:190 +0x510
github.com/cockroachdb/pebble/internal/compact.(*Runner).WriteTable(0xc00864d6c0, {0xde, 0x2, {0x0, 0x0, {0x0, 0x0}, 0x0, {0x0, 0x0}, ...}}, ...)
	external/com_github_cockroachdb_pebble/internal/compact/run.go:151 +0x1ca
github.com/cockroachdb/pebble.(*DB).compactAndWrite(0xc00543d208, 0x162, 0xc00648e008, {0x0, 0x0, 0x0}, 0x6)
	external/com_github_cockroachdb_pebble/compaction.go:2953 +0x6d1
github.com/cockroachdb/pebble.(*DB).runCompaction(0xc00543d208, 0x162, 0xc00648e008)
	external/com_github_cockroachdb_pebble/compaction.go:2846 +0x62d
github.com/cockroachdb/pebble.(*DB).compact1(0xc00543d208, 0xc00648e008, 0x0)
	external/com_github_cockroachdb_pebble/compaction.go:2283 +0x19e
github.com/cockroachdb/pebble.(*DB).compact.func1({0x89d41d8?, 0xc0052271d0?})
	external/com_github_cockroachdb_pebble/compaction.go:2197 +0xa7
runtime/pprof.Do({0x89d4038?, 0xd45c580?}, {{0xc0032e8fc0?, 0x1382ea0?, 0x897db20?}}, 0xc007697f88)
	GOROOT/src/runtime/pprof/runtime.go:51 +0x9d
github.com/cockroachdb/pebble.(*DB).compact(0xc00543d208, 0xc00648e008, 0x0)
	external/com_github_cockroachdb_pebble/compaction.go:2194 +0x7c
created by github.com/cockroachdb/pebble.(*DB).tryScheduleAutoCompaction in goroutine 22888
	external/com_github_cockroachdb_pebble/compaction.go:1859 +0x42b
Log preceding fatal error 

=== RUN   TestBackupRestoreRandomDataRoundtrips
    test_log_scope.go:165: test logs captured to: outputs.zip/logTestBackupRestoreRandomDataRoundtrips3035365575
    test_log_scope.go:76: use -show-logs to present logs inline
    backup_rand_test.go:139: Verifying table "taBle_1"
    backup_rand_test.go:139: Verifying table "table_2"
    backup_rand_test.go:139: Verifying table "table_3"
    backup_rand_test.go:139: Verifying table "table_4"
    backup_rand_test.go:139: Verifying table "tab̌le_5"
    backup_rand_test.go:139: Verifying table "taBle_1"
    backup_rand_test.go:139: Verifying table "table_2"
    backup_rand_test.go:139: Verifying table "table_3"
    backup_rand_test.go:139: Verifying table "table_4"
    backup_rand_test.go:139: Verifying table "tab̌le_5"
    backup_rand_test.go:139: Verifying table "taBle_1"
    backup_rand_test.go:139: Verifying table "table_2"
    backup_rand_test.go:139: Verifying table "table_3"
    backup_rand_test.go:139: Verifying table "table_4"
    backup_rand_test.go:139: Verifying table "tab̌le_5"
    backup_rand_test.go:139: Verifying table "taBle_1"
    backup_rand_test.go:139: Verifying table "table_2"
    backup_rand_test.go:139: Verifying table "table_3"
    backup_rand_test.go:139: Verifying table "table_4"
    backup_rand_test.go:139: Verifying table "tab̌le_5"
    backup_rand_test.go:216: Testing subset backup/restore tab̌le_5
    backup_rand_test.go:139: Verifying table "tab̌le_5"
    backup_rand_test.go:229: combo 1 [tab̌le_5]
    backup_rand_test.go:216: Testing subset backup/restore table_4
    backup_rand_test.go:139: Verifying table "table_4"
    backup_rand_test.go:229: combo 2 [table_4]
    backup_rand_test.go:216: Testing subset backup/restore table_4, tab̌le_5
    backup_rand_test.go:139: Verifying table "table_4"
    backup_rand_test.go:139: Verifying table "tab̌le_5"
    backup_rand_test.go:229: combo 3 [table_4 tab̌le_5]
    backup_rand_test.go:216: Testing subset backup/restore table_3

Parameters:

  • attempt=1
  • run=1
  • shard=1
Help

See also: How To Investigate a Go Test Failure (internal)

/cc @cockroachdb/disaster-recovery

This test on roachdash | Improve this report!

Jira issue: CRDB-46296
@github-actions github-actions bot added branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-disaster-recovery labels Jan 8, 2025
@github-actions GitHub Actions
Copy link
Author

github-actions bot commented Jan 8, 2025

pkg/backup/backuprand/backuprand_test.TestBackupRestoreRandomDataRoundtrips failed on master @ c3eb6e5c071d366cf4d1879b1d34c69a96d2c83d:

Fatal error:

panic: first key in block must have zero shared length
	panic: Release called on a BufferPool with in-use buffers

Stack:

goroutine 18868 [running]:
github.com/cockroachdb/pebble/sstable/block.(*BufferPool).Release(0xc0075418c8)
	external/com_github_cockroachdb_pebble/sstable/block/buffer_pool.go:182 +0xc5
panic({0x6321020?, 0x8965bf0?})
	GOROOT/src/runtime/panic.go:770 +0x132
github.com/cockroachdb/pebble/sstable/rowblk.(*Iter).readFirstKey(0x0?)
	external/com_github_cockroachdb_pebble/sstable/rowblk/rowblk_iter.go:416 +0x478
github.com/cockroachdb/pebble/sstable/rowblk.(*Iter).Init(0xc003180418?, 0xd45e5c0?, 0x0?, 0xc003180218?, {0x7fede4300b90?, 0x89da3c8?, 0xc003180108?}, {0x8e8e, 0x0, {0x2, ...}})
	external/com_github_cockroachdb_pebble/sstable/rowblk/rowblk_iter.go:251 +0x265
github.com/cockroachdb/pebble/sstable/rowblk.(*Iter).InitHandle(0xc003180418, 0xccd65c0, {{0x0?}, {0xc0075418c8?, 0x89da3c8?}}, {0x8e8e, 0x0, {0x2, 0x9, 0xc0040be870}})
	external/com_github_cockroachdb_pebble/sstable/rowblk/rowblk_iter.go:271 +0x18f
github.com/cockroachdb/pebble/sstable.(*singleLevelIterator[...]).loadDataBlock(0x8b15780, 0x1)
	external/com_github_cockroachdb_pebble/sstable/reader_iter_single_lvl.go:545 +0x317
github.com/cockroachdb/pebble/sstable.(*singleLevelIterator[...]).skipForward(0x8b15780)
	external/com_github_cockroachdb_pebble/sstable/reader_iter_single_lvl.go:1398 +0x65
github.com/cockroachdb/pebble/sstable.(*singleLevelIterator[...]).Next(0x8b15780)
	external/com_github_cockroachdb_pebble/sstable/reader_iter_single_lvl.go:1294 +0xe5
github.com/cockroachdb/pebble.(*levelIter).Next(0xc00a80b408)
	external/com_github_cockroachdb_pebble/level_iter.go:765 +0x78
github.com/cockroachdb/pebble.(*mergingIter).nextEntry(0xc00788dc20, 0xc005eb53f8, {0x0?, 0x10597670?, 0xc00e672390?})
	external/com_github_cockroachdb_pebble/merging_iter.go:541 +0x27b
github.com/cockroachdb/pebble.(*mergingIter).Next(0xc00788dc20)
	external/com_github_cockroachdb_pebble/merging_iter.go:1189 +0x51
github.com/cockroachdb/pebble/internal/keyspan.(*InterleavingIter).nextPos(0xc00963ac10)
	external/com_github_cockroachdb_pebble/internal/keyspan/interleaving_iter.go:646 +0x8f
github.com/cockroachdb/pebble/internal/keyspan.(*InterleavingIter).Next(0xc00963ac10)
	external/com_github_cockroachdb_pebble/internal/keyspan/interleaving_iter.go:478 +0xe5
github.com/cockroachdb/pebble/internal/compact.(*Iter).iterNext(0xc00963aa08)
	external/com_github_cockroachdb_pebble/internal/compact/iterator.go:667 +0x2e
github.com/cockroachdb/pebble/internal/compact.(*Iter).nextInStripeHelper(0xc00963aa08)
	external/com_github_cockroachdb_pebble/internal/compact/iterator.go:710 +0x3d
github.com/cockroachdb/pebble/internal/compact.(*Iter).nextInStripe(...)
	external/com_github_cockroachdb_pebble/internal/compact/iterator.go:701
github.com/cockroachdb/pebble/internal/compact.(*Iter).setNext(0xc00963aa08)
	external/com_github_cockroachdb_pebble/internal/compact/iterator.go:798 +0x1c7
github.com/cockroachdb/pebble/internal/compact.(*Iter).Next(0xc00963aa08)
	external/com_github_cockroachdb_pebble/internal/compact/iterator.go:575 +0xff7
github.com/cockroachdb/pebble/internal/compact.(*Runner).writeKeysToTable(0xc00e6736c0, {0x8a49ec0, 0xc009768a88})
	external/com_github_cockroachdb_pebble/internal/compact/run.go:190 +0x510
github.com/cockroachdb/pebble/internal/compact.(*Runner).WriteTable(0xc00e6736c0, {0x52, 0x2, {0x0, 0x0, {0x0, 0x0}, 0x0, {0x0, 0x0}, ...}}, ...)
	external/com_github_cockroachdb_pebble/internal/compact/run.go:151 +0x1ca
github.com/cockroachdb/pebble.(*DB).compactAndWrite(0xc005417208, 0x85, 0xc007541808, {0x0, 0x0, 0x0}, 0x6)
	external/com_github_cockroachdb_pebble/compaction.go:2953 +0x6d1
github.com/cockroachdb/pebble.(*DB).runCompaction(0xc005417208, 0x85, 0xc007541808)
	external/com_github_cockroachdb_pebble/compaction.go:2846 +0x62d
github.com/cockroachdb/pebble.(*DB).compact1(0xc005417208, 0xc007541808, 0x0)
	external/com_github_cockroachdb_pebble/compaction.go:2283 +0x19e
github.com/cockroachdb/pebble.(*DB).compact.func1({0x89d4ab8?, 0xc007723590?})
	external/com_github_cockroachdb_pebble/compaction.go:2197 +0xa7
runtime/pprof.Do({0x89d4918?, 0xd45e5c0?}, {{0xc007d9f320?, 0x10fc092?, 0x89d4918?}}, 0xc004779f88)
	GOROOT/src/runtime/pprof/runtime.go:51 +0x9d
github.com/cockroachdb/pebble.(*DB).compact(0xc005417208, 0xc007541808, 0x0)
	external/com_github_cockroachdb_pebble/compaction.go:2194 +0x7c
created by github.com/cockroachdb/pebble.(*DB).tryScheduleAutoCompaction in goroutine 18864
	external/com_github_cockroachdb_pebble/compaction.go:1859 +0x42b
Log preceding fatal error 

=== RUN   TestBackupRestoreRandomDataRoundtrips
    test_log_scope.go:165: test logs captured to: outputs.zip/logTestBackupRestoreRandomDataRoundtrips826470771
    test_log_scope.go:76: use -show-logs to present logs inline
    backup_rand_test.go:139: Verifying table "table_1"
    backup_rand_test.go:139: Verifying table "tab😋le_2"
    backup_rand_test.go:139: Verifying table "tab\"le%v_3"
    backup_rand_test.go:139: Verifying table "table_1"
    backup_rand_test.go:139: Verifying table "tab😋le_2"
    backup_rand_test.go:139: Verifying table "tab\"le%v_3"
    backup_rand_test.go:139: Verifying table "table_1"
    backup_rand_test.go:139: Verifying table "tab😋le_2"
    backup_rand_test.go:139: Verifying table "tab\"le%v_3"
    backup_rand_test.go:139: Verifying table "table_1"
    backup_rand_test.go:139: Verifying table "tab😋le_2"
    backup_rand_test.go:139: Verifying table "tab\"le%v_3"
    backup_rand_test.go:216: Testing subset backup/restore "tab""le%v_3"
    backup_rand_test.go:139: Verifying table "tab\"le%v_3"
    backup_rand_test.go:229: combo 1 [tab"le%v_3]
    backup_rand_test.go:216: Testing subset backup/restore tab😋le_2
    backup_rand_test.go:139: Verifying table "tab😋le_2"
    backup_rand_test.go:229: combo 2 [tab😋le_2]
    backup_rand_test.go:216: Testing subset backup/restore tab😋le_2, "tab""le%v_3"
    backup_rand_test.go:139: Verifying table "tab😋le_2"
    backup_rand_test.go:139: Verifying table "tab\"le%v_3"
    backup_rand_test.go:229: combo 3 [tab😋le_2 tab"le%v_3]
    backup_rand_test.go:216: Testing subset backup/restore table_1
    backup_rand_test.go:139: Verifying table "table_1"
    backup_rand_test.go:229: combo 4 [table_1]
    backup_rand_test.go:216: Testing subset backup/restore table_1, "tab""le%v_3"
    backup_rand_test.go:139: Verifying table "table_1"
    backup_rand_test.go:139: Verifying table "tab\"le%v_3"
    backup_rand_test.go:229: combo 5 [table_1 tab"le%v_3]
    backup_rand_test.go:216: Testing subset backup/restore table_1, tab😋le_2

Parameters:

  • attempt=1
  • run=1
  • shard=1
Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

@cockroach-teamcity
Copy link
Member

pkg/backup/backuprand/backuprand_test.TestBackupRestoreRandomDataRoundtrips failed with artifacts on master @ a26ce67dac19aa0186375a3d6f5c27c322042eb9:

github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4({0x81355b8?, 0x40074877c0?}, {0x67980c0?, 0x4006240dc0?})
	pkg/rpc/context.go:824 +0x3c
github.com/cockroachdb/cockroach/pkg/rpc.kvAuth.unaryInterceptor({0x40031d4000?, {{0x0?}, {0x81905e0?, 0x4004269260?}}}, {0x81355b8, 0x40074877c0}, {0x67980c0, 0x4006240dc0}, 0x40054e61c0, 0x40054e6200)
	pkg/rpc/auth.go:90 +0x15c
github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4({0x81355b8?, 0x40074877c0?}, {0x67980c0?, 0x4006240dc0?})
	pkg/rpc/context.go:824 +0x3c
github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.func1.1({0x81355b8?, 0x40074877c0?})
	pkg/rpc/context.go:132 +0x40
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr(0x4003c6ee10, {0x81355b8, 0x40074877c0}, {0x690fca4, 0x21}, 0x400c4b9e10)
	pkg/util/stop/stopper.go:349 +0x100
github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.func1({0x81355b8?, 0x40074877c0?}, {0x67980c0?, 0x4006240dc0?}, 0x400c4b9e98?, 0x1bfc2fc?)
	pkg/rpc/context.go:130 +0x7c
github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4({0x81355b8?, 0x40074877c0?}, {0x67980c0?, 0x4006240dc0?})
	pkg/rpc/context.go:824 +0x3c
github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.func2({0x81355b8?, 0x40074877c0?}, {0x400c4b9f28?, 0x42c85c?}, {0x67980c0?, 0x4006240dc0?}, {0x65f4860, 0x4008a26800}, 0x80?, {0x68?, ...})
	pkg/rpc/context.go:723 +0x44
github.com/cockroachdb/cockroach/pkg/rpc.NewContext.ClientInterceptor.func8({0x81355b8, 0x40074877c0}, {0x690fca4, 0x21}, {0x67980c0, 0x4006240dc0}, {0x65f4860, 0x4008a26800}, 0x0, 0x4001f70190, ...)
	pkg/util/tracing/grpcinterceptor/grpc_interceptor.go:236 +0x2e8
github.com/cockroachdb/cockroach/pkg/rpc.getChainUnaryInvoker.func1({0x81355b8, 0x40074877c0}, {0x690fca4, 0x21}, {0x67980c0, 0x4006240dc0}, {0x65f4860, 0x4008a26800}, 0x0, {0x0, ...})
	pkg/rpc/context.go:908 +0xdc
github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.func3({0x81355b8, 0x4007487400}, 0x4006240c80, {0x0, 0x0, 0x0})
	pkg/rpc/context.go:793 +0x2a4
github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch(...)
	pkg/rpc/context.go:916
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch(0x400a77e060, {0x81355b8, 0x4007487400}, 0x8?, {0x80f9d90, 0x4005800360}, 0x4006240c80)
	pkg/kv/kvclient/kvcoord/transport.go:209 +0x17c
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext(0x400a77e060, {0x81355b8, 0x4007487400}, 0x4006240c80)
	pkg/kv/kvclient/kvcoord/transport.go:187 +0x90
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas(0x40035de008, {0x81355b8, 0x4007487400}, 0x4006240b40?, {0x400018fdb0, 0x40093c6ff0}, 0x0)
	pkg/kv/kvclient/kvcoord/dist_sender.go:2755 +0x12d8
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendPartialBatch(0x40035de008, {0x81355b8, 0x4007487400}, 0x4006240b40, {{0x40064edf83, 0x3, 0x9}, {0x40064edf83, 0x4, 0x9}}, ...)
	pkg/kv/kvclient/kvcoord/dist_sender.go:2211 +0x518
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).divideAndSendBatchToRanges(0x40035de008, {0x81355b8, 0x4007487400}, 0x4006240b40, {{0x40064edf83, 0x3, 0x9}, {0x40064edf83, 0x4, 0x9}}, ...)
	pkg/kv/kvclient/kvcoord/dist_sender.go:1746 +0x258
github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).Send(0x40035de008, {0x8134240, 0x4002bdaaf0}, 0x4006240b40)
	pkg/kv/kvclient/kvcoord/dist_sender.go:1265 +0x4e0
github.com/cockroachdb/cockroach/pkg/kv.(*CrossRangeTxnWrapperSender).Send(0x400354ca68, {0x8134240, 0x4002bdaaf0}, 0x4006240b40)
	pkg/kv/db.go:224 +0x94
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).sendBatch.func1.1({0x8134240, 0x4002bdaaf0})
	pkg/internal/client/requestbatcher/batcher.go:351 +0xa0
github.com/cockroachdb/cockroach/pkg/util/timeutil.RunWithTimeout({0x8134198?, 0x4005616000?}, {0x40022a4340, 0x24}, 0x46c6fa02c, 0x40087e7df8)
	pkg/util/timeutil/timeout.go:28 +0x80
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).sendBatch.func1.2({0x8134198, 0x4005616000})
	pkg/internal/client/requestbatcher/batcher.go:369 +0xc8
github.com/cockroachdb/cockroach/pkg/internal/client/requestbatcher.(*RequestBatcher).sendBatch.func1({0x8134198, 0x4005616000})
	pkg/internal/client/requestbatcher/batcher.go:391 +0x17c
github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2({0x6866ad8?, 0x40087e7fb0?})
	pkg/util/stop/stopper.go:498 +0x198
created by github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx in goroutine 478
	pkg/util/stop/stopper.go:488 +0x374
Help

See also: How To Investigate a Go Test Failure (internal)

This test on roachdash | Improve this report!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
A-disaster-recovery branch-master Failures and bugs on the master branch. C-test-failure Broken test (automatically or manually discovered). O-robot Originated from a bot. release-blocker Indicates a release-blocker. Use with branch-release-2x.x label to denote which branch is blocked. T-disaster-recovery
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@cockroach-teamcity