Closed
Description
When running e2e parallel on CI:
2022-12-20T06:12:18.527699Z ERROR risingwave_storage::monitor::monitored_store: Failed in get: Hummock error: Expired Epoch: watermark 3557394892259328, epoch 3557394889375744.
backtrace of inner error:
0: <risingwave_storage::hummock::error::HummockError as core::convert::From<risingwave_storage::hummock::error::HummockErrorInner>>::from
at ./src/storage/src/hummock/error.rs:65:10
1: <T as core::convert::Into<U>>::into
at /rustc/bdb07a8ec8e77aa10fb84fae1d4ff71c21180bb4/library/core/src/convert/mod.rs:726:9
2: risingwave_storage::hummock::error::HummockError::expired_epoch
at ./src/storage/src/hummock/error.rs:119:9
3: risingwave_storage::hummock::utils::validate_epoch
at ./src/storage/src/hummock/utils.rs:60:20
4: risingwave_storage::hummock::state_store::<impl risingwave_storage::hummock::HummockStorage>::build_read_version_tuple
at ./src/storage/src/hummock/state_store.rs:117:9
5: risingwave_storage::hummock::state_store::<impl risingwave_storage::hummock::HummockStorage>::get::{{closure}}
at ./src/storage/src/hummock/state_store.rs:67:13
6: <risingwave_storage::store_impl::verify::VerifyStateStore<A,E> as risingwave_storage::store::StateStoreRead>::get::{{closure}}
at ./src/storage/src/store_impl.rs:316:79
7: <S as risingwave_storage::store_impl::boxed_state_store::DynamicDispatchedStateStoreRead>::get::{{closure}}
at ./src/storage/src/store_impl.rs:707:47
8: <core::pin::Pin<P> as core::future::future::Future>::poll
at /rustc/bdb07a8ec8e77aa10fb84fae1d4ff71c21180bb4/library/core/src/future/future.rs:124:9
9: <async_stack_trace::StackTraced<F,_> as core::future::future::Future>::poll
at ./src/utils/async_stack_trace/src/lib.rs:149:36
10: <risingwave_storage::monitor::monitored_store::MonitoredStateStore<S> as risingwave_storage::store::StateStoreRead>::get::{{closure}}
at ./src/storage/src/monitor/monitored_store.rs:112:17
11: risingwave_storage::table::batch_table::storage_table::StorageTable<S>::get_row::{{closure}}
at ./src/storage/src/table/batch_table/storage_table.rs:259:81
12: <risingwave_batch::executor::join::distributed_lookup_join::InnerSideExecutorBuilder<S> as risingwave_batch::executor::join::local_lookup_join::LookupExecutorBuilder>::add_scan_range::{{closure}}
at ./src/batch/src/executor/join/distributed_lookup_join.rs:389:17
13: <core::pin::Pin<P> as core::future::future::Future>::poll
at /rustc/bdb07a8ec8e77aa10fb84fae1d4ff71c21180bb4/library/core/src/future/future.rs:124:9
14: risingwave_batch::executor::join::lookup_join_base::LookupJoinBase<K>::do_execute::{{closure}}
at ./src/batch/src/executor/join/lookup_join_base.rs:102:65
Compute node logs at https://buildkite.com/risingwavelabs/pull-request/builds/14221#01852e1b-256d-4d2a-ba95-45a72ff71360.