Skip to content

substreams run does not report the attempt number  #547

@matthewdarwin

Description

@matthewdarwin

substreams run does not report the attempt number. If a block is retried 3 times, these retry counts are not visible in the UI.

The timer resets on every attempt, but there is no visibility that the number of attempts is increasing.

Example, after 3 attempts are tried, running ipfs://QmYAFz2iRNj41tP8DyAg61X4NoqaAxgf4W4j7Gn1bCtTs7 on arbitrum-one with -H "X-Sf-Substreams-Parallel-Jobs: 1

Connected (trace ID af96fc72c64d9f2028841d8cb0f4a47e)
Progress messages received: 1391 (2/sec)
Backprocessing history up to requested target block 263384000:
(hit 'm' to switch mode)

Stage 0: map_erc4626_tokens,store_rates_for_last_7_days
Stage 1: map_rates,graph_out


stage 0 (1 jobs)          204419220  ::  204419220-223909000 223910000-223911000 223913000-248418000 248419000-248422000 248423000-248425000 248427000-248428000 248432000-248433000 248439000-248441000 248443000-248444000
stage 1 (0 jobs)                  0  ::

  Longest-running jobs:
    [Stage: 0, Range: 223909000-223910000, Duration: 232s]


Error: rpc error: code = Internal desc = error during init_stores_and_backprocess: run_parallel_process failed: parallel processing run: scheduler run: segment starting at block 223909000 timed out 3 times, giving up. Last error: receiving stream resp: rpc error: code = DeadlineExceeded desc = execute modules: applying executor results "map_erc4626_tokens" on block 223909200 (adcfc110c55ce62937972c9c175d55913928c1a8314024c581f7cbd218d6c8f5): execute: maps wasm call: block 223909200: module "map_erc4626_tokens": general wasm execution failed: call: running wasm extension "rpc::eth_call": timeout while doing eth_call: [{"params":[{"to":"0e8125ffd845941eb5db0b698b9c966c65623e80","gas":50000000,"data":"MTzlZw=="},{}],"method":"eth_call","jsonrpc":"2.0","id":1}], context deadline exceeded (recovered by wazero)
wasm stack trace:
        rpc.eth_call(i32,i32,i32)
        ._ZN24substreams_ethereum_core3rpc8eth_call17habd93a212df8465eE(i32,i32,i32)
        ._ZN4core3ops8function5impls80_$LT$impl$u20$core..ops..function..FnOnce$LT$A$GT$$u20$for$u20$$RF$mut$u20$F$GT$9call_once17h54ed345d735db5b4E(i32,i32)
        ._ZN106_$LT$core..iter..adapters..flatten..Flatten$LT$I$GT$$u20$as$u20$core..iter..traits..iterator..Iterator$GT$4next17h579296660035e335E(i32,i32)
        .map_erc4626_tokens(i32,i32), context deadline exceeded

Note the "Progress messages received" vs the "Duration".

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions