Amazon selectors have changed (my fix included)

[Frank-Steiner]

Hi,
at least for me the Amazon selectors have changed so that docudigger doesn't find any invoices. Just in case someone comes accross the same problem, this worked for me:

Changes in selector.helper.js:

  //orderCards: `div.order.js-order-card`,
    orderCards: `div.order-card.js-order-card`,
  //orderNr: `.yohtmlc-order-id span:nth-last-child(1) bdi`,
    orderNr: `.yohtmlc-order-id span:nth-last-child(1)`,
  //yearFilter: `select[name='orderFilter']#orderFilter`,
    yearFilter: `select[name='timeFilter']#time-filter`,

Changes in amazon/index.js:

    async goToYearAndPage(year, orderPage, amazon) {
    ...
        // const nextPageUrl = new URL(`?ie=UTF8&orderFilter=year-${year}&search=&startIndex=${10 * (orderPage)}`, amazon.orderPage);
        const nextPageUrl = new URL(`?ie=UTF8&timeFilter=year-${year}&search=&startIndex=${10 * (orderPage)}&ref_=ppx_yo2ov_dt_b_filter_all_y${year}`, amazon.orderPage);

cu,
Frank

[dosubot]

Thanks for sharing your fix! Your changes to the Amazon selectors and the URL logic are not yet present in the current codebase. The selectors in use are still div.order.js-order-card, .yohtmlc-order-id span:nth-last-child(1) bdi, and select[name='orderFilter']#orderFilter, and the pagination URL uses orderFilter instead of timeFilter with the extra ref_ parameter you suggested.

There are several open issues and discussions confirming that Amazon frequently changes its frontend, which breaks scraping for many users, and your approach matches what others have found effective for newer Amazon layouts (example). Selector updates are typically shared in issues or pull requests, and the maintainers encourage users to contribute working selectors for their region or frontend version.

If your fix works reliably, it would be helpful to share it in an open issue or PR so others can benefit and the maintainers can consider merging it for broader support.

To reply, just mention @dosu.

---

^{How did I do? Good | Irrelevant | Incorrect | Verbose | Hallucination | Report 🐛 | Other}    

[thethinker990]

This files and parameters are only for v2.0.7, which does not start on my machine correctly with SyntaxError warnings

(node:27296) Warning: SyntaxError
module: @oclif/core@4.0.31
task: findCommand (scrape:all.d)
plugin: @disane-dev/docudigger
root: C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger
message: Cannot use import statement outside a module
See more details with DEBUG=*
(Use `node --trace-warnings ...` to show where the warning was created)
(node:27296) Warning: SyntaxError
module: @oclif/core@4.0.31
task: findCommand (scrape:amazon:index.d)
plugin: @disane-dev/docudigger
root: C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger
message: Cannot use import statement outside a module
See more details with DEBUG=*
Platform:  win32

--tracewarning

(node:2552) Warning: SyntaxError
module: @oclif/core@4.0.31
task: findCommand (scrape:all.d)
plugin: @disane-dev/docudigger
root: C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger
message: Cannot use import statement outside a module
See more details with DEBUG=*
(Use `node --trace-warnings ...` to show where the warning was created)
(node:2552) Warning: SyntaxError
module: @oclif/core@4.0.31
task: findCommand (scrape:amazon:index.d)
plugin: @disane-dev/docudigger
root: C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger
message: Cannot use import statement outside a module
See more details with DEBUG=*
C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\node_modules\@oclif\core\lib\parser\validate.js:10
            throw new errors_1.NonExistentFlagsError({
                  ^

NonExistentFlagsError: Nonexistent flag: --tracewarning
See more help with --help
    at validateArgs (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\node_modules\@oclif\core\lib\parser\validate.js:10:19)
    at validate (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\node_modules\@oclif\core\lib\parser\validate.js:190:5)
    at Object.parse (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\node_modules\@oclif\core\lib\parser\index.js:20:35)
    at async Amazon.parse (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\node_modules\@oclif\core\lib\command.js:244:25)
    at async Amazon.initFlags (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\dist\classes\scrape-command.class.js:40:33)
    at async Amazon.init (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\dist\classes\base.class.js:16:9)
    at async Amazon.init (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\dist\classes\scrape-command.class.js:27:9)
    at async Amazon._run (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\node_modules\@oclif\core\lib\command.js:301:13)
    at async Config.runCommand (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\node_modules\@oclif\core\lib\config\config.js:425:25)
    at async Object.run (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\node_modules\@oclif\core\lib\main.js:95:16) {
  code: undefined,
  oclif: { exit: 2 },
  skipOclifErrorHandling: undefined,
  suggestions: undefined,
  parse: {
    input: {
      '--': undefined,
      args: {},
      argv: [
        '-u',
        '****',
        '-p',
        '****',
        '-c',
        '*/30 * * * *',
        '-r',
        '--fileDestinationFolder',
        'C:\\OneDrive\\Desktop\\docudiggger',
        '--onlyNew',
        '--yearFilter=2022',
        '--tracewarning'
      ],
      context: Amazon {
        argv: [
          '-u',
          '****',
          '-p',
          '****',
          '-c',
          '*/30 * * * *',
          '-r',
          '--fileDestinationFolder',
          'C:\\OneDrive\\Desktop\\docudiggger',
          '--onlyNew',
          '--yearFilter=2022',
          '--tracewarning'
        ],
        config: Config {
          options: {
            root: 'C:\\Users\\Patrick\\AppData\\Local\\nvm\\v20.18.3\\node_modules\\@disane-dev\\docudigger\\bin\\run'
          },
          arch: 'x64',
          bin: 'docudigger',
          binAliases: undefined,
          binPath: undefined,
          cacheDir: 'C:\\Users\\Patrick\\AppData\\Local\\docudigger',
          channel: 'stable',
          configDir: 'C:\\Users\\Patrick\\AppData\\Local\\docudigger',
          dataDir: 'C:\\Users\\Patrick\\AppData\\Local\\docudigger',
          dirname: 'docudigger',
          flexibleTaxonomy: false,
          home: 'C:\\Users\\Patrick',
          isSingleCommandCLI: false,
          name: '@disane-dev/docudigger',
          npmRegistry: undefined,
          nsisCustomization: undefined,
          pjson: {
            name: '@disane-dev/docudigger',
            version: '2.0.7',
            description: 'Universal and extensible document scraper to get documents from pages (like customer portals etc.)',
            author: 'Marco Franke @Disane87',
            bin: [Object],
            homepage: 'https://github.com/disane87/docudigger',
            license: 'MIT',
            main: 'dist/index.js',
            repository: 'disane87/docudigger',
            files: [Array],
            dependencies: [Object],
            devDependencies: [Object],
            oclif: [Object],
            scripts: [Object],
            engines: [Object],
            bugs: 'https://github.com/Disane87/docudigger/issues',
            keywords: [Array],
            types: 'dist/index.d.ts'
          },
          platform: 'win32',
          plugins: Map(4) {
            '@disane-dev/docudigger' => [Plugin],
            '@oclif/plugin-help' => [Plugin],
            '@oclif/plugin-commands' => [Plugin],
            '@oclif/plugin-plugins' => [Plugin]
          },
          root: 'C:\\Users\\Patrick\\AppData\\Local\\nvm\\v20.18.3\\node_modules\\@disane-dev\\docudigger',
          shell: 'powershell',
          theme: undefined,
          topicSeparator: ' ',
          updateConfig: { node: {}, s3: [Object] },
          userAgent: '@disane-dev/docudigger/2.0.7 win32-x64 node-v20.18.3',
          userPJSON: undefined,
          valid: true,
          version: '2.0.7',
          warned: false,
          windows: true,
          _base: '@oclif/core@4.0.31',
          _commandIDs: [
            'scrape:all',
            'scrape:amazon',
            'help',
            'commands',
            'plugins',
            'plugins:inspect',
            'plugins:install',
            'plugins:add',
            'plugins:link',
            'plugins:reset',
            'plugins:uninstall',
            'plugins:unlink',
            'plugins:remove',
            'plugins:update'
          ],
          _commands: Map(14) {
            'scrape:all' => [Object],
            'scrape:amazon' => [Object],
            'help' => [Object],
            'commands' => [Object],
            'plugins' => [Object],
            'plugins:inspect' => [Object],
            'plugins:install' => [Object],
            'plugins:add' => [Object],
            'plugins:link' => [Object],
            'plugins:reset' => [Object],
            'plugins:uninstall' => [Object],
            'plugins:unlink' => [Object],
            'plugins:remove' => [Object],
            'plugins:update' => [Object]
          },
          _topics: Map(12) {
            'scrape' => [Object],
            'scrape:all' => [Object],
            'scrape:amazon' => [Object],
            'help' => [Object],
            'commands' => [Object],
            'plugins' => [Object],
            'plugins:inspect' => [Object],
            'plugins:install' => [Object],
            'plugins:link' => [Object],
            'plugins:reset' => [Object],
            'plugins:uninstall' => [Object],
            'plugins:update' => [Object]
          },
          commandPermutations: Permutations(24) [Map] {
            'scrape' => [Set],
            'scrape:all' => [Set],
            'scrape:amazon' => [Set],
            'help' => [Set],
            'commands' => [Set],
            'plugins' => [Set],
            'plugins:inspect' => [Set],
            'inspect' => [Set],
            'inspect:plugins' => [Set],
            'plugins:install' => [Set],
            'install' => [Set],
            'install:plugins' => [Set],
            'plugins:link' => [Set],
            'link' => [Set],
            'link:plugins' => [Set],
            'plugins:reset' => [Set],
            'reset' => [Set],
            'reset:plugins' => [Set],
            'plugins:uninstall' => [Set],
            'uninstall' => [Set],
            'uninstall:plugins' => [Set],
            'plugins:update' => [Set],
            'update' => [Set],
            'update:plugins' => [Set],
            validPermutations: [Map]
          },
          pluginLoader: PluginLoader {
            options: [Object],
            errors: [],
            plugins: [Map],
            pluginsProvided: false
          },
          rootPlugin: Plugin {
            options: [Object],
            alias: '@disane-dev/docudigger',
            alreadyLoaded: false,
            children: [],
            commandIDs: [Array],
            commands: [Array],
            commandsDir: 'C:\\Users\\Patrick\\AppData\\Local\\nvm\\v20.18.3\\node_modules\\@disane-dev\\docudigger\\dist\\commands',
            hasManifest: false,
            hooks: [Object],
            isRoot: true,
            manifest: [Object],
            moduleType: 'commonjs',
            name: '@disane-dev/docudigger',
            parent: undefined,
            pjson: [Object],
            root: 'C:\\Users\\Patrick\\AppData\\Local\\nvm\\v20.18.3\\node_modules\\@disane-dev\\docudigger',
            tag: undefined,
            type: 'core',
            valid: true,
            version: '2.0.7',
            _base: '@oclif/core@4.0.31',
            _debug: [Function (anonymous)],
            commandCache: undefined,
            commandDiscoveryOpts: [Object],
            flexibleTaxonomy: false
          },
          topicPermutations: Permutations(1) [Map] {
            'scrape' => [Set],
            validPermutations: [Map]
          }
        },
        debug: [Function (anonymous)],
        id: 'scrape:amazon',
        logger: null,
        pupeteerArgs: [
          '--window-size=1920,1080',
          '--no-sandbox',
          '--disable-setuid-sandbox'
        ],
        selectorWaitTimeout: 2000,
        processedWebsites: {},
        pluginName: 'amazon',
        possibleYears: []
      },
      flags: {
        logLevel: {
          parse: [AsyncFunction: parse],
          summary: 'Specify level for logging.',
          options: [ 'trace', 'debug', 'info', 'warn', 'error' ],
          default: 'info',
          env: 'LOG_LEVEL',
          input: [],
          multiple: false,
          type: 'option',
          name: 'logLevel'
        },
        debug: {
          parse: [AsyncFunction: parseBool],
          char: 'd',
          default: true,
          env: 'DEBUG',
          allowNo: false,
          type: 'boolean',
          name: 'debug'
        },
        logPath: {
          parse: [AsyncFunction: parse],
          char: 'l',
          description: 'Log path',
          default: './logs/',
          env: 'LOG_PATH',
          input: [],
          multiple: false,
          type: 'option',
          name: 'logPath'
        },
        recurring: {
          parse: [AsyncFunction: parseBool],
          char: 'r',
          default: true,
          env: 'RECURRING',
          allowNo: false,
          type: 'boolean',
          name: 'recurring'
        },
        recurringCron: {
          parse: [AsyncFunction: parse],
          char: 'c',
          description: 'Cron pattern to execute periodically',
          env: 'RECURRING_PATTERN',
          default: '*/30 * * * *',
          dependsOn: [ 'recurring' ],
          input: [],
          multiple: false,
          type: 'option',
          name: 'recurringCron'
        },
        subFolderForPages: {
          parse: [AsyncFunction: parseBool],
          aliases: [ 'subFolderForPages' ],
          description: 'Creates subfolders for every scraped page/plugin',
          env: 'SUBFOLDER_FOR_PAGES',
          allowNo: false,
          type: 'boolean',
          name: 'subFolderForPages'
        },
        fileDestinationFolder: {
          parse: [AsyncFunction: parse],
          aliases: [ 'fileDestinationFolder' ],
          default: './data/',
          description: 'Amazon top level domain',
          env: 'FILE_DESTINATION_FOLDER',
          input: [],
          multiple: false,
          type: 'option',
          name: 'fileDestinationFolder'
        },
        fileFallbackExentension: {
          parse: [AsyncFunction: parse],
          aliases: [ 'fileFallbackExentension' ],
          default: '.pdf',
          description: 'Amazon top level domain',
          env: 'FILE_FALLBACK_EXTENSION',
          input: [],
          multiple: false,
          type: 'option',
          name: 'fileFallbackExentension'
        },
        onlyNew: {
          parse: [AsyncFunction: parseBool],
          aliases: [ 'onlyNew' ],
          description: 'Gets only new invoices',
          env: 'ONLY_NEW',
          allowNo: false,
          type: 'boolean',
          name: 'onlyNew'
        },
        username: {
          parse: [AsyncFunction: parse],
          char: 'u',
          description: 'Username',
          required: true,
          env: 'AMAZON_USERNAME',
          input: [],
          multiple: false,
          type: 'option',
          name: 'username'
        },
        password: {
          parse: [AsyncFunction: parse],
          char: 'p',
          description: 'Password',
          required: true,
          env: 'AMAZON_PASSWORD',
          input: [],
          multiple: false,
          type: 'option',
          name: 'password'
        },
        tld: {
          parse: [AsyncFunction: parse],
          char: 't',
          description: 'Amazon top level domain',
          default: 'de',
          env: 'AMAZON_TLD',
          input: [],
          multiple: false,
          type: 'option',
          name: 'tld'
        },
        yearFilter: {
          parse: [AsyncFunction: parse],
          aliases: [ 'yearFilter' ],
          description: 'Filters a year',
          env: 'AMAZON_YEAR_FILTER',
          input: [],
          multiple: false,
          type: 'option',
          name: 'yearFilter'
        },
        pageFilter: {
          parse: [AsyncFunction: parse],
          aliases: [ 'pageFilter' ],
          description: 'Filters a page',
          env: 'AMAZON_PAGE_FILTER',
          input: [],
          multiple: false,
          type: 'option',
          name: 'pageFilter'
        }
      },
      strict: true
    },
    output: {
      args: {},
      argv: [ '--tracewarning' ],
      flags: {
        logLevel: 'info',
        debug: true,
        logPath: './logs/',
        recurring: true,
        recurringCron: '*/30 * * * *',
        fileDestinationFolder: 'C:\\OneDrive\\Desktop\\HPScan\\docudiggger',
        fileFallbackExentension: '.pdf',
        onlyNew: true,
        username: '****',
        password: '****',
        tld: 'de',
        yearFilter: 2022
      },
      metadata: {
        flags: {
          logLevel: { setFromDefault: true },
          debug: { setFromDefault: true },
          logPath: { setFromDefault: true },
          subFolderForPages: { setFromDefault: true },
          fileFallbackExentension: { setFromDefault: true },
          tld: { setFromDefault: true },
          pageFilter: { setFromDefault: true }
        }
      },
      nonExistentFlags: [ '--tracewarning' ],
      raw: [
        {
          flag: 'username',
          input: '****',
          type: 'flag'
        },
        {
          flag: 'password',
          input: '****',
          type: 'flag'
        },
        { flag: 'recurringCron', input: '*/30 * * * *', type: 'flag' },
        { flag: 'recurring', input: '-r', type: 'flag' },
        {
          flag: 'fileDestinationFolder',
          input: 'C:\\OneDrive\\Desktop\\HPScan\\docudiggger',
          type: 'flag'
        },
        { flag: 'onlyNew', input: '--onlyNew', type: 'flag' },
        { flag: 'yearFilter', input: '2022', type: 'flag' }
      ]
    }
  },
  showHelp: true,
  flags: [ '--tracewarning' ]
}

Node.js v20.18.3

With 2.0.7-dev.4 I get no error but it's not working either. I see the puppeteer popup, so login does work correctly.

(node:4212) Warning: SyntaxError
module: @oclif/core@4.2.10
task: findCommand (scrape:all.d)
plugin: @disane-dev/docudigger
root: C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger
message: Cannot use import statement outside a module
See more details with DEBUG=*
(Use `node --trace-warnings ...` to show where the warning was created)
(node:4212) Warning: SyntaxError
module: @oclif/core@4.2.10
task: findCommand (scrape:amazon:index.d)
plugin: @disane-dev/docudigger
root: C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger
message: Cannot use import statement outside a module
See more details with DEBUG=*
Platform:  win32
[info] [2025-11-23 17:11:03] [scrape:amazon]:   OnlyNew activated.
[info] [2025-11-23 17:11:03] [scrape:amazon]:   Getting last run
[warn] [2025-11-23 17:11:03] [scrape:amazon]:   No latest orders. OnlyNew deactivated.
[info] [2025-11-23 17:11:03] [scrape:amazon]:   Getting last run. Got: null
[info] [2025-11-23 17:11:03] [scrape:amazon]:   No latest scrape found. Processing all years and pages.
[info] [2025-11-23 17:11:06] [scrape:amazon]:   Logged in
[info] [2025-11-23 17:11:07] [scrape:amazon]:   Year filter undefined. Getting all possible years
[info] [2025-11-23 17:11:07] [scrape:amazon]:   First possible year: undefined
[info] [2025-11-23 17:11:07] [scrape:amazon]:   Last possible year: undefined
[info] [2025-11-23 17:11:07] [scrape:amazon]:   No years determined. Exiting.
[info] [2025-11-23 17:11:07] [scrape:amazon]:   Recurring activated. Not terminating. Waiting for next run.

In 2.0.6 it's actually logging in and scraping through the pages, but it's not finding any documents, but there are some

Does someone know how one can change the selectors in 2.0.6? I am not too deep in JS

[Frank-Steiner]

The "no years determined" is exactly what you need to change the amazon/index.js file for as described. Just change @disane-dev/docudigger/dist/commands/scrape/amazon/index.js with a text editor, as well as ...scrape/amazon/helpers/selectors.helper.js

[thethinker990]

Thanks, now it does more (2.0.7-dev.4), it scrapes through the pages, finds some invoice but I get this error:

[info] [2025-11-24 00:11:54] [scrape:amazon]:   Starting year 2024
[error] [2025-11-24 00:11:57] [scrape:amazon]:  Couldn't get orderPageCount 1 within 2000ms. Assume only one page. Waiting for selector `ul.a-pagination li.a-normal:nth-last-child(2) a` failed: Waiting failed: 2000ms exceeded
[info] [2025-11-24 00:11:57] [scrape:amazon]:   Page count: 1
[info] [2025-11-24 00:11:57] [scrape:amazon]:   Processing page 1
[info] [2025-11-24 00:11:59] [scrape:amazon]:   Checking page 1 for orders
[info] [2025-11-24 00:11:59] [scrape:amazon]:   Got 1 orders. Processing...
[info] [2025-11-24 00:11:59] [scrape:amazon]:   Order number: 305-1111111-1111111
[info] [2025-11-24 00:11:59] [scrape:amazon]:   Order date: 19. März 2024
[error] [2025-11-24 00:11:59] [scrape:amazon]:  unhandledRejection: Cannot read properties of null (reading 'click')
TypeError: Cannot read properties of null (reading 'click')
    at Amazon.clickInvoiceSpan (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\dist\commands\scrape\amazon\index.js:142:21)
    at async Amazon.processOrderPage (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\dist\commands\scrape\amazon\index.js:103:13)
    at async Amazon.processYears (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\dist\commands\scrape\amazon\index.js:85:47)
    at async Amazon.run (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\dist\commands\scrape\amazon\index.js:38:35)
    at async Amazon._run (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\node_modules\@oclif\core\lib\command.js:181:22)
    at async Config.runCommand (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\node_modules\@oclif\core\lib\config\config.js:456:25)
    at async Object.run (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\node_modules\@oclif\core\lib\main.js:96:16)

In 2.0.7 it does not finde the 2024 order, skips to 2023 but does not download anything either:

[info] [2025-11-24 00:11:23] [scrape:amazon]:   Year "2024" done. Skipping to next year
[info] [2025-11-24 00:11:23] [scrape:amazon]:   Starting year 2023
[info] [2025-11-24 00:11:25] [scrape:amazon]:   Determined order pages 2
[info] [2025-11-24 00:11:25] [scrape:amazon]:   Page count: 2
[info] [2025-11-24 00:11:25] [scrape:amazon]:   Processing page 1
[info] [2025-11-24 00:11:26] [scrape:amazon]:   Checking page 1 for orders
[info] [2025-11-24 00:11:26] [scrape:amazon]:   Got 2 orders. Processing...
[info] [2025-11-24 00:11:26] [scrape:amazon]:   Order number: 305-1111111-1111111
[info] [2025-11-24 00:11:26] [scrape:amazon]:   Order date: 7. März 2023
[error] [2025-11-24 00:11:26] [scrape:amazon]:  unhandledRejection: Cannot read properties of null (reading 'click')
TypeError: Cannot read properties of null (reading 'click')
    at Amazon.clickInvoiceSpan (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\dist\commands\scrape\amazon\index.js:142:21)
    at async Amazon.processOrderPage (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\dist\commands\scrape\amazon\index.js:103:13)
    at async Amazon.processYears (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\dist\commands\scrape\amazon\index.js:85:47)
    at async Amazon.run (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\dist\commands\scrape\amazon\index.js:38:35)
    at async Amazon._run (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\node_modules\@oclif\core\lib\command.js:302:22)
    at async Config.runCommand (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\node_modules\@oclif\core\lib\config\config.js:425:25)
    at async Object.run (C:\Users\Patrick\AppData\Local\nvm\v20.18.3\node_modules\@disane-dev\docudigger\node_modules\@oclif\core\lib\main.js:95:16)

My run parameter: docudigger scrape amazon -u 'uuu' -p 'ppp' -c '*/30 * * * *' -r --fileDestinationFolder 'C:\OneDrive\Desktop\'

[Frank-Steiner]

The timeout error you find in your first log can be solved by increasing the timeout from 2 seconds to e.g. 30. In the file ./dist/classes/scrape-command.class.js change the timeout to this.selectorWaitTimeout = 30000

The click error is complicated. docudigger cannot handle orders that have no invoce. That happens e.g. when an order has been canceled before an invoice has been created, then there is just no click button for the invoice popup. This is difficult to solve, because a) you have to store the order state and adjust the code for canceled orders and b) you have to create another kind of looping through the orders because docudiggert uses index variable "5" for the 5th order on the page. But if the 4th order was a canceled one without a invoice popup, the popup for the 5th order is the 4th invoice popup on that page and docudiggers goes wrong with the indices and misses all following invoices on this page.

I've kached all this for my own version of docudigger, but it is very much taylored for my own needs (never going back further than 3 months, string-matching for german language), so if you are not familiar with javascript, you likely cannot adjust it so that it works for you :(

[thethinker990]

Question is, what is faster, learning the basics of JS and tailor the application to my needs or download all invoices manually and just using the application for newer invoices.

But thank you very much for your help

[Frank-Steiner]

Well, you might try. As far as I see (hopefully not missing anything) all changes are only in dist/commands/scrape/amazon/index.js (and the selectors file as described above). So here's what I've changed:
Line 79:
for (const orderPage of [...Array(orderPageCount).keys()].map(pageNo => pageNo + 1)) {
to
for (const orderPage of [...Array(orderPageCount).keys()]) {
as it was always missing the first page of orders otherwise.

Line 101

         for (const [orderIndex, orderCard] of orderCards.entries()) {
            const { orderNumber, order } = await this.getOrder(orderCard);
            await this.clickInvoiceSpan(orderCard, orderIndex);
            const invoiceUrls = await this.getInvoiceUrls(orderIndex);
            if (this.options.onlyNew && (orderNumber == this.lastScrapeWithInvoices?.number)) {
                this.logger.info(`Order ${orderNumber} already handled. Exiting.`);
                onlyNewInvoiceHandled = true;
            }
            order.invoices = this.getInvoices(invoiceUrls, orderIndex);
            processedOrders.push(order);
            ...       

to

	var i=0;
        for (const [orderIndex, orderCard] of orderCards.entries()) {
            const { orderNumber, order } = await this.getOrder(orderCard);
	    // might have no click button for orders if the whole order was "canceled"
	    const okmissing = await this.clickInvoiceSpan(orderCard, i, order.status);
	    if (okmissing) {
	      this.logger.info(`order canceled, no invoice, continue`);
	      continue;
	    }
            if (this.options.onlyNew && (orderNumber == this.lastScrapeWithInvoices?.number)) {
                this.logger.info(`Order ${orderNumber} already handled. Exiting.`);
                onlyNewInvoiceHandled = true;
            }
	   order.invoices = this.getInvoices(invoiceUrls, i,order);
	    i++;
	    processedOrders.push(order);
            ...

Line 136:
const nextPageUrl = new URL(`?ie=UTF8&orderFilter=year-${year}&search=&startIndex=${10 * (orderPage)}`, amazon.orderPage);
to
const nextPageUrl = new URL(`?ie=UTF8&timeFilter=year-${year}&search=&startIndex=${10 * (orderPage)}&ref_=ppx_yo2ov_dt_b_filter_all_y${year}`, amazon.orderPage);

Line 139:
async clickInvoiceSpan(orderCard, orderIndex) {
to
async clickInvoiceSpan(orderCard, orderIndex, orderStatus) {

Line 142: here you will have to change the german string "Storniert" to whatever "Canceled" is in your language
invoiceSpan.click();
to

	if ((invoiceSpan === null) && (orderStatus == "Storniert" )) return true;
        invoiceSpan.click();
	return false;

Line 144:
getInvoices(invoiceUrls, orderIndex) {
to
getInvoices(invoiceUrls, orderIndex,order) {

Line 222: before the line const orderDateLuxon insert a line
const orderStatus = await orderCard.$eval(this.selectors.orderStatus, (handle) => handle.innerText);

Line 227: before the line number: orderNumber insert a line
status: orderStatus,

Ah, and you must insert a new selector in the selectors.helper.js for the order state:
orderStatus: `div.yohtmlc-shipment-status-primaryText span`,
e.g. right below orderNr

That should be all hopefully. Give it a try