Discussions

• 1 You must be logged in to vote

  🙏

  Requeue URLs giving HTTP 429

  Jamesking56 asked Sep 22, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Question: Can a running crawler be stopped?

  Hawksama asked Aug 26, 2025 in Q&A · Unanswered

  

  

  0
• 6 You must be logged in to vote

  🙏

  403 Forbidden when crawling an external website with spatie crawler.

  Calbo67 asked Apr 25, 2021 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  💬

  error cURL error 35: error:0A00018A:SSL routines::dh key too small

  juangomes376 started Oct 25, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  Max crawl depth not working

  sasa-andjelic-nqode asked Sep 18, 2024 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  For sitemap crawl url is not working (url loc from inside sitemap are not crawled)

  alexandrutanasie asked Sep 4, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  CrawlUrl getId access before initialization

  Redominus asked Aug 28, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  Pause and Resume Crawl

  Xaelp started Jan 9, 2023 in General · Closed

  

  

  1
• 1 You must be logged in to vote

  🙏

  Outbound Traffic Over a Reserved IP (Digital Ocean)

  vicgonvt asked Aug 8, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Cookies in clientOptions

  davidgeisler1998 asked Apr 2, 2024 in Q&A · Unanswered

  

  

  2
• 1 You must be logged in to vote

  🙏

  Class "Spatie\Crawler\CrawlObservers\CrawlObserver" not found in production

  ahmadnajmdev asked Apr 1, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Declaration of App\Observers\CustomCrawlerObserver::crawled

  linjection asked Nov 15, 2022 in Q&A · Answered

  

  

  

  

  4
• 1 You must be logged in to vote

  💡

  Breaking change: moving shouldCrawl from CrawProfile to crawl observers

  cth-latest started Jan 1, 2024 in Ideas

  

  

  2
• 1 You must be logged in to vote

  💬

  LinkAdder::extractLinksFromHtml()

  Xaelp started Nov 28, 2023 in General · Closed

  

  

  1
• 1 You must be logged in to vote

  💬

  Depth Tree Structure

  Xaelp started Oct 17, 2023 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  Cannot install under php 8.1.2

  maverickchangithub asked Nov 21, 2023 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  💡

  Crawler stops after www-version redirect to non-www version

  buismaarten started Nov 18, 2023 in Ideas

  

  

  0
• 1 You must be logged in to vote

  🙏

  Custom/extendable CrawlUrl

  rudiedirkx asked Sep 22, 2022 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  💬

  This crawler does it only work on laravel?

  thiagovieiradev started Oct 31, 2022 in General

  

  

  

  

  3
• 2 You must be logged in to vote

  🙏

  Crawler simply stops

  mrtnmueller asked Apr 6, 2023 in Q&A · Unanswered

  

  

  1
• 2 You must be logged in to vote

  🙏

  wait little more time until javascript fully rendered?

  nzakjames asked Feb 22, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  [requestException] cURL error 60: SSL certificate problem: unable to get local issuer certificate

  GabMic asked Feb 5, 2021 in Q&A · Answered

  

  

  

  

  4
• 1 You must be logged in to vote

  💡

  CrawlObserver and CrawlProfile interfaces

  rudiedirkx started Sep 22, 2022 in Ideas

  

  

  0
• 1 You must be logged in to vote

  🙏

  Running in an infinite cron job?

  kjoedion asked Sep 19, 2022 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Follow all redirects, including HTML meta and Javascript

  rzb asked Jul 25, 2022 in Q&A · Unanswered

  

  

  1