medium severityFirecrawl scrape/crawl API (JS mode)

Scrape/crawl returns incomplete page content (e.g., missing table of contents links), despite full content visible in browser and working with other tools like pyppeteer. Logs suggest Playwright not fully utilized even with waitFor enabled.

Root cause

Insufficient wait time after page load for JavaScript to execute and render dynamic content (e.g., table of contents links), causing Playwright to scrape before DOM is fully updated. Firecrawl defaults to automatic JS handling but may require explicit delays for complex sites.

firecrawlplaywrightjavascript_renderingwaitFordynamic-contentincomplete-scrape

Citations