Add Firecrawl curated skill for web scraping and search#163
Open
leonardogrig wants to merge 1 commit intoopenai:mainfrom
Open
Add Firecrawl curated skill for web scraping and search#163leonardogrig wants to merge 1 commit intoopenai:mainfrom
leonardogrig wants to merge 1 commit intoopenai:mainfrom
Conversation
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
I'm Leo, dev rel at Firecrawl. The skills catalog covers a lot of ground already, from deployment to observability to browser automation. One thing that's missing is a dedicated web data extraction skill: scraping pages to clean markdown, searching the web, discovering URLs across a site. Adding Firecrawl here so Codex users can pull structured web content into their workflows without writing scraping logic from scratch.
Happy to adjust anything, add extra credits for testing, or help with integration details.
What this adds
A new curated skill at
skills/.curated/firecrawl/that gives Codex agents the ability to search the web, scrape pages, and extract structured data via thefirecrawlCLI.Files:
skills/.curated/firecrawl/SKILL.md- CLI reference with search, scrape, and map commands, auth setup, file organization patterns, parallelization, and sandbox troubleshootingskills/.curated/firecrawl/agents/openai.yaml- Skill metadata (display name, description, icons, default prompt)skills/.curated/firecrawl/assets/firecrawl-small.svg- Small icon (currentColor SVG for theming)skills/.curated/firecrawl/assets/firecrawl.png- Large icon (100x100 PNG)skills/.curated/firecrawl/LICENSE.txt- Apache 2.0Why this matters for the Skills Catalog
The existing curated skills handle deployment (Vercel, Netlify, Cloudflare, Render), browser automation (Playwright), project management (Linear), observability (Sentry), and content creation (PDF, docs, spreadsheets). What's missing is a way for agents to pull live web content into their context: reading documentation pages, researching APIs, checking current information, extracting data from URLs.
Firecrawl fills that gap. It's a CLI tool that handles:
How agents use it
Setup
The skill includes auth error handling and sandbox troubleshooting (with
sandbox_permissions=require_escalatedguidance for network access).Follows repo conventions
agents/openai.yaml,assets/,LICENSE.txt,SKILL.md)name,description)currentColor, large PNG at 100x100quick_validate.pyvalidationFirecrawl DevRel