Skip to content

A Python script to crawl a website up to a specified depth and generate a summary using the OpenAI API.

Notifications You must be signed in to change notification settings

peterzat/linksage

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 

Repository files navigation

LinkSage

A Python script to crawl a website up to a specified depth and generate a summary using the OpenAI API.

Setup

  1. Install dependencies:
    pip install -r requirements.txt
  2. Set API Key: Open linksage.py and replace "YOUR_API_KEY" with your actual OpenAI API key.

Usage

python linksage.py <URL> [--depth N]
  • <URL>: The starting URL to crawl (e.g., https://example.com).
  • --depth N: (Optional) The maximum crawl depth. Defaults to 2.

Example:

python linksage.py https://example.com --depth 2

About

A Python script to crawl a website up to a specified depth and generate a summary using the OpenAI API.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages