Skip to content

def-initialize/webfetch

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 

Repository files navigation

webfetch

Fetches a URL and saves the main content as a Markdown file.

Pipeline: fetch()Readability (main content extraction) → Turndown (HTML → Markdown)

Uses the same extraction engine as OpenClaw's built-in web_fetch tool, but saves the full output to disk without any AI involvement.

Usage

tsx webfetch.ts <url> [--output <path>]

Output defaults to /tmp/webfetch-output.md.

Examples

tsx webfetch.ts https://example.com/article
tsx webfetch.ts https://example.com/article --output /tmp/article.md

Install

npm install

Requirements

  • Node.js 18+
  • tsx (npm i -g tsx)

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors