Skip to content

Add openweb skill — typed JSON access to 90+ websites#238

Closed
imoonkey wants to merge 1 commit into
vercel-labs:mainfrom
imoonkey:add-openweb-skill
Closed

Add openweb skill — typed JSON access to 90+ websites#238
imoonkey wants to merge 1 commit into
vercel-labs:mainfrom
imoonkey:add-openweb-skill

Conversation

@imoonkey
Copy link
Copy Markdown

Summary

  • Adds openweb skill — typed JSON access to 90+ real websites for AI agents
  • Backed by the openweb CLI which calls the same APIs the websites call internally — no browser automation, no vision API, no LLM-powered HTML parsing
  • Adds README entry under "openweb" following the existing skill format

Skill Details

Field Value
Name openweb
Author openweb-org
Version 0.1.5
License MIT
Category Web data access / agent capability

What it does

OpenWeb gives agents structured JSON access to real websites. Instead of scraping HTML or driving a headless browser, it calls the same internal APIs the website itself uses — the result is fast, cheap, and token-efficient.

For sites that need authenticated access, OpenWeb starts a managed Chrome instance and reuses the user's existing browser session (cookies, JWTs, CSRF tokens, request signing, exchange chains all auto-resolved). The source profile is never modified; the temp snapshot is auto-deleted after 5 min idle.

Operations are gated by a four-tier permission system (read / write / delete / transact) so destructive or financial actions require user confirmation by default.

Coverage today

90+ sites across:

  • Search (Google, DuckDuckGo, Bing, Brave, Kagi)
  • Shopping (Amazon, Walmart, eBay, Target, Costco, Home Depot)
  • Travel (Booking, Google Flights, Airbnb, Expedia, Tripadvisor)
  • Finance (Bloomberg, Yahoo Finance, Robinhood, Coinbase, Xueqiu)
  • Social (Reddit, X, Instagram, Hacker News, Threads)
  • News & content (YouTube, Wikipedia, Medium, Substack)
  • Dev tools (GitHub, GitLab, Stack Overflow, npm)
  • Real estate (Zillow, Redfin, Realtor)

Run openweb sites for the full list. Not listed? The full skill bundle includes an add-site workflow so any site can be added through the agent.

Why this fits

The repo already includes agent skills for deployment (vercel-deploy-claimable), CLI integrations (vercel-cli-with-tokens), and external services (e.g., clicks-protocol in #211, the-colony in #220). This adds a web-data-access skill for agents that need typed JSON from real websites — a complementary capability to the existing dev-focused skills.

Notes

  • skills/openweb/SKILL.md is a thin entry-point following the repo's existing convention. The full skill bundle (workflows, knowledge files for auth/extraction/bot-detection patterns, add-site authoring guide) lives at the canonical repo.
  • Includes skills/openweb.zip per repo packaging convention.
  • All trust boundaries documented inline (no telemetry, no exfil, browser profile snapshot scope, etc.).
  • ClawHub security scan: OpenClaw Benign + VirusTotal Benign (clawhub.ai/imoonkey/openweb).

Project links

Adds skills/openweb — a thin entry-point skill backed by the openweb CLI
(npm: @openweb-org/openweb). Returns typed JSON from 90+ real websites
across search, shopping, travel, finance, social, news, and dev tools.

For sites that need authenticated access, the CLI starts a managed Chrome
instance and reuses the user's existing browser session; auth (cookies,
JWT, CSRF, request signing, exchange chains) is auto-resolved.

Operations are gated by a four-tier permission system (read / write /
delete / transact) configurable via $OPENWEB_HOME/config.json.

The full skill bundle (workflows, knowledge files, add-site authoring
guide) lives at the canonical repo (https://github.com/openweb-org/openweb)
and can be installed via the documented one-liner.
@vercel
Copy link
Copy Markdown

vercel Bot commented Apr 22, 2026

@imoonkey is attempting to deploy a commit to the Vercel Team on Vercel.

A member of the Team first needs to authorize it.

@imoonkey
Copy link
Copy Markdown
Author

Closing this — after digging into how skills.sh actually indexes, I realized it crawls SKILL.md from any GitHub repo via npx skills add install telemetry, not only from this curated collection. So the openweb skill will reach skills.sh / Hermes / etc through the canonical openweb-org/openweb repo without needing to live here.

Apologies for the noise on your queue, and thanks for the careful curation work on the official collection — happy to revisit if you ever open up a broader "agent capability" track separate from the Vercel/React focus.

@imoonkey imoonkey closed this Apr 22, 2026
@imoonkey imoonkey deleted the add-openweb-skill branch April 22, 2026 03:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant