Skip to content
anyai.fyi

scrape-webpage

Skill from adobe/skills

Research & Web Worth a look curated contains scripts pipelinescrapehtmlcontentscrapinganalysis

Install

npx skills add adobe/skills --skill scrape-webpage

Runs the open skills CLI and installs the skill for your agent (Claude Code, Codex, Cursor …). Alternatively copy the skill folder into .claude/skills/ or upload it in Claude.ai under Settings → Skills.

As a Claude Code plugin

/plugin marketplace add anthropics/claude-plugins-official /plugin install aem-edge-delivery-services@adobe-skills

This skill is part of the plugin “aem-edge-delivery-services”. In Claude Code the plugin installs it together with the plugin’s other skills, commands and hooks.

What does the scrape-webpage skill do?

Use this when the page-import pipeline needs to fetch a source webpage and prepare it for import/migration to AEM Edge Delivery Services. Covers scraping content, extracting metadata, downloading images, and returning analysis JSON with paths, metadata, cleaned HTML, and local images. Do not invoke directly — called by page-import as a pipeline step.

Description from the SKILL.md in the source repository.

Questions about scrape-webpage

What does the scrape-webpage skill do?

Use this when the page-import pipeline needs to fetch a source webpage and prepare it for import/migration to AEM Edge Delivery Services. Covers scraping content, extracting metadata, downloading images, and returning analysis JSON with paths, metadata, cleaned HTML, and local images. Do not invoke directly — called by page-import as a pipeline step.

How do I install scrape-webpage?

In a terminal: npx skills add adobe/skills --skill scrape-webpage. The skills CLI asks which agents to install it for. In Claude.ai you can upload the skill folder as a ZIP under Settings → Skills.

Which agents can use scrape-webpage?

Skills use the open SKILL.md format, which Claude Code, Claude.ai, the Claude API, OpenAI Codex, Cursor, Gemini CLI and other agents support.

Is scrape-webpage safe to use?

Our automatic check found patterns worth a look (see “Check”). That is not proof of anything bad – read the SKILL.md and scripts before installing.

More skills from adobe/skills

workfront-planning-advisory
adobe/skills

Workfront Planning Advisory: architecting and troubleshooting Adobe Workfront Planning (WFP, aka "Maestro"): workspace and record-type design, connections and hierarchies, formula fields, object and connection limits across Select/Prime/Ultimate tiers, the Planning API (filtering …

Development curated
No risky patterns found
semrush
adobe/skills

Competitive SEO and traffic data from the Semrush MCP server (v2) for any domain, including ones nobody here owns — keyword search volume and difficulty, the keywords a domain ranks for, which …

Research & Web curated
No risky patterns found
create-custom-component
adobe/skills

Create a custom form component for an AEM Forms Edge Delivery Services (Form block) project — scaffold blocks/form/components/<name>, extend an OOTB field type (text-input, drop-down, panel, etc.), define authoring properties in _<name>.json …

Frontend & UI curated
No risky patterns found
query-index-optimizer
adobe/skills

Audit the query index of an AEM Edge Delivery Services site. Reads the whole index page by page, measures its size and the fill rate of each property, checks the properties against …

Development curated
Worth a look
performance-budget
adobe/skills

Measure what an AEM Edge Delivery Services page requests before its Largest Contentful Paint element is ready, and compare it with the 100 KB budget.

Development curated
No risky patterns found
optel-interpreter
adobe/skills

Interprets Operational Telemetry (OpTel, formerly RUM) data of an AEM Edge Delivery Services site. Loads the bundles with @adobe/rum-distiller, reports traffic and Core Web Vitals at p75 with their sample counts, splits …

Data & Databases curated
Worth a look
dev-console-unsubscribe-api
adobe/skills

Use when the user wants to remove an Adobe API from a credential — phrases like "unsubscribe from Analytics", "remove Firefly from this credential", "stop using this API", or "disconnect an API".

Development curated
No risky patterns found
dev-console-create-project
adobe/skills

Use when the user wants to create a new Adobe Developer Console project — phrases like "create a project", "new project", "set up a project", "create an App Builder project", or "start …

Development curated
No risky patterns found

Related skills in Research & Web

ai-research-explore
lllllllama/rigorpilot-skills

Rigor Explore compatible skill slug for meaningful and potentially novel deep learning research candidates. Use when the researcher has chosen the task family, dataset, benchmark, evaluation method, provided SOTA references, and wants …

Research & Web 360k installs
No risky patterns found
ai-research-reproduction
lllllllama/rigorpilot-skills

Rigor Reproduce compatible skill slug for README-first deep learning repository reproduction. Use when the user wants an end-to-end, minimal-trustworthy flow that reads the repository first, selects the smallest documented inference or evaluation …

Research & Web 360k installs
No risky patterns found
run-train
lllllllama/rigorpilot-skills

Rigor Train skill for deep learning research repositories. Use when a documented or selected training command should be run conservatively for startup verification, short-run verification, full kickoff, or resume, with command, config …

Research & Web 359k installs
No risky patterns found
explore-run
lllllllama/rigorpilot-skills

Rigor Improve / Rigor Explore run leaf skill for bounded exploratory evidence in deep learning research repositories. Use when the researcher explicitly authorizes exploratory runs such as small-subset validation, short-cycle guess-and-check, batch …

Research & Web 359k installs
No risky patterns found
just-scrape
scrapegraphai/just-scrape

Search, scrape, crawl, extract structured data, and monitor web pages via the ScrapeGraph AI CLI.

Research & Web 245k installs
Worth a look
web-search
101-skills/superpowers

Web search and content extraction with Tavily and Exa via inference.sh CLI. Apps: Tavily Search, Tavily Extract, Exa Search, Exa Answer, Exa Extract. Capabilities: AI-powered search, content extraction, direct answers, research.

Research & Web 130k installs
No risky patterns found
sales-enablement
coreyhaines31/marketingskills

When the user wants sales collateral, or asks what to give a champion or rep, or how to answer an objection or make the case: decks, one-pagers, objection handling, demo scripts, talk …

Research & Web 130k installs
No risky patterns found
caveman-explore
juliusbrussee/caveman

Read-only repository explorer for cold-start orientation, broad cross-file localization, or when a direct search failed. Skip it when the exact file or symbol is already named.

Research & Web 128k installs
No risky patterns found