← Back to Skills Marketplace
dataify-server

Dataify Web Unlocker

by dataify-server · GitHub ↗ · v1.0.0 · MIT-0
cross-platform ✓ Security Clean
39
Downloads
0
Stars
0
Active Installs
1
Versions
Install in OpenClaw
/install dataify-web-unlocker
Description
Unlock or fetch difficult web pages through the Dataify Web Unlocker API. Use when needs to retrieve HTML or rendered content from sites that may block norma...
README (SKILL.md)

Dataify Web Unlocker

Use the bundled wrappers to call Dataify's Web Unlocker API with a stable parameter set across platforms.

Treat every request field as optional user input except for url. Confirm the target url with the user before making the request if it is not already explicit in the prompt. For every other field, keep the default value unless the user explicitly asks to override it.

Workflow

  1. Use scripts/invoke-dataify-web-unlocker.py on macOS/Linux or when cross-platform portability matters.
  2. Use scripts/invoke-dataify-web-unlocker.ps1 on Windows when PowerShell is the best fit.
  3. Use a raw curl command only when the user explicitly asks for it.
  4. Confirm the target url with the user if it was not clearly provided. Do not guess the URL.
  5. Treat every other request field as optional. Override a field only when the user explicitly asked for a non-default value.
  6. Let the script read DATAIFY_API_TOKEN from the environment.
  7. If the token is missing, stop and tell the user to sign in at Dataify Dashboard to obtain DATAIFY_API_TOKEN.
  8. Return the API response body directly unless the user asks for extra post-processing.

Set DATAIFY_API_TOKEN

Prefer a permanent environment-variable setup instead of setting the token only for the current terminal session.

Windows PowerShell, permanent for the current user:

[Environment]::SetEnvironmentVariable("DATAIFY_API_TOKEN", "your_token_here", "User")

Then reopen PowerShell. If the current session also needs the token immediately, run:

$env:DATAIFY_API_TOKEN = "your_token_here"

macOS or Linux, permanent for bash:

echo 'export DATAIFY_API_TOKEN="your_token_here"' >> ~/.bashrc
source ~/.bashrc

macOS or Linux, permanent for zsh:

echo 'export DATAIFY_API_TOKEN="your_token_here"' >> ~/.zshrc
source ~/.zshrc

Default request body

Use these defaults unless the user asks for different values. Only url must be collected before the real request is sent:

{
  "url": "https://www.google.com",
  "type": "html",
  "js_render": "True",
  "block_resources": "",
  "clean_content": "",
  "country": "us",
  "headers": "",
  "cookies": "",
  "wait": "",
  "wait_for": "",
  "follow_redirect": "True",
  "isjson": "1"
}

Preferred commands

Ask for the URL first if the user did not provide one. After that, the minimal call should pass only url and rely on defaults for everything else.

Cross-platform Python:

python scripts/invoke-dataify-web-unlocker.py --url "https://www.google.com"

Windows PowerShell:

& ".\scripts\invoke-dataify-web-unlocker.ps1" -Url "https://www.google.com"

Common overrides in Python:

python scripts/invoke-dataify-web-unlocker.py \
  --url "https://example.com" \
  --js-render "True" \
  --country "us" \
  --wait "3000" \
  --wait-for ".main-content"

Common overrides in PowerShell:

& ".\scripts\invoke-dataify-web-unlocker.ps1" `
  -Url "https://example.com" `
  -JsRender "True" `
  -Country "us" `
  -Wait "3000" `
  -WaitFor ".main-content"

Use --dry-run or -DryRun to preview the endpoint, authorization state, and JSON payload without making the network request:

python scripts/invoke-dataify-web-unlocker.py --url "https://example.com" --dry-run
& ".\scripts\invoke-dataify-web-unlocker.ps1" -Url "https://example.com" -DryRun

Raw curl fallback

If the user explicitly wants the raw request, use curl.exe in PowerShell, not curl, to avoid the PowerShell alias ambiguity.

Before calling the API, check the token:

if (-not $env:DATAIFY_API_TOKEN) {
  Write-Error "DATAIFY_API_TOKEN is not set. Sign in at https://www.dataify.com/ to obtain it."
  exit 1
}

Then send the request:

curl.exe -X POST "https://webunlocker.dataify.com/request" `
  -H "Authorization: Bearer $env:DATAIFY_API_TOKEN" `
  -H "Content-Type: application/json" `
  -d "{\"url\":\"https://www.google.com\",\"type\":\"html\",\"js_render\":\"True\",\"block_resources\":\"\",\"clean_content\":\"\",\"country\":\"us\",\"headers\":\"\",\"cookies\":\"\",\"wait\":\"\",\"wait_for\":\"\",\"follow_redirect\":\"True\",\"isjson\":\"1\"}"

Parameter notes

  • url is the only field that should be treated as required input from the user.
  • Ask the user to confirm url if it is missing or ambiguous.
  • headers and cookies are passed through as strings exactly as provided by the caller.
  • Keep boolean-like fields as strings such as "True" because that matches the supplied API format.
  • Keep isjson as "1" unless the user explicitly requests a different response mode.
  • Prefer minimal overrides. Do not invent custom headers, cookies, waits, render settings, or country overrides unless the user requested them.
  • The Python wrapper uses only the standard library so it stays portable and does not require third-party packages.
Usage Guidance
Install only if you intend to use Dataify as a third-party web-fetching service. Treat DATAIFY_API_TOKEN like a password, rotate it if exposed, and do not send authentication cookies, Authorization headers, internal URLs, private account pages, or regulated data unless you understand that Dataify may receive them.
Capability Assessment
Purpose & Capability
The stated purpose is to fetch or unlock difficult web pages through Dataify, and the artifact implements that by posting user-supplied request fields to Dataify's Web Unlocker endpoint.
Instruction Scope
Activation language is broad for difficult web fetches, but the workflow requires an explicit or confirmed URL and says optional fields such as headers and cookies should only be changed when the user asks.
Install Mechanism
The package contains markdown guidance, an agent metadata file, and a standard-library Python wrapper with no third-party dependencies; it references a PowerShell wrapper that is not present, which is a quality issue rather than a security issue.
Credentials
Network access to Dataify and use of DATAIFY_API_TOKEN are proportionate to the API-wrapper purpose, but documentation should more prominently warn that URLs, headers, cookies, and page content are sent to a third party.
Persistence & Privilege
The docs recommend persistent environment-variable storage for DATAIFY_API_TOKEN, which is common for API tools but should be treated as secret credential storage.
How to Use
  1. Make sure OpenClaw is installed (local or Docker)
  2. Run the install command in chat: /install dataify-web-unlocker
  3. After installation, invoke the skill by name or use /dataify-web-unlocker
  4. Provide required inputs per the skill's parameter spec and get structured output
Version History
v1.0.0
Initial release of Dataify Web Unlocker skill. - Unlock or fetch web pages using the Dataify Web Unlocker API, with strong support for handling blocks, JavaScript rendering, redirects, country selection, and custom headers/cookies. - Bundled cross-platform Python and PowerShell scripts for easy API invocation. - Only the `url` parameter is required—prompt users to confirm the target URL if not explicit. - All other fields use safe defaults unless the user specifies overrides. - Provides clear instructions for setting the `DATAIFY_API_TOKEN` environment variable. - Supports a dry-run mode for previewing requests without sending them. - Detailed fallback instructions for using raw `curl` requests when needed.
Metadata
Slug dataify-web-unlocker
Version 1.0.0
License MIT-0
All-time Installs 0
Active Installs 0
Total Versions 1
Frequently Asked Questions

What is Dataify Web Unlocker?

Unlock or fetch difficult web pages through the Dataify Web Unlocker API. Use when needs to retrieve HTML or rendered content from sites that may block norma... It is an AI Agent Skill for Claude Code / OpenClaw, with 39 downloads so far.

How do I install Dataify Web Unlocker?

Run "/install dataify-web-unlocker" in the OpenClaw or Claude Code chat to install it in one step — no extra setup required.

Is Dataify Web Unlocker free?

Yes, Dataify Web Unlocker is completely free, licensed under MIT-0. You can download, install and use it at no cost.

Which platforms does Dataify Web Unlocker support?

Dataify Web Unlocker is cross-platform and runs anywhere OpenClaw / Claude Code is available (cross-platform).

Who created Dataify Web Unlocker?

It is built and maintained by dataify-server (@dataify-server); the current version is v1.0.0.

💬 Comments