Open Skills Logo
Open Skills

scrapfly-automation

Automate Scrapfly tasks via Rube MCP (Composio). Always search tools first for current schemas.

Author

@ComposioHQ

Category

Development Tools

Install

Hot:34

Download and extract to your skills directory

Copy command and send to AI Agent for auto-install:

Download and install this skill https://openskills.cc/api/download?slug=composiohq-composio-skills-scrapfly-automation&locale=en&source=copy

Scrapfly Automation - Rube MCP Automation Skill

Skill Overview


By integrating Composio’s Scrapfly toolkit through Rube MCP, this enables automated operation of Scrapfly web scraping tasks. You can connect and execute Scrapfly tools without needing an API key.

Use Cases


  • Automated Scraping Task Management: When you need to run Scrapfly scraping operations on a scheduled basis or on demand, use RUBE_MULTI_EXECUTE_TOOL to batch process multiple scraping requests.

  • Dynamic Tool Discovery and Execution: The Scrapfly tool schema may change. Use RUBE_SEARCH_TOOLS to fetch the latest tool patterns in real time, ensuring your code remains compatible.

  • Enterprise-Grade Scraping Workflows: Using Rube MCP session management and connection status checks, you can build reliable Scrapfly automation flows suitable for production deployments.

    • Core Features


  • Automatic Tool Discovery: Use RUBE_SEARCH_TOOLS to query available tools in real time, retrieving the complete tool schema, input parameters, and execution plan. This avoids hardcoding outdated tool definitions.

  • Connection Management: Use RUBE_MANAGE_CONNECTIONS to check the Scrapfly connection status. Support establishing connections via Composio authentication links to ensure the connection is active before execution.

  • Batch Tool Execution: Use RUBE_MULTI_EXECUTE_TOOL to run multiple Scrapfly operations in one go. It supports session reuse and memory management, improving efficiency for batch jobs.

    • Common Questions

    What configuration does Rube MCP require?


    Simply add https://rube.app/mcp as an MCP server to use it—no API key is required. After adding, you can use RUBE_SEARCH_TOOLS to verify whether the connection is working properly.

    How do I handle changes to the Scrapfly tool schema?


    Always call RUBE_SEARCH_TOOLS before executing to retrieve the current tool mode. This tool returns the latest tool definitions, input schema, and known pitfalls, ensuring your code is compatible with the latest Scrapfly version.

    What should be checked before running a Scrapfly task?


    Use RUBE_MANAGE_CONNECTIONS to verify whether the Scrapfly connection status is ACTIVE. If it’s not activated, complete Composio authorization using the authentication link returned. After execution, check the pagination markers in the response to ensure you obtain the complete results.