SpyWeb — The Next-Gen Web Monitoring Engine

Deploy Anywhere.

Dual binary. Zero dependencies. Total control.

Linux

x86_64 / Server

Ideal for headless servers and 24/7 VPS monitoring. Includes systemd-ready binary.

Download

Windows

x86_64 / Desktop

Includes the System Tray app for silent background monitoring and instant notifications.

Download

macOS

Universal / M1 / M2

Native builds optimized for Apple Silicon and Intel-based Macs.

Universal

ARM64

Onboarding

Get Started in Seconds.

1

Unzip & Launch

Download the binary for your system and extract. Zero installers, zero runtimes—just a single, high-performance executable.

2

Configure

Define your targets in jobs.toml. Use simple selectors for basics, or drop in a Lua script for complex extraction logic.

3

Deploy

Fire up the engine. SpyWeb monitors in the background, dedupes data, and alerts you via Slack, Discord, or Desktop notifications.

Built for Precision.

Hyper-Efficient

Under 5MB idle RAM. Perfect for running hundreds of jobs on the cheapest $5 VPS without breaking a sweat.

Lua Scripting

Go beyond selectors. Write custom logic for anti-bot bypass, data transformation, and conditional alerting.

Hot-Reload

No restarts. Save your config.toml or hooks.lua and the engine respawns jobs instantly with zero downtime.

Built-in Intelligence

Integrated database handles deduplication, state persistence, and record history out of the box.

Alert Anywhere

Native desktop notifications, custom webhooks, and raw JSON export. Integrate with Discord, Slack, or your own API.

Zero Friction

Dual binary for convenience. Zero runtime or external dependencies. Just download, configure, and monitor. It's that simple.

Fault Tolerant

Isolated job execution ensures that a single job failure or Lua error never crashes the engine. Built-in recovery logic keeps your data flowing.

Bring Your Own UI

Every SpyWeb instance serves a local REST API. Access your raw data to build custom dashboards or integrate with your favorite tools. Read API Guide →

Simple or Scriptable.

config/default

                                # simple monitoring job that loops on default interval ( runs every 10 minutes )
[[jobs]]
name = "Job Board Scraper"
url = "https://example.com/jobs"
selector = ".job-card"
fields = ["title:h2", "salary:.salary-badge"]
                            

                                -- The "Hybrid" Pattern: Combine CSS + Regex logic
function after_extract(items)
    -- Extract app_id from a <script> tag variable using patterns
    local internal_id = last_fetch.body:match('var app_id = "(%w+)"')
    
    for _, item in ipairs(items) do
        -- Inject the hidden ID into every extracted item
        item.fields.app_id = internal_id or "not_found"
        
        -- Clean up price: "$1,200.00" -> "1200.00"
        if item.fields.price then
            item.fields.price = item.fields.price:match("%d+%.?%d*")
        end
    end
    return items
end
                            

Check out GitHub examples or our documentation for more detailed examples.

Endless Possibilities.

E-Commerce

Track price drops, restocks, and competitor discounts on any shop without an API.

Job Boards

Be the first to apply. Monitor specialized job boards and get instant notifications.

Real Estate

Watch for new listings in specific neighborhoods and skip the aggregator delays.

Crypto & Finance

Monitor whale movements, new token listings, or regulatory updates in real-time.

OSINT & News

Track government sites, court records, or niche news portals for breaking information.

AI Training

Automate the collection of clean, structured datasets for LLM fine-tuning or RAG.

Web Monitoring. Redefined for Speed & Simplicity.