Does this violate platform terms of service?

It uses Firecrawl's search endpoint which finds publicly available content via web search — it doesn't use platform APIs or scrape logged-in pages directly. Always respect rate limits and robots.txt.

Can I monitor multiple clients?

Yes — the config file supports multiple brand profiles, each with their own keywords, competitors, and notification channels.

How accurate is the sentiment analysis?

Claude's sentiment scoring is very accurate for English text. For ambiguous posts, it flags them as 'neutral' for human review rather than guessing.

Social Media Intelligence Scraper

Monitor X, Reddit, and LinkedIn for brand mentions and trends

Time Saved

10 hrs/week

Steps

6 steps

Industry

Agency

Department

Marketing

10 hrs/week6 stepsAgencyMarketing

MediumMarketing & Social Media

Difficulty

Overview

Agencies and marketers need to know what's being said about their clients and competitors across social platforms. This automation builds a scraping pipeline using Firecrawl and Claude that monitors X/Twitter, Reddit threads, and LinkedIn posts for specific keywords, brand mentions, and industry hashtags. It runs on a schedule, deduplicates content, uses AI to score relevance and sentiment, and delivers a formatted daily digest via email or Slack. Perfect for agencies managing multiple client brands.

Target audience: Marketing agencies, social media managers, brand managers, and PR teams

Implementation Steps

Claude Code creates a Node.js project with Firecrawl SDK, Claude API, and node-cron

via Claude Code

Configure target keywords, brand names, subreddits, and hashtags in a config file

via Claude Code

Build scrapers for each platform using Firecrawl /search endpoint

via Firecrawl

Claude API scores each result for relevance, sentiment, and urgency

via Claude API

Results are deduplicated, ranked, and formatted into a Markdown digest

via Claude Code

Digest is sent via email (Resend) or Slack webhook on a daily schedule

via Resend

Build It

Open Claude Code in your terminal

Run claude in your project directory

Copy and paste this prompt

Claude builds the entire project for you

It will scaffold files, install dependencies, and wire up the full workflow

Business Case

Problem

Manually checking X, Reddit, and LinkedIn for brand mentions and trends is time-consuming and things get missed

Solution

Automated scraping pipeline that monitors all three platforms and delivers AI-scored daily digests

Impact

Never miss a brand mention, trending topic, or competitor move — respond faster and stay ahead

Features

Multi-platform monitoring

MVP

Scrapes X/Twitter, Reddit, and LinkedIn from a single config

AI relevance scoring

MVP

Claude rates each mention for relevance, sentiment, and urgency

Daily digest emails

MVP

Formatted summary delivered to inbox or Slack every morning

Competitor tracking

Monitor competitor brands alongside your own

Trend detection

Identifies emerging topics and hashtags in your industry

Tech Stack

Claude CodeRequired

Builds the entire scraping and analysis pipeline

FirecrawlRequired

Searches and scrapes social media platforms

Claude APIRequired

Scores relevance, sentiment, and generates digest summaries

Resend

Sends daily digest emails

node-cronRequired

Schedules daily scraping runs

FAQ

Related Workflows

Competitor Price & Market Monitor

Build a tool that monitors competitor websites for pricing changes, new features, and market positioning — then generates a weekly analysis report with actionable insights.

Medium·4 hrs/week·6 steps

Enter your email to continue

Verify your email once to access all free workflows.

We'll never spam you. One-time verification only.

Unlock Full Library

Unlock Full Library

Social Media Intelligence Scraper

Overview

Implementation Steps

Build It

Business Case

Problem

Solution

Impact

Features

Multi-platform monitoring

AI relevance scoring

Daily digest emails

Competitor tracking

Trend detection

Tech Stack

FAQ

Related Workflows

Competitor Price & Market Monitor

Enter your email to continue

AI Sales Outreach & Prospecting Agent

AI Lead Nurture Email Sequence Builder