A specialized tool designed to extract detailed group, community, and member insights from Skool.com. It streamlines research, analytics, and growth tracking for online communities by providing structured and high-quality data. Ideal for creators, analysts, and automation workflows looking to unlock meaningful insights.
Created by Bitbash, built to showcase our approach to Scraping and Automation!
If you are looking for skool-scraper-goat you've just found your team — Let’s Chat. 👆👆
This project provides a robust scraping solution for gathering structured information from Skool groups, including member metrics, courses, posts, branding, and community activity. It solves the challenge of manually inspecting large communities by automating data retrieval at scale. It is designed for researchers, community managers, growth consultants, and analytics teams seeking deeper visibility into Skool ecosystems.
- Discovers relevant Skool groups using keyword-based search or direct URLs.
- Extracts full group metadata, including branding, creation dates, privacy settings, and ownership details.
- Gathers detailed community metrics such as member counts, engagement levels, and content statistics.
- Operates with configurable concurrency and batching for high-volume scraping tasks.
- Supports advanced proxy setups for reliable, stable, and scalable data collection.
| Feature | Description |
|---|---|
| Group Discovery | Search and extract Skool groups using keywords or direct URLs. |
| Detailed Group Insights | Retrieve metadata including descriptions, branding, content volume, and structure. |
| Member & Community Metrics | Collect total members, online activity, admin counts, and engagement indicators. |
| Proxy Management | Built-in proxy rotation for stable large-scale scraping. |
| Batch Processing | Efficient and memory-optimized batch operations for processing large datasets. |
| Real-Time Logging | Tracks progress, request retries, and performance metrics during scraping. |
| Configurable Modes | Supports SCRAPE_GROUPS now, with SCRAPE_MEMBERS mode coming soon. |
| Field Name | Field Description |
|---|---|
| id | Unique identifier for the Skool group. |
| name | Internal group slug used by Skool. |
| displayName | Human-friendly name of the group. |
| url | Direct URL to the Skool group page. |
| description | Group description or mission statement. |
| privacy | Visibility level of the group (public/private). |
| membership | Membership type settings. |
| createdAt | Timestamp indicating group creation. |
| updatedAt | Latest data update timestamp. |
| branding | Contains color theme, initials, and logo URLs. |
| content | Includes course counts, modules, posts, rules, etc. |
| community | Member statistics, including total, online, and admins. |
| owner | Full profile of the group owner, including bio and social links. |
| search | Original query metadata (if scraped via keyword). |
{
"search": {
"query": "ai",
"queryIndex": 15
},
"id": "group-id",
"name": "group-name",
"displayName": "Group Display Name",
"url": "https://www.skool.com/group-name",
"description": "Group description",
"privacy": 1,
"membership": 1,
"createdAt": "2024-04-09T15:26:09.355362Z",
"updatedAt": "2024-11-22T12:29:10.023724Z",
"branding": {
"color": "#009E5D",
"initials": "ID",
"logo": {
"small": "https://...",
"large": "https://...",
"favicon": "https://...",
"cover": "https://..."
}
},
"content": {
"courses": {
"total": 15,
"modules": 267
},
"posts": 871,
"rules": 3
},
"community": {
"members": {
"total": 351,
"online": 10,
"admins": 2
}
},
"owner": {
"id": "owner-id",
"name": "username",
"firstName": "First",
"lastName": "Last",
"bio": "Owner bio",
"location": "Location",
"social": {
"website": "https://...",
"youtube": "https://...",
"instagram": "https://...",
"facebook": "-",
"twitter": "-",
"linkedin": "-"
}
}
}
Skool Scraper Goat/
├── src/
│ ├── runner.js
│ ├── extractors/
│ │ ├── group_parser.js
│ │ └── utils.js
│ ├── workflows/
│ │ └── batch_processor.js
│ ├── network/
│ │ └── proxy_manager.js
│ └── config/
│ └── settings.example.json
├── data/
│ ├── sample_output.json
│ └── keywords.txt
├── package.json
├── requirements.txt
└── README.md
- Market researchers use it to compare community sizes and engagement across niches, enabling data-driven market insights.
- Community managers use it to monitor group activity and identify growth opportunities.
- Agencies use it to discover potential partnerships and evaluate competitor communities.
- Data analysts use it to gather structured datasets for trend modeling and audience segmentation.
- Developers use it to feed automation pipelines with consistently formatted Skool group data.
Q: Do I need proxies to run this scraper effectively? A: While it can run without proxies, residential proxies significantly increase stability and consistency, especially when scraping many groups.
Q: Can it scrape individual member profiles? A: The current version focuses on group-level insights. A dedicated SCRAPE_MEMBERS mode is planned for detailed profile extraction.
Q: How many groups can it scrape per keyword? A: You can configure up to 1000 groups per keyword, depending on availability and rate limits.
Q: Does it support concurrency adjustments? A: Yes, concurrency and batch sizes are fully configurable to match performance needs.
Primary Metric: Handles up to 100 groups in under 30 seconds with moderate concurrency settings.
Reliability Metric: Consistently achieves 95–100% success rate when used with residential proxies and retries enabled.
Efficiency Metric: Optimized batch processing reduces memory load by over 40% during large-scale runs.
Quality Metric: Delivers near-complete data fields for over 98% of processed groups, ensuring high analytical accuracy.
"Bitbash is a top-tier automation partner, innovative, reliable, and dedicated to delivering real results every time." Nathan Pennington
|
"Bitbash delivers outstanding quality, speed, and professionalism, truly a team you can rely on." Eliza
|
"Exceptional results, clear communication, and flawless delivery. Syed
|