---
name: openphish-community-ingestion
description: "How to get OpenPhish Community Feed data into a pandas DataFrame and Parquet: access, the request, the format, limits, quirks and terms."
---

# Load the OpenPhish Community Feed into pandas and Parquet

Source entry: https://signal-lab-jet.vercel.app/datasets/openphish-community
Provider: https://openphish.com/phishing_feeds.html
Checked against the provider's documentation: 2026-11-01

## Access
- No account or key. The Community Feed is a public plain-text download.
- The free-service terms permit personal, academic or independent research only and exclude research supporting business operations.

## Request
```bash
curl 'https://openphish.com/feed.txt'
```

## Format
Plain text with one active phishing URL per line and no header or metadata fields.

## Load into pandas and Parquet
Needs Python 3 with requests, pandas and pyarrow.
```python
"""OpenPhish Community Feed -> pandas -> Parquet. Do not request any listed URL."""
import requests
import pandas as pd

URL = "https://openphish.com/feed.txt"
HEADERS = {"User-Agent": "Mozilla/5.0 (X11; Linux x86_64) SignalLabCheck/1.0"}
r = requests.get(URL, headers=HEADERS, timeout=60)
r.raise_for_status()
urls = [line.strip() for line in r.text.splitlines() if line.strip()]
df = pd.DataFrame({"url": urls})
df.to_parquet("openphish_community.parquet", index=False)
print(len(df), "phishing URLs in the community feed")
```
Run by us on 2026-11-01 (python 3.13.5 | pandas 3.1.0 | pyarrow 26.0.0 | requests 2.34.2). Result: 300 phishing URLs in the community feed

## Limits
- Rate limit: Not stated.
- The Community Feed updates every 12 hours and provides limited fields with no archive.
- The free-service terms restrict use to personal, academic or independent research that does not support business operations.

## Quirks
- The file has no timestamps, confidence, target-brand or network fields.
- The feed contains dangerous destinations. Do not visit or fetch listed URLs or hosts; request only the feed URL.
- The list changes as active phishing pages appear or are removed, and false positives are possible.

## Terms and attribution
- Free-service use is limited to personal, academic or independent research that does not support business operations.
- Do not redistribute the feed or derived portions without written permission.
- Terms page: https://openphish.com/terms.html

## Sources
- https://openphish.com/phishing_feeds.html: "Law enforcement agencies may be eligible to access the Premium Gov Feed at no cost."
- https://openphish.com/terms.html: "The Services are provided solely for your personal use."
- https://openphish.com/kb.html: "This allows us to rapidly scale up (process more data), deliver data efficiently, and provide global coverage."

## Help improve this skill
Missing a source, or see something to improve? Call the MCP tool suggest_source or feedback (or POST /api/suggest or /api/feedback). Reviewed ideas: https://signal-lab-jet.vercel.app/agent-suggestions

Information for educational purposes only. Free tiers, limits and licenses belong to the providers and may change; check the provider's own terms before using the data.