FreshRSS: A Self-Hosted Aggregator with Built-In XPath Scraping

What FreshRSS Solves and Who It Is For

FreshRSS solves the problem of aggregating news from multiple sources into a single, self-hosted interface. It is for individuals and organizations that want control over their reading data and do not want to rely on cloud-based feed readers. The project explicitly supports multi-user setups with anonymous reading mode, which suits families, small teams, or communities. It also handles sites that do not publish RSS or Atom feeds through native XPath-based scraping. That feature is the main differentiator from many other aggregators, which require external services or plugins for scraping. The target user is technically comfortable enough to run a PHP application on a server, but not necessarily a developer.

The Mechanism: XPath Scraping and JSON Support

FreshRSS's scraping mechanism is based on XPath 1.0, as documented in the project's website scraping guide. For a site without a feed, an administrator defines an XPath query that selects the article elements from the HTML. FreshRSS then fetches the page and extracts the content according to that query. The README states that it also supports JSON documents, which means you can parse structured data from APIs or JSON-based sites. This is a manual process: you must know the site's HTML structure and write the correct XPath. There is no automatic detection or machine learning. The data flow is straightforward: the fetcher retrieves the URL, the XPath engine processes the DOM, and the results become feed items. This approach works for simple, predictable layouts, but it has no tolerance for markup changes.

Getting It Running: Installation and Configuration

Installation is manual or automated. The README lists Docker, YunoHost, and several cloud providers. For manual install, you download the archive or clone the repository, place it on a server, and expose only the ./p/ folder to the web. You must give the web server user write access to the ./data/ folder. Then you access the application in a browser and follow the installation wizard, or use the command-line interface. The requirements are specific: PHP 8.1 or later with extensions like cURL, DOM, JSON, XML, session, and ctype. For databases, you need PostgreSQL 10+, SQLite, MariaDB 10.6+, or MySQL 8.0+. Advanced configuration lives in config.default.php, and you modify the generated data/config.php. The README also advises enabling AllowEncodedSlashes in Apache for better mobile client compatibility. These steps are clear but require a server administrator's attention.

A Genuine Limitation: Basic Scraping and Maintenance Burden

The XPath scraping is explicitly described as 'basic' in the README. That means it is not a general-purpose scraping tool. It will fail on sites with dynamic content loaded via JavaScript, because the fetcher only sees the initial HTML. It also breaks when a site's layout changes; you would have to update the XPath queries manually. The documentation does not mention any built-in scheduler for scraping intervals, so you rely on the feed update cycle. For sites that change frequently or use complex structures, this is the wrong tool. Another limitation is that the README warns about exposing the data folder, but it does not provide a detailed security hardening guide beyond that. The burden of maintaining scrapers falls entirely on the administrator.

Maintenance and Upgrade Cost

FreshRSS releases a new version every two to three months, according to the README. That means regular upgrades are part of the maintenance cycle. The project also maintains an 'edge' branch for rolling releases, which is useful for testers but not for production. The upgrade process is not described in the README, but the release cadence implies you must plan for updates. The code is licensed under AGPL-3.0, which has implications if you modify and distribute the software: you must share your changes under the same license. For internal use, this is not a concern. The documentation mentions a CLI, which can help with maintenance tasks like import/export, but the README does not detail all commands. The database requirements are version-specific, so you must keep your database up to date to match FreshRSS's support.

Comparison with Alternatives: Different Approaches to Scraping

A common alternative to FreshRSS is a hosted feed reader like Feedly or Inoreader. These services provide scraping as a built-in feature, often with automatic detection and a user-friendly interface for creating custom feeds. The key difference is that they are not self-hosted, so you give up control over your data and rely on their infrastructure. Another alternative is a dedicated scraping tool like Huginn or a custom script using Python's BeautifulSoup. Huginn is an automation platform that can scrape and aggregate, but it is heavier and more complex to set up. FreshRSS's advantage is that it combines aggregation and scraping in one lightweight PHP app. The trade-off is that its scraping is simplistic compared to a dedicated tool. If your scraping needs are extensive, you would be better off with a purpose-built scraper that can handle JavaScript rendering and complex selectors.

Who Should Adopt FreshRSS and What to Verify First

FreshRSS is a strong fit for users who want a self-hosted aggregator with a small footprint. The README claims it runs on a Raspberry Pi 1 with under a second response time for 150 feeds and 22,000 articles, which is a concrete performance indicator. It is also suitable for those who need multi-user support and are comfortable with PHP. Before adopting, verify that your server meets the PHP and database requirements. Test the XPath scraping on the specific sites you care about, because the documentation warns it is basic. Check whether the sites you want to scrape use JavaScript, as that will likely fail. Also confirm that you can expose only the ./p/ folder, because the data folder contains personal information. If you are not prepared to maintain XPath queries and handle regular upgrades, FreshRSS may not be the right choice.

Editorial conclusion

Adopt FreshRSS if you want a self-hosted, multi-user aggregator with a low server footprint and are willing to configure XPath scrapers for feedless sites. Avoid it if you need automated, robust scraping without manual per-site work, or if your team lacks PHP administration skills. Before deploying, verify that your database (PostgreSQL, SQLite, MySQL, or MariaDB) meets the version requirements and that you can expose only the ./p/ folder to the web. Also test the XPath scraping on your target sites, because it only handles simple HTML structures and JSON documents, and it may break when sites change their markup.

Official sources

1. Official documentation
2. Official README
3. Project repository
4. Release notes