LesLibres.org/Rss-Bridge
2
0
Fork 0
Code Issues Pull requests Releases Wiki Activity
Fork de https://github.com/RSS-Bridge/rss-bridge
1787 commits 2 branches 0 tags 9.4 MiB
PHP 98.9%
CSS 0.6%
JavaScript 0.5%
Find a file
ORelio de8cee6a1c Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 
* Debug mode improvements

 - Improve debug warning message
 - Restore error reporting in debug mode
 - Fix 'notice' messages for unset fields

* Add parsing utility functions

html.php
 - extractFromDelimiters
 - stripWithDelimiters
 - stripRecursiveHTMLSection
 - markdownToHtml (partial)

bridges
 - remove now-duplicate functions
 - call functions from html.php instead

* [Anidex] New bridge

Anime torrent tracker

* [Anime-Ultime] Restore thumbnail

* [CNET] Recreate bridge

Full rewrite as the previous one was broken

* [Dilbert] Minor URI fix

Use new self::URI property

* [EstCeQuonMetEnProd] Fix content extraction

Bridge was broken

* [Facebook] Fix "SpSonsSoriSsés" label

... which was taking space in item title

* [Futura-Sciences] Use HTTPS, More cleanup

Use HTTPS as FS now offer HTTPS
Clean additional useless HTML elements

* [GBATemp] Multiple fixes

- Fix categories: missing "break" statements
- Restore thumbnail as enclosure
- Fix date extraction
- Fix user blog post extraction
- Use getSimpleHTMLDOMCached

* [JapanExpo] Fix bridge, HTTPS, thumbnails

- Fix getSimpleHTMLDOMCached call
- Upgrade to HTTPS as JE now offers HTTPS
- Restore thumbnails as enclosures

* [LeMondeInformatique] Fix bridge, HTTPS

- Upgrade to HTTPS as LMI now offers HTTPS
- Restore thumbnails using small images
- Fix content extraction
- Fix text encoding issue

* [Nextgov] Fix content extraction

- Restore thumbnail and use small image
- Field extraction fixes

* [NextInpact] Add categories and filtering by type

- Offer all RSS feeds
- Allow filtering by article type
- Implement extraction for brief articles
- Remove article limit, many brief articles are publied all at once

* [NyaaTorrents] New bridge

Anime torrent tracker

* [Releases3DS] Cache content, restore thumbnail

- Use getSimpleHTMLDOMCached
- Restore thumbnail as enclosure

* [TheHackerNews] Fix bridge

 - Fix content extraction including article body
 - Restore thumbnail as enclosure

* [WeLiveSecurity] HTTPS, Fix content extraction

- Upgrade to HTTPS as WLS now offers HTTPS
- Fix content extraction including article body

* [WordPress] Reduce timeout, more content selectors

- Reduce timeout to use default one (1h)
- Add new content selector (articleBody)
- Find thumbnail and set as enclosure
- Fix <script> cleanup

* [YGGTorrent] Increase limit, use cache

- Increase item limit as uploads are very frequent
- Use getSimpleHTMLDOMCached

* [ZDNet] Rewrite with FeedExpander

- Upgrade to HTTPS as ZD now offers HTTPS
- Use FeedExpander for secondary fields
- Fix content extraction for article body

* [Main] Handle MIME type for enclosures

Many feed readers will ignore enclosures (e.g. thumbnails) with no MIME type. This commit adds automatic MIME type detection based on file extension (which may be inaccurate but is the only way without fetching the content).

One can force enclosure type using #.ext anchor (hacky, needs improving)

* [FeedExpander] Improve field extraction

- Add support for passing enclosures
- Improve author and uri extraction
- Fix 'notice' PHP error messages

* [Pull] Coding style fixes for #802

* [Pull] Implementing changes for #802

 - Fix coding style issues with str append
 - Remove useless CACHE_TIMEOUT
 - Use count() instead of $limit
 - Use defaultLinkTo() + handle strings
 - Use http_build_query()
 - Fix missing </em>
 - Remove error_reporting(0)
 - warning CSS (@LogMANOriginal)
 - Fix typo in FeedExpander comment

* [Main] More documentation for markdownToHtml

See #802 for more details
2018-09-09 20:20:13 +01:00
bridges Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
cache PHP settings 2016-11-05 21:33:31 +01:00
caches [FileCache] reseting cached file stat result to have correct getTime() result (#792) 2018-08-25 20:00:51 +01:00
formats Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
lib Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
static Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
tests tests: reuse RssBridge.php instead of implementing a custom solution 2018-08-10 15:33:32 +02:00
vendor [core] Add urljoin (#756) 2018-08-02 06:31:56 +02:00
.dockerignore Add dockerfile to create an official docker image (#720) 2018-06-23 16:51:48 +02:00
.gitattributes First commit 2013-08-06 23:57:22 +02:00
.gitignore Add user config (#653) 2018-05-29 11:52:17 +02:00
.travis.yml [tests] Add unit test for bridge implementation 2018-08-09 17:04:16 +02:00
CHANGELOG.md [CHANGELOG] Add 2017-08-19 2017-08-19 21:08:44 +02:00
config.default.ini.php Add basic authentication support (#728) 2018-06-27 19:09:41 +02:00
CONTRIBUTING.md Add contribution guidelines. 2017-03-07 11:46:54 +00:00
Dockerfile Add dockerfile to create an official docker image (#720) 2018-06-23 16:51:48 +02:00
index.php Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
phpcs.xml [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
phpunit.xml [tests] Add unit test for bridge implementation 2018-08-09 17:04:16 +02:00
README.md [README] Add a "Deploy to Cloud" button for Docker 2018-08-21 18:40:39 +02:00
scalingo.json Typo 2016-08-02 23:37:01 +02:00
UNLICENSE let's unlicense ! 2014-05-21 20:11:01 +02:00

README.md

rss-bridge

LICENSE GitHub release Build Status Docker Build Status

rss-bridge is a PHP project capable of generating ATOM feeds for websites which don't have one.

Supported sites/pages (main)

  • Bandcamp : Returns last release from bandcamp for a tag
  • Cryptome : Returns the most recent documents from Cryptome.org
  • DansTonChat: Most recent quotes from danstonchat.com
  • DuckDuckGo: Most recent results from DuckDuckGo.com
  • Facebook : Returns the latest posts on a page or profile on Facebook
  • FlickrExplore : Latest interesting images from Flickr
  • GooglePlus : Most recent posts of user timeline
  • GoogleSearch : Most recent results from Google Search
  • Identi.ca : Identica user timeline (Should be compatible with other Pump.io instances)
  • Instagram: Most recent photos from an Instagram user
  • OpenClassrooms: Lastest tutorials from fr.openclassrooms.com
  • Pinterest: Most recent photos from user or search
  • ScmbBridge: Newest stories from secouchermoinsbete.fr
  • ThePirateBay : Returns the newest indexed torrents from The Pirate Bay with keywords
  • Twitter : Return keyword/hashtag search or user timeline
  • Wikipedia: highlighted articles from Wikipedia in English, German, French or Esperanto
  • YouTube : YouTube user channel, playlist or search

Plus many other bridges to enable, thanks to the community

Output format

Output format can take several forms:

  • Atom : ATOM Feed, for use in RSS/Feed readers
  • Html : Simple html page.
  • Json : Json, for consumption by other applications.
  • Mrss : MRSS Feed, for use in RSS/Feed readers
  • Plaintext : raw text (php object, as returned by print_r)

Screenshot

Welcome screen:

Screenshot

RSS-Bridge hashtag (#rss-bridge) search on Twitter, in ATOM format (as displayed by Firefox):

Screenshot

Requirements

  • PHP 5.6, e.g. AddHandler application/x-httpd-php56 .php in .htaccess
  • openssl extension enabled in PHP config (php.ini)
  • curl extension enabled in PHP config (php.ini)

Enabling/Disabling bridges

By default, the script creates whitelist.txt and adds the main bridges (see above). whitelist.txt is ignored by git, you can edit it:

  • to enable extra bridges (one bridge per line)
  • to disable main bridges (remove the line)
  • to enable all bridges (just one wildcard * as file content)

New bridges are disabled by default, so make sure to check regularly what's new and whitelist what you want!

Deploy

Deploy on Scalingo Deploy to Docker Cloud

Authors

We are RSS Bridge Community, a group of developers continuing the project initiated by sebsauvage, webmaster of sebsauvage.net, author of Shaarli and ZeroBin.

Patch/contributors :

Licenses

Code is Public Domain.

Including PHP Simple HTML DOM Parser under the MIT License

Technical notes

  • There is a cache so that source services won't ban you even if you hammer the rss-bridge with requests. Each bridge can have a different duration for the cache. The cache subdirectory will be automatically created and cached objects older than 24 hours get purged.
  • To implement a new Bridge, follow the specifications and take a look at existing Bridges for examples.
  • To enable debug mode (disabling cache and enabling error reporting), create an empty file named DEBUG in the root directory (next to index.php).
  • For more information refer to the Wiki

Rant

Dear so-called "social" websites.

Your catchword is "share", but you don't want us to share. You want to keep us within your walled gardens. That's why you've been removing RSS links from webpages, hiding them deep on your website, or removed feeds entirely, replacing it with crippled or demented proprietary API. FUCK YOU.

You're not social when you hamper sharing by removing feeds. You're happy to have customers creating content for your ecosystem, but you don't want this content out - a content you do not even own. Google Takeout is just a gimmick. We want our data to flow, we want RSS or ATOM feeds.

We want to share with friends, using open protocols: RSS, ATOM, XMPP, whatever. Because no one wants to have your service with your applications using your API force-feeding them. Friends must be free to choose whatever software and service they want.

We are rebuilding bridges you have wilfully destroyed.

Get your shit together: Put RSS/ATOM back in.