Rss-Bridge/bridges
ORelio de8cee6a1c Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802)
* Debug mode improvements

 - Improve debug warning message
 - Restore error reporting in debug mode
 - Fix 'notice' messages for unset fields

* Add parsing utility functions

html.php
 - extractFromDelimiters
 - stripWithDelimiters
 - stripRecursiveHTMLSection
 - markdownToHtml (partial)

bridges
 - remove now-duplicate functions
 - call functions from html.php instead

* [Anidex] New bridge

Anime torrent tracker

* [Anime-Ultime] Restore thumbnail

* [CNET] Recreate bridge

Full rewrite as the previous one was broken

* [Dilbert] Minor URI fix

Use new self::URI property

* [EstCeQuonMetEnProd] Fix content extraction

Bridge was broken

* [Facebook] Fix "SpSonsSoriSsés" label

... which was taking space in item title

* [Futura-Sciences] Use HTTPS, More cleanup

Use HTTPS as FS now offer HTTPS
Clean additional useless HTML elements

* [GBATemp] Multiple fixes

- Fix categories: missing "break" statements
- Restore thumbnail as enclosure
- Fix date extraction
- Fix user blog post extraction
- Use getSimpleHTMLDOMCached

* [JapanExpo] Fix bridge, HTTPS, thumbnails

- Fix getSimpleHTMLDOMCached call
- Upgrade to HTTPS as JE now offers HTTPS
- Restore thumbnails as enclosures

* [LeMondeInformatique] Fix bridge, HTTPS

- Upgrade to HTTPS as LMI now offers HTTPS
- Restore thumbnails using small images
- Fix content extraction
- Fix text encoding issue

* [Nextgov] Fix content extraction

- Restore thumbnail and use small image
- Field extraction fixes

* [NextInpact] Add categories and filtering by type

- Offer all RSS feeds
- Allow filtering by article type
- Implement extraction for brief articles
- Remove article limit, many brief articles are publied all at once

* [NyaaTorrents] New bridge

Anime torrent tracker

* [Releases3DS] Cache content, restore thumbnail

- Use getSimpleHTMLDOMCached
- Restore thumbnail as enclosure

* [TheHackerNews] Fix bridge

 - Fix content extraction including article body
 - Restore thumbnail as enclosure

* [WeLiveSecurity] HTTPS, Fix content extraction

- Upgrade to HTTPS as WLS now offers HTTPS
- Fix content extraction including article body

* [WordPress] Reduce timeout, more content selectors

- Reduce timeout to use default one (1h)
- Add new content selector (articleBody)
- Find thumbnail and set as enclosure
- Fix <script> cleanup

* [YGGTorrent] Increase limit, use cache

- Increase item limit as uploads are very frequent
- Use getSimpleHTMLDOMCached

* [ZDNet] Rewrite with FeedExpander

- Upgrade to HTTPS as ZD now offers HTTPS
- Use FeedExpander for secondary fields
- Fix content extraction for article body

* [Main] Handle MIME type for enclosures

Many feed readers will ignore enclosures (e.g. thumbnails) with no MIME type. This commit adds automatic MIME type detection based on file extension (which may be inaccurate but is the only way without fetching the content).

One can force enclosure type using #.ext anchor (hacky, needs improving)

* [FeedExpander] Improve field extraction

- Add support for passing enclosures
- Improve author and uri extraction
- Fix 'notice' PHP error messages

* [Pull] Coding style fixes for #802

* [Pull] Implementing changes for #802

 - Fix coding style issues with str append
 - Remove useless CACHE_TIMEOUT
 - Use count() instead of $limit
 - Use defaultLinkTo() + handle strings
 - Use http_build_query()
 - Fix missing </em>
 - Remove error_reporting(0)
 - warning CSS (@LogMANOriginal)
 - Fix typo in FeedExpander comment

* [Main] More documentation for markdownToHtml

See #802 for more details
2018-09-09 20:20:13 +01:00
..
ABCTabsBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
AcrimedBridge.php links: Rename defaultImageSrcTo to defaultLinkTo 2017-02-18 13:41:45 +01:00
AllocineFRBridge.php Update saisons AllocineFRBridge 2017-10-16 22:24:49 -04:00
AmazonBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
AmazonPriceTrackerBridge.php [AmazonPriceTrackerBridge] Improve Amazon scraper logic (#761) 2018-07-31 21:44:37 +02:00
AnidexBridge.php Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
AnimeUltimeBridge.php Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
Arte7Bridge.php bridges: Fix bridges with custom headers and options 2018-04-06 20:42:19 +02:00
AskfmBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
BandcampBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
BastaBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
BlaguesDeMerdeBridge.php [BlaguesDeMerdeBridge] Adjust to layout changes 2018-08-10 21:08:47 +02:00
BloombergBridge.php Initial commit for Bloomberg bridge with top stories and search (#607) 2018-01-12 12:08:15 +00:00
BooruprojectBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
CastorusBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
ChristianDailyReporterBridge.php Add ChristianDailyReporterBridge (#697) 2018-05-29 11:28:22 +02:00
CNETBridge.php Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
CollegeDeFranceBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
CommonDreamsBridge.php bridges: Fix coding styles 2017-02-12 15:34:08 +01:00
ContainerLinuxReleasesBridge.php bridges: Fix bridges failing unit test 2018-08-09 17:04:16 +02:00
CopieDoubleBridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
CourrierInternationalBridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
CryptomeBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
DailymotionBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
DanbooruBridge.php [DanbooruBridge] Fix bridge 2018-08-09 21:55:43 +02:00
DansTonChatBridge.php DansTonChatBridge: test before accessing plaintext 2018-04-19 21:00:18 +02:00
DauphineLibereBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
DealabsBridge.php bridges: Fix bridges failing unit test 2018-08-09 17:04:16 +02:00
DemoBridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
DemonoidBridge.php Rewrote DemonoidBridge. Fixes #626. 2018-04-17 15:25:02 +02:00
DeveloppezDotComBridge.php bridges: Fix coding styles 2017-02-12 15:34:08 +01:00
DiceBridge.php Adding DiceBridge.php 2017-04-23 19:19:50 -05:00
DilbertBridge.php Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
DiscogsBridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
DollbooruBridge.php bridges: Fix coding styles 2017-02-12 15:34:08 +01:00
DribbbleBridge.php [DribbbleBridge] Add dribble bridge listing last dribble popular shots (#558) 2017-08-06 20:29:21 +02:00
DuckDuckGoBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
EliteDangerousGalnetBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
ElloBridge.php bridges: Fix bridges failing unit test 2018-08-09 17:04:16 +02:00
ElsevierBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
EstCeQuonMetEnProdBridge.php Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
EtsyBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
ETTVBridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
EZTVBridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
FacebookBridge.php Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
FB2Bridge.php bridges: Fix bridges failing unit test 2018-08-09 17:04:16 +02:00
FDroidBridge.php [FDroid] minor fixes for Travis CI 2018-04-15 13:21:48 +02:00
FeedExpanderExampleBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
FierPandaBridge.php [FierPandaBridge] Fix bridge 2018-07-21 18:07:03 +02:00
FilterBridge.php bridges: Fix bridges failing unit test 2018-08-09 17:04:16 +02:00
FlickrBridge.php [FlickrBridge] Fix missing scheme for image URLs 2018-07-23 20:14:46 +02:00
FootitoBridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
ForGifsBridge.php [ForGifsBridge] Fix permissions of ForGifsBridge 2018-09-09 17:34:36 +01:00
FourchanBridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
FuturaSciencesBridge.php Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
GBAtempBridge.php Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
GelbooruBridge.php [GelbooruBridge] Fix bridge not getting tags correctly 2017-08-05 22:38:24 +02:00
GiphyBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
GitHubGistBridge.php [GitHubGistBridge] Add new bridge 2018-07-29 16:31:47 +02:00
GithubIssueBridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
GithubSearchBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
GizmodoBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
GoComicsBridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
GOGBridge.php [GOGBridge] Added bridge for GOG.com 2018-09-09 17:32:36 +01:00
GooglePlusPostBridge.php [GooglePlusPostBridge] Fix title is empty if content is too short 2018-09-08 17:07:57 +02:00
GoogleSearchBridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
GrandComicsDatabaseBridge.php [GrandComicsDatabaseBridge] Fix links in content (#804) 2018-09-08 11:12:27 +01:00
HDWallpapersBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
HentaiHavenBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
HotUKDealsBridge.php [DealabsBridge] First version of the generic "Pepper" Bridge (#726) 2018-07-13 00:35:13 +01:00
IdenticaBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
InstagramBridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
InstructablesBridge.php [InstructableBridge] Add new bridge (#724) 2018-07-21 15:25:13 +02:00
IPBBridge.php [IPBBridge] Use limit for the number of items 2018-04-06 22:25:49 +02:00
JapanExpoBridge.php Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
JustETFBridge.php [JustETFBridge] Add new bridge 2018-06-30 10:27:05 +02:00
KATBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
KernelBugTrackerBridge.php [KernelBugTrackerBridge] Fix too many parameters requesting HTML DOM 2018-04-06 20:42:19 +02:00
KonachanBridge.php bridges: Fix coding styles 2017-02-12 15:34:08 +01:00
KoreusBridge.php bridges: Fix coding styles 2017-02-12 15:34:08 +01:00
KununuBridge.php [KununuBridge] Fix broken page layout and sort reviews 2018-06-30 10:27:05 +02:00
LeBonCoinBridge.php Add fields to leboncoin bridge (#783) 2018-08-31 14:34:41 +01:00
LegifranceJOBridge.php Update LegifranceJOBridge.php 2018-01-09 14:57:17 +01:00
LeMondeInformatiqueBridge.php Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
LesJoiesDuCodeBridge.php [LesJoiesDuCode] Switch to HTTPS and remove author (#787) 2018-08-21 17:41:56 +02:00
LichessBridge.php bridges: Fix coding styles 2017-02-12 15:34:08 +01:00
LinkedInCompanyBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
LolibooruBridge.php bridges: Fix coding styles 2017-02-12 15:34:08 +01:00
LWNprevBridge.php [LWNprevBridge] Fix everchanging url 2017-08-05 15:56:35 +02:00
MangareaderBridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
MilbooruBridge.php bridges: Fix coding styles 2017-02-12 15:34:08 +01:00
MixCloudBridge.php Update MixCloudBridge.php 2018-01-11 11:44:51 +00:00
MoebooruBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
MoinMoinBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
MondeDiploBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
MsnMondeBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
MspabooruBridge.php bridges: Fix coding styles 2017-02-12 15:34:08 +01:00
MydealsBridge.php [DealabsBridge] First version of the generic "Pepper" Bridge (#726) 2018-07-13 00:35:13 +01:00
NasaApodBridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
NeuviemeArtBridge.php Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
NextgovBridge.php Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
NextInpactBridge.php Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
NiceMatinBridge.php bridges: Fix coding styles 2017-02-12 15:34:08 +01:00
NotAlwaysBridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
NovelUpdatesBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
NyaaTorrentsBridge.php Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
OpenClassroomsBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
ParuVenduImmoBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
PcGamerBridge.php apply phpcbf for automatic style fixes 2017-12-24 16:45:56 -05:00
PickyWallpapersBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
PinterestBridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
PixivBridge.php Fixed timestamp on Pixiv bridge (#785) 2018-08-18 16:54:24 -03:00
RadioMelodieBridge.php [RadioMelodieBridge] Add new bridge (#640) 2018-03-11 15:38:07 +01:00
RainbowSixSiegeBridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
ReadComicsBridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
Releases3DSBridge.php Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
ReporterreBridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
RTBFBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
Rue89Bridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
Rule34Bridge.php bridges: Fix coding styles 2017-02-12 15:34:08 +01:00
Rule34pahealBridge.php bridges: Fix coding styles 2017-02-12 15:34:08 +01:00
SafebooruBridge.php bridges: Fix coding styles 2017-02-12 15:34:08 +01:00
SakugabooruBridge.php bridges: Fix coding styles 2017-02-12 15:34:08 +01:00
ScmbBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
ScoopItBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
SensCritiqueBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
SexactuBridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
ShanaprojectBridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
Shimmie2Bridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
SkimfeedBridge.php [SkimfeedBridge] Add new bridge 2018-07-27 23:18:32 +02:00
SoundcloudBridge.php Changed the API key used for SoundCloud bridge. Should fix #599 2018-04-17 14:24:00 +02:00
SteamBridge.php Fix SteamBridge (#637) (#639) 2018-03-12 09:22:34 +00:00
StripeAPIChangeLogBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
SuperbWallpapersBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
SuperSmashBlogBridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
SupInfoBridge.php bridges: Fix bridges failing unit test 2018-08-09 17:04:16 +02:00
TagBoardBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
TbibBridge.php bridges: Fix coding styles 2017-02-12 15:34:08 +01:00
TebeoBridge.php fix: TébéoBridge Travis cleanup 2018-02-11 19:08:19 +01:00
TheCodingLoveBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
TheHackerNewsBridge.php Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
ThePirateBayBridge.php [ThePirateBayBridge] Add instructions 2017-08-28 20:00:00 +02:00
TheTVDBBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
TwitterBridge.php Fix twitter list filter test #613, fix and change getName() for lists. (#614) 2018-01-12 12:07:40 +00:00
UnsplashBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
UsbekEtRicaBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
ViadeoCompanyBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
VkBridge.php bridges: Fix bridges failing unit test 2018-08-09 17:04:16 +02:00
WallpaperStopBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
WebfailBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
WeLiveSecurityBridge.php Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
WhydBridge.php [phpcs] enforce single quotes (#732) 2018-06-29 22:55:33 +01:00
WikiLeaksBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
WikipediaBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
WordPressBridge.php Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
WordPressPluginUpdateBridge.php [phpcs] Add missing rules 2017-07-29 19:55:12 +02:00
WorldOfTanksBridge.php Mise à jour du bridge pour WorldOfTanks (#527) 2018-04-22 12:58:07 +02:00
XbooruBridge.php bridges: Fix coding styles 2017-02-12 15:34:08 +01:00
YandereBridge.php bridges: Fix coding styles 2017-02-12 15:34:08 +01:00
YGGTorrentBridge.php Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
YoutubeBridge.php [YoutubeBridge] Add duration limits for all modes 2018-07-21 14:33:07 +02:00
ZDNetBridge.php Catching up | [Main] Debug mode, parse utils, MIME | [Bridges] Add/Improve 20 bridges (#802) 2018-09-09 20:20:13 +01:00
ZenodoBridge.php Added RSS bridge for zenodo.org (#749) 2018-07-16 12:02:41 +02:00