LesLibres.org/Rss-Bridge
2
0
Fork 0
Code Issues Pull requests Releases Wiki Activity
572 commits 2 branches 0 tags 9.4 MiB
Commit graph

366 commits

Author SHA1 Message Date
Kevin Lagaisse
445568db27 Change url again & constant factorization 2016-01-26 18:39:05 +01:00
ORelio
d16d514736 [Facebook] Capcha retrieval and response submit 
This does not solve the captcha issue but allows the viewer to manually
solve the captcha by displaying a form and using the response from the
viewer. Maybe a first step to automated captcha solving?

This process relies on the use of a PHP session for storing captcha
details so that the user cannot submit anything else than the response
to the captcha. Response is filtered before being forwarded, also. Once
captcha is solved we get a page ready to be parsed, as usual.

Combined to some kind of OCR, this could automatically solve the
captcha, but currently if only automates the process of retrieving the
challenge and submitting the response.
 2016-01-23 21:53:25 +01:00
ORelio
1e998ab6dd [CNET] Update HTML parsing to reflect changes 
HTML parsing wasn't working anymore due to changes on CNET's website.
 2016-01-23 21:45:22 +01:00
logmanoriginal
e2043574f2 Remove content duplication 2016-01-22 20:14:03 +01:00
logmanoriginal
d1fe87651d Add items in reverse order (add to front) for correct ordering 2016-01-22 19:34:19 +01:00
logmanoriginal
182dcbec60 Encode special chars for feeds to work properly 2016-01-22 19:30:45 +01:00
logmanoriginal
621c7af6b7 Add title to inputs and improve descriptions 2016-01-21 21:49:23 +01:00
logmanoriginal
b5c7566b7a Merge branch 'master' into MangareaderBridge 2016-01-21 21:20:17 +01:00
logmanoriginal
4422024cfd Add new option to get popular updates 2016-01-20 22:01:45 +01:00
logmanoriginal
a73807130a Reduce parameter name to bare minimum 2016-01-20 20:56:09 +01:00
logmanoriginal
170818a625 Return entire chapter name as item title 2016-01-20 20:53:32 +01:00
logmanoriginal
0e1b84263e Return items starting at the end, not the beginning when working with limits 2016-01-19 21:41:14 +01:00
logmanoriginal
2e4e0077a8 Move date information into a time tag 2016-01-19 21:36:41 +01:00
Ginko-Aloe
195ba94115 Create JapanExpoBridge.php 2016-01-19 19:20:21 +01:00
Ginko-Aloe
438a389286 urlencode keyword parameter 
in order to handle non-trivial request keywords
 2016-01-19 18:04:35 +01:00
Mitsu
33c6495333 Merge pull request #194 from Albirew/patch-1 
TPB changed domain (again)
 2016-01-19 13:48:35 +01:00
Mitsu
79a610ea69 Merge pull request #195 from LogMANOriginal/TwitchApiBridge 
Clarify meaning of Broadcasts option in TwitchApiBridge
 2016-01-19 13:48:30 +01:00
Mitsu
31177912e0 Merge pull request #198 from teromene/rss-bridge-enclosures 
Rss bridge enclosures
 2016-01-19 13:45:23 +01:00
Teromene
4deefdfd7d Add enclosures support, see example in DemoBridge. 2016-01-19 12:34:38 +00:00
Teromene
379c89045b Quoted the "r" and "k" in the parameters 2016-01-19 12:15:16 +00:00
logmanoriginal
e6f388d6e4 Add new option to receive chapter updates for one specific manga 2016-01-16 16:30:29 +01:00
Albirew
6deebb56a5 changed TLD .ms -> .se 
On continue le jeu du chat et de la souris =)
 2016-01-15 18:20:30 +01:00
logmanoriginal
ff9c60f53c Use '/latest' instead of the main page to reduce loading time 2016-01-10 09:46:35 +01:00
logmanoriginal
2aba815b55 Implement new Bridge to mangareader.net 
This Bridge returns information about the last updates on mangareader.net
 2016-01-10 00:00:16 +01:00
logmanoriginal
29481c73c1 Clarify meaning of Broadcasts option 
Twitch returns Broadcasts when set to true, highlights otherwise. See also:
https://github.com/justintv/Twitch-API/blob/master/v3_resources/videos.md#get-channelschannelvideos
 2016-01-09 21:00:30 +01:00
Albirew
7e91186c6c TPB changed domain (again) 
TPB added .ms TLD and on the fly, .vg got down.
PS: .se TLD still exist.
 2016-01-09 10:23:19 +01:00
Mitsu
15021ebd78 Merge pull request #190 from ORelio/master 
[T411] Use search instead of RSS
 2015-12-24 02:17:44 +01:00
Paul Vayssiere
d885897c40 Desactivate auto play for Arte's links 
No need to use my bandwidth and processor if I just want to look at
more description
 2015-12-23 13:33:50 -08:00
ORelio
47a79f821a [T411] Use search instead of RSS 
Search isn't as severely rate limited as RSS
Search can enforce sorting to most recent entries
Bonus: Use a lower cache duration (1h instead of 3h)
 2015-12-17 22:31:12 +01:00
nkania
7d03d72708 Added a bridge for fier-panda.fr 2015-12-11 11:51:35 +01:00
Teromene
1a4a428449 Correction de quelques problèmes avec RSSExpander suite à la migration dans lib/Bridge. 
Correction de typos.
Ajout de la possibilité d'utiliser un proxy.
 2015-12-06 15:56:39 +01:00
Teromene
e582c887fb Ajout du paramètre pattern pour les entrées de type texte, ajout du required côté HTML. 
Correction de la page d'accueuil pour qu'elle soit conforme aux standards du W3C.
Correction de la regex de listage des fichiers pour qu'elle ignore les sauvegardes.
Ajout d'un nettoyeur HTML, par défaut.
 2015-12-06 15:56:39 +01:00
teromene
38829e7739 Little refactoring to reduce logic on index.php. 
Moved RssExpander as a core logic system to lib/Bridge.php

Signed-off-by: teromene <teromene@teromene.fr>
 2015-12-06 15:56:39 +01:00
teromene
80008f01f8 Updating a few bridges. 
Adding everybody to the contributors in README.md

Signed-off-by: teromene <teromene@teromene.fr>
 2015-12-06 15:56:39 +01:00
teromene
78c9dcc705 Last batch of bridges, all implemented ! 
Signed-off-by: teromene <teromene@teromene.fr>
 2015-12-06 15:56:39 +01:00
teromene
b3733069d4 3rd batch of bridges. 
Signed-off-by: teromene <teromene@teromene.fr>
 2015-12-06 15:56:39 +01:00
teromene
3cb652b812 Deuxième lot de bridges. 2015-12-06 15:56:39 +01:00
teromene
2d526f4e0a Correction de quelques bugs dans les bridges, qui apparaissent à cause du fait qu'ils sont tous instanciés lors du chargement de tout les bridges. 
Ré-ajout et ré-utilisation de getName et getURI, qui permettent d'avoir des élements dynamiques.
Changement en public de certaines valeurs.
Changement du nom de certaines constantes, déja utilisés.

Signed-off-by: teromene <teromene@teromene.fr>
 2015-12-06 15:56:39 +01:00
teromene
11ad75c7e6 Premier lot de bridges utilisant le premier système. 
Signed-off-by: teromene <teromene@teromene.fr>
 2015-12-06 15:56:39 +01:00
teromene
5d2e7ac83d Ajout d'options multiples pour les méta-données. 
Ajout d'un bridge de démonstration, DemoBridge.
Ajout d'un début de documentation pour créer un bridge dans CREATE_BRIDGE.md
 2015-12-06 15:56:39 +01:00
teromene
2deef45867 Première version du nouveau système de méta-données. 
Voir exemple dans YoutubeBridge.
 2015-12-06 15:56:39 +01:00
Mitsukarenai
e9e7a421ff (merge control) 2015-12-06 15:55:47 +01:00
Jeremy Benoist
b0305430c7 .pw just changed to .io 2015-11-06 22:49:40 +01:00
Hauke Schade
ffc01fa3bd added WikipediaDEBridge 2015-11-04 20:22:48 +01:00
Mitsukarenai
ba161b0b12 [Arte+7] remove-merge bridges, 2 lists for language selection 2015-10-31 13:26:56 +01:00
Mitsukarenai
b339f157c1 [WordOfTanks] add language select list 2015-10-30 18:37:01 +01:00
Mitsukarenai
871efdd5ce [TwitchApi] broadcast select list 2015-10-30 18:30:58 +01:00
Mitsukarenai
42fc08b93d [OpenClassrooms] fixed, list selection 2015-10-30 18:27:49 +01:00
Mitsukarenai
0eb7731481 [AnimeUltime ] add list selection 2015-10-30 18:03:55 +01:00
Mitsukarenai
182be9b575 [LeBonCoin] -oops- forgot keyword type 2015-10-30 17:49:46 +01:00
Mitsukarenai
60a82b52b7 [LeBonCoin] add region selection list 2015-10-30 17:45:10 +01:00
Mitsukarenai
3115cd8e3a [Arte+7] dropdown list for category selection 2015-10-30 12:38:52 +01:00
Mitsu
fcc072170c Merge pull request #156 from teromene/master 
Add support for list parameters
 2015-10-30 12:26:29 +01:00
Mitsukarenai
e1dac3abb3 [Arte] update bridges (new website) - fix #165 2015-10-30 11:26:49 +01:00
Mitsu
d90b118671 Merge pull request #164 from ORelio/master 
[Facebook] Convert textual emoticons to ASCII
 2015-10-26 17:00:19 +01:00
ORelio
b592f8ebbf [Facebook] Convert textual emoticons to ASCII 
Currently emoticons are retrived in textual form eg <i><u>smile
emoticon</u></i> which is not really visual... so let's convert them back
as ASCII emoticons eg ':)'. This works using a hardcoded table mapping
emoticon names to their visual representation, and the regular expression
match the two words because eg in french facebook will display
<i><u>émoticône smile</u></i> so we need to test both. Unknown emoticon
descriptions will be left as is.
 2015-10-24 20:14:12 +02:00
Mitsu
23f0fa3ed8 Merge pull request #163 from polo2ro/master 
Fix url for par vendu immo bridge
 2015-10-23 17:37:30 +02:00
Paul de Rosanbo
52bdc39948 Fix url for par vendu, remove variable to fix the unread status of items 
some rss clients (ex: liferea)
 2015-10-23 16:38:37 +02:00
Mitsu
a1b4414da3 Merge pull request #162 from ORelio/master 
FaceBook improvements, NextInpact notice fix
 2015-10-23 14:49:21 +02:00
ORelio
c8ef31bac6 [NextInpact] Fix php notice message 
For non-premium articles, a notice is generated because of trying to get
property from a non-object. Fixed that with a proper check using is_object
 2015-10-23 12:19:12 +02:00
ORelio
300b8bba9b [Facebook] More cleaning and bypass link redirect 
Remove a bunch of useless html node properties
Bypass all l.php facebook link redirections
Restore <u> and <i> basic formatting
 2015-10-23 12:18:55 +02:00
Mitsu
3780eb58bd Merge pull request #161 from ORelio/master 
Add AnimeUltime, CNET, LeMondeInformatique, Silicon, 3DSDB, T411
 2015-10-22 17:36:24 +02:00
ORelio
0051615b82 Fix some HTTP error codes (404->500) 2015-10-22 15:20:42 +02:00
ORelio
5c987b74d5 Update T411 domain name 2015-10-22 15:01:16 +02:00
ORelio
ea7c8cc314 Add T411 bridge 2015-10-22 14:57:33 +02:00
ORelio
44edc7fc22 Add 3DS Scene Releases bridge 2015-10-22 14:55:11 +02:00
ORelio
f036bff6b4 Add Silicon News bridge 2015-10-22 14:52:34 +02:00
ORelio
e7966dd102 Add Le Monde Informatique bridge 2015-10-22 14:52:15 +02:00
ORelio
24f3bb84d8 Add CNET News bridge 2015-10-22 14:51:56 +02:00
ORelio
e261c9a594 Add Anime Ultime bridge 2015-10-22 14:51:39 +02:00
Brice Maron
33dea43bcf [LesJoiesDuCode] decode html entities in title 2015-10-13 23:39:48 +02:00
Brice Maron
497d3fd7aa [LesJoiesDuCode] Fix markup detection 2015-10-13 23:28:38 +02:00
Mitsukarenai
85ebb70b74 [Numerama] Add author to feed output 2015-10-13 17:59:55 +02:00
Mitsukarenai
35ac1d76b2 [Numerama] fix undecoded entity on title 2015-10-13 00:37:55 +02:00
Mitsukarenai
c17fe0c898 [Numerama] change feed URL source 2015-10-12 20:47:53 +02:00
Mitsukarenai
01d6859f77 [Numerama] update bridge post extraction (issue #158) 2015-10-12 17:13:27 +02:00
Mitsu
36ba93eea3 Merge pull request #153 from ORelio/master 
Improve FaceBook, NextInpact, Wordpress bridges
 2015-09-20 17:03:15 +02:00
teromene
81f89b1246 Ajout de la possibilité d'avoir une liste en paramètre, voir exemple d'utilisation dans DauphineLibereBridge. 2015-09-14 13:59:20 +01:00
Mitsukarenai
c030d011d2 BooruProject: tighter param control | WorldOfTanks: URL format update 2015-09-12 20:00:26 +02:00
Mitsu
f643617cac Merge pull request #154 from kranack/master 
FIX Soundcloud Bridge
 2015-09-10 00:24:05 +02:00
Damien Calesse
2c18ee2d53 Fix cache duration for soundcloudBridge 2015-09-10 00:00:29 +02:00
Damien Calesse
91b1415e3d Fix Soundcloud bridge (remove var_dump and reset cache duration) 2015-09-09 00:15:01 +02:00
Damien Calesse
8edddcd97f Fix Soundcloud bridge (change client key, URI now use HTTPS and change URI according with soundcloud API) 2015-09-09 00:13:56 +02:00
ORelio
5b2c8e91d0 Improve Wordpress Bridge 
Retrieve post author
Retrieve post thumbnail
Retrieve title from <h2> if no <h1>
Minor code indentation fixes
 2015-09-05 14:42:57 +02:00
ORelio
8b9c40534b NextInpactBridge: Add mention for premium articles 
Add mention on article bottom (n% to discover)
Minor name fix: Nextinpact -> NextInpact
Further code indentation fixes
 2015-09-05 14:42:55 +02:00
ORelio
d7436c2d0a Improve Facebook Bridge 
Retrieve author display name from page title
Build short readable title using name and content
Convert relative links into absolute links
Remove attributes from </a> tags (may cause issues)
Remove onclick and onmouseover (javascript code)
Retrieve url of first image of post as thumnail
Use author avatar as thumnail if no first image
Use display name in feed name: name - Fb bridge
Minor code indent fixes and use simple quotes
 2015-09-05 14:42:54 +02:00
ORelio
80fe041f32 NextImpactBridge Improvements 
- Add subtitle
- Add news main image
- Add thumbnail rss field
- Add author rss field
- Minor code cleanup
 2015-09-04 18:11:04 +02:00
teromene
ee4d4d9603 Ajout du support des journaux de profils 2015-09-02 13:49:36 +02:00
teromene
7b9c180654 Ajout d'un bridge pour Courrier International. 2015-09-01 19:45:39 +02:00
teromene
9dfa1d6f25 Ajout d'une URI par post 2015-09-01 00:04:13 +02:00
teromene
7680b065b5 Modification de la durée du cache 2015-08-31 23:02:11 +02:00
teromene
221ac239e1 Ajout d'un bridge pour Facebook 2015-08-31 22:59:08 +02:00
GregThib
9f93656bf4 Anti-hotlinking was apparently disabled 
It seems that anti-hotlinking method (data-src + JS) was disabled on Rue89 site.
Because I'm not sure that modification is permanent, I put an "if" for testing it before replacement.
--> tested ok on my rssbridge instance. IMG are back.
 2015-08-07 16:30:42 +02:00
Mitsu
d39336525d Merge pull request #128 from Nyutag/master 
[new] ReporterreBridge
+ fixes [CADBridge] [CommonDreamsBridge]
 2015-07-30 11:59:53 +02:00
Mitsukarenai
d95f4024f5 [TheOatMeal] fixes 2015-07-30 11:57:26 +02:00
Mitsu
ce89ed0fc5 Merge pull request #136 from Riduidel/TheOatmeal 
[new] The oatmeal
 2015-07-30 11:42:21 +02:00
Mitsu
1678378bab [TwitchApi] Fix homepage link 2015-07-30 11:29:25 +02:00
Mitsu
9bf493cf92 Merge pull request #140 from LogMANOriginal/TwitchApiBridge 
[new] TwitchApiBridge
 2015-07-30 11:28:27 +02:00
GregThib
17e887631c AuthorName in the output (usefull for RSS readers) 
Add the Author's name in the output fields.
 2015-07-23 16:05:26 +02:00
logmanoriginal
1055fd4e8b Add TwitchApiBridge 2015-07-14 13:36:44 +02:00