Commit graph

2040 commits

Author SHA1 Message Date
logmanoriginal
2eec89ab27 [bridges] Change all bridges to use BridgeAbstract with getSimpleHTMLDOMCached 2016-09-10 19:11:09 +02:00
logmanoriginal
7b5e367678 [travis] Allow hhvm and nightly to fail 2016-09-10 19:10:42 +02:00
logmanoriginal
9f2dd48684 [BridgeAbstract] Add getSimpleHTMLDOMCached
This function is a copy of the get_cached function from
HttpCachingBridgeAbstract, adding all parameters of
getSimpleHTMLDOM in order to replace the need of
HttpCachingBridgeAbstract entirely
2016-09-10 19:04:01 +02:00
logmanoriginal
a726f73afe Merge branch 'fixIndividualBridges' of https://framagit.org/peetah/rss-bridge 2016-09-10 18:53:19 +02:00
Pierre Mazière
bf8214e3dd [GithubIssueBridge] add getURI() and getName()
Signed-off-by: Pierre Mazière <pierre.maziere@gmx.com>
2016-09-10 11:44:55 +02:00
Pierre Mazière
73b4aea084 [GithubIssueBridge]: fix collecting issue comments
Signed-off-by: Pierre Mazière <pierre.maziere@gmx.com>
2016-09-10 11:44:18 +02:00
logmanoriginal
33584b8423 [HttpCachingBridgeAbstract] General cleanup
- Remove buildCacheFilePath -> Single use, so no real purpose
- Simplify debug messages
- Cleanup documentation
2016-09-10 00:34:25 +02:00
logmanoriginal
3a94956915 [bridges] Remove calls to get_cached and remove_from_cache 2016-09-10 00:19:24 +02:00
logmanoriginal
3a92a1e04b [HttpCachingBridgeAbstract] Remove get_cached_time and remove_from_cache
Bridges no longer require to check cache file durations
manually as get_cached now supports the duration parameter
2016-09-10 00:09:10 +02:00
logmanoriginal
1a2a48e129 [HttpCachingBridgeAbstract] Use sha1 cache file names
Previously folder hierarchies were created based on the input URL
which could result in very deep folder structures. Using SHA1 file
names also allows to check for old files more effectively (via
fileatime)
2016-09-10 00:00:10 +02:00
logmanoriginal
ce00c6f869 [HttpCachingBridgeAbstract] Don't pass cache directory as parameter 2016-09-09 22:23:40 +02:00
logmanoriginal
84956c4daf [HttpCachingBridgeAbstract] Add duration parameter to 'get_cached'
This allows to specify the cache duration for a specific
url without the need to delete the cache file first.
Instead the cache file is automatically deleted if the
duration elapsed.
2016-09-09 22:23:15 +02:00
logmanoriginal
9711e87fc9 Merge branch 'fixIndividualBridges' of https://framagit.org/peetah/rss-bridge 2016-09-09 21:03:42 +02:00
Mitsu
8c71a35771 [README] fix the required PHP version
Code requirements have changed, see issue #390
2016-09-09 18:03:36 +02:00
Pierre Mazière
c383f8697a [InstagramBridge] fix item url
Signed-off-by: Pierre Mazière <pierre.maziere@gmx.com>
2016-09-06 08:41:43 +02:00
logmanoriginal
579d13462f Merge branch 'FeedExpander' of https://github.com/logmanoriginal/rss-bridge 2016-09-05 20:27:45 +02:00
logmanoriginal
2861a855e4 [bridges] Define max items and clear caches 2016-09-05 20:26:45 +02:00
logmanoriginal
f1fb527607 [FeedExpander] Add optional parameter to specify max items
Allows caller of collectExpandableDatas to request a limited
amount of items
2016-09-05 20:17:00 +02:00
logmanoriginal
179e73fb80 [bridges] Change to extend from FeedExpander 2016-09-05 20:10:19 +02:00
logmanoriginal
11be7ccb60 Merge branch 'FileSplitting' of https://github.com/logmanoriginal/rss-bridge 2016-09-05 18:06:20 +02:00
logmanoriginal
298dc49c67 [lib] Split Bridge/Cache/Format into one file per class
The files have grown to a size where it is necessary to search
for a class in a file. This commit splits the content into one
file per class. RSS-Bridge will require implementations and
the implementations will require (once) the interfaces.
2016-09-05 18:05:19 +02:00
logmanoriginal
d98bb25de6 Merge branch 'fixIndividualBridges' of https://framagit.org/peetah/rss-bridge 2016-09-05 17:31:26 +02:00
Pierre Mazière
a0dfbe6efd [AcrimedBridge] reapply code simplification
Signed-off-by: Pierre Mazière <pierre.maziere@gmx.com>
2016-09-04 14:58:25 +02:00
Pierre Mazière
3daeacc208 [VkBridge] use 'Group or user name' parameter instead of full URI
This breaks compatibility with previous versions of VkBridge (which
seems broken anyway).
Bridges should never use full URIs as inputs since their validation will
always be more complicated, hence prone to security issues,
than rebuilding a clean URI from simple validated inputs.
2016-09-04 14:43:10 +02:00
Pierre Mazière
0c139941d9 [NovelUpdatesBridge] use 'name' parameter instead of full URI
This breaks compatibility with previous versions of NoveUpdatesBridge.
Bridges should never use full URIs as inputs since their validation will
always be more complicated, hence prone to security issues,
than rebuilding a clean URI from simple validated inputs.

Signed-off-by: Pierre Mazière <pierre.maziere@gmx.com>
2016-09-04 14:43:10 +02:00
Pierre Mazière
d60220769e [FourChanBridge] fix relative links
Signed-off-by: Pierre Mazière <pierre.maziere@gmx.com>
2016-09-04 14:43:10 +02:00
Pierre Mazière
fec864e010 [FourchanBridge] use 'category' and 'thread' parameters instead of full URI
This breaks compatibility with previous versions of FourChanBridge.
Bridges should never use full URIs as inputs as their validation will
always be more complicated, hence prone to security issues,
than rebuilding a clean URI from simple validated inputs.

Signed-off-by: Pierre Mazière <pierre.maziere@gmx.com>
2016-09-04 14:43:10 +02:00
logmanoriginal
671703cd37 Merge branch 'FeedExpander' of https://github.com/logmanoriginal/rss-bridge 2016-09-04 13:51:19 +02:00
logmanoriginal
15f24b3cf4 [Acrimed] Use internal RSS 2.0 parser 2016-09-04 13:47:13 +02:00
logmanoriginal
acde8a2cea [Bridge] Support 'dc:date' for RSS 2.0 parser 2016-09-04 13:46:57 +02:00
logmanoriginal
778bbd8d85 [Freenews] Use internal RSS 2.0 parser 2016-09-04 13:38:21 +02:00
logmanoriginal
78050972f4 [Les400Culs] Use internal RSS 2.0 parser 2016-09-04 13:32:58 +02:00
logmanoriginal
88f52196b8 [bridges] Fix bridges extending RssExpander to FeedExpander 2016-09-04 13:28:55 +02:00
logmanoriginal
546c0036df [Bridge] Rename class RssExpander to FeedExpander
This class no is not RSS only anymore
2016-09-04 13:28:12 +02:00
logmanoriginal
878db6f96e [bridges] Rename 'parseRSSItem' to 'parseItem' 2016-09-04 13:26:40 +02:00
logmanoriginal
39788485ea [Bridge] Rename 'parseRSSItem' to 'parseItem' 2016-09-04 13:26:17 +02:00
logmanoriginal
e30ce8aea0 Merge branch 'fixIndividualBridges' of https://framagit.org/peetah/rss-bridge 2016-09-04 13:22:35 +02:00
logmanoriginal
cd361f8fc0 Merge branch 'ooruFusion' of https://framagit.org/peetah/rss-bridge 2016-09-04 13:17:48 +02:00
logmanoriginal
1de148bf5d [TheOatMeal] Use core parser functions 2016-09-04 13:17:28 +02:00
logmanoriginal
0770ca1ad1 [FeedExpanderExample] Add bridge to test behavior 2016-09-04 13:16:34 +02:00
logmanoriginal
149b64879e [Bridge] Support 'dc' namespace for RSS 1.0 2016-09-04 13:05:17 +02:00
logmanoriginal
8fa0b9660f [Bridge] Fix ATOM feed uri detection 2016-09-04 12:40:42 +02:00
logmanoriginal
bf20a2f687 [Bridge] Remove uneccesary debug message 2016-09-04 12:34:56 +02:00
logmanoriginal
51a3a75aac [Bridge] Add RSS 1.0 and 2.0 parser 2016-09-04 12:32:56 +02:00
logmanoriginal
f781965825 [Bridge] Add RSS 0.91 parser 2016-09-04 11:45:14 +02:00
logmanoriginal
0e5775012f [Bridge] Rename parameter 'name' to 'url' 2016-09-04 11:01:13 +02:00
Pierre Mazière
e7f2bf19f3 [bridges] Shimmie v2 based imageboards derive from DanbooruBridge
Signed-off-by: Pierre Mazière <pierre.maziere@gmx.com>
2016-09-04 01:27:58 +02:00
Pierre Mazière
fd6bcbbafe [Bridges] Moebooru and MyImouto based imageboards derive from MoebooruBridge
Signed-off-by: Pierre Mazière <pierre.maziere@gmx.com>
2016-09-04 01:27:58 +02:00
Pierre Mazière
8ae05a0241 [bridges] Gelbooru based imageboards derive form DanbooruBridge
Signed-off-by: Pierre Mazière <pierre.maziere@gmx.com>
2016-09-04 01:27:58 +02:00
Pierre Mazière
97926b839e [bridges] one bridge for technically different imageboard solutions
Danbooru serves HTML content while Moebooru send content in JSON format

Signed-off-by: Pierre Mazière <pierre.maziere@gmx.com>
2016-09-04 01:27:58 +02:00