Commit graph

2527 commits

Author SHA1 Message Date
logmanoriginal
d7ff8b9ac7 [TwitterBridge] Fix title includes anchors in plaintext format
The title attribute includes tags (anchors) instead of raw text.
While this works fine in a browser, using a raw format like plain-
text or json breaks with expected behavior.

This commit changes the order in which functions are applied. By re-
moving anchors AFTER fixing the title, the final result does not
include tags and the title is still fixed.

This bug was introduced by d81b61ccfa

References: #546
2017-07-05 18:42:03 +02:00
logmanoriginal
ab46af9719 [TwitterBridge] Avoid empty content caused by new login policy
Twitter now requires login to access "Tweets & Replies" which
breaks feeds using the default behavior. Using the "Without
replies" option still works.

This commit makes the "Without replies" option default. That way
existing feeds will return contents again. The parameter can still
be checked but its status has no effect anymore.

Notice: The parameter should not be removed as that would cause
any feed using the parameter to stop working because of "Invalid
parameter"

References #544
2017-07-03 19:53:18 +02:00
LogMANOriginal
06babeb644 Merge pull request #541 from Frenzie/filterbridge_real
[FilterBridge] Initial implementation of basic title permit and block
2017-07-03 19:15:28 +02:00
LogMANOriginal
341010b391 Merge pull request #535 from Frenzie/filterbridge
[FeedExpander] Deal with empty item
2017-07-03 19:13:12 +02:00
Frans de Jonge
995d78fa5a [FilterBridge] Initial implementation of basic title permit and block
See the comment https://github.com/RSS-Bridge/rss-bridge/issues/402#issuecomment-305982306

Split off from https://github.com/RSS-Bridge/rss-bridge/pull/535
2017-06-24 15:11:40 +02:00
Frans de Jonge
781e4f1908 [FeedExpander] Deal with empty item 2017-06-24 15:09:15 +02:00
logmanoriginal
ae59b20c0c [TwitterBridge] Fix double slashes in URI
This fixes double slashes in the feed URI (https://twitter.com//...
instead of https://twitter.com/...)

Reported via #538
2017-06-19 00:19:55 +02:00
logmanoriginal
d81b61ccfa [TwitterBridge] Fix missing spaces
This commit improves readability of tweets by adding spaces before
anchors in the text.

- Hide "invisible" tags which were not rendered hidden because of
missing CSS.
- Fix spacing between anchors

Reported via #539
2017-06-19 00:17:46 +02:00
Teromene
9c78362fd7 Warn when accessing a private page. 2017-06-15 11:51:11 +01:00
Teromene
18c6f0126f Fix FB2 bridge 2017-06-15 11:42:59 +01:00
LogMANOriginal
d5f47efcea Merge pull request #533 from Frenzie/patch-2
[RTBFBridge] Update URI
2017-05-28 20:37:11 +02:00
Frans de Jonge
601f61f063 [RTBFBridge] Update URI
A series URL still looks like: https://www.rtbf.be/auvio/emissions/detail?id=3553

But an individual episode has been changed from https://www.rtbf.be/auvio/emissions/detail?id=2217881 to https://www.rtbf.be/auvio/detail?id=2217881
2017-05-28 20:15:59 +02:00
logmanoriginal
8ed4812e00 [FacebookBridge] Add requester languages to HTTP header
If no accepted languages are specified Facebook will guess your
language. This guess can go horribly wrong if your server does not
provide origin information.

This adds a context header with language information when retrieving
page contents. The accepted languages are read from the list of
accepted languages specified by the web browser of the requester.

References #530
2017-05-07 13:27:37 +02:00
Teromene
f38db4d79e Merge pull request #528 from Jocker666z/patch-1
Update URI of t411 bridge
2017-05-04 12:30:18 +01:00
Jocker666z
88d1068406 update uri 2017-05-04 12:01:14 +02:00
logmanoriginal
627038e2fa [YoutubeBridge] Improve URL handling in video descriptions
This improves the translation of regular text to anchors by adding
support for additional characters '?&=-_' to fix common URLs.

Notice: The regex pattern is by no means complete. That means it is
likely to break in the future. More sophistiated solutions however
are insanely complex. See: http://stackoverflow.com/a/190405

References #520
2017-05-02 22:03:44 +02:00
logmanoriginal
5b541e380a [TwitterBridge] Optimize returned image sizes
Twitter provides an easy way to receive various image sizes based
on the same image URI:

https://dev.twitter.com/overview/api/entities-in-twitter-objects

We support different sizes: thumb, small, medium and large. The
media_url defaults to medium but you can retrieve the media in
different sizes by appending a colon + the size key (for example:
https://pbs.twimg.com/media/A7EiDWcCYAAZT1D.jpg:thumb).

-- Twitter Developer Documentation

TwitterBridge now makes use of this feature in order to provide
thumbnail images in the content and original sized images as
enclosures.

References #526
2017-05-02 21:45:26 +02:00
Mitsu
c375ddd6ab Merge pull request #521 from Frenzie/master
WikipediaBridge: fix French Wikipedia
2017-04-28 19:26:54 +02:00
Frans de Jonge
44c3110db0 WikipediaBridge: fix French Wikipedia 2017-04-28 19:15:23 +02:00
logmanoriginal
120e74c1b4 [YoutubeBridge] Improve readability of feed contents
Previously feed contents were rendered as one block of text with
no structure. This brings back the structure of original video
descriptions and makes links in the description work again.

References #520
2017-04-27 21:44:26 +02:00
LogMANOriginal
890ba69116 Merge pull request #518 from rogerdc/master
Adding DiceBridge.php
2017-04-25 21:59:57 +02:00
LogMANOriginal
d6da2ce406 Merge pull request #519 from sysadminstory/master
[AllocineFRBridge] Update Faux Raccord link
2017-04-25 21:48:48 +02:00
Gilles Maurer
0eb5711a68 [AllocineFRBridge] Update Faux Raccord link
This update the link to last season of the Show "Faux raccord"
2017-04-25 01:11:50 +02:00
rogerdc
a4ef42c2e9 Adding DiceBridge.php
Dice.com is a technology-oriented job search site. This bridge allows you to create RSS feeds for the jobs listed there.

Happy job hunting!
2017-04-23 19:19:50 -05:00
logmanoriginal
28331e7cd6 [BridgeAbstract] Return cached infos when using cached items
Re-requesting the same feed in normal mode (not debug mode)
returns the cached version. The name and URI of the feed
however was not returned.

This adds checks to getName() and getURI() in order to return
the cached infos when using the cached version.

Notice: For this to work correctly all bridges must call to
parent::getName() and parent::getURI() respectively if the
queriedContext is not defined. Example:

switch($this->queriedContext){
	case 'My context':
		// do your stuff here!
		break;
	default: parent::getName();
}
2017-04-23 21:06:25 +02:00
logmanoriginal
6eadc6ca6f [TwitterBridge] Show quotes and pictures
This adds new features to show quotes and pictures in feeds.

Quotes will show up on top of a tweet and are separated from
the quoting feed by a horizontal line.

Pictures that are embedded in the tweet will be captured and
attached to the feed using enclosures. By default the picture
will also be shown in the feed itself. This can be disabled
using the option '&noimg=on'

Some codes are now split into separate functions so they can be used
for tweets and quotes alike.
2017-04-22 16:01:00 +02:00
logmanoriginal
638d173b70 [PinterestBridge] Fix checkbox not working
Changed behaviour of the checkbox to use the custom parser when
active. That way if the parameter is missing the default value
applies and the feed returns from the provided RSS

Reported via #498
2017-04-10 14:34:45 +02:00
logmanoriginal
a9535797e6 [ShanaprojectBridge] Don't throw error if timestamp is missing 2017-04-10 13:38:02 +02:00
logmanoriginal
fc9084eb17 [MangareaderBridge] Fix double forward slashes
Double forward slashes caused all external links in the feed to break
2017-04-10 13:20:07 +02:00
logmanoriginal
e221358ead [FacebookBridge] Handle summary posts
Previously summary posts were ignored which resulted in the last
two posts not showing up in the feed (the latest two are shown in
the summary post).

Now summary posts are treated like regular posts, returning them
as part of the regular feed.

References #502, #505
2017-04-10 13:04:41 +02:00
logmanoriginal
2500d0df93 [PinterestBridge] Fix implementation after DOM changes
Due to breaking DOM changes this bridge required re-implementation.
With this fix the brige will make use of the JSON data embedded in
the returned HTML. The content returned for all contexts is similar
with only a few differences due to limitations of the JSON.

Feeds returned for a given username and board will by default make
use of the provided RSS feed instead of using the custom filter.
This bahaviour can be changed by setting the  optional parameter
'&r=off' (on by default)

Notice: The JSON data for userdata and search results is very
different, so two functions were implemented to account for that.

References #498
2017-04-09 23:38:35 +02:00
logmanoriginal
4124c707d4 [SexactuBridge] Fix typo 2017-04-09 21:44:05 +02:00
logmanoriginal
8e84b52152 [SexactuBridge] Fix URI and timestamp
* const DOMAIN is not supported, it must be const URI
* strtotime should be used instead of date_parse in order to
receive a valid integer
* Some small readability enhancement
2017-04-09 21:33:50 +02:00
Nicolas Delsaux
f3b6b264d3 [SexactuBridge] Use most modern version of bridge api and cached pages (#504)
Fixed #503 to use most modern version of bridge api and cached pages
2017-04-09 21:15:01 +02:00
logmanoriginal
360f9da072 [EtsyBridge] Add new bridge
This bridge generates feeds for a given search term, optionally
adds the picture to the content and allows for additional query
extensions (GET parameters) to be passed to the bridge. That
way custom filter can be applied without the need to reproduce
them in this bridge (they got a lot!)

Etsy provides a good set of feeds as described here:
https://www.etsy.com/help/article/100

(so there is no need to include them here)

References #492
2017-03-27 20:18:19 +02:00
logmanoriginal
e3b335b9ff [WikiLeaksBridge] Add new bridge
This bridge will fetch contents from https://wikileaks.org

Available options are:

- Category: Defines a list of categories to select from
- Show teaser: Defines whether to show the teaser or not

Notice: Feeds provided by WikiLeaks do not work, see
https://wikileaks.org/wiki/RSS

Closes #489
2017-03-26 17:58:26 +02:00
logmanoriginal
9acd30a5c5 [GooglePlusPostBridge] Autofix user names
User names can either be an ID (series of numbers), or an actual
name, where the name always starts with a '+'.

This commit adds a check for automatically fixing provided user
names which are missing the '+'.
2017-03-26 16:50:42 +02:00
logmanoriginal
3276d4e3d5 [GooglePlusPostBridge] Fix content loading
- Do not force language via HTTP header
The header enforced the language to be french which caused problems parsing
the exact time due to spellings (strtotime cannot work with 'semaines'). If
further issues are experienced try forcing en-us instead.
=> This should really be done in the RSS-Bridge core

- Fix loading problems due to pinned articles
Pinned articles do not provide a timestamp. Building the timestamp step-by-step
solves parsing errors.

- Use class names instead of CSS paths
CSS paths change based on the article. Pinned articles provide a different
DOM structure which caused parsing errors.

Reported via #499
2017-03-26 16:41:20 +02:00
Corentin Garcia
88586381e7 [GithubSearchBridge] Added github search bridge (#500)
* [GithubSearchBridge] Added github search bridge, only repos search atm
2017-03-25 11:24:00 +00:00
niawag
ebe897f120 Create KATBridge.php (#501)
Create KATBridge.php
2017-03-25 11:23:36 +00:00
Teromene
1a4c3f4418 Add a search bar to simplify looking for a bridge. (#494)
* Add a search bar to simplify looking for a bridge.

* Fix phpcs line length.

* Change the phpcs config.
2017-03-21 20:31:10 +00:00
Corentin Garcia
2ac0469750 Updated 4 bridges to use HTTPS (#497)
* [NextInpactBridge] Use https

* [InstagramBridge] Use https

* [GBAtempBridge] Use https

* [LeBonCoinBridge] Use https
2017-03-21 20:27:12 +00:00
Teromene
c0181d8d41 Merge pull request #496 from corenting/patch-2
[RainbowSixSiegeBridge] Added bridge for Rainbow Six Siege blog
2017-03-21 20:26:36 +00:00
Corentin Garcia
ea3073e27f
[RainbowSixSiegeBridge] Added bridge for Rainbow Six Siege blog 2017-03-20 21:32:31 +01:00
LogMANOriginal
20ea75994d Merge pull request #495 from corenting/patch-1
[NasaApodBridge] Use HTTPS instead of HTTP
2017-03-20 19:02:32 +01:00
Corentin Garcia
a84c245fa0 [NasaApodBridge] Use HTTPS instead of HTTP 2017-03-20 14:26:08 +01:00
logmanoriginal
b48a44c979 [UsbekEtRicaBridge] Add new bridge
Adds a new bridge to fetch contents from https://usbeketrica.com/
Feeds are build from cards displayed on the front page

This bridge provides two options:
- limit: Defines how many articles are returned
- fullarticle: Defines whether or not the full article is retured

Requested via #457
2017-03-19 14:32:59 +01:00
logmanoriginal
c6ce453c47 [MixCloudBridge] Fix bridge broken after DOM changed
This commit fixes DOM changes reported via #436
New DOM introduced via
https://blog.mixcloud.com/2017/01/10/take-a-look-at-the-new-and-improved-mixcloud/
2017-03-19 12:04:59 +01:00
logmanoriginal
bd92392921 [GooglePlusPostBridge] Fix bridge implementation
This bridge was broken due to DOM changes. This commit fixes
most of the broken code. Hashtags do no longer work because
they are no longer supported/provided.

The timing might be off as the source only provides a rough
relative value like '1 hour' or '1 year'.

Closes #485
2017-03-18 21:09:06 +01:00
Teromene
59025d96bc Add an indicator to show the HTTP status of the site. (#483) 2017-03-18 19:02:18 +00:00