RSS-Bridge: How to Extract Full Articles with several Images from a Website

[Dyxen07]

I want some websites in my Nextcloud News integration, but some of these don't support RSS. So I found out that this RSS-Bridge container can turn almost everything into an RSS feed with a good bridge. The basic idea is that I want to have the articles on https://kinocheck.de/news/archiv as an RSS feed with everything (title, subtitle, date, all images). One of the hardest parts is to get every image and display them. Furthermore, when I try to add the Atom feed in my Nextcloud News, it sometimes has a thumbnail and sometimes not.

CSS Selector Bridge

First I tried the CSS Selector Bridge with the following settings. I got the title, an incorrect author, datetime, thumbnail, and the images that are only URLs and aren’t displayed on the "Generate feed" HTML page.
The URL for html:
https://rss-page.duckdns.org/?action=display&bridge=CssSelectorBridge&home_page=https%3A%2F%2Fkinocheck.de%2Fnews%2Farchiv&url_selector=ul.list-news+>+li&url_pattern=&content_selector=section%23content&content_cleanup=aside.content-article-aside%2C+div.social-embed-wrapper%2C+div.video-player-wrapper&title_cleanup=&thumbnail_as_header=on&limit=15&format=Html

The URL for Atom:
https://rss-page.duckdns.org/?action=display&bridge=CssSelectorBridge&home_page=https%3A%2F%2Fkinocheck.de%2Fnews%2Farchiv&url_selector=ul.list-news+>+li&url_pattern=&content_selector=section%23content&content_cleanup=aside.content-article-aside%2C+div.social-embed-wrapper%2C+div.video-player-wrapper&title_cleanup=&thumbnail_as_header=on&limit=15&format=Atom

CSS Selector Complex Bridge

Next I tried the CSS Selector Complex Bridge with some more settings, but it didn’t display any images.

The URL for html:
https://rss.riwido.duckdns.org/?action=display&bridge=CssSelectorComplexBridge&home_page=https%3A%2F%2Fkinocheck.de%2Fnews%2Farchiv&cookie=&title_cleanup=&entry_element_selector=ul.list-news+>+li&url_selector=a&url_pattern=&limit=15&use_article_pages=on&article_page_content_selector=section%23content&content_cleanup=aside.content-article-aside%2C+div.social-embed-wrapper%2C+div.video-player-wrapper&title_selector=h1&category_selector=h2%2C+h3&author_selector=span.details+span.authorName+a&time_selector=&time_format=&format=Html

The URL for Atom:
https://rss.riwido.duckdns.org/?action=display&bridge=CssSelectorComplexBridge&home_page=https%3A%2F%2Fkinocheck.de%2Fnews%2Farchiv&cookie=&title_cleanup=&entry_element_selector=ul.list-news+>+li&url_selector=a&url_pattern=&limit=15&use_article_pages=on&article_page_content_selector=section%23content&content_cleanup=aside.content-article-aside%2C+div.social-embed-wrapper%2C+div.video-player-wrapper&title_selector=h1&category_selector=h2%2C+h3&author_selector=span.details+span.authorName+a&time_selector=&time_format=&format=Atom

XPathBridge

After the CSS part, I tried the XPath Bridge. It showed the title and subtitle but didn't have an image, and the text of the article was missing (it doesn't open the URL to extract the article for a feed). So I added a CSS Selector Feed Expander, and it felt like I’m going around in circles - I again have no images.

The URL for html:
https://rss-page.duckdns.org/?action=display&bridge=XPathBridge&url=https%3A%2F%2Fkinocheck.de%2Fnews%2Farchiv&item=%2Fhtml%2Fbody%2Fsection%2Fdiv%2Fsection%2F%2Ful%5B%40class%3D"list-news"%5D%2Fli&title=.%2F%2Fa%2Fdiv%5B%40class%3D"content"%5D%2Fdiv%5B%40class%3D"title"%5D&content=.%2F%2Fa%2Fdiv%5B%40class%3D"content"%5D%2Fdiv%5B%40class%3D"subtitle"%5D&uri=&author=%2Fhtml%2Fbody%2Fsection%2Fdiv%2Fmain%5B%40class%3D"article"%5D+%2Fheader%5B%40class%3D"article-details"%5D+%2Fspan%5B%40class%3D"details"%5D+%2Fspan%2Fstrong%2Fa%5B%40class%3D"Zum+Autoren-Profil"%5D&timestamp=&enclosures=.%2F%2Fa%2Fdiv%5B%40class%3D"image-wrapper+image-fit+color-ladylike"%5D%2Fpicture%2Fimg&categories=&format=Html

The URL for Atom:
https://rss-page.duckdns.org/?action=display&bridge=XPathBridge&url=https%3A%2F%2Fkinocheck.de%2Fnews%2Farchiv&item=%2Fhtml%2Fbody%2Fsection%2Fdiv%2Fsection%2F%2Ful%5B%40class%3D"list-news"%5D%2Fli&title=.%2F%2Fa%2Fdiv%5B%40class%3D"content"%5D%2Fdiv%5B%40class%3D"title"%5D&content=.%2F%2Fa%2Fdiv%5B%40class%3D"content"%5D%2Fdiv%5B%40class%3D"subtitle"%5D&uri=&author=%2Fhtml%2Fbody%2Fsection%2Fdiv%2Fmain%5B%40class%3D"article"%5D+%2Fheader%5B%40class%3D"article-details"%5D+%2Fspan%5B%40class%3D"details"%5D+%2Fspan%2Fstrong%2Fa%5B%40class%3D"Zum+Autoren-Profil"%5D&timestamp=&enclosures=.%2F%2Fa%2Fdiv%5B%40class%3D"image-wrapper+image-fit+color-ladylike"%5D%2Fpicture%2Fimg&categories=&format=Atom

Conclusion

In the beginning, I didn’t even know about XPath and CSS selectors, but figured out how to use them correctly. My last idea is to create a custom bridge, but I don't know how to do that. I've spent so much time in ChatGPT, but the AI gets stuck at some point and won't help anymore. Also, the answers give a direction but aren’t correct. So I have to figure out a way by myself.

Another thing I noticed is that it copies the part with the image URL but seems to cut out the section with the img and picture tags.

What is my mistake, and what should I try next? Or can’t Nextcloud or Atom process more than one picture in a feed? Is there a post, issue, or discussion I’ve missed that could help me with my problem? Should I try to make a custom bridge?

I hope my English spelling is not too bad and someone can help me.

[HolgerAusB]

Mh,

• open the homepage a sub-page of kinocheck.de like /news the root path don't work.
• press ctrl+U for source view.
• press ctrl-F to open search bar and search for rss
• you will find https://kinocheck.de/rss/news

Isn't that, what you want?

Seems to be already a fulltext feed right from kinocheck. No bridge needed.

EDIT:
Oh sorry, images are missing, just the embedded video is in

EDIT 2:
changed above. in the root of kinocheck.de there is no rss link in the html code, only on /news or /news/archiv

[HolgerAusB]

images are JavaScript injected at kinocheck. I don't know if RSS Bridge is able to solve this

[Dyxen07]

Thanks for your answer. I didn’t even know that the news homepage has an RSS feed, because the main page doesn’t have one.
But even on https://kinocheck.de/rss/news, there aren’t really any images. The only images are video thumbnails, as you already mentioned.
And at this point, we’re back to the problem that I couldn’t solve. Maybe it can’t even be solved.

[HolgerAusB]

The Bridges of RSS-Bridge uses JavaScript. As I am not a developer, I can't help with this.

But inspired by your issue, I just wrote a site-config for FiveFilter's Fulltext-RSS. Should be live on the free service after 10pm CET. And for the low post frequency of kinocheck, that should work for you.

There I am string-replacing the <a>-links of the images into <img> nodes and also the href-attribute to src-attribute