Ask HN: Why is it so hard to download podcasts?
6 comments
Many people have given their "why," but I'll give another "how".
castget¹ is a simple tool that does exactly what you want, just add a feed URL and it pulls all the episodes. It has a nice catchup mode so you can add feeds that you've listened to elsewhere without pulling all the old episodes too. hpodder² is another tool I've used in the past, but I can't remember why I switched.
Depending on how much you like cobbling together your own solution html-xml-utils³ makes it incredibly easy to script a solution. For example, "curl feed | hxselect -c -s '\n' 'enclosure::attr(url)'" would list just the URLs. feedparser⁴ is a battle tested solution for processing feeds if you'd prefer a proper parsing solution over a hacky shell script(it will correctly handle different formats without any extra work for example).
¹ https://castget.johndal.com/
² https://github.com/jgoerzen/hpodder/
³ https://www.w3.org/Tools/HTML-XML-utils/
⁴ https://github.com/kurtmckee/feedparser
castget¹ is a simple tool that does exactly what you want, just add a feed URL and it pulls all the episodes. It has a nice catchup mode so you can add feeds that you've listened to elsewhere without pulling all the old episodes too. hpodder² is another tool I've used in the past, but I can't remember why I switched.
Depending on how much you like cobbling together your own solution html-xml-utils³ makes it incredibly easy to script a solution. For example, "curl feed | hxselect -c -s '\n' 'enclosure::attr(url)'" would list just the URLs. feedparser⁴ is a battle tested solution for processing feeds if you'd prefer a proper parsing solution over a hacky shell script(it will correctly handle different formats without any extra work for example).
¹ https://castget.johndal.com/
² https://github.com/jgoerzen/hpodder/
³ https://www.w3.org/Tools/HTML-XML-utils/
⁴ https://github.com/kurtmckee/feedparser
Thanks for all your suggestions! You and others have provided a lot of solutions in this thread, and I appreciate it.
I was looking at feedparser last night, and it definitely seems like the go-to for rolling my own as a learning exercise.
Cheers.
I was looking at feedparser last night, and it definitely seems like the go-to for rolling my own as a learning exercise.
Cheers.
Many modern podcasts don't actually include any ads in their source audio, relying instead on dynamic ad insertion.
Many podcast hosts provide dynamic ad insertion functionality. Unlike baked-in ads, podcast creators mark the locations of where ads can be inserted and, when requested by a user, the host generates a new MP3 on-the-fly using the user's tracking data (geolocation, demographics, etc.) that is then downloaded to their device.
This allows old podcasts to continue to generate ad revenue by dynamically inserting ads from currently-running ad campaigns.
https://advertise.acast.com/news-and-insights/the-benefits-o...
Many podcast hosts provide dynamic ad insertion functionality. Unlike baked-in ads, podcast creators mark the locations of where ads can be inserted and, when requested by a user, the host generates a new MP3 on-the-fly using the user's tracking data (geolocation, demographics, etc.) that is then downloaded to their device.
This allows old podcasts to continue to generate ad revenue by dynamically inserting ads from currently-running ad campaigns.
https://advertise.acast.com/news-and-insights/the-benefits-o...
This really addresses my question directly. Thank you. It makes a lot of sense.
I wonder if this ad insertion happens for downloading directly from RSS feeds as well. Typically, there is a link in the RSS feed directly to an .mp3 file, and I don't know if it would be possible to set the RSS link to a URL which would custom "build" a new mp3 for each download with dynamic ads injected. Is it just the case that some podcasts do not have "public" RSS feeds? I don't know if i've come across any...
I wonder if this ad insertion happens for downloading directly from RSS feeds as well. Typically, there is a link in the RSS feed directly to an .mp3 file, and I don't know if it would be possible to set the RSS link to a URL which would custom "build" a new mp3 for each download with dynamic ads injected. Is it just the case that some podcasts do not have "public" RSS feeds? I don't know if i've come across any...
If downloaded from the podcast host, it'll always insert ads.
To answer your original question, I threw together a python script that takes an RSS feed and downloads all the podcasts in that feed.
https://gist.github.com/zachwlewis/7ad4182e21768dae98cabd17b...
Hope that helps!
To answer your original question, I threw together a python script that takes an RSS feed and downloads all the podcasts in that feed.
https://gist.github.com/zachwlewis/7ad4182e21768dae98cabd17b...
Hope that helps!
Fantastic. I appreciate it very much!
Despite there being many good solutions and suggestions from people here, I ended up creating my own podcast downloader as a learning experience:
https://github.com/EricRa/python-scripts/tree/main/modules/p...
Appreciate everyone's suggestions and time!
https://github.com/EricRa/python-scripts/tree/main/modules/p...
Appreciate everyone's suggestions and time!
The title should really be "Ask HN: Why is it so hard to download podcasts from their websites". Oops.
> Why do some podcast sites makes it so difficult to simply download?
Advertising.
Advertising.
I tried to address this in my question. Of all the examples I can think of, the ads are embedded in the downloadable episode MP3. Is there additional advertisement revenue going to the podcast creators from the third-party sites?
[deleted]
The web page the podcast is embedded in likely contains a significant set of "ads" (of various types) that either directly produce revenue, or "increase engagement" (supposedly) to then further cause more ads to be seen.
spotify has a "download" button.
This requires using a third-party app for no reason. Unless you meant viewing the episode list from the Spotify site, in which case I certainly can't find a download button anywhere (when not logged in).
You can use the first party Apple Podcasts app, it’s actually quite good now and has all the features I used to subscribe to pocketcasts for (Cross device sync, queueing, high speed playback etc) but it works better. You can tell it to download the podcasts.
Apple Podcasts also seems to natively support some paywalled/subscription podcasts from publications I am subscribed to. Personally I think podcast listening is juuuust different enough from general mp3/music listening that it’s invaluable to have a dedicated app. Especially if you’re like me and listen to like 4-5 hours a day of podcast content.
Apple Podcasts also seems to natively support some paywalled/subscription podcasts from publications I am subscribed to. Personally I think podcast listening is juuuust different enough from general mp3/music listening that it’s invaluable to have a dedicated app. Especially if you’re like me and listen to like 4-5 hours a day of podcast content.
I appreciate the suggestion. I can see the appeal of using a specific app for podcasts, but it is not my preference.
A lot of this question is really just motivated by trying to understand the reasoning for not having a simple download option on (many) podcast websites.
A lot of this question is really just motivated by trying to understand the reasoning for not having a simple download option on (many) podcast websites.
I know im pulling a No true Scotsman, but i think a RSS feed and Podcast belong together. Of the 13 different podcasts that have currently an episode in my queue, only 2 of them have no webpage directly associated to them. Of the 11 i can access the audio file in all of them.
For reference, I made this post after trying to download episodes from this site:
https://www.pushkin.fm/podcasts/hot-money/episode-1-murder-b...
I am given the option to either listen to the embedded podcast on the site (with no easy way to right-click/save as the actual mp3. Or I can get directed to one of the following:
Apple podcasts Spotify Stitcher (I don't think this even exists anymore?) IHeart RSS
So if I'm attempting to get the podcast using a browser, my options are to:
1) Click the RSS feed, search the feed for the episode, find the direct sound file link, and download it that way
2) View the page source and search the source for the link to the MP3 (this is possible here, but sometimes it is obscured depending on the site).
Just adding a simple "download" link among these which directly downloads the mp3 file without addition clicks would be great here imo.
https://www.pushkin.fm/podcasts/hot-money/episode-1-murder-b...
I am given the option to either listen to the embedded podcast on the site (with no easy way to right-click/save as the actual mp3. Or I can get directed to one of the following:
Apple podcasts Spotify Stitcher (I don't think this even exists anymore?) IHeart RSS
So if I'm attempting to get the podcast using a browser, my options are to:
1) Click the RSS feed, search the feed for the episode, find the direct sound file link, and download it that way
2) View the page source and search the source for the link to the MP3 (this is possible here, but sometimes it is obscured depending on the site).
Just adding a simple "download" link among these which directly downloads the mp3 file without addition clicks would be great here imo.
try fountain.fm. you can actually earn sats for listening and boost your favorite episodes.
Ideally, I would like to be able to just download every episode of a podcast all in one go since disk space is not an issue. Is there any possible automated way to do this from an RSS feed?
As an aside, is there an actual reason podcasters would prefer you use a third-party service to download their shows? The ads are embedded in the sound file, so you're not avoiding ad exposure. Is it mainly just for tracking metrics and the higher probability that you will consume more shows once "subscribing"?