mikiher
de5d8650e8
Add profiling to podcast library filterdata queries
2025-02-16 12:47:23 +02:00
mikiher
8f192b1b17
Add profiling to podcasts and podcast episodes page queries
2025-02-16 09:46:32 +02:00
mikiher
21343b5aa0
Add count cache to libraryItemsPodcastQueries
2025-02-16 09:40:29 +02:00
mikiher
a5508cdc4c
Remove unnecessary 'distinct: true' from podcast episodes page query
2025-02-16 09:32:00 +02:00
mikiher
bd4f48ec39
Add required: true to includes in podcast episodes page query
2025-02-16 09:29:57 +02:00
mikiher
cb9fc3e0d1
Replace numEpisodesIncomplete subquery with cached user progress calculation
2025-02-16 09:22:06 +02:00
mikiher
707533df8f
Remove numEpisodes subquery from podcasst page query
2025-02-16 09:15:54 +02:00
mikiher
2e48ec0dde
Use libraryItem.title[IgnorePrefix] for sorting podcasts page query
2025-02-16 09:08:27 +02:00
mikiher
f1e46a351b
Separate feed query from podcasts page query
2025-02-16 09:05:54 +02:00
mikiher
8ee5646d79
fix stringifySequelizeQuery and add tests
2025-02-15 23:57:27 +02:00
advplyr
5ca12eee19
Fix count cache by stringify Symbols #3979
2025-02-13 18:07:59 -06:00
Conner McCall
f460297daf
fix: allow upgrading HTTP to HTTPS for redirects
...
Re: #3142 and #3658
When adding certain podcasts, the server encountered a redirect from an HTTP URL to an HTTPS domain, causing an error that was difficult for end users to diagnose without inspecting logs or HTML.
This issue arose due to SSRF security measures that blocked such redirects. Instead of failing in these cases, we now detect when the error is caused by an HTTP-to-HTTPS upgrade. If confirmed, we upgrade the initial URL to HTTPS and resend the request.
Since this change does not allow cross-protocol or cross-domain redirections, it remains secure while resolving most of the reported issues.
Affected podcasts that are now fixed:
- D&D is for Nerds
- The New Yorker: The Writer's Voice - New Fiction from The New Yorker
- Radiolab
2025-02-13 09:19:02 -06:00
advplyr
a34813b3ab
Fix server crash remove column name ambiguity #3966
2025-02-12 08:52:20 -06:00
mikiher
a13143245b
Improve page load queries on title, titleIgnorePrefix, and addedAt sort order
2025-02-08 12:29:23 +02:00
mikiher
52bb28669a
Add a profile utility function
2025-02-08 10:41:56 +02:00
Michael Vincent
3f7af8acfb
Add Accept-Encoding header to getPodcastFeed()
...
This commit adds the Accept-Encoding header to getPodcastFeed() with
gzip, compress, and deflate support. This allows servers to send a
compressed response that'll be decompressed by axios transparently.
Audiobookshelf is currently using axios v0.27.2, which enables the
decompress option by default. The decompress feature supports gzip,
compress, and deflate algorithms (see axios/lib/adapters/http.js).
axios v0.27.2 does not add the Accept-Encoding header to requests
automatically, so that's the responsibility of the caller.
2025-02-05 23:12:58 -06:00
advplyr
5e5a604d03
Fix name parser to not use "last, first" format when not using comma separators. Adds unit tests #3940
2025-02-05 17:25:31 -06:00
advplyr
201e12ecc3
Update downloadFile to debug log percentage complete
2025-02-05 16:15:00 -06:00
advplyr
558173e086
Update custom metadata provider results to sanitize html descriptions #3880
2025-01-26 10:51:18 -06:00
advplyr
a4d0f95ecc
Merge pull request #3880 from mikiher/rich-text-book-descriptionss
...
Support rich text book descriptions
2025-01-25 13:42:37 -06:00
advplyr
d4ba8b9d9f
Fix server crash on failed to extract epub image #3889
2025-01-24 17:24:37 -06:00
mikiher
286185329d
Support rich text book descriptions
2025-01-22 08:53:23 +02:00
advplyr
28681d3783
Merge pull request #3732 from Timtam/allow-mrss-item-enclosures-for-podcasts
...
check for mrss item media:content when extracting item enclosures
2025-01-20 15:08:43 -06:00
advplyr
54a4b09592
Update RSS feed to exclude empty tags, format duration, use CDATA
2025-01-20 13:57:56 -06:00
Toni Barth
bdd8e5bb58
Merge remote-tracking branch 'remotes/upstream/master' into allow-mrss-item-enclosures-for-podcasts
2025-01-20 10:28:09 +01:00
advplyr
1a67f57551
Update podcast downloads to fallback to download without tagging due to inaccurate rss feed enclosures #3837
2025-01-14 15:48:06 -06:00
advplyr
64e9ac9d8f
Fix merging embedded chapters for multi-track audiobooks giving incorrect chapter ids #3361
...
- Also trim chapter titles on probe (remove carriage return)
2025-01-12 09:56:48 -06:00
advplyr
0f20ed101e
Update podcast RSS parser to handle HTML not wrapped in CDATA #3778
2025-01-10 15:42:52 -06:00
advplyr
02ecf7ccfe
Fix catch exception on failed to parse comic metadata #3804
2025-01-08 16:53:56 -06:00
advplyr
05ff5f1956
Merge pull request #3771 from sbyrx/master
...
Adds a configuration for podcast feed and episode download timeout
2025-01-08 14:10:20 -06:00
advplyr
108eaba022
Migrate tools and collapse series. fix continue shelves. remove old objects
2025-01-05 14:09:03 -06:00
advplyr
d5ce7b4939
Migrate to new library item in scanner
2025-01-05 12:05:01 -06:00
sbyrx
e64302f1d4
Merge branch 'advplyr:master' into master
2025-01-04 20:15:59 -05:00
advplyr
fdbca4feb6
Merge pull request #3776 from mikiher/fix-ffmpeg-concat-file
...
Fix ffmpeg concat file escaping
2025-01-04 16:04:18 -06:00
advplyr
6d52f88a96
Update controllers to use toOldJSON functions
2025-01-04 15:20:41 -06:00
advplyr
d8823c8b1c
Update podcasts to new library item model
2025-01-04 12:41:09 -06:00
advplyr
69d1744496
Update podcasts to new library item model
2025-01-03 16:48:24 -06:00
Toni Barth
18dfbdd983
Merge remote-tracking branch 'remotes/upstream/master' into allow-mrss-item-enclosures-for-podcasts
2025-01-02 17:10:09 +01:00
mikiher
fe2ba083be
Fix ffmpeg concat file escaping
2025-01-02 13:34:25 +02:00
sbyrx
0d8d0a650b
Adds a configuration for podcast feed and episode download timeout
2025-01-01 19:41:19 +00:00
advplyr
d811ec3806
Merge pull request #3714 from nichwall/zip_download_speedup
...
Change: no compression when downloading library item as zip file
2024-12-25 08:59:43 -06:00
advplyr
94fdd99ab5
Fix wrong url used for SSRF filter in fileUtils
2024-12-24 15:07:11 -06:00
advplyr
331c7c011c
Support SSRF_REQUEST_FILTER_WHITELIST as a comma separated string of hostnames to pass through the ssrf request filter #3742
2024-12-23 17:18:08 -06:00
Toni Barth
4d2241769e
also check for mrss item enclosures when extracting items
2024-12-18 19:15:09 +01:00
advplyr
63b3f22504
Trim podcast descriptions #3720
2024-12-17 17:44:18 -06:00
advplyr
b39268ccb0
Remove old Feed/FeedEpisode/FeedMeta objects
2024-12-15 17:54:36 -06:00
Nicholas Wallace
61729881cb
Change: no compression when downloading library item as zip file
2024-12-07 16:52:31 -07:00
Vito0912
7486d6345d
Resolved a server crash when a playback session lacked associated media metadata.
2024-12-07 09:34:06 +01:00
advplyr
c35185fff7
Update prober to accept grp1 as an alternative tag to grouping #3681
2024-12-05 16:15:23 -06:00
advplyr
9774b2cfa5
Update JSDocs for groupFileItemsIntoLibraryItemDirs
2024-12-04 16:30:35 -06:00
advplyr
344890fb45
Update watcher files changed function to use the same grouping function as other scans
2024-12-04 16:25:17 -06:00
advplyr
95c80a5b18
Merge pull request #3672 from Techwolfy/disc-folder-support
...
Support additional disc folder names
2024-12-03 17:28:32 -06:00
advplyr
84803cef82
Fix:Load year in review stats for playback sessions with null mediaMetadata
2024-12-02 17:23:25 -06:00
Techwolf
cc89db059b
Fix second instance of regex
2024-12-01 18:41:38 -08:00
Techwolf
a03146e09c
Support additional disc folder names
2024-12-01 18:10:44 -08:00
advplyr
a5e38d1473
Fix:Error adding new series if a series has a null title #3622
2024-11-18 07:59:02 -06:00
advplyr
778256ca16
Fix:Server crash on new libraries when getting filter data #3623
2024-11-18 07:42:24 -06:00
advplyr
75eef8d722
Fix:Book library sort by publishedYear #3620
...
- Updated sort to cast publishedYear to INTEGER
2024-11-17 16:00:44 -06:00
advplyr
4c88e9c8d2
Merge pull request #3594 from nichwall/filter_data_longer_cache
...
Increase cache time for `filterdata` in library
2024-11-16 16:18:54 -06:00
advplyr
45f8b06d56
Fix:CBC Radio podcast RSS feeds not accepting our user-agent string #3322
2024-11-15 08:30:54 -06:00
advplyr
2e970cbb39
Fix:Series Progress filters incorrect - showing for any users progress #2923
2024-11-09 18:03:50 -06:00
Nicholas Wallace
e8d8b67c0a
Add: check for deleted items
2024-11-08 10:49:12 -07:00
Nicholas Wallace
e57d4cc544
Add: filter update check to podcast libraries
2024-11-08 09:33:34 -07:00
Nicholas Wallace
435b7fda7e
Add: check for changes to library items
2024-11-08 09:09:18 -07:00
snakehnb
7ef14aabed
Avoid parsing first and last names in Chinese, Japanese and Korean languages
2024-11-04 16:13:14 +08:00
advplyr
f3d2b781ab
Add mime types for MPEG/MPG
2024-11-01 09:12:40 -05:00
Achim
32105665c1
'mpg' and 'mpeg' added as supported audio-type/file-extension
2024-10-31 15:29:40 +01:00
advplyr
953ffe889e
Update:Book series embeds in grouping meta tag as semicolon deliminated, book meta tag parser falls back to using grouping tag for series if set #3473
2024-10-20 16:58:13 -05:00
Ihor Sofiichenko
d668462529
Fix Extract Cover Error for files with multiple embedded covers
2024-10-17 00:27:21 -07:00
advplyr
d2c405c126
Fix decade filter and query by casting publishedYear to Int
2024-10-15 16:12:56 -05:00
Greg Lorenzen
217038b085
Fix and simplify filter logic for publishedDecades
2024-10-14 20:58:09 +00:00
advplyr
ddd2c0ae4e
Add:Filter for missing chapters & alphabetize missing subitems #3497
2024-10-12 15:56:49 -05:00
advplyr
df6afc957f
Add localization for notification descriptions
2024-10-12 15:22:21 -05:00
Greg Lorenzen
f38b6636e3
Add published decade filter option ( #3489 )
...
* Add strings for PublishedDecade and PublishedDecades
* Add publishedDecades filter options to LibraryFilterSelect
* Add publishedDecades to libraries store
* Add publishedDecades to getFilterData
* Add database method to add published decades to filter data
* Add published decade in BookScanner
* Add 'publishedDecades' to invalidFilters in user.js
* Add publishedDecades filter group to MediaGroupQuery
* Update client/strings/en-us.json
* Auto formatting
---------
Co-authored-by: advplyr <dev@advplyr.com>
Co-authored-by: advplyr <advplyr@protonmail.com>
2024-10-08 17:20:42 -05:00
advplyr
0adceaa3f0
Remove asciiOnlyToLowerCase
2024-10-08 16:59:45 -05:00
mikiher
37eae3406c
Remove debug messages
2024-09-29 12:27:30 +03:00
mikiher
501dc938e6
Add Nunicode sqlite extension integration
2024-09-29 09:22:39 +03:00
advplyr
1a8811b69a
Remove unused requires
2024-09-18 14:26:10 -05:00
mikiher
072028c740
Cleanup empty directiories inside the temp extraction dir
2024-09-18 10:16:46 +03:00
mikiher
0d08aecd56
Move from libarchive to node-unrar-js for cbr and node-stream-zip for cbz
2024-09-18 08:28:15 +03:00
mikiher
0b31792660
catch file extraction errors in parseComicMetadata
2024-09-15 11:48:33 +03:00
advplyr
65d1e7be56
Merge pull request #3394 from mikiher/webp-embed
...
Convert webp images to jpeg during metadata embed
2024-09-09 16:02:17 -05:00
mikiher
422bb8c31c
Convert webp images to jpeg during metadata embed
2024-09-09 15:28:53 +03:00
advplyr
4ddd2788f0
Fix:Byte conversion to use 1000 instead of 1024 to be accurate with abbrevs #3386
2024-09-07 16:52:42 -05:00
advplyr
0344a63b48
Clean out old unused objects
2024-09-03 17:04:58 -05:00
advplyr
9f60017cfe
Update:Remove oldSeries model
2024-09-01 15:26:43 -05:00
advplyr
db86bfd63d
Fix:New authors not setting lastFirst column, updates for new Series model
2024-09-01 15:08:56 -05:00
advplyr
ba742563c2
Remove old Author object & fix issue deleting empty authors
2024-08-31 13:27:48 -05:00
advplyr
c45c82306e
Remove old library, folder and librarysettings model
2024-08-28 17:26:23 -05:00
advplyr
159ccd807f
Updates to migrate off of old library model
2024-08-24 16:09:54 -05:00
advplyr
5d13faef33
Updates to LibraryController to use new Library model
...
- Additional validation on API endpoints
- Removed success toast when reorder libraries
2024-08-24 15:38:15 -05:00
Nicholas Wallace
9c87c3a095
Free memory after extracting comic
2024-08-19 22:05:25 -07:00
Nicholas Wallace
4de65b4369
Autoformat parseComicMetadata
2024-08-19 21:00:16 -07:00
advplyr
bb1a72269a
Remove old User object with old MediaProgress & AudioBookmark
2024-08-19 17:26:17 -05:00
Nicholas W
27b3a44147
Add: Backup notification ( #3225 )
...
* Formatting updates
* Add: backup completion notification
* Fix: comment for backup
* Add: backup size units to notification
* Add: failed backup notification
* Add: calls to failed backup notification
* Update: notification OpenAPI spec
* Update notifications to first check if any are active for an event, update JS docs
---------
Co-authored-by: advplyr <advplyr@protonmail.com>
2024-08-18 14:32:05 -05:00
advplyr
663c9e0fa9
Fix podcast filter user permissions query
2024-08-15 15:54:03 -05:00
advplyr
9facf77ff1
Update remove old sync local sessions endpoint & update MeController routes to use new user model
2024-08-11 13:09:53 -05:00
advplyr
68ef3a07a7
Update controllers to use new user model
2024-08-10 17:15:21 -05:00
advplyr
202ceb02b5
Update:Auth to use new user model
...
- Express requests include userNew to start migrating API controllers to new user model
2024-08-10 15:46:04 -05:00
advplyr
3a1e9abd68
Revert unicode sqlite extension to fix db corruption #3241
2024-08-09 16:41:52 -05:00
