TwonkyServer 6.0.39 playlist generation

General discussion about the media server. Feature requests. Hints, tips and tricks.
Locked
fluXXXion
Posts:12
Joined:Wed Oct 06, 2010 9:21 am
AV Hardware:QNAP TS-419P+ | Acer Aspire Revo R3610 | iPhone 4
TwonkyServer 6.0.39 playlist generation

Post by fluXXXion » Sat Jul 21, 2012 11:58 am

I have updated my NAS (QNAP TS-419P+) to the latest Firmware revision which also includes a new TwonkyServer Version (6.0.39).
Unfortunately the server starts scanning the music files (~ 52.000 MP3 files) and generating wpl playlist files from scratch.
Normally this takes about one day, during this process the twonkymediaserver process takes 95 to 100 % of the CPU load.

Currently this process runs for 3 days and 2 hours, I have no idea when this will be finished.

Is there any way to stop this?
What are these wpl files for?
Is it possible to backup them prior to the next FW update and restore them afterwards?
Why are all playlists recreated when I restart the TwonkyServer or rescan the media directories?
I would not take care about that if this process takes a few hours, but a few days (weeks?) are inacceptable.

Twonky_Rick
Posts:3816
Joined:Wed Nov 19, 2008 1:59 am
AV Hardware:Samsung 650 Series TV (2010), 4.5TB HP MediaSmart server with 100,000 songs, 5) AT&T U-Verse STB, CE form-factor Media Center PC and 6 other networked PCs running TwonkyManager, 2 Sonos ZP80, Sonos S5 speaker, Apple TV (running XBMC), Roku Soundbridge, X-Box 360, Sony PS3, Kodak 10" Wireless Photo Frame, iPhone with PlugPlayer software, Sonos CR-100.
Location:San Diego
Contact:

Re: TwonkyServer 6.0.39 playlist generation

Post by Twonky_Rick » Tue Jul 24, 2012 12:09 am

It seems like you might have a problem with corrupted media files which is causing problems with the file scanner. Can you identify which file it's stopping on and send that file to me for testing?

I don't have an answer to your WPL question, but I'll try to get one.

- Rick
Follow me on Twitter! mostlytech1
Checkout my blog: http://mostly-tech.com/

Twonky_Rick
Posts:3816
Joined:Wed Nov 19, 2008 1:59 am
AV Hardware:Samsung 650 Series TV (2010), 4.5TB HP MediaSmart server with 100,000 songs, 5) AT&T U-Verse STB, CE form-factor Media Center PC and 6 other networked PCs running TwonkyManager, 2 Sonos ZP80, Sonos S5 speaker, Apple TV (running XBMC), Roku Soundbridge, X-Box 360, Sony PS3, Kodak 10" Wireless Photo Frame, iPhone with PlugPlayer software, Sonos CR-100.
Location:San Diego
Contact:

Re: TwonkyServer 6.0.39 playlist generation

Post by Twonky_Rick » Wed Jul 25, 2012 12:48 am

Here is the answer I received:
I think the easiest way to solve this is to start from scratch.

1. You should stop TwonkyServer and then manually delete the database and cache directories of TwonkyServer.
2. You should also check the server-managed directories where Twonky keeps uploaded items and playlists. If there are WPL files there, you should move them to a location outside the shared locations (or just delete them).

In general having many playlist files slows down the scan process a lot. TwonkyServer has to verify for each playlist if the items inside the playlist are in the shared locations or not. This can take quite some time because it happens in two steps: First it's converted to WPL and then it's imported.

Q: Why do we create a bunch of WPL files during the file scanning process?
A: Any supported playlist format is converted to a WPL playlist. The WPL playlist is imported by TwonkyServer.
Thanks Burkhard for providing this answer.

-Rick
Follow me on Twitter! mostlytech1
Checkout my blog: http://mostly-tech.com/

fluXXXion
Posts:12
Joined:Wed Oct 06, 2010 9:21 am
AV Hardware:QNAP TS-419P+ | Acer Aspire Revo R3610 | iPhone 4

Re: TwonkyServer 6.0.39 playlist generation

Post by fluXXXion » Wed Jul 25, 2012 8:14 pm

Thanks.
After the scan was still running for over 7 days I have deactivated UPnP-Mediaserver (which is TwonkyServer 6.0.39), deleted all concerned directories and installed TS 6.0.38 from QPKG Center of my QNAP.
Will report back when the scan is finished...

Twonky_Rick
Posts:3816
Joined:Wed Nov 19, 2008 1:59 am
AV Hardware:Samsung 650 Series TV (2010), 4.5TB HP MediaSmart server with 100,000 songs, 5) AT&T U-Verse STB, CE form-factor Media Center PC and 6 other networked PCs running TwonkyManager, 2 Sonos ZP80, Sonos S5 speaker, Apple TV (running XBMC), Roku Soundbridge, X-Box 360, Sony PS3, Kodak 10" Wireless Photo Frame, iPhone with PlugPlayer software, Sonos CR-100.
Location:San Diego
Contact:

Re: TwonkyServer 6.0.39 playlist generation

Post by Twonky_Rick » Wed Jul 25, 2012 11:28 pm

Thanks.

A server log might help if you're still seeing problems. Let me know if you don't know how to generate one. Thanks.

- Rick
Follow me on Twitter! mostlytech1
Checkout my blog: http://mostly-tech.com/

fluXXXion
Posts:12
Joined:Wed Oct 06, 2010 9:21 am
AV Hardware:QNAP TS-419P+ | Acer Aspire Revo R3610 | iPhone 4

Re: TwonkyServer 6.0.39 playlist generation

Post by fluXXXion » Thu Jul 26, 2012 4:47 pm

You mean "Maintenance" - "Logging" on the TS config page?

How long should it normally take for 52.000 MP3 files to scan? It is running for 10 hours now...

fluXXXion
Posts:12
Joined:Wed Oct 06, 2010 9:21 am
AV Hardware:QNAP TS-419P+ | Acer Aspire Revo R3610 | iPhone 4

Re: TwonkyServer 6.0.39 playlist generation

Post by fluXXXion » Fri Jul 27, 2012 7:54 am

Finished after approx. 16 hours. I think this is acceptable.

BUT: Now I have duplicate entries for "Artist/album" etc., and many artists are missing. Restarting the server again :|
I think I will start from scratch again if this does not succeed - please tell me which directories should be deleted manually.

Twonky_Rick
Posts:3816
Joined:Wed Nov 19, 2008 1:59 am
AV Hardware:Samsung 650 Series TV (2010), 4.5TB HP MediaSmart server with 100,000 songs, 5) AT&T U-Verse STB, CE form-factor Media Center PC and 6 other networked PCs running TwonkyManager, 2 Sonos ZP80, Sonos S5 speaker, Apple TV (running XBMC), Roku Soundbridge, X-Box 360, Sony PS3, Kodak 10" Wireless Photo Frame, iPhone with PlugPlayer software, Sonos CR-100.
Location:San Diego
Contact:

Re: TwonkyServer 6.0.39 playlist generation

Post by Twonky_Rick » Mon Jul 30, 2012 7:34 pm

Checking... Standby...

- Rick
Follow me on Twitter! mostlytech1
Checkout my blog: http://mostly-tech.com/

Twonky_Rick
Posts:3816
Joined:Wed Nov 19, 2008 1:59 am
AV Hardware:Samsung 650 Series TV (2010), 4.5TB HP MediaSmart server with 100,000 songs, 5) AT&T U-Verse STB, CE form-factor Media Center PC and 6 other networked PCs running TwonkyManager, 2 Sonos ZP80, Sonos S5 speaker, Apple TV (running XBMC), Roku Soundbridge, X-Box 360, Sony PS3, Kodak 10" Wireless Photo Frame, iPhone with PlugPlayer software, Sonos CR-100.
Location:San Diego
Contact:

Re: TwonkyServer 6.0.39 playlist generation

Post by Twonky_Rick » Wed Aug 08, 2012 12:33 am

Sorry for the delay. Here is the response which I received:
I don't know the settings QNAP uses on their NAS. This returns the full config settings from TS:

http://<IP>:<PORT>/rpc/get_all

The response contains the properties dbdir and cachedir

In addition he could also check the directories configured for servermanagedmusicdir, servermanagedpicturedir and servermanagedvideodir. If one of these contains huge amounts of WPL files, he should delete those as well.
- Rick

[Thanks for Burkhard for this info.]
Follow me on Twitter! mostlytech1
Checkout my blog: http://mostly-tech.com/

Locked