Page 1 of 1

Content rescan doesn't seem to be working

Posted: Sun Jan 18, 2009 12:38 pm
by Otacon
Hi

I cant seem to get content rescanning to do anything - be that by manually pushing the button under 'Maintenance', setting the interval value to -1 for automated (inotify?), or any other value. In all cases I actually have to restart the server to kick it off (last database change becomes 'in progress' and my additional files show up).

I'm running under Linux - can anyone help? I'd be interested to know if the same problem is happening on other platforms as well.

Thanks

Re: Content rescan doesn't seem to be working

Posted: Tue Jan 20, 2009 12:44 pm
by Otacon
*bump*

Re: Content rescan doesn't seem to be working

Posted: Tue Jan 20, 2009 6:57 pm
by gosi
I also seem to have the same problems. It did work with Twonky series 4 but not with 5.x what is kinda annoying!
Hopefully somebody finds the time to fix that. Also what I have is sometimes the same file twice in Twonky though there is no duplicate on the HDD ...

Re: Content rescan doesn't seem to be working

Posted: Wed Feb 04, 2009 1:52 pm
by vankadia
this is also happening with me. i email support as well and the only answer they gave was. this is working at our end. i did send couple of more email saying complete senario but there is no reply. i am definitely not buying buggy product which has poor customer support

Re: Content rescan doesn't seem to be working

Posted: Thu Feb 05, 2009 3:06 pm
by dhr
doesn't work on my side either. Only way is to restart server (or let the server rebuild the database) ...
I first thought it might be because my media files reside on a cluster drive, but that isn't the case. The server shows the same problem on a normaly attached harddrive. (running debian etch)

rgds Dirk

Re: Content rescan doesn't seem to be working

Posted: Thu Feb 05, 2009 7:43 pm
by dan
I'm having the same problem. Only a rebuild of the database will show me the new Files.
Linux 2.4.35-wt1 Non-SMP
TwonkyMedia 5.0.46

Re: Content rescan doesn't seem to be working

Posted: Sat Feb 07, 2009 1:53 am
by tonig
I appear to be having the same issue. A rebuild or restart is needed to find new content.

Running on Debian 4.0 and tested on 5.0 server using an Intel Atom chip.

Rebuild of database doesn't work correctly

Posted: Sat Feb 07, 2009 2:59 pm
by and
Hi,

Similar scenario over here with 5.0.46 on Linux; rebuild of database doesn't work correctly.
The Twonkey database doesn't reflect the actual content of the directory tree entered under Sharing.
Without changing anything in my content directory tree Twonkey Server is increasing the number of Music tracks and Photos each time a DataBase Rebuild is started. I have only one content directory specified; this directory contains several sub and sub/sub-directories with a total of 2682 .jpg-files and 17714 .mp3-files.
After several DataBase Rebuilds the Twonkey Server status showed:
Music tracks: 460330
Photos: 47486
Restart Server and Rescan content directory didn't change anything.

The only workaround I found so far to rebuild the database properly:
* Stop the Twonkey Media Server
* Delete the cache and database directory of the Server (look for cachedir dbdir in twonkymedia-server-default.ini)
* Start the Twonkey Media Server (Rebuild DataBase should start automatically)
The database should be OK after the rebuild process has finnished.
But at least over here another start of Rebuild DataBase is messing things up again.
To avoid problems, I've set Rescan of content directories to 0 and do a rebuild of the database as described above each time I add new content.

Regards,

Andreas

Re: Content rescan doesn't seem to be working

Posted: Sat Feb 07, 2009 3:04 pm
by triam
Same on my side. There is no way for a rescan whitout build a new Database. I'am using Debian 5.0 and Twonky 5.0.40

--
regards

Triam

Re: Content rescan doesn't seem to be working

Posted: Sat Feb 07, 2009 10:32 pm
by Lennart
I am having the same problem with TMS on my DNS-323 NAS. It occured with 4.4.11 and 5.0.46

A simple content directory rescan seems to do the trick just fine with 4.4.11 (which I am running now), so my guess is, there might be something wrong with the "-1" value as rescan interval. Also, the webinterface displays "60" minutes as the chosen update interval after a restart of the server. The config file, however, lists the correct "-1".

PS: I had the same issue with 5.0.46 on my PC...

Re: Content rescan doesn't seem to be working

Posted: Sun Feb 08, 2009 1:37 am
by bluewhale
I have exactly the same problem under windows - video files not showing, rescan adding some new (not all), not deleting references to files which are no longer in that position. Files showing up twice.

I will do one final rebuild - if that doesn't work I'll try 4.11.

The good news is that I've been told the following: "I just created a ticket about a rescan problem with TMS 5.0 that sounds similar to what you're seeing. You can check status on this by referring to DLNA-1079." by a member of staff on these forums.

See here http://www.twonkyforum.com/viewtopic.php?f=24&t=6110

Re: Content rescan doesn't seem to be working

Posted: Sun Feb 08, 2009 5:46 am
by NoAhBoDy
Glad to know it wasn't just me...I thought I was going crazy...had no problems with 4.x versions but since 5.0.40 and .46, anything I add to my content directories never gets added without a server restart or db rebuild. I have my rescan set to -1 and also had it set to 60. Using Linux ver running Fedora Core 6.

Re: Content rescan doesn't seem to be working

Posted: Sun Feb 08, 2009 9:40 pm
by bluewhale
I have resolved all my problems by using 4.11 (and ignoring version 5). I suggest you do the following. As I understand, the licence key for 5 works with 4.11 server.

(I completely uninstalled mediamanager v5 - deleted all the directories etc). Then did a clean install of 4.11.

I now spend my time watching films on my TV, not restarting the server on the PC

Re: Content rescan doesn't seem to be working

Posted: Tue Feb 10, 2009 10:36 pm
by Eviltubbie
The 5.x version definitely ignores the directories I configure as "Sharing". I checked the logfile and I think the reason for our problems became obvious: Twonky reads everything below the root-directory, where Twonky-Server is installed ("/mnt")! For example: I defined "/musik-dirk" as sharing-directory for music. This directory directly is located under "/mnt".
The Twony-Server is also installed under "/mnt", it is located in "mnt/share/twonky...", which has the same root-directory ("mnt") as the root of the path, it scans!

When I look at the log-file, I find entries like:

21:30:17:665 LOG_SCAN: adding file /mnt/dirk_home/_Install-Programme/Netzwerk/ethereal-doc/ChIntroDownload.html

You see that the scan accesses the directory "/mnt" and everything below that. That's definitely wrong! So Twonky not just scans the wrong directories, it also added totaly wrong files and file formats!
Under version 4.x I had no problems at all!
I checked the twonky-server-default.ini and there is an entry named "conentbase" which points to "/mnt". Maybe this entry is the one, that Twonky uses as sharing-directory?
I alread sent a mail to Twonky. Hope, they fixes that. Otherwise I will request my money back for the update to 5.x!

Re: Content rescan doesn't seem to be working

Posted: Wed Feb 11, 2009 7:55 am
by vankadia
worse thing is support is not replying or releasing any patch on this issue. and each time supports reply back with oh it works at our end. how can we download older version? does any one have any other paid software that's does the job. i am really sick of this twonky media 5

Re: Content rescan doesn't seem to be working

Posted: Wed Feb 11, 2009 12:23 pm
by mikle_01
The same Problem with my 5.0.46 on my Synology DS107+; adding one or more files -> manual Rescan works not, even automatic with 0 or other settings. Only rebuild od db fix it...terrible!!! Went back to 4.4.11
And Support by Twonky!? We're all loughing! After a short time of hope (Rick suggested that) seems, that the whole company be on holliday

Re: Content rescan doesn't seem to be working

Posted: Wed Feb 11, 2009 2:00 pm
by NoAhBoDy
Went back to 4.4.11 here to until something is done to fix 5.x...all working good with previous version here too.

I too contacted Twonky regarding the issue and got nothing but the auto-reply...

Hopefully they *are* on holidays...

Re: Content rescan doesn't seem to be working

Posted: Wed Feb 11, 2009 11:04 pm
by Eviltubbie
5.x f***** sucks! I gave it up! Just went back to 4.4.11 on my Linkstation. Worked from scratch! These guys should do their homework before they sell software that's not worth to be called software!

Re: Content rescan doesn't seem to be working

Posted: Thu Feb 12, 2009 7:32 pm
by bluewhale
Eviltubbie wrote:The 5.x version definitely ignores the directories I configure as "Sharing". I checked the logfile and I think the reason for our problems became obvious: Twonky reads everything below the root-directory, where Twonky-Server is installed ("/mnt")! For example: I defined "/musik-dirk" as sharing-directory for music. This directory directly is located under "/mnt".
The Twony-Server is also installed under "/mnt", it is located in "mnt/share/twonky...", which has the same root-directory ("mnt") as the root of the path, it scans!

When I look at the log-file, I find entries like:

21:30:17:665 LOG_SCAN: adding file /mnt/dirk_home/_Install-Programme/Netzwerk/ethereal-doc/ChIntroDownload.html

You see that the scan accesses the directory "/mnt" and everything below that. That's definitely wrong! So Twonky not just scans the wrong directories, it also added totaly wrong files and file formats!
Under version 4.x I had no problems at all!
I checked the twonky-server-default.ini and there is an entry named "conentbase" which points to "/mnt". Maybe this entry is the one, that Twonky uses as sharing-directory?
I alread sent a mail to Twonky. Hope, they fixes that. Otherwise I will request my money back for the update to 5.x!
I thought it must have been something I did - I carefully setup which directories to search but the log file (when I could still see a log file) was scanning a whole load of directories that I didn't want shared - and then throwing away the results.

4.4.11 works like a charm.

Re: Content rescan doesn't seem to be working

Posted: Thu Feb 12, 2009 8:07 pm
by jaak
My HD streaming blog post about that

I made upgrade from 4.x to 5.0.46, paid for it and got product, what is not rescanning directories! Shame! I spent many hours, trying to understand where is the problem. I go back to old but want my money back and compensation for lost time.

Re: Content rescan doesn't seem to be working

Posted: Thu Feb 12, 2009 10:32 pm
by Eviltubbie
@bluewhale:
No, it doesn't! When I check the content in the MediaBrowser, I see nothing than crap! Moreover: I have an Onkyo 905 AV-Receiver, a Philips 52PFL9703D TV and a PS3. None of those systems can access the content, provided by Twonky 5.0.46. My Onkyo failed to connect. My Philips too. My PS3 showed empty directories! In the connected devices menu I couldn't see my devices, except the Onkyo, but also the Onkyo disappeared in the menu more or less periodically!
After all, I went back to 4.4.5. Everything worked well from scratch! Afterwards I tried 4.4.11 and again, everyting worked from scratch.
By the way: why the hell does 5.x have to read everything in the directory and throw away the unnecessary files afterwards? It a total waste of time and ressources to read needless directories and their content. What, if users have additional gigabytes of data in the /mnt-path that should not be read by Twonky?
When I define directories that should be shared, then I expect, that Twonky just reads them and nothing else.
I'm also working as a software-developer and I'm really suprised about the status of the software you bring out as release candidate where we, the customers have to pay for! The problems mentioned especially in this thread can be reproduced very easy and I'm wondering, why you didn't recognize those things in your beta testphase!

Re: Content rescan doesn't seem to be working

Posted: Fri Feb 13, 2009 2:17 pm
by dhr
there was no beta-testphase - people like us who paid for the upgrade are testing right now ...
definitely not the way it should be

Re: Content rescan doesn't seem to be working

Posted: Fri Feb 13, 2009 2:23 pm
by mikle_01
dhr wrote:there was no beta-testphase - people like us who paid for the upgrade are testing right now ...
definitely not the way it should be
Of course there was a beta testphase - since nearly 1 year (Christian posted that first "beta 5" in April 2008).

But you're still right - it*s the right way to scare us paying customers away :(

Re: Content rescan doesn't seem to be working

Posted: Fri Feb 13, 2009 6:27 pm
by Lennart
I am going officially insane.

I do have problems with content rescaning with all versions of TMS on my NAS (DNS-323, D-Link).

5.0.46: As described in this thread, the rescanning does not work at all and I have to manually rebuild the database. The upside: Once I worked around the "pink LED problem", the build is running very stable and fast. Just what you'd expect from the server.

4.4.9/4.4.11: With both versions, I can't get auto rescan to work. I set the rescan interval to "-1", the server asks me to restart the server. After that, the "-1" in the sharing-menu magically turned back to 60, and after 60 minutes uptime, the server starts updating.

I am going nuts...

Re: Content rescan doesn't seem to be working

Posted: Sat Feb 14, 2009 3:21 am
by NoAhBoDy
Lennart wrote:I am going officially insane.
4.4.9/4.4.11: With both versions, I can't get auto rescan to work. I set the rescan interval to "-1", the server asks me to restart the server. After that, the "-1" in the sharing-menu magically turned back to 60, and after 60 minutes uptime, the server starts updating.

I am going nuts...
That sounds like a rights problem...maybe the config can't be written to?

as for going nuts, sorry, can't help you there :P

Re: Content rescan doesn't seem to be working

Posted: Sat Feb 14, 2009 9:14 am
by jaak
Wor-around

I went back to 4.4.11, Twonky has new download page: http://www.twonkymedia.com/installs.html for previous versions.
Rescan works for 4.4.11 and Win XP

Jaak

Re: Content rescan doesn't seem to be working

Posted: Sat Feb 14, 2009 9:41 am
by Lennart
NoAhBoDy wrote:
Lennart wrote:I am going officially insane.
4.4.9/4.4.11: With both versions, I can't get auto rescan to work. I set the rescan interval to "-1", the server asks me to restart the server. After that, the "-1" in the sharing-menu magically turned back to 60, and after 60 minutes uptime, the server starts updating.

I am going nuts...
That sounds like a rights problem...maybe the config can't be written to?

as for going nuts, sorry, can't help you there :P
Yeah, I thought about that - and chmodded the ini-file to 777 for good measure. Didn't change anything.

Re: Content rescan doesn't seem to be working

Posted: Sat Feb 14, 2009 12:41 pm
by breakdaice
I can confirm - linux server 5.0.46 doesn't still do automatic content rescan (-1) on CentOS 5.2 i386. It is really dissapointing that I've bought an upgrade for a working product and actually got less for the money I paid. Twonky support and developers - it's time to pull your heads out of your asses and fix this NOW! People have been reporting this same bug for a MONTH by now!!! You sell a commercial product so please hire better coders or better testers/debuggers otherwise you will go down under!

Hopeing to get some results SOON!

Re: Content rescan doesn't seem to be working

Posted: Sat Feb 14, 2009 3:09 pm
by RichKi
I may be sending you on a wild goose chase here as I'm a complete noob to MBWE, but I had a similar problem that I've now resolved. It was all to do with install locations. While the server was finding new media, it couldn't record the fact that it had.

I've posted an update here: http://mybookworld.wikidot.com/forum/t- ... ost-384906.

Re: Content rescan doesn't seem to be working

Posted: Sat Feb 14, 2009 5:24 pm
by NoAhBoDy
RichKi wrote:I may be sending you on a wild goose chase here as I'm a complete noob to MBWE, but I had a similar problem that I've now resolved. It was all to do with install locations. While the server was finding new media, it couldn't record the fact that it had.

I've posted an update here: http://mybookworld.wikidot.com/forum/t- ... ost-384906.
When I went to 5.0.x I renamed my install directory to match that in the ReadMe and although my settings would save, the content scan did not work. I also never understood why the db went to ~/.TwonkyMedia either...that was unconfigurable. The solution you mention may only fix the problem with the above user's problem with the settings not saving...

Re: Content rescan doesn't seem to be working

Posted: Sun Feb 15, 2009 5:22 pm
by Wolfi
The same here. Linux server 5.0.46 - database is not correct - not all files in it. Auto rescan does not work (-1). From time to time database show inncorecct numer fo files (one rescan X - other after some days Y (Y ~ 3*X).

Re: Content rescan doesn't seem to be working

Posted: Thu Feb 19, 2009 8:45 pm
by Otacon
Just for the folks who weren't aware, this issue has been fixed, but that build hasn't been released yet:

http://www.twonkyforum.com/viewtopic.ph ... 390#p22390

Re: Content rescan doesn't seem to be working

Posted: Sat Mar 07, 2009 6:49 pm
by breakdaice
5.0.55 and the bug still excists. After initial scan all files are found and then right after that if any media is added server will not find it any more and the only way to resolve the situation is run maintenance and rebuild database. Then everything is found again until the next time you add smth.

Is it really that hard to find the bug?! Maybe you rushed the 5.x release too much and ended up dissapointing a lot of your loyal customers?

Re: Content rescan doesn't seem to be working

Posted: Sat Mar 07, 2009 7:50 pm
by mgillespie
breakdaice wrote:5.0.55 and the bug still excists. After initial scan all files are found and then right after that if any media is added server will not find it any more and the only way to resolve the situation is run maintenance and rebuild database. Then everything is found again until the next time you add smth.

Is it really that hard to find the bug?! Maybe you rushed the 5.x release too much and ended up dissapointing a lot of your loyal customers?

Are you sure it's not a bug with inotify on your system? The scenario you describe works fine for me on Linux 5.0.55 build. I add files, inotify is working, because it starts a rescan, and after the scan, the new file is there. Not all NAS devices ship with inotify support!! When you set "Rescan in minutes:" to -1 (scan on filesystem change), does it stick, or does it revert to the default value (60mins I believe).

When you copy the file, does the web interface indicate that a rescan occured (look at the "Last database change:" on the server status webpage)

Re: Content rescan doesn't seem to be working

Posted: Sun Mar 08, 2009 5:44 pm
by breakdaice
mgillespie wrote:Are you sure it's not a bug with inotify on your system? The scenario you describe works fine for me on Linux 5.0.55 build. I add files, inotify is working, because it starts a rescan, and after the scan, the new file is there. Not all NAS devices ship with inotify support!! When you set "Rescan in minutes:" to -1 (scan on filesystem change), does it stick, or does it revert to the default value (60mins I believe).

When you copy the file, does the web interface indicate that a rescan occured (look at the "Last database change:" on the server status webpage)
I should have explained myself better. Tha NAS box I reffer to is CentOS 5.2 (RHEL5 freeware) with all the latest updates and patches. Hardware is more than satisfactory for this purpose and most likely doesn't have much anything to do with this problem. My rescan is set to "-1" and that sticks quite nicely.

Last database change: 00:16:32

Cheers!

Re: Content rescan doesn't seem to be working

Posted: Mon Mar 09, 2009 2:26 pm
by NoAhBoDy
breakdaice wrote:5.0.55 and the bug still excists. After initial scan all files are found and then right after that if any media is added server will not find it any more and the only way to resolve the situation is run maintenance and rebuild database. Then everything is found again until the next time you add smth.

Is it really that hard to find the bug?! Maybe you rushed the 5.x release too much and ended up dissapointing a lot of your loyal customers?
I have similar issues with 5.0.55 as well..I thought it was working but after some extended use I'm finding the rescan bug still exists as well. I have had my db double in size and odd things happen after adding new content. I have had to rebuild the db numerous times as well.

Re: Content rescan doesn't seem to be working

Posted: Mon Mar 09, 2009 7:53 pm
by Otacon
I've not managed to reproduce the rescan bug with 55 yet, it's working fine with me. Are you sharing symlinked dirs? Remember you need followlinks=1 in the config file if thats the case :)

Re: Content rescan doesn't seem to be working

Posted: Mon Mar 09, 2009 8:18 pm
by vankadia
i have the same problem. it scan's music and photos fine but if i add very big video file in the content directory it wont place that file or just place one file among others if i have to rescan or restart the server.

Re: Content rescan doesn't seem to be working

Posted: Tue Apr 07, 2009 10:39 pm
by malarcy
I have this problem as well on a brand new install on Ubuntu, no symlinks in the share path for me but no autoscan - I have tried 15 and -1 as the values.

Paul

Re: Content rescan doesn't seem to be working

Posted: Mon Apr 15, 2019 8:07 pm
by Vsider
Same problem here with Ubuntu 18.4 and Twonky 8.5.1.
Auto-scan doesnt work or sometimes works after a few hours(!) after adding new content.
Manual scan however always works fine.

Any clues from support?