Jump to content
Division-M Community
Grant

Primary files > Duplicate after removing hard drive

Recommended Posts

Hello Everyone:

I've read community posts here and read the knowledge base articles, but I don't know how to fix this issue.  I suppose it's going to be a support ticket, but I'll post the situation here.

I'm on Drive Bender 2.8.2.2 - installed because I had trouble with the Landing Zone not clearing - and it did the trick.

So, the other day, my stand-alone Windows 7 64 bit box, that I use only for Drive Bender storage and some media server software began to freeze occasionally.  I know from the past that it's because of CRC SMART errors on some 12 year old, 1TB, Samsung HDDs that I have owned.  SMART says "excellent," but I know the CRC error well from other Samsung HDD issues and decided to replace it with a new WD 4TB.  This did solve the freeze up.  I use HDD Scan, by the way to check SMART status.

In Drive bender console or whatever, I clicked on the blue box with the minus sign to remove the drive from the pool.  I later read the KB article about just manually removing the drive, but I did it, what I thought was the safe way, by clicking the blue box to remove from the pool.  This took about three or four days to do, but, eventually, I got a "success" dialog box and I could see that the drive was no longer in the pool.  However, I was nearing the capacity of the remaining drives and even the landing zone filled up to near capacity.

I put the new drive in, formatted it, and added it to the pool with the blue box + sign and let Drive Bender do it's thing.

Balancing began to happen ("even mode"), and was successful, yet I still have files in the landing zone.  They are only primary files in the landing zone when I click on the info for that drive.

** Main problem:  I have approximately 35,000, primary files more than the duplicate count.  I have clicked on repair the pool, performed a file system health check on the pool, perform a balancing pass on the pool, and perform a validation pass on the pool.  I've done all this multiple times.  Still. I have roughly 20%  more primary files than duplicate.   I also have a nearly-full Landing Zone that won't clear.  By the way, I am duplicating the entire pool, all files and folders.

** How do I balance the primary and duplicate file count now?  There's no way that I can search and delete 35k duplicate files.

This KB article mentions a registry change, however, I don't have "HM Action Multiple Primaries" in any of the Division-M/Drive Bender registry folders.  

Short of re-creating the whole pool, any ideas from readers?

 

 

 

 

 

Share this post


Link to post
Share on other sites

You could try removing duplication completely, wait 24 hours (or your pre-defined time period) for the balancing to run, then once all removed, re-duplicate them.

Unless others have suggestions, I'd raise a Support Ticket.

Share this post


Link to post
Share on other sites

CBers, I put in a support ticket, but I'll also remove duplication from the pool, let it run, and then see what happens.  What's odd is that the duplicate count shows ~165K files and that's roughly what I'm sending to the pool.  The primary count is greater, at ~200K files.

Share this post


Link to post
Share on other sites

First of all, I would recommend upgrading to v3 (v3.1.0.0), balancing has been much improved in v3. If you have turned off duplication (and let it finish), then map a drive letter to the pool (see - https://support.division-m.com/hc/en-us/articles/214027203-How-do-I-map-or-remove-a-drive-letter-to-one-of-the-drives-in-the-pool-), you can then use Windows Explorer to search for folders called "FOLDER.DUPLICATE.$DRIVEBENDER"... you can simply delete these folders if there are any left (use shift-delete so they don't end up in the recycle bin).   Also, we need to ensure the clearing zone is being cleared before we re-enable duplication (let me know if this is not the case)... the file count should sort itself when the next file check is performed.

Share this post


Link to post
Share on other sites

Anthony,

I removed duplication and let Drive Bender "do it's thing" but found that the landing zone still had files.  Unfortunately, I did not follow the procedure to map a drive to the pool to find and delete the duplicate folders and files because my primary file count was way above my duplicate count.  I don't know how that happens, but it must have been because of how I removed a "failing drive" by using the "-" remove drive from the pool button instead following the KB article about removing a drive.  I just figured that, after deleting the dupes, I'd still have too many primary files eating away at the storage space.

A bit of background -  I use Drive Bender on a stand-alone Windows 7 machine.  It is a great replacement for WHS v1 that I had for years, but that was limited to 2tb drives.  Now, this Win 7 box,with Drive Bender, is an 11 TB JBOD with some media server software on it for a smart tv and Lights-Out software to shut it down when not in use.  The purpose of using Drive Bender is to mirror the files from two desktop computers at my house with SyncBack Pro, so that I have only a copy of my main files, rather than an extra storage space.  Anyway, I basically started from scratch - and that was perfectly fine with me.  I installed v3.1.0.0, recreated the pool from six, various sized, disk drives, (one 320 gb drive is a dedicated landing zone) and mirrored the two desktops to this one computer with Drive Bender. 

However, I am now enabling duplication on the pool, but Drive Bender seems to be stuck at validating files.  Only 222 duplicate files are showing in the pool out of ~166K files after running all night.  I tried a file system health check on the pool, but nothing has changed, however, it looks like it ran, according to the log.  I see a lot of exclamation point warnings in the log for what looks like duplication tasks.  They are in groups (or lines) of 4 . . . . and there are many of them.  Here's a group of sequential log file lines.

Worker task ID - Waiting on task to signal complete has timed out ( task" TSafeFileCopyTask exceeded: 30000 MS), killing off owning Thread Id: 3
Worker task Id - the file copy task has timed out while copying the file
Worker task id - refreshing failed on the file (file path) - returned: crOperationTimedOut moving file from
Worker Task ID - unable to process duplicate file for (file path) at this time.  Will skip and schedule a new validation task on this file only.

Right now, I am thinking of starting all over again with a fresh install of Win 7 and re-installing Drive Bender and the other software, but I'm not sure if I'll be faced with this same issue.

Anthony, Thank you for your reply.  I appreciate your work on Drive Bender.  I know that any software support is time consuming.  

 

Share this post


Link to post
Share on other sites

I gather from your post that you have a trouble ticket open?? To me I can't see how a clean install of Win7 and DB will help. The pool drives would be in the same state as soon as DB initialized which would leave your pool in the same state it's currently in. If you don't have a ticket open you should open one as this sounds like it's something that Anthony will need to take a closer look at.

https://support.division-m.com/hc/en-us/requests/new

Share this post


Link to post
Share on other sites

Ok, so not to leave my issue open, what I did, ultimately, is to wipe everything on my box and start from scratch.  It's no big deal since I don't use this Windows 7 box for primary storage. It's mirrored information from three different desktops in my house.  I installed W7Pro, Drive Bender 3.1 and threw in 6 other 3.5 disks, but did not do a landing drive this time.  I copied all the data back to the box using SyncBack Pro and all is well.  Now, what I thought was a failing hard drive before was a loose power connection on the drive and that messed up my data.  I also bought Hard Disk Sentinel to monitor trends in the health of the drive.  This is amazing software.

Can an an expert like CBers or Anthony chime in on something?  I am asking because I cannot find a clear answer in the community.

If I have all drives with duplication on and then I have an out-right failure on a disk drive and also I have no intention of replacing the drive, is the correct procedure to get running again, to go to "Pool Options" and then "Repair this Pool" and then once dupes copy over as primary everything is good-to-go?

Thanks again for this great software!

Share this post


Link to post
Share on other sites

 

 

 

Can an an expert like CBers or Anthony chime in on something?  I am asking because I cannot find a clear answer in the community.

 

I wouldn't class myself as an expert, just a longtime user, but thanks

 

Why wouldn't you replace a failed disk?

 

 

Share this post


Link to post
Share on other sites

I wouldn't replace a failed disk because I may not have a spare one handy and decide not to spend the money to replace it.   I've got about 12 tb, total, in the pool, and maybe use about 1/3rd of that, so it won't harm me to just run the remaining drives in the pool and still have plenty of capacity.

Share this post


Link to post
Share on other sites

Sound to me like you have plenty of spare space that removing (or having a failure) a drive should be no big deal and the repair should do the job provided there's enough free space on the remaining drives to handle the amount of used space on the removed/failed drive.

Share this post


Link to post
Share on other sites

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Guest
Reply to this topic...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.

Loading...

×
×
  • Create New...