DJGold

Dj Sean · Posted: Fri Jul 14, 2006 7:37 pm Post subject: Gigabyte, then on to Terabyte

In the thread:

http://start.djgold.com/talk/viewtopic.php?p=16959#16959

we got to talking about how much music we have collected and catalogued.

So I got to thinking, I doubt many of us have reached the Terabyte realm yet when it comes to how much music we have stored.

But, I am curious, how much do you have??

As for me, I have 6522 songs, 22.5 days worth (if played back to back), 44.05 Gigabytes on my Apple laptop, and that doesn't include my vinyl or CD's that I have not ripped yet.

If I do count those, I estimate the number to be around 15,000 songs total, which would equal about 103 Gigabytes or 51.74 days of music.

Dang, I thought I had more!! :oops:

DJ Teddy Bear · Posted: Fri Jul 14, 2006 9:39 pm Post subject:

When I got done ripping, I had close to 16,000 songs.

Then I got rid of the duplicates. Only TRUE duplicates. Different mixes, I kept.

I'm down to about 13,500.

Dj Sean · Posted: Fri Jul 14, 2006 10:11 pm Post subject:

wow, I recall doing the same. I had alot of duplicates, I can't remember how many but it was close to your number teddy.

Everytime you click on the orginal file, from the folder, it creates a new song in the player. This I know is true for itunes at least.

Do you know how many gigs your at??

This of course, can vary alot, because we all use different bitrates but it is interesting to know, none the less.

jwg · Joined: September 15th, 2004 Posts: 1089 Location: Erie, PA

Have heard stories of people with 30,000, 40,000, 50,000 MP3s on their hard drives. Obviously, that must be a TON of duplicate files. Would be impossible to have that high a range unless you own every song ever recorded.

Currently, my hard drive has about 13,000 with several duplicates in my main decade folders and my wedding formality folders. Old Red 5.2 allowed shortcuts to songs from another folder. FX doesn't allow that unless I haven't discovered it yet. A complete music (sorry Ken, lol) library at about 13,000 files or just a bit more is almost perfect. There's many 'forgotten' 60's, 70's, 80's and 90's songs ripped that never or rarely get play. You could probably get by with an 8,000-9,000 song library.

goodknightdj · Joined: August 3rd, 2005 Posts: 149

Well, I have over 42,000 titles but I will admit the dupes.

Berr, when you eliminated the duplicates did you do a delete or did you move them to another drive? I've been thinking about building an archive drive for duplicates.

Another thing, what about genres? That seems to be my weakest area as far as the MP3 tag is concerned. Is there a "definitive" publication that let's you look up the real genre of a title?

Dj Sean · Posted: Mon Jul 17, 2006 1:22 am Post subject:

Quote: when you eliminated the duplicates did you do a delete or did you move them to another drive?
In my case, sense I use itunes there is a great function built right in, under EDIT you can select "show duplicate songs" and from there I just deleted the true duplicates, being careful not delete the remixes as it cannot descern the difference.

Quote: Another thing, what about genres?
Good question, as for genre's I had made my choices as it is really a matter of opinion but you can search Amazon.com or itunes library and it will show the genre's of each song.
[/quote]

jwg · Joined: September 15th, 2004 Posts: 1089 Location: Erie, PA

Since I use Excel for my DJI database, I bought a software program (a bit pricey at $50.00 but worth it) that will highlight duplicates. For as many times as I've used it, the software has paid for itself over and over.

Sure, there is a way you can manually do it in Excel, but this is 2 mouseclicks and you're done!

DJPete · Posted: Mon Jul 17, 2006 6:45 pm Post subject:

I'm using OTS -- 13,560 Songs using 53.6 Gig

Jumpin' Jeff · Posted: Tue Jul 18, 2006 6:09 am Post subject: Re: Gigabyte, then on to Terabyte

I'm sitting at 10256 with no duplicates that I have found.

jwg · Joined: September 15th, 2004 Posts: 1089 Location: Erie, PA

Certainly not knocking anyone with 20,000 or more song libraries. As hard drives get bigger, am adding back in some of those lost classics from the 60's, 70's, 80's and 90's. Especially love going on GEMM.com and purchasing the single versions not already in the collection. :)

goodknightdj · Joined: August 3rd, 2005 Posts: 149

Hey John:

I didn't know about GEMM.com. Thanks.

jwg · Joined: September 15th, 2004 Posts: 1089 Location: Erie, PA

Tom:

It's pricey at times, many songs are only on vinyl too. CD singles can be pricey too. Sometimes, they'll kill you in shipping. And, it can take a couple weeks to receive something. The GEMM site is confusing sometimes when tracking your orders.
____________________________

Has anyone here on DJGold actually moved up to a TB drive yet?

TheBartman47 · Posted: Tue Jul 18, 2006 10:21 am Post subject:

I don't have a TB drive, but where I work on my day job has a server with a Terabyte storage capacity using 5 hard drives in a RAID array.

And a place where I previously worked, we had a section of the network that could transmit 1.28 terrabits of data per second, roughly equivalent to 16.5 million simultaneous telephone calls, down one strand of fiber optic cable smaller than a hair on your head.

Anyway, just trying to put a scope on just low large a terrabyte is. If you have that much hard drive space, you might very well could fit every commercially available song ever recorded.

Dj Sean · Posted: Tue Jul 18, 2006 2:03 pm Post subject:

Quote: If you have that much hard drive space, you might very well could fit every commercially available song ever recorded.

Or at least most every popular request in any genre in high quality WAV or AIFF format. This is my ideal I think after discussing what is possible and what formats are the best.

djconroy · Joined: November 22nd, 2005 Posts: 52 Location: Milford, CT

I've got 2 400GB external USB drives, one for Music, one for Karaoke. Backing up is a pain - It can take forever!

I'm looking into incremental backups so that once the full backup completes, subsequent backups only worry about new files. Haven't spent the time yet, though.

Eventually I'd like to find a rackmount USB RAID enclosure so I can tolerate a failed HD and keep running. Backups don't help if you're on a gig and your portable HD fails (unless you bring duplicate HD's).

Jim Weisz · Joined: May 23rd, 2005 Posts: 65 Location: Dallas, TX

djconroy wrote: I've got 2 400GB external USB drives, one for Music, one for Karaoke. Backing up is a pain - It can take forever!

Are you backing up onto other external hard drives? I have several 300GB hard drives (some used for primary storage & some for back-up) and I just do my back-ups at night and they're done by morning.

Dj Sean · Posted: Thu Aug 17, 2006 1:47 pm Post subject: Re: Gigabyte, then on to Terabyte

A RAID system would be the way to go it seems.

But if one harddrive fails does that mean you lose parts of all your songs or just many songs?? I am still learning about RAID systems.

What I mean is, doesn't a RAID system spread out (for example) one song's data through out the many H.D.'s or does it store one whole song on one H.D.?

I would imagine you can chose either option, right?

Jumpin' Jeff · Posted: Thu Aug 17, 2006 1:57 pm Post subject: Re: Gigabyte, then on to Terabyte

I use Filesync for incremental backups between 2 drives. I can if I desire, do a bit per bit compareison, but normally simply do a compare, and update older files with new, or add the new files that are missing from the destination drive.

I highly recommend it.

dokai · Posted: Thu Aug 17, 2006 2:24 pm Post subject: Re: Gigabyte, then on to Terabyte

Dj Sean wrote: What I mean is, doesn't a RAID system spread out (for example) one song's data through out the many H.D.'s or does it store one whole song on one H.D.?

Depends on the RAID level. A RAID 5 array stripes data across multiple drives, and then calculates the parity information for each stripe and stores that also. That way if a drive fails, the missing data can be extrapolated from the parity information. In RAID 1, you're just mirroring data between two drives, so both drives would have a complete copy of the entire song.

Here's a pretty decent introduction to RAID concepts: http://en.wikipedia.org/wiki/RAID

len · Joined: July 2nd, 2005 Posts: 104

Last I looked, I had about 14,500, including duplicates. That doesn't include all the classical and jazz I listen to, plus the 20 - 25 crates of 12" I have in the basement from the good old days. Plus, the 30 crates of lp down there.