Listening to digital music storage devices

Posted by: Jan-Erik Nordoen on 21 September 2011

The latest issue of HiFi Critic contains an enticing piece by Andrew Harrison and Stephen Harris (of Naim) on sound quality differences between various digital music storage technologies. In a nutshell, they noted marked SQ differences according to the manner in which music was stored ; differences that were considered in some cases « akin to changing loudspeakers ».

 

The reference system comprised a dCS Purcell Upsampler and Delius DAC feeding a Music First system controller and Chord SPM 1200C power amp, into B&W 802D speakers. Cabling was mostly Nordost ; power conditioning by Isotek. The NAS units were linked to the audio system by a UnitiServe and an NDX, the Serve used as a ripping tool and network server. The NDX’s DAC was bypassed to use the dCS two-box DAC.

 

Storage devices were sited in another room connected to a Cisco Linksys E4200 wireless gigabit router in the listening room via Belkin Cat 6 cable. Another gigabit switch in a remote room (NetGear Prosafe GS108) enabled several NAS units to be online at the same time, each connected to the switch with a high-quality Cat 5e patch cable.

 

First, two 4-bay QNAP boxes were compared: the QNAP TS-439 Pro equipped with four 2-TB Seagate LP drives (QNAP1), vs the QNAP TS-419P+ equipped with four 2-TB Hitachi Deskstar 7K3000 disks (QNAP2). QNAP 2 came out ahead with better tunefulness, « lines of melody and rhythm cooperating better », better instrument distinction and tonally less messy than the QNAP1. The difference was considered as substantial as upgrading from a ₤500 DAC to ₤2000 one.

 

The second comparison was on one NAS, a Synology DS411 Slim, comparing four different drives, two hard disk drives and two solid-state drives: (HDDs : 500 G Hitachi Travelstar 7K500 and a 500 G Seagate Momentus 7200.4 ; SDDs : 128G Kingston SSDNow and a 120 GB Corsair F120.)

 

The overall ranking placed the SQ of the Kingston SSD ahead of the QNAP2 – though the latter had the best bass performance -- followed by either of the HDDs in the Synology NAS.

 

The kicker in the article though was a sidebar comparing different RAID configurations on another Synology unit, the DS 211 equipped with two 2TB Western Digital RE-GP HDDs set up in RAID 0, i.e., with the data striped across them to augment performance. The verdict ? Possibly the best result of all the configurations listened to, with sustained pace and drive, body and richness to music -- that through the Kingston SSD seemed lightweight  -- and an overall relaxed quality that enticed further listening.

 

The tests were preliminary and in no way intended as a buyers’ guide, yet they certainly provide food for thought and ideas for endless hours of experimentation.

 

Jan

Posted on: 21 September 2011 by Simon-in-Suffolk

Jan, being an engineer and a member of the AES I do find these type of 'evaluations' irritating, misleading and ultimately pointless that surely can only confuse the layperson.

The key points to note/measure would surely be the frame sizes, MTU sizes and possibly sources of RF - or the measurement of CM RF on the ethernet lead, and the spacing of the frames into the NDX and the rate of broadcoast packets etc. These are the variables, not the manufacturers of NAS types, configurations etc  as these are spurious and the parameters I mention can change from network to network or config to config. There is no magic here.

 

Therefore a proper engineering analysis would be to show the differning network parameters  into the NDX using Wiresharke etc and referencing that to perceived SQ. You can annotate the equipment used for each test if you wish.

 

This is more meaningful and wil not unneccesarily confuse, and is also controllable and determisitic in different envionments. A real missed opportunity.

 

Finally people like Likesmusic could quite rightly say in my opinion there should be no difference from the NDX and it should accept a wide range of network paramters and sound consistent.

Posted on: 21 September 2011 by james n
Simon - excellent post. There is a thread running on the Hi Fi Critic forum and your informed comments would be welcomed.

James
Posted on: 21 September 2011 by Jan-Erik Nordoen

Hi Simon,

 

I share your concerns but am surprised by your reaction. Any scientific or engineering evaluation begins with anecdotal evidence, then a hypothesis, then testing.

 

The article intrigued me because of the level of differences reported. The point of the article was to say « we can hear differences, we don't yet know why, but they're substantial and musically meaningful ». The authors point out that measurements under controlled conditions, combined with listening tests, are required to tests different hypotheses. 

 

My point in posting was to bring attention to an area for SQ improvement that seems to passing under our radar on this forum.

 

Jan

Posted on: 21 September 2011 by Simon-in-Suffolk
Jan, I agree, my reaction is negative as it is a missed opportunity to tabulate more relevant variables against SQ, and instead the variables listed seem spurious and provide no insight what is happening.

I guess I feel it will add to more spurious debate and confusion just like all that nonsense over ripping did.

It's also been a long day, and a very large customer integration is not quite going to plan this evening.... :-(

Simon
Posted on: 21 September 2011 by Simon-in-Suffolk
James,I took a peek, and Terrcym and Pete_w seemed to say exactly the same as I have and seem to be thinking along the same lines... We are not alone :-)
Posted on: 22 September 2011 by james n

Ah yes - just had another look and it's looking a lot more interesting.

 

James

Posted on: 22 September 2011 by Guido Fawkes

> they noted marked SQ differences according to the manner in which music was stored


and then the men in white coats came to .............................

 

Was it 1st April or had they been smoking something? 

Sure and my documents have less spelling mistakes when loaded from SSD rather than a Hard Drive. 

 

Jan, please tell me this a joke 

 

If you want to hear a difference then you probably will, but this kind of article does nothing for the credibility of this hobby. 

 

> we can hear differences, we don't yet know why

 

Probably they can, but it has nothing whatever to do with the storage device (unless it is broken). 

It could be a thousand things. It is not their hearing I'm doubting, but the conclusion. 


What next - identical rips sounding different because of how they were ripped? No, not even Hi-Fi Critic could claim that 


I agree with Simon's original post 100%


All the best, Guy

Posted on: 22 September 2011 by DavidDever

Possibly the 2 x 2TB striped Western Digital HDD pair offered the best steady-state noise performance? I'd have tried another chassis (non-QNAP) with that pair–I use a striped D-Link DNS-323 as one of my disk arrays at home.

Posted on: 22 September 2011 by likesmusic

Were the listening tests sighted or unsighted?

 

What does 'better tunefulness' mean?  Is there any evidence that such a construct will be agreed upon or consistently judged by trained or untrained listeners?

Posted on: 22 September 2011 by Jan-Erik Nordoen
Originally Posted by Guido Fawkes:

Jan, please tell me this a joke 

No joke. Is the article a brave move or a stupid one ? Would HiFi Critic be willing to risk their credibility ? Read the thread on their forum and draw your own conclusions ; whatever your stance on this issue, though, you're sure to find something there to bolster it...

 

If you want to hear a difference then you probably will, but this kind of article does nothing for the credibility of this hobby.

... neither do discussions of Burndy destressing or cable directionality for that matter

 

 

and I second James' invitation to Simon to join in. It would be helpful.

 

 

Posted on: 22 September 2011 by likesmusic

Let's first establish whether the experiences reported in the article were valid, repeatable and shared by others. 

Posted on: 22 September 2011 by Jan-Erik Nordoen
Originally Posted by likesmusic:

Let's first establish whether the experiences reported in the article were valid, repeatable and shared by others. 

Validity is only measurable in this case by reported personal experience, unless you use the chills (goosebump) reaction to music, which is involuntary.  If the reported experiences are valid internally then they are repeatable, I would think. If they are valid externally then they would be detectable by others (shared).

 

To control variables, the first test would be to use a single NAS, but with different RAID configurations to see if the striped configuration does actually yield any benefits.

 

Has anyone done this ?

 

Thanks

 

Jan

Posted on: 22 September 2011 by DavidDever

In order to do this, a second NAS is required to store the test library, which is then copied onto the device under test.

 

Most importantly, striping block size would also be a consideration–increase stripe size and the number of fetches will decrease–the performances when using larger stripe sizes should tend toward that of a JBOD array; somewhere in the middle is an ideal size for music files (of what arbitrary size?).

Posted on: 22 September 2011 by likesmusic

Anyone care to define 'better tunefulness' before all sorts of pseudo-scientific gobbledegook gets postulated?

 

And don't forget, it is quite conceivable that sunspot activity needs to be held constant for such listening tests, at least if the SATA cable was in alignment with magnetic north.

Posted on: 22 September 2011 by Jan-Erik Nordoen

I'll have a go.

 

If something is tuneful, it is pleasing to the ear, i.e., melodic or euphonious. Highly subjective of course. The authors used the phrase « lines of melody and rhythm cooperating better ».

Posted on: 22 September 2011 by Jan-Erik Nordoen
Originally Posted by likesmusic:

And don't forget, it is quite conceivable that sunspot activity needs to be held constant for such listening tests...

Tell me about it : on March 13, 1989, a solar storm took down the power grid for the entire province of Québec. My music system had some of the blackest backgrounds I've ever experienced.

Posted on: 22 September 2011 by likesmusic

 Credulous neurotics and their money are soon parted.

Posted on: 22 September 2011 by Jan-Erik Nordoen

I say: Give us some...

 

Posted on: 22 September 2011 by Simon-in-Suffolk
Originally Posted by likesmusic:

And don't forget, it is quite conceivable that sunspot activity needs to be held constant for such listening tests, ....

Well we are screwed then as Cycle 24 is really bubbling and sun spot activity is the highest since cycle 23, with a major X1.4 class  flare at 11.00 GMT today, with some of the resultant CME expected to hit Earth's magnetophere on 25th September. (This will create good Northern/Southern Lights)

Oh yes people who have 'Radio Moscow' breakthrough - you are at risk of  increased breakthrough over the coming months

Posted on: 22 September 2011 by Simon-in-Suffolk

Oh yes - back on topic. I compared a Mirrored netgear NAS  accessed by my  seperate WHS uPNP server with the same uPNP server streaming from its local un RAIDed disk instead of the NAS. Nil difference what-so-ever on redbook and hidef wave playback.  My frame sizes from my uPNP server to my NDX in both scenarios - un suprisingly  -were exactly the same.

THis is in a senario of NDX -> NDAC / 555PS where I can hear the benefit of putting a ferrite clamp choke around the NDX/NDAC DC1 SPDIF cable.

Simon

 

Posted on: 22 September 2011 by likesmusic
Originally Posted by Simon-in-Suffolk:

Nil difference what-so-ever on redbook and hidef wave playback

 

 

 

I should hope so. Any other result and it's money back time.

Posted on: 23 September 2011 by Guido Fawkes
Originally Posted by Simon-in-Suffolk:

Oh yes - back on topic. I compared a Mirrored netgear NAS  accessed by my  seperate WHS uPNP server with the same uPNP server streaming from its local un RAIDed disk instead of the NAS. Nil difference what-so-ever on redbook and hidef wave playback.  My frame sizes from my uPNP server to my NDX in both scenarios - un suprisingly  -were exactly the same.

THis is in a senario of NDX -> NDAC / 555PS where I can hear the benefit of putting a ferrite clamp choke around the NDX/NDAC DC1 SPDIF cable.

Simon

 

Thanks Simon - some sanity is returning. The electrical things like RFI that you speak of can definitely affect sound, but when these fellows put the differences down to where two identical digital streams originated from then I have to wonder about their motivation or perhaps they are just trying to be controversial. 


I think if a listener compares the same CD on the same system then they may hear differences, but these will be for reasons such as a change in the environment coupled with psychology. 

 

Posted on: 23 September 2011 by DavidDever
Not "where", but "when" and "how often" - somewhere out there exists a stochastic testing process for analyzing this (difference in) behavior....
Posted on: 23 September 2011 by DavidDever
When you stripe data across a pair of hard disks, you set a block size.
Posted on: 23 September 2011 by DavidDever
...and you have to tune this for best performance based on the average size of the files you are writing to disk.