Thats definitely an interesting test, but none of the measurement data is provided, they are only testing LCD displays, and they do not specify
which displays were tested.
There was only max/mine dE2000 values posted for the meters, and no mention of what the measurements taken were. It looks like they are probably only greyscale measurements, where colorimeters will usually do OK with.
An accurate test would have a minimum of:
- 11-point greyscale data using dEuv
- RGBCMY data using dE94 or 2000.
Once you start taking full gamut measurements of a display rather than simply looking at greyscale, then you really start to see where colorimeters fall apart.
I'd agree with you there. The site is a bit fragmented in some ways. They go into displays they've tested in other portions, but it isn't completely unified. I noticed Chromix is mentioned there, and they do some of their own testing, but it's presented in more of a blog fashion.
In tests I have seen performed across various display technologies and LCD backlighting types, the i1Pro and ColorMunki came out on top above all colorimeters once you started taking gamut measurements from the displays. These tests included high-end colorimeters such as the Klein K-10. (reference meter was an ORB optronix SP-100 Spectroradiometer)
The thing with a colorimeter is that it will perform very wellabove any consumer-grade spectroif the target displays gamut and spectral characteristics happen to be a good match for its optical filters, and you are testing a new meter rather one that has been in use for a while. (colorimeters degrade over time whereas most spectro designs are relatively stable)
The problem is that without a reference meter to hand, you have no way of knowing whether the target display is indeed a good match.
The i1Pro 2 hardware revision primarily addresses measurement stability over time. Accuracy is on-par with the original i1Pro hardware. You will actually find that the i1Pro 2 hardware labelled as an "i1Pro Rev.E" device. (the last "i1Pro 1" was an "i1Pro Rev.D")
I've noticed the same thing. The i1 display pro/ colormunki display (note the colorimeter version, the name is used for different devices) do perform well with some of the Adobe RGB displays. I agree that it's a generic approach done for cost reasons, but once you're up to NEC/Eizo there is some level of testing. NEC offers oem packages with tested colorimeters for their displays. Eizo uses lookup tables in their software for any colorimeter they support. It's not the same thing as having a device 100% matched to the characteristics of the display, but none of these solutions are completely infallible. Displays aren't even 100% uniform and you're generally basing the calculations off the center (although some do have options to test this). If you scroll down the page on that link, they compare against sRGB and "wide gamut" as in greater in volumetric representation than sRGB . In the ones labeled wide gamut, the colormunki scores poorly against their reference radiometer. In the case of Apple displays, they are within the sRGB realm.
It still scored much worse than the colormunki display which is a colorimeter. Perhaps that's the one you were suggesting came in second? That's basically an i1 display pro, but you can't use it with non X-rite software. The spectrophotometer version is labeled "photo/design". It did not come in second, and the first chart is just unit to unit variability.
In tests I have seen performed across various display technologies and LCD backlighting types, the i1Pro and ColorMunki came out on top above all colorimeters once you started taking gamut measurements from the displays. These tests included high-end colorimeters such as the Klein K-10. (reference meter was an ORB optronix SP-100 Spectroradiometer)
When were they performed? If they were older tests, more than a year ago really, I'm not surprised. Even then the colormunki was a poor choice, but none of the colorimeters made at that time were really designed for some of the recent display generations.
They were testing against a reference grade radiometer. It mentions a Photo Research PR-730 was used for the tests.
The colormunki photo/design (spectrophotometer) measured
"standard gamut" mean error 4.9 White, 10.6 black.
"wide gamut" mean error 6.1 white, 15.9 black
These are basically terrible. You'd be better off leaving it at the out of the box profile in most situations compared to such results. The validations are likely to come in cleaner assuming that colors measured are within reproducible gamut even accounting for manufacturing variations in the displays.
The colormunki display which is a colorimeter scored 1.1, 2.0, 1.7, 2.8.
I think you misread the chart somewhere, but this is why I've stated that X-rite's naming convention is very poor.