Very different performance of the power Doppler modalities of several ultrasound machines ascertained by a microvessel flow phantom
© Ten Cate et al.; licensee BioMed Central Ltd. 2013
Received: 10 June 2013
Accepted: 2 October 2013
Published: 24 October 2013
In many patients with rheumatoid arthritis (RA) subclinical disease activity can be detected with ultrasound (US), especially using power Doppler US (PDUS). However, PDUS may be highly dependent on the type of machine. This could create problems both in clinical trials and in daily clinical practice. To clarify how the PDUS signal differs between machines we created a microvessel flow phantom.
The flow phantom contained three microvessels (150, 1000, 2000 microns). A syringe pump was used to generate flows. Five US machines were used. Settings were optimised to assess the lowest detectable flow for each US machine.
The minimal detectable flow velocities showed very large differences between the machines. Only two of the machines may be able to detect the very low flows in the capillaries of inflamed joints. There was no clear relation with price. One of the lower-end machines actually performed best in all three vessel sizes.
We created a flow phantom to test the sensitivity of US machines to very low flows in small vessels. The sensitivity of the power Doppler modalities of 5 different machines was very different. The differences found between the machines are probably caused by fundamental differences in processing of the PD signal or internal settings inaccessible to users. Machines considered for PDUS assessment of RA patients should be tested using a flow phantom similar to ours. Within studies, only a single machine type should be used.
Rheumatoid arthritis (RA) is a common disease with a prevalence of around 1% worldwide . RA is potentially an invalidating disease , but early diagnosis in the so-called window of opportunity [3, 4] and treatment according to a treat-to-target protocol  can optimise the outcome for RA patients. Adding ultrasound (US) to the diagnostic workup and monitoring of treatment may provide even better results. In rheumatological US both greyscale and power Doppler (PD) are used, of which PDUS seems to have the largest value. PDUS has the potential to reclassify patients to a higher joint group according to the 2010 classification criteria for RA, increasing the risk for undifferentiated arthritis to be definite RA . Furthermore, the presence of PDUS inflammation in joints that are not swollen at clinical examination has shown to be clinically relevant in patients in remission of RA, since it predicts occurrence of flare and erosive progression [7–10]. Correct assessment of the presence and absence of a PD signal indicating the presence of inflammation is therefore vital in rheumatological US.
If there are indeed large differences in the performance of PDUS per machine, the choice of machine might be essential for a valid detection of inflammation. Using different machines within a multi-machine study or during patient treatment could then have a detrimental impact on treatment decisions or study outcome.
To quantify the suspected differences in PD sensitivity of different machines in an objective way, we decided to perform an in vitro experiment. To compare the PD function of different US machines one could use a flow phantom. This flow phantom should mimic the tissue that is scanned by PDUS in rheumatology; that is, very small vessels and very low flows. To our knowledge, no studies have been conducted investigating the size of capillaries and the blood flow velocity in an inflamed joint, but there are data on capillaries in healthy subjects’ nailfolds and capillaries in periulcerous regions. These capillaries have a diameter of around 30 μm and the blood flow velocity can be as low as 0.5 mm/second [13, 14]. Flow phantoms previously presented did not compare US machines , used vessels that were considerably larger than capillaries, or assessed many capillaries close to each other at once, making it impossible to evaluate the flow velocity in the individual vessels [11, 12, 16, 17]. For these reasons, we created a new flow phantom with a very small, single vessel to obtain the lowest detectable flow velocity of five US machines. Two additional larger vessels were included in the phantom for comparison with the literature [11, 12].
The actual volume transported through the vessels was tested by turning on the pump, and completely filling the vessel until drops of BMF came out of the capillary. A complete number of drops were captured in a container while recording the time. This container was weighed before and after this experiment on a microbalance. With the relative density of the BMF we calculated the flow (transported volume per time).
Ultrasound machines and settings
Machines tested (alphabetical order) and probes used
Aloka Ltd., Tokyo, Japan α7 (probe UST-5411)
Esaote, Maastricht, the Netherlands MyLab60 (probe LA 435)
Philips Healthcare, Amsterdam, the Netherlands iU22 (probe L9-3)
Ultrasonix Medical Corporation, Vancouver, Canada (probe L14-5/38)
VisualSonics, Toronto, Canada Vevo2100 (probe MS200)
Measuring the reliability of the pump
2,000 μm vessel
1,000 μm vessel
150 μm vessel
150 μm vessel
150 μm vessel
Lowest detected flow velocity resulting in a continuous positive power Doppler ultrasound signal
2,000 μm vessel
1,000 μm vessel
150 μm vessel
Settings for detection of lowest flow velocity in the 150 μm vessel
Pulse repetition frequency/velocity range
We showed that the sensitivity of the PD modalities of five US machines (three machines used in the clinic and two used for research) was very different, using a microvessel flow phantom. The very large differences found between the machines are only partly explained by each machine’s Doppler frequency, lower limits of PRF and wall filter settings, but are most probably caused mainly by fundamental differences in processing the PD signal or internal settings inaccessible to users. There was no clear relation with price or technical sophistication of the machines: a lower-end machine (Machine B) performed best for all three vessels, while mid-range and high-end research machines (Machines D and E) did not detect any flow in the smallest vessel, against expectations.
Only one machine of the five (Machine B) could detect the low flow velocity in capillaries that based on previous research are estimated to be between 0.5 and 1 mm/second. Machine C came close to this limit, which underlines our conclusion that the observed differences are mainly caused by differences in processing of the signal, since the probe that was available for Machine C had a bandwidth of only 3 to 9 MHz. When a high-frequency probe would have been used with this machine, it might also have been able to detect flow less than 1 mm/second in the smallest vessel. The other machines did not perform appropriately according to this limit.
As mentioned above, flow phantoms have been published in the literature before [11, 12, 15–17]. However, when comparing the PD modalities of different US machines it is essential to use small, individual vessels. A positive PD signal depends on the total detected Doppler signal power within the range gate (the colour Doppler pixel size, typically <1 mm). This power depends on the number of particles that have a velocity above a certain threshold. This threshold is determined by the wall filter, the PRF/velocity range. Whether a PD signal is actually detected/displayed is also dependent on the noise level of the system and the system’s ability to suppress clutter and signal from stationary targets. If the vessel diameter is larger than the gate size, the velocity threshold will determine the lowest detectable velocity. This explains why the minimum velocities found for 1 and 2 mm vessels are similar.
However, if the velocity is the same but the vessel is much smaller than the gate size, the number of moving particles will be lower and more stationary tissue will be inside the gate range. The tissue suppression and noise level then become more important and the minimal detectable velocity will be raised. This means that a phantom with a vessel too large in diameter [11, 12] may use a flow velocity similar to that in vessels in an inflamed joint, but more particles are inside one pixel in the phantom situation (in vitro) compared with the situation in an inflamed joint (in vivo). This can possibly cause a positive PD signal based on the large number of particles. In a flow phantom using a bundle of capillaries [16, 17] one can never know for sure the flow velocity in each vessel. The possibility therefore remains that the flow is very high in a few capillaries, causing a positive PD signal solely based on the high flow velocity of particles in these few capillaries.
A study comparing Machines A and B (older versions than in our study) on a 1,000 μm flow phantom has been published in the past . These older versions of the machines were ranked regarding sensitivity the same as in our study. However, in our study Machine B detected a considerably lower flow compared with the previous study: 0.06 mm/second in our study versus 1.3 mm/second in the previous. Machine A detected a twofold lower flow in our study: 2.2 mm/second in our study versus 3.9 mm/second in the earlier study.
Another study tested an earlier, single-element version of Machine E (VisualSonics, Toronto, Canada Vevo 770;) on a microvessel flow phantom with vessel dimensions similar to ours (160 μm) . In this microvessel, the Vevo 770 did detect flows as low as 0.5 mm/second. In our study Machine E did not detect any flow in the smallest vessel (150 μm). A possible explanation for this higher sensitivity for low flows could be that the Vevo 770 uses a mechanically steered probe with a single element, as opposed to the array probe we used on Machine E in our study. In general, the Doppler processing of a single-element system can be very different from that of an array system.
Some observations raised discussion within our research group. One of these discussions was about the very low flows detected by Machine B in the 2,000 μm vessel. To verify this finding the experiment was repeated several times by two observers (DFTC and MvdV), which resulted in similar findings. When setting the flow slightly lower, the signal disappeared. Therefore, we think the measured flow is correct. A possible explanation for this low limit is that the PRF can be set to a very low level and the wall filter cutoff frequency is probably also very low, in combination with a good clutter suppression. However, in in vivo situations, normal tissue or probe motion will prevent detecting such extremely low flows.
Another observation that raised discussion is the lower flow detected in the 1,000 μm vessel as compared with the 2,000 μm vessel. A reason for this could be that the flow velocity profile in the 1,000 μm vessel is shaped differently, as compared with the 2,000 μm vessel, resulting in a larger difference between average flow and maximum flow. This may even have been reinforced by compression of the smaller vessel by the tissue-mimicking material. This means the average flow velocity is actually higher than estimated, since the calculation is quadratically dependent on the microvessel diameter. If the maximum velocity of the peak flow is slightly higher than the wall filter cutoff, this results in a positive PD signal. The peak flow may therefore be rather similar in the 2,000 μm and the 1,000 μm vessels, but due to the shape of the flow profile this corresponds to a lower average flow velocity in the 1,000 μm vessel. While the true value for the flow velocities may differ from the calculated values, this difference is the same for all machines, so the comparison between machines is still valid per vessel.
A drawback of our study is that we have made assumptions on the capillary sizes and flow velocities in inflamed joints based on papers published on healthy subjects and periulcerous regions. This may not be entirely correct. Therefore, at present it is crucial to ascertain the flow velocities and capillary sizes in inflamed joints. With this information the minimal flows that rheumatological US machines need to be able to detect will be known.
Nonetheless, for a reliable and reproducible detection of very low flows in inflamed joints, the choice of the US machine and its settings seems very important. Caution should be exercised when conducting a multi-machine trial or when making treatment decisions based on PDUS. Our flow phantom could be used to decide which US machine to use both in clinical practice and in clinical trials.
We created a flow phantom to test the sensitivity of US machines to very low flows in small vessels. We found that the sensitivity of the PD modalities was very different between five US machines. Based on the results of our study it would be advisable to standardise and validate US machines both for rheumatological clinical practice and for clinical trials. Our phantom could be used for this purpose.
Pulse repetition frequency
We thank H.M.M. van Beusekom, PhD, pathobiologist, from the Department of Cardiology, Erasmus MC, for providing us with the microbalance and helping us test the reliability of the pump.
- Silman AJ, Pearson JE: Epidemiology and genetics of rheumatoid arthritis. Arthritis Res. 2002, 4: S265-S272. 10.1186/ar578.PubMed CentralView ArticlePubMedGoogle Scholar
- Gordon P, West J, Jones H, Gibson T: A 10 year prospective followup of patients with rheumatoid arthritis 1986–96. J Rheumatol. 2001, 28: 2409-2415.PubMedGoogle Scholar
- Mottonen T, Hannonen P, Korpela M, Nissila M, Kautiainen H, Ilonen J, Laasonen L, Kaipiainen-Seppanen O, Franzen P, Helve T, Koski J, Gripenberg-Gahmberg M, Myllykangas-Luosujärvi R, Leirisalo-Repo M, FIN-RACo Trial Group, FINnish Rheumatoid Arthritis Combination therapy: Delay to institution of therapy and induction of remission using single-drug or combination-disease-modifying antirheumatic drug therapy in early rheumatoid arthritis. Arthritis Rheum. 2002, 46: 894-898. 10.1002/art.10135.View ArticlePubMedGoogle Scholar
- Quinn MA, Emery P: Window of opportunity in early rheumatoid arthritis: possibility of altering the disease process with early intervention. Clin Exp Rheumatol. 2003, 21: S154-S157.PubMedGoogle Scholar
- Grigor C, Capell H, Stirling A, McMahon AD, Lock P, Vallance R, Kincaid W, Porter D: Effect of a treatment strategy of tight control for rheumatoid arthritis (the TICORA study): a single-blind randomised controlled trial. Lancet. 2004, 364: 263-269. 10.1016/S0140-6736(04)16676-2.View ArticlePubMedGoogle Scholar
- Filer A, De Pablo P, Allen G, Nightingale P, Jordan A, Jobanputra P, Bowman S, Buckley CD, Raza K: Utility of ultrasound joint counts in the prediction of rheumatoid arthritis in patients with very early synovitis. Ann Rheum Dis. 2011, 70: 500-507. 10.1136/ard.2010.131573.PubMed CentralView ArticlePubMedGoogle Scholar
- Brown AK, Conaghan PG, Karim Z, Quinn MA, Ikeda K, Peterfy CG, Hensor E, Wakefield RJ, O'Connor PJ, Emery P: An explanation for the apparent dissociation between clinical remission and continued structural deterioration in rheumatoid arthritis. Arthritis Rheum. 2008, 58: 2958-2967. 10.1002/art.23945.View ArticlePubMedGoogle Scholar
- Foltz V, Gandjbakhch F, Etchepare F, Rosenberg C, Tanguy ML, Rozenberg S, Bourgeois P, Fautrel B: Power Doppler ultrasound, but not low-field magnetic resonance imaging, predicts relapse and radiographic disease progression in rheumatoid arthritis patients with low levels of disease activity. Arthritis Rheum. 2012, 64: 67-76. 10.1002/art.33312.View ArticlePubMedGoogle Scholar
- Peluso G, Michelutti A, Bosello S, Gremese E, Tolusso B, Ferraccioli G: Clinical and ultrasonographic remission determines different chances of relapse in early and long standing rheumatoid arthritis. Ann Rheum Dis. 2011, 70: 172-175. 10.1136/ard.2010.129924.View ArticlePubMedGoogle Scholar
- Scire CA, Montecucco C, Codullo V, Epis O, Todoerti M, Caporali R: Ultrasonographic evaluation of joint involvement in early rheumatoid arthritis in clinical remission: power Doppler signal predicts short-term relapse. Rheumatology (Oxford). 2009, 48: 1092-1097. 10.1093/rheumatology/kep171.View ArticleGoogle Scholar
- Browne JE, Watson AJ, Hoskins PR, Elliott AT: Validation of a sensitivity performance index test protocol and evaluation of colour Doppler sensitivity for a range of ultrasound scanners. Ultrasound Med Biol. 2004, 30: 1475-1483. 10.1016/j.ultrasmedbio.2004.09.005.View ArticlePubMedGoogle Scholar
- Koski JM, Saarakkala S, Helle M, Hakulinen U, Heikkinen JO, Hermunen H: Power Doppler ultrasonography and synovitis: correlating ultrasound imaging with histopathological findings and evaluating the performance of ultrasound equipments. Ann Rheum Dis. 2006, 65: 1590-1595. 10.1136/ard.2005.051235.PubMed CentralView ArticlePubMedGoogle Scholar
- Stucker M, Baier V, Reuther T, Hoffmann K, Kellam K, Altmeyer P: Capillary blood cell velocity in human skin capillaries located perpendicularly to the skin surface: measured by a new laser Doppler anemometer. Microvasc Res. 1996, 52: 188-192. 10.1006/mvre.1996.0054.View ArticlePubMedGoogle Scholar
- Stucker M, Huntermann C, Bechara FG, Hoffmann K, Altmeyer P: Capillary blood cell velocity in periulcerous regions of the lower leg measured by laser Doppler anemometry. Skin Res Technol. 2004, 10: 174-177. 10.1111/j.1600-0846.2004.00064.x.View ArticlePubMedGoogle Scholar
- Pinter SZ, Lacefield JC: Detectability of small blood vessels with high-frequency power Doppler and selection of wall filter cut-off velocity for microvascular imaging. Ultrasound Med Biol. 2009, 35: 1217-1228. 10.1016/j.ultrasmedbio.2009.01.010.View ArticlePubMedGoogle Scholar
- Kamishima T, Nishida M, Horie T, Narita A, Sagawa A, Henmi M, Shirato H, Terae S: Power Doppler signal calibration using capillary phantom for pannus vascularity in rheumatoid finger joint. A pilot study. Clin Exp Rheumatol. 2011, 29: 1057-PubMedGoogle Scholar
- Veltmann C, Lohmaier S, Schlosser T, Shai S, Ehlgen A, Pohl C, Becher H, Tiemann K: On the design of a capillary flow phantom for the evaluation of ultrasound contrast agents at very low flow velocities. Ultrasound Med Biol. 2002, 28: 625-634. 10.1016/S0301-5629(02)00499-4.View ArticlePubMedGoogle Scholar
- Teirlinck CJ, Bezemer RA, Kollmann C, Lubbers J, Hoskins PR, Ramnarine KV, Fish P, Fredeldt KE, Schaarschmidt UG: Development of an example flow test object and comparison of five of these test objects, constructed in various laboratories. Ultrasonics. 1998, 36: 653-660. 10.1016/S0041-624X(97)00150-9.View ArticlePubMedGoogle Scholar
- Ramnarine KV, Nassiri DK, Hoskins PR, Lubbers J: Validation of a new blood-mimicking fluid for use in Doppler flow test objects. Ultrasound Med Biol. 1998, 24: 451-459. 10.1016/S0301-5629(97)00277-9.View ArticlePubMedGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.