The following question is addressed: to what extent an n-tuple of m-by-m Hermitian matrices is determined by its joint numerical range. The cases m = 2, n arbitrary, and m = n = 3 are considered in detail. The latter case requires application of Groebner bases.