They'd balance a spoon-shaped piece of magnetic rock on any flat surface, and since it was magnetic, the handle would swivel to align itself with the Earth's magnetic poles.
They tend, on balance, to point up, as this means that they are pointing in the same direction as the magnetic field a configuration that is much more stable than the reverse.