It looks like a rock, or maybe a pile of manure, by the horse’s rearmost hoof. Rumor is that the turtle was added by the sculpture to symbolize how slow the State of Connecticut was to pay him for this work. But then, everything in this state moves more slowly than necessary, including the wait at this intersection for a pedestrian walk signal.
