Taylor had made his way to 18 off 46 balls. He then attempted to fend a bouncer from Morne Morkel.
It was a back of a length delivery that nastily climbed up onto Taylor. He had his eyes off the ball which then struck him squarely on the hands.
The area swelled up noticeably and Ross Taylor was seen wincing in pain.
It hasn't been a good year thus far for Taylor. In January he tore his calf muscle attempting to run a quick single in the one-off Test against Zimbabwe. The injury forced him out the game till the onset of the Tests against South Africa.
Team physiotherapist Paul Close was on the scene quickly with the magic spray.
Despite the swelling, the brave cricketer tried to battle on. He faced one more delivery and guided a single to backward point. He then raised his bat to the pavilion, unable to carry on..
Here New Zealand's captain Ross Taylor gets a pat on the back from Dale Steyn as he goes off the field. An x-ray later confirmed that Taylor has a fracture of the ulna bone of his left forearm.
It was unclear how long Taylor would be sidelined. New Zealand Cricket's medical director Ian Murphy said the skipper would see an orthopaedic surgeon "to determine the best course of action and length of time out of the game".
Taylor is scheduled to play for the Delhi Daredevils in the Indian Premier League starting next month, and New Zealand's next commitment after the South African series is a West Indies tour starting in late June.