Back
Michel N'Guessan scored the only goal of the game in the 90th minute after coming off the bench just moments earlier.
Siwelele were on the front foot from the first whistle with an early corner that was headed just wide of the target by Siyabonga Ndebele.
The home team then settled into a period of composed passing before a half-chance for Rise and Shine as Tlou Nkwe swung in a corner at the other end that needed clearing by the Siwelele backline.
A seventh minute Bonginkosi Dlamini set-piece was swung in too deep for an advanced Juan Mutudza before Jody February put his body on the line to punch clear a dangerous free-kick swung in by Nkwe.
Manelis Mazibuko managed to get a shot on target after being fed by Tebogo Potsane on the edge of the 18-yard area and Oscarine Masuluke needed two attempts to secure the ball.
Christian Saile was just wide with a first time shot just minutes later as Siwelele continued to look threatening.
February made light work of a well hit half volley from Tidimalo Molokwane as Polokwane got forward, while there was a delay in proceedings at the other end as Edwin Ramaja was pushed into Masuluke by Saile.
There were calls for a penalty as Mazibuko went down in the box under the challenge of Ramaja, but the referee waved play on.
With the first half winding down, Mazibuko thought he was through on goal after a good ball forward out of midfield, but Manuel Kambala got back to make a vital tackle and knock the ball out of play.
The only change at the break saw Polokwane introduce Giovanni Philander for Keorapetse Sebone.
Nkwe wasted an opportunity to swing in a cross from the left as the away team started the second half on the ball, with a delivery that hit the side-netting.
Saile was inches away from connecting to a good low ball from Potsane form the right from after a superb through ball from Sphesihle Jeza to set his teammate down the right flank.
Lucky Mahlatsi and Batlhabane Monty Moketsi were introduced for Juan Mutudza and Tshepang Matube for Rise and Shine with 55 minutes on the clock as they looked to wrestle control of this tie from Siwlele.
The home team were certainly not as dominant after the break as they had been in the first half where Mazibuko had been pulling the strings.
Tidimalo Molokwane tried his luck from range on 67 minutes with an effort he fired well past the target, ahead of a triple change for Siwelele as Matthew Marou, Selaelo Rasebotja and Shadrack Kobedi came on for Saile, Thato Letshedi and Katlego Mokhuoane.
A cross from Philander from the right was just too far ahead of his teammates in the box, before a Potsane delivery at the other end was well read by an advancing Masuluke.
February got both hands to a Nkwe cross form the left after a promising Polokwane break forward with time running out for both sides to find a winner.
Michel N'Guessan was introduced for Siwlele in a last throw of the dice for the home team, as a late substitute for Sphesihle Jeza on 87 minutes, and he found the winner just three minutes later.
The action had been swinging from end to end but with no real final product until Potsane danced his way past a number of Polokwane City defenders before feeding N'Guessan, who slid a low shot past a hapless Masuluke.
The result saw Siwelele move onto six points in 14th place on the league standings from eight games, and left Polokwane in 11th place with seven points.