Edinburgh 17 Ulster 13:Ulster came within a whisker of adding Edinburgh's scalp to that of Bath but late scores at Murrayfield denied Brian McLauglin's side. The bonus point keeps Ulster in second place with Stade Francais and Bath playing tomorrow.
With just over 10 minutes remaining Visser went over for an unconverted try before Godman sealed victory with a last-minute penalty.
Ulster had beaten Bath in their Heineken Cup opener while Edinburgh had gone down to Stade Francais and the spirits of the Edinburgh fans among the crowd of 5747 will have sunk before kick-off with the news that multi-capped, multi-points kicking full back Chris Paterson was out with a viral infection replaced by Steve Jones.
However, his kicking replacement Godman gave his side the best possible start by kicking home a penalty in the first minute from just inside the Ulster half.
Ulster adopted a conservative approach with number 10 Ian Humphreys repeatedly stabbing the ball into good positions.
Edinburgh tried to raise the pace but to little effect. However, in the 20th minute a drive from a line out brought a penalty on the Ulster 22 that Godman kicked home.
However, from the re-start the whole face of the game changed. Ulster winger Timoci Nagusa broke from the edge of the ruck and the Edinburgh defence was left looking at one another as he cut inside to the posts from where Humphreys converted.
This put Edinburgh into their shell and things only got worse. After Godman had missed a long penalty Humphreys kicked one to open the points gap to 10-6.
Edinburgh at last got some zip into their play as the interval beckoned but Godman had a drop goal charged down and then missed his second penalty.
In control Ulster began the second half with a slick penalty to touch, line out drive, followed by a penalty against Edinburgh kicked by Humphreys.
Again Edinburgh raised the pace and following a penetrative run by Roddy Grant, Nick De Luca was held up on the line.
With the game now moving into the last quarter and the home substitutes adding impetus Edinburgh became established in the visitors’ half.
The pressure brought a penalty when the scrum went down. Godman struck it home in the 67 minutes and even better was to follow two minutes when Godman set De Luca free.
He carved an opening before releasing Dutch winger Tim Visser who got over in the corner for an unconverted try. Godman confirmed the win with a last-minute penalty concluding constant Edinburgh pressure.