I see from various sites that the last man hanged for sodomy in Sydney was Thomas Parry in 1839, although the last "gay execution" seems to have been one in Tasmania in 1863.
I've read before of scandal in Sydney relating to what convicts were getting up to at night in their barracks, but hadn't read of this more upper class, somewhat amusing, matter before:
But it was clearly a vice that was not confined only to the lower orders. In 1836, Sydney was rocked by the Reverend Yate scandal. This involved a protégé of the very respectable Samuel Marsden who was known as the 'flogging parson' for his penchant, as a magistrate, to hand out severe sentences as a deterrent. Yate was a well known and widely published preacher in England, who had even had an audience with King William IV. On the voyage out to Sydney on the Prince Regent, Yate had spent much time in the company – and the hammock – of the third mate, Edwin Denison. When they arrived in Sydney in June of that year, the two moved into lodgings together in Park Street, where they were joined by another sailor from the Prince Regent, with the unlikely name of Dick Deck. Neighbours soon complained about the men's behaviour, and the scandal became the talk of Sydney, although the Crown Solicitor suggested that 'it seems more than probable that the crime of sodomy cannot be proved against him according to law'. By mid-December of that same year, Yate and Denison had sailed for England, much to the relief of the Anglican community in Sydney.9