Pope Francis has urged the Catholic Church to shun modern temptations and stick to its gospel roots.

In his first public mass, the Pontiff warned that it would become just another NGO if it didn't act according to the teachings of Christ.

Speaking in perfect Italian and without notes, the Argentine said:

"We can walk all we want, we can build many things, but if we don't proclaim Jesus Christ, something is wrong. We would become a compassionate NGO and not a Church which is the bride of Christ,".

It seems the new Pontiff has started as he means to go on after it emerged he had paid a personal visit to a Rome hostel, where he had left his belongings before entering the conclave on Tuesday.

He wanted to thank the staff in person and pay his own bill.

The 76-year-old lived a humble life in Buenos Aires, where he shunned the pomp and grandeur of his position as Archbishop.

It's widely reported that he opted for a bicycle over a chauffeur driven limo and would often visit the local slums to speak to those in poverty.

Pope Francis' homily also focused on faith:

"When we walk without the cross, when we build without the cross and when we proclaim Christ without the cross, we are not disciples of the Lord. We are worldly," he said.