He was very happy without it!
Read in Phillipians, he mentions joy about 17 times in that letter!
And he was even in prison!!
Let nothing be done through selfish ambition or conceit, but in lowliness of mind let each esteem others better than himself. Let each of you look out not only for his own interests, but also for the interests of others. Let this mind be in you which was also in Christ Jesus, (Philippians 2:3-5 NKJV)