What did Paul mean by his desire to "depart and be with Christ" in Philippians 1:23?

Was Paul saying he expected to go to heaven to "be with Christ" immediately after his death? What decision was Paul struggling with in this passage in Philippians?

In Philippians 1:21-24 Paul wrote, "For to me, to live is Christ, and to die is gain. But if I live on in the flesh, this will mean fruit from my labor; yet what I shall choose I cannot tell. For I am hard-pressed between the two, having a desire to depart and be with Christ, which is far better. Nevertheless to remain in the flesh is more needful for you."

Sobered by the possibility of dying, and weary of the stresses of life, Paul acknowledged that he would welcome the rest death brings in some ways. Since all conscious thought ceases upon death (Ecclesiastes 9:5), and the righteous remain in the grave until their resurrection at the return of Christ (1 Thessalonians 4:16), he would "be with Christ" in his next waking moment. However, recognizing the need for his continued service to the church at Philippi, Paul believed that he would not die before seeing the members there again.

Some try to contort this scripture to say that Paul expected to go to heaven to "be with Christ" the instant that he died. But it says nothing of going to heaven. Further, interpreting Paul's words this way would conflict with the rest of Scripture, which reveals that Christians do not go to heaven upon death.