You can't stay in the company of God without being in agreement with God.
The devil was in disagreement with God so he was kicked out of heaven.
Isaiah 14:12. “How you are fallen from heaven, O shining star, son of the morning! You have been thrown down to the earth, you who destroyed the nations of the world.Man’s agreement with the devil in the Garden was a disagreement with God
The man was in agreement with the devil about the Garden, which brought him into disagreement with God. So man was kicked out of the Garden.Much more in Bishop Boone's outline and Scriptures!