So, he solved this issue

– In the introduction to the album ‘Secretary of Two Popes’ with photos of the outstanding photographer Grzegorz Gałązka, you mentioned about the story from the first days of the pontificate of John Paul II. Perhaps, it is the best shown relationship between the Pope and Fr. Stanisław Dziwisz.
– I heard it from John Paul II. He once talked about the first days after the conclave in 1978. When he became pope, he invited Fr. Stanislaus. He informed him that he wanted him to remain his personal secretary. Just like for many years in Krakow. But Father Dziwisz said: “I will not be a secretary.” He argued that he did not know the Vatican State and the Roman Curia well. He added that many priests know Italian better. Of course, the Pope did not care. But Father Dziwisz re-examine that he will not become a secretary. Then, John Paul II began to collect documents and items from his desk. Father Stanisław stood amazed. The Holy Father looked at him and said: “If you are coming back to Poland, I am coming back too!” And so, he solved this issue. They remained in the Vatican, and their relationship was based on enormous respect and mutual trust.

With the consent of Fr. Archbishop. Mieczysław Mokrzycki – “Secretary of two popes – conversation with priest Archbishop.
Mieczysław Mokrzycki. ” Literary Publishing House.