had grown up

"had become an adult"

refused to be called

This can be stated in active form. Alternate translation: "refused to allow people to call him" (See: rc://en/ta/man/translate/figs-activepassive)