Bones of Joseph? Eww

Exodus 13:19 says, “And Moses took the bones of Joseph with him: for he had straitly sworn the children of Israel, saying, God will surely visit you; and ye shall carry up my bones away hence with you.”  Why would Joseph have sworn the children of Israel to this?  Joseph had a great life in Egypt.  He basically ran the place.