Elon Musk lived with his father but their relationship went bad. He is even vocal as he claimed him to be “terrible”. He has two (2) half-siblings with his father.