I would not drive that until its repaired. The 1st generation Sequoia's lower ball joint design can suffer complete separation when worn out like that. It can damage the control arm, hub, brake lines, ABS system, suspension components, etc. not to mention loss of control and in some cases roll over.
Genuine 555 Sankei are OEM btw. No need to buy direct from Toyota. Buy the ball joints with the replacement bolts(4) too. Sankei offers them in a kit or the ball joints alacart.