I'm sorry I can't be more helpful other that offering suggestions as I'm not running AD, but here's another offering...

What if you tried...

$adsUser.FirstName = "Fred"
$adsUser.SetInfo