The interesting bit is the speech recognition; the assistant part has been done. Apple's Newton could do it way back in the nineties: tell it to make an "appointment with Bob at 5" and it'd add a calendar entry at 5PM linked to the most likely contact named Bob.
