Baby olives?

Our newly planted olive tree had lots of blossom last month or so - are these baby olives growing - so exciting if they are the tree is full of them. After our only olive tree was planted someone said we may need two for it to bear fruit - but may be we might get a crop after all??