A phosphodiester bond is the bond that joins the 5' carbon of the sugar molecule from one nucleotide to the 3' carbon of an adjacent nucleotide's sugar. It involves two separate "ester" bonds linking the sugars to an intermediate phosphate group, hence the name.
Multiple phosphodiester bonds will join nucleotides into a growing nucleic acid polymer, as shown in the figure below.