Many foods can be hazardous for babies, especially when they first eat solid food. Not every food is safe for a baby to eat. Some foods require extra preparation to be safe for babies to swallow without choking on. However, some other foods can elicit an allergic reaction in babies and should be avoided when they first begin eating solid foods.