Can I give my baby a bottle at times and breastfeed at other times? It's not recommended. Bottle nipples are easier for the baby to suck on and they will obtain bad breastfeeding technique which in turn will cause them to be less hungry or not get enough milk from breastfeeding.