Sounds like you have caterpillars! Little green caterpillars decimated my petunias one year before I realized what was going on. They eat holes in the flowers, bigger and bigger, and then move on to the buds, eventually eating everything. The best thing to eradicate them is something called "Bt", and it works fantastically well. It's a spray you can find at garden stores that contains Bacillus Thuringiensis. You can read more about it, but it is 100% effective against caterpillars.
I'm planning on growing some normal petunias first. Then once the price has come down a bit (and I have some experience keeping petunias alive and overwintering them indoors) I'll grab a Firefly plant.
I did however buy some of those new purple tomatoes. Hopefully they'll do well enough I'll be able to make some crosses I want to try (Early Girl and San Marzano).
The one I got my wife a month ago is doing great! It has like 6 flowers blooming right now and another handful about to. These things are so fucking cool!