Oh deer! I think Rosemary may be the only deer proof plant but lavender and Euphorbias are also very unpalatable to deer. Plants with fuzzy leaves such as lady's mantle and lamb's ear are not tasty to deer and for the center of the pot a tall and narrow barberry such as the Orange Rocket barberry would make an elegant, drought proof and mostly deer proof focal point. Large sword ferns in the pots would also look nice.  I have also used battery powered deer shocks that you can order from Amazon to place in your container gardens. The deer are lured to lick or taste the point on a slender stake then get a harmless but painful shock to their tongues. You place these stakes around your patio or container garden area.  This could scare them off from your potted plants for good or just teach them to avoid the stakes. In general you have to keep changing things up with deer repellent sprays, water sprays and shocking devices if you want to demand 'not tonight deer' and enjoy your garden. Keep growing, Marianne Binetti