We went to Provence this year for our anniversary (2nd.) The duck was wonderful. In Saratoga we like Brindisi's a lot- it's continental type food. A good romantic Italian place is Paolo Lombardi's in Wynantskill/West Sand Lake- 25 minutes from Latham. In downtown I LOVE Le Serre- hubby was hesitant about French food, but loved it (very continental menu too.) My favorite restaurant around is The Pillars but it's out in New Lebanon (40 minute drive.)
For our first anniversary, my DH and I went back to one of my favorite places- The Four Chimney's Bed & Breakfast / Inn in Bennington (45 minutes from Latham.) We've stayed & Eaten there 7-10 times, and each time was perfect. Their food is wonderful (try the mustard soup if it's on the menu- crazy sounding but delicious), the ambiance is very romantic, and if you stay over Our room picks are: Room one is beautiful- newly decorated, gas fireplace, oversized (2 person) jacuzzi tub and one of the best beds EVER (king), and Room 2 has a nice wood fireplace, four poster King bed and a great couples marble shower. We also liked the ice house / carriage house for their privacy and Room 5 has a queen bed, but also fireplace, couples jacuzzi, and is tucked under the eaves. The breakfasts here are full b'fast cooked to order- and very delicious.