Combine the olive oil, vinegar, bay leaves and garlic in a small saucepan and heat just until warm over low heat.
Remove from the heat and stir in the lemon rind, thyme, rosemary and fennel seeds.
Place the olives in a wide mouthed jar and pour in the olive oil mixture.
Shake the jar to coat the olives.
Refrigerate for two hours or for up to two weeks.
Shake the jar a few times a day to redistribute the seasonings.
Tip
Advance preparation: These will keep for about two weeks in the refrigerator.