Combine cream cheese, sour cream, sugar, and vanilla. With a fork, remove a small amount of the center from each dessert cup. Fill centers of cups with cream cheese mixture. Arrange pecans on top of each. Chill until serving time. Just before serving, heat together caramel topping and brandy in a saucepan. Spoon over filled dessert cups.