Combine cream cheese and butter, beating until smooth. Add powdered sugar and the vanilla, and then beat until light. Add a couple of tablespoons of milk at a time to thin. By hand, stir pecans into mixture. Refrigerate until needed.
Always add solid ingredients, nuts or fruits, at the end of mixing and gently mix in by hand.