If you don't want to spend too much on a taxi, go to tourism information centre in the arrival hall and ask to call a taxi. It is much cheaper than to take the one that are in front of the airport.
Tourism Centre @ Vilnius Airport
val-k added
Also you could get a free Vilnius map and City guide