Bring potatoes to boil in large pot of water. Reduce heat to medium-low and simmer until potatoes are tender, about 17 minutes. Drain; let stand until cool enough to handle, about 20 minutes.
Cut potatoes into 3/4-inch pieces. Place 1 layer of potatoes in large bowl; sprinkle with some of vinegar and salt and pepper. Continue layering potatoes with vinegar, salt, and pepper. Add all remaining ingredients; toss. Season with salt and pepper. DO AHEAD Can be made the day before. Cover and chill.