Add cubed and peeled potatoes to a large pot and cover potatoes with cold water.
Place potatoes on stove over high heat and bring to a boil. Boil potatoes until they are fork tender, about 20 minutes.
Once potatoes are fork tender, drain and add to a large mixing bowl.
Add mayo, mustard, olives, pickles and onions to bowl with potatoes. Fold ingredients in until the potato salad is combined. Season with salt and pepper to taste.
Eat warm or put in the refrigerator to cool for a couple hours.