# Glossary

## Algo: Sorting algorithm

A sorting algorithm is an algorithm that puts elements of a list in a certain order. The most-used orders are numerical order and lexicographical order. Efficient sorting is important for optimizing the use of other algorithms (such as search and merge algorithms) that require sorted lists to work correctly; it is also often useful for canonicalizing data and for producing human-readable output. More formally, the output must satisfy two conditions:

1. The output is in nondecreasing order (each element is no smaller than the previous element according to the desired total order);
2. The output is a permutation (reordering) of the input.

Sorting algorithms are often classified by:

• Computational complexity (worst, average and best behavior) of element comparisons in terms of the size of the list ($n$). For typical serial sorting algorithms good behavior is $O(n \log n)$, with parallel sort in $O(log^2 n)$, and bad behavior is $O(n^2)$. (See Big O notation.) Ideal behavior for a serial sort is $O(n)$, but this is not possible in the average case, optimal parallel sorting is $O(log n)$. Comparison-based sorting algorithms, which evaluate the elements of the list via an abstract key comparison operation, need at least $O(n \log n)$ comparisons for most inputs.
• Computational complexity of swaps (for in place algorithms).
• Memory usage (and use of other computer resources). In particular, some sorting algorithms are in place. Strictly, an in place sort needs only $O(1)$ memory beyond the items being sorted; sometimes $O(\log n)$ additional memory is considered in place.
• Recursion. Some algorithms are either recursive or non-recursive, while others may be both (e.g., “Merge Sort”).
• Stability: stable sorting algorithms maintain the relative order of records with equal keys (i.e., values).
• Whether or not they are a comparison sort. A comparison sort examines the data only by comparing two elements with a comparison operator.
• General method: insertion, exchange, selection, merging, etc. Exchange sorts include bubble sort and quicksort. Selection sorts include shaker sort and heapsort. Also whether the algorithm is serial or parallel. The remainder of this discussion almost exclusively concentrates upon serial algorithms and assumes serial operation.
• Adaptability: Whether or not the presortedness of the input affects the running time. Algorithms that take this into account are known to be adaptive.

Examples of sorting algorithms: “Insertion Sort”, “Merge Sort”, “Heap Sort”, “Quick Sort”.

Visualizations of various sorting algorithms: By David R. Martin: http://www.sorting-algorithms.com/ By David Galles: http://www.cs.usfca.edu/~galles/visualization/ComparisonSort.html