chapter 22: elementary graph algorithms overview: definition of a graph representation of graphs...
TRANSCRIPT
Chapter 22: Elementary Graph Algorithms
Overview:Definition of a graphRepresentation of graphs
adjacency listmatrix
Elementary search algorithmsbreadth-first search (BFS)depth-first search(DFS)
topological sortstrongly connected components
Notation
Graph G(V,E) is a data structure defined by a set of vertices Va set of eges E
|V| = # of vertices
|E| = # of edges
Usually omit | | in asymptotic notationQ(V, E) means Q(|V|, |E|)
Adj = adjacency-list representation of G(V,E) is an array of |V| lists
Adj[u] contains all vertices adjacent to vertex u
For a directed graph, edge (uv) represented by v in Adj[u]. sum of lengths of adjacency lists = |E|
For an undirected graph, edge (u,v) appears as v in Adj[u] and as u in Adj[v].
\sum of lengths of adjacency lists = 2|E|
Memory requirement is Q(V+E)
A weighted graph has a function w(u,v) defined on the domain E.
The weight of edge (u,v) can be stored as property of vertex v in Adj[u].
adjacency-matrix representation:
Number the vertices 1,2,...|V|
Define |V| x |V| matrix A such that aij = 1 if (i, j) E, aij = 0 otherwise
For a weighted graph, set aij = w(i,j) if (i, j) E
Disadvantage is requires Q(V2) memory regardless of |E|
Advantage is speed of determining if edge (u,v) is in graph
For an undirected graph A is symmetric
A sparse graphs mean |E| << |V|2 adjacency-list representation preferred (saves space)
A dense graph means |E| ~ |V|2
adjacency-matrix representation preferred (speed)
Graph representations
1
1
Breadth-first search: Given G(V,E) and a source vertex s,
Breadth-first search does the following:(1) finds every vertex v reachable from s
(2) calculates distance (minimum number of edges) between s and v
(3) produces a Breadth-first tree with s as the root and every reachable vertex as a node
The path from s to v in the Breadth-first tree corresponds to the shortest path in G. “Breadth-first” finds all vertices at distance k from s before searching for any vertices at distance k+1.
BFS(G,s) pseudo code for each u V(G) – {s}
do color[u] white, d[u] , p[u] NIL
(Initialization: color all vertices white for “undiscovered” set distance from s as infinite, set predecessor in Breadth-first tree to NIL)
color[s] gray, d[s] 0, p[s] NIL
(initialize s as gray for “discovered” i.e. reachable from sA gray vertex has been discovered but its adjacency list has not been searched for links to other vertices. After adjacency list is searched, color is changed to black)
Q 0, Enqueue(Q,s)
(A “first-in first-out” queue holds a list of the current gray vertices Gray vertices with the smallest distance from s are processed firstResolve ambiguity by some rule like alphabetical order)
BFS(G,s) algorithm continued while Q 0
do u Dequeue(Q)for each v Adj[u]
do if color[v] = white then color[v] = gray d[v]d[u] + 1p[v] uEnqueue(Q,v)
color[u] black (adj list searched)
Runtime analysis:initialization requires O(V).each vertex is discovered at most once queue operations require O(V).searching adjacency lists requires O(E) total runtime O(V+E)
Example of BFS p596
Predecessor of v: p(v) is the vertex in whose adjacency list v was discovered
Predecessor sub-graph Gp(Vp,Ep)Vp = {v V : p[v] NIL} {s}Ep = {(p[v],v) : v Vp - {s}}
Predecessor sub-graph of BFS is a single tree
Finding shortest path is most common application of Breadth-first search
d(s,u) = shortest path between s and any u Vd(s,u) = if u is not reachable from s
Weight of a path is the sum of the weights of its edges
For an unweighted graph,weight of path = number of edges = length of path
For weighted graph, least-weight is not necessarily shortest path
Theorem 22.5: On termination of BFS(G,s), (1)all reachable vertices have been found
(2) d[v] = d(s,v) for v V (some may be infinite)
(3) for any reachable v s, a shortest path includes p[v] followed by edge (p[v],v).
Depth-first search: Explores all edges leaving a given vertex, v, before “backtracking” to explore edges leaving the vertex from which v was discovered
Continues until all vertices reachable from a given source are discovered If the graph still contains undiscovered vertices, choose a new source
p[v] = u if v was discovered in a search of the adjacency list of u
As in BFS, vertices initialized to white, colored gray when discovered, colored back after their adjacency list has been examined
d[v] is the timestamp field when v was discovered
f[v] is the timestamp field when v was blackened
range of timestamps is 1 to 2|V| d[v] < f[v]
Classification of edges:
Tree edge connects vertex to its predecessor
Back edge connects vertex to an ancestor in the same tree(also self loops in directed graph)
Forward edge connects vertex to descendant in the same tree
Cross edge: all othersIf in the same tree, then one vertex cannot be an ancestor of the other
Edges (u,v) can be classified by the color v when it is first exploredwhite v tree edgegray v back edgeblack v forward or cross edge
DFS Pseudocodes:
DFS(G)for each u V (initialization)
do color[u] white, p[u] NILtime 0for each u V (choose a new source)
do if color[u] = white then DFS-Visit(u)
DFG-Visit(u) (DFS from source u)color[u] gray, time time +1, d[u] time
(vertex u discovered)for each v adj[u]
do if color[v] = whitethen p[v] u, DFG-Visit(v)
color[u] black, f[u] time, time time +1(finished with vertex u)
DFS: Fig 22.4 p605
Predecessor subgraph Gp = (V,Ep); Ep = {(p[v],v) ; v V and p[v] NIL}Gp contains all the vertices of G; hence, may be multiple trees
Predecessor subgraph showing “parenthesis” structure
Predecessor subgraph showing Non-tree edgesB-edge: head () contains tail ()F-edge: tail () contains head ()C-edge: connects disjoint ()Note C-edges inside trees.
Fig 22.5 p607
Properties of DFS:
Gp of DFS is a forest of trees, each of which reflects the pattern of recursive calls to DFS-Visit (slide 15)
Pattern of discovery and finishing times has “parenthesis structure” (slide 18)For any 2 vertices u and v, exactly one of the following is true(1) intervals [d[u], f[u]] and [d[v], f[v]] are disjoint and
neither u nor v is a descendent of the other(2) [d[u], f[u]] is contained entirely in [d[v], f[v]] and
u is a descendent of v(3) [d[v], f[v]] is contained entirely in [d[u], f[u]] and
v is a descendent of u.
Corollary of the Parenthesis Theorem:
Vertex v is a descendant of u in the depth-first forest of G if and only if d[u] < d[v] < f[v] < f[u]
Theorem 22.10: Only tree and back edges occur in a DFS of an undirected graph
In DFS of undirected graph, edge type is determined by direction of search when edge is encountered.
Consider edge(u,v) with v in u’s adjacency list.
If edge(u,v) is traversed from u to v, then v is discovered on the traversal and edge(u,v) is a tree edge.
The only remaining option for traversal of edge(u,v) is from v to u = p(v), which we call a “back” edge in an undirected graph.
Predecessor graph is a single tree
CptS 450 Spring 2015[All problems are from Cormen et al, 3rd Edition]
Homework Assignment 11: due 4/15/151. ex 22.2-2 p 601 Draw Gp Show all edges2. ex 22.3-2 p 610 Draw Gp Show all edges
White-Path Theorem: Vertex v is a descendant of u in the depth-first forest of G (directed or undirected) if and only if at the time d[u] when u is discovered, v can be reached from u by a path consisting entirely of white vertices.
Lemma 22:11 A directed graph is acyclic if and only if a DFS yields no back edges
Proof: If G has a back edge (u,v) then v is an ancestor of u and (u,v) completes a cycle in G.
If G contains cycle c and v is the first vertex discovered in c, then a white path exist to vertex u the last vertex in c By white-path theorem, u is a decendent of v (u,v) must be a back edge
DAG = directed acyclic graphPrecedence among events: common use of DFS on DAGs
Example: precedence of events getting dressed
topological sort:linear ordering of vertices in a dag such that if G contains directed edge (u,v), then u appears before v in the ordering
Pseudocode for topological sort:Topological-Sort(G)
DFS(G) yields f[v] for all verticesAt each f[v], insert the vertex into the front of a linked listreturn list
New graph topology: all edges point left-to-rightf(v) decreases left-to-right
Theorem 22.12: Proof of the correctness of Topological-Sort(G)
When edge (u,v) is explored in the DFS of a dag, v must be white or black because
if v is gray, then (u,v) is a back edge (we would be exploring the adjacency list of v) and DFS of a dag cannot yield a back edge.
If v is white, then v is a descendant of u and f[v] < f[u] (Corollary of the Parenthesis Theorem in slide #19)
If v is black, then f[v] has already been assigned and, since we are still exploring the adj[u], f[v] < f[u].
Thus, for any edge(u,v) in the dag, f[v] < f[u]
\in topological sort, v will be on the right of u
\ all edges point to the right
Strongly Connected Components (SCCs) Strongly connected components (SCCs) of directed graph G(V,E) are a set of vertices VSCC V such that for every pair of vertices u and v, u ~> v and v ~> u (u reachable from v and v reachable from u)
Component graph GSCC = (VSCC, ESCC)Let C1, C2, ..., Ck denote the SCCs of directed graph G
VSCC = {v1, v2, ..., vk} contains a vertex from each SCC
edge (vi,vj) ESCC if G contains edge (x,y) for some x Ci and y Cj
(i.e. edges the component graph connect the SCCs of G)
Transpose of directed G(V,E) = GT(V,ET) where ET = {(u,v) : (v,u) E}(i.e. GT has same vertices a G, but its edges are reversed)
SCC(G) Pseudocode: Call DFS(G) to get f[u] for all vertices
Construct the transpose of G
Call DFS(GT) with vertices in order of decreasing f[u] of DFS(G)
The vertices of each tree of the DFS(GT) forest are a SCC of G
Example: Fig 22.9 p616
SCC(G) Pseudocode: Call DFS(G) to get f[u] for all vertices
Construct the transpose of G
Call DFS(GT) with vertices in order of decreasing f[u] of DFS(G)
The vertices of each tree of the DFS(GT) forest are a SCC of G
CptS 450 Spring 2015[All problems are from Cormen et al, 3rd Edition]
Homework Assignment 12: due 4/22/151. ex 22.4-1 p 614 Topo sort on DAG of Fig 22.8 p6152. ex 22.5-2 p 620 SCCs on graph in Fig 22.6 p611
Lemma 22.14Let C and C’ be distinct SCCs of directed G(V,E). Let (u,v) E be an edge with u in C and v in C’, then f(C) > f(C’)
Case 1: d(C) < d(C’) use white path theoremCase 2: d(C) > d(C’) use parenthesis structure
Corollary 22.15Let C and C’ be distinct SCCs of directed G(V,E). Let (u,v) ET be an edge with u in C and v in C’, then f(C) < f(C’)
Theorems behind the SCC pseudo-code
How Strongly-Connected-Components(G) works:
In the DFS of GT, start with a vertex in Cmax, the SCC that has the largest finish time.
The search will visit all of the vertices of Cmax but will not find an edge that connects Cmax to any other SCC.
If such an edge were found to C’, then by Corollary 22.15 of Lemma 22.14 f(Cmax) < f(C’), which violates the choice of Cmax as the SCC with the largest finish time
As the source of the next DFS in GT, chose a vertex in C’, the SCC with f(C’) larger than all other finishing time except those in Cmax.
The search will visit all the vertices of C’ and may find some edges that connect it to Cmax but not to any other SCC.
Since the vertices of Cmax have already been discovered, the only new vertices visited from the second source are those in C’.