ankit garg princeton univ. joint work with leonid gurvits rafael oliveira ccny princeton univ. avi...
DESCRIPTION
Commutative Polynomial Identity Testing (PIT) Arithmetic Circuit Arithmetic FormulaTRANSCRIPT
![Page 1: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/1.jpg)
Ankit GargPr inceton Univ.
Jo int work with
Leonid Gurvits Rafael Ol iveira CCNY Pr inceton Univ.
Avi WigdersonIAS
Noncommutative rational identity testing (over the rationals)
![Page 2: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/2.jpg)
Outline
Introduction to PIT/RIT.Symbolic matricesAlgorithmConclusion/Open problems
![Page 3: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/3.jpg)
Commutative Polynomial Identity Testing (PIT)
: polynomials in commuting variables over and their representations.
Example:
𝑦 1 𝑦 2 1
+¿ +¿×
𝑦 1 𝑦 2 1
+¿ +¿×
𝑦 3Arithmetic Circuit Arithmetic Formula
![Page 4: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/4.jpg)
Commutative Polynomial Identity Testing
Given two representations as circuits or formulas, check if they represent the same polynomial.
Equivalent to checking if a representation represents the polynomial.
[Schwartz, Zippel, DeMillo-Lipton ~80]: Randomized polynomial time algorithm.
Plug random values for the variables.Deterministic polynomial time algorithm? – major
open problem.
![Page 5: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/5.jpg)
Non-commutative PIT
: polynomials in non-commuting variables over and their representations.
Examples: ,
𝑥1 𝑥2 1
+¿ +¿×
𝑥1 𝑥2 1
+¿ +¿×
𝑥3Arithmetic Circuit Arithmetic Formula
![Page 6: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/6.jpg)
Non-commutative PIT
[Raz-Shpilka `05]: Deterministic polynomial time algorithm for formulas.
[Amitsur-Levitzki `50, Bogdanov-Wee `05]: Randomized polynomial time algorithm for circuits (polynomial degree).
Plugging random field elements does not work.Example: If non-commutative polynomial of degree ,
plugging random matrices gives non-zero whp. tight! Deterministic polynomial time
algorithm for circuits open.
![Page 7: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/7.jpg)
Commutative Rational identity testing (RIT)
: rational functions in commuting variables and their representations.
Example:
𝑦 1 𝑦 2 1
+¿ +¿×
𝑦 3 𝑦 1
INV
+¿
![Page 8: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/8.jpg)
Commuting RIT
Given a rational expression as a formula/circuit, is it identically ?
Can be reduced to (commutative) PIT.
Every commutative rational expression can be (efficiently) written as a ratio of two polynomials.
![Page 9: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/9.jpg)
Non-commutative rational identity testing
: non-commutative rational functions and their representations.
Example: No easy canonical form.
𝑥1 𝑥2 1
+¿ +¿×
𝑥 𝑥1
INV
+¿
![Page 10: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/10.jpg)
Non-commutative RIT
Given two non-commutative rational expressions as formulas/circuits, determine if they represent the same element.
What does it mean for two expressions represent the same element? – No easy canonical form.
Operational definition [Amitsur `66].
![Page 11: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/11.jpg)
Free Skew Field
Given a rational expression : :=
Example: .
Call an expression valid if .
![Page 12: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/12.jpg)
Free Skew Field
[Definition]: Two valid rational expressions and are equivalent if
.
[Amitsur `66]: Equivalence classes of valid rational expressions form a skew (non-commutative) field.
Theorem [Amitsur `66]: If and , then .
![Page 13: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/13.jpg)
Non-commutative rational identity testing
Given two valid rational expressions as formulas/circuits, are they equivalent?
Also known as the word problem for the free skew field.
Same as, given a valid rational expression, is it equivalent to ?
Not even clear if it is decidable.
![Page 14: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/14.jpg)
Non-commutative rational identity testing
[Cohn-Reutenauer `99]: Reduce to solving a system of (commutative) polynomial equations (for formula representations).
Can also be deduced from structural results in
[Cohn `71].
Several other algorithms but all exponential time (with or without randomness).
![Page 15: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/15.jpg)
Non-commutative rational identity testing
[Theorem]: . For formulas, there is a deterministic polynomial time algorithm for non-commutative RIT.
[IQS `15b, next talk]: Deterministic polynomial time algorithm for formulas over large enough fields.
For circuits, the best algorithms exponential (with or without randomness). Even without divisions.
![Page 16: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/16.jpg)
Outline
Introduction to PIT/RIT.Symbolic matricesAlgorithmConclusion/Open problems
![Page 17: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/17.jpg)
Symbolic matrices
are matrices over . are non-commutative variables.
has entries linear polynomials in .
Call singular if . (over )
![Page 18: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/18.jpg)
Symbolic matrices
singular over .
has a factorization , matrix over , matrix over .
has a factorization , matrix over, matrix over. [Cohn `71] Not true in the commutative
setting!
![Page 19: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/19.jpg)
Symbolic matrices
has a factorization , matrix whose entries are affine forms, matrix whose entries are affine forms. [Cohn `71]
There exist scalar invertible matrices s.t. has a Hall blocker.
[Cohn `71]
![Page 20: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/20.jpg)
Symbolic matrices
There exist scalar invertible matrices s.t. has a Hall blocker.
𝑗
𝑖𝑖+ 𝑗>𝑛
![Page 21: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/21.jpg)
SINGULAR
SINGULAR: Given , test whether singular over .
[Cohn `70s]: Non-commutative rational identity (for formulas) testing reduces to SINGULAR.
Analogue of Valiant’s determinantal representation of commutative formulas (before Valiant).
![Page 22: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/22.jpg)
SINGULAR
[Theorem]: SINGULAR is in P for .
[IQS `15b, next talk]: SINGULAR is in P for large enough fields.
Next: Restate SINGULAR in simple linear algebra language.
![Page 23: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/23.jpg)
Shrunk Subspaces
[Definition]: A subspace is shrunk by if there exists a subspace and .
𝑉 𝑊𝐴𝑖
![Page 24: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/24.jpg)
Shrunk Subspaces
SINGULAR testing for is the same as testing if admit a shrunk subspace.
Also testing if in the nullcone of the left-right action [next talk].
![Page 25: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/25.jpg)
Outline
Introduction to PIT/RIT.Symbolic matricesAlgorithmConclusion/Open problems
![Page 26: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/26.jpg)
Doubly stochastic operators
[Gurvits `04]: Let be matrices over . If and (doubly stochastic) then admit no shrunk subspace.
Also true in an approximate sense. +
![Page 27: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/27.jpg)
Doubly stochastic operators
+
[Gurvits `04]: If , then admit no shrunk subspace.
Admitting a shrunk subspace is invariant under the left-right action.
![Page 28: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/28.jpg)
Doubly stochastic operators
Admitting a shrunk subspace is invariant under the left-right action.
Let be invertible matrices. Then admit no shrunk subspace iff admit no shrunk subspace.
[Gurvits `04]: If there exist invertible matrices s.t. , then admit no shrunk subspace.
![Page 29: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/29.jpg)
Doubly stochastic operators
[Gurvits `04]: If there exist invertible matrices s.t. , then admit no shrunk subspace.
[Gurvits `04]: admit no shrunk subspace iff there exist invertible matrices s.t. .
![Page 30: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/30.jpg)
Algorithm G
Given: matrices .Goal: determine if there exist invertible s.t.
for = and
Can always ensure one of the conditions by appropriate normalization.
Take. Ensures .Take. Ensures .
![Page 31: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/31.jpg)
Algorithm G
Left normalization: Take, .Right normalization: Take , .
Algorithm: Repeat for steps: Left normalize; Right normalize; Check if If yes, output no shrunk subspace. Else shrunk subspace.
![Page 32: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/32.jpg)
Algorithm G
Algorithm already suggested in [Gurvits `04].
Our contribution: prove that it works!
“Non-commutative extension” of matrix scaling algorithms [Sinkhorn `64, LSW ‘98].
![Page 33: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/33.jpg)
Analysis - Capacity
Potential function: capacity.
Lemma 1: (after normalization).Lemma 2: increases at each step by a factor
of as long as .Theorem 3: , if admit no shrunk subspace.
Main contribution
![Page 34: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/34.jpg)
Fullness dimension
Goal: Test if is non-singular.
Natural algorithm: Plug in matrix values for the ’s.
Choose random matrices of dimension and check whether .
How large to take?[Derksen `01, IQS `15a]: suffices.Doesn’t give a polynomial time algorithm but
helps in our analysis of capacity!
![Page 35: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/35.jpg)
Fullness dimension
[Derksen-Makam `15]: suffices! Use ideas from [IQS `15a].
[IQS `15b] give deterministic polynomial time algorithm for all large enough fields [next talk].
![Page 36: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/36.jpg)
Outline
Introduction to PIT/RIT.Symbolic matricesAlgorithmConclusion/Open problems
![Page 37: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/37.jpg)
Conclusion
Analytic algorithm for a purely algebraic problem!
Polynomial degree bounds not essential to put algebraic geometric problems in P.
Not essential for this specific problem [next talk].
![Page 38: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/38.jpg)
Open Problems
Randomized polynomial time algorithm for non-commutative circuits (without division and degree bounds).
Conjecture: If is computed by a non-commutative circuit of size , then there exist matrices of dimension s.t. .
[Amitsur-Levitzki `50]: If of degree , then there exist matrices of dimension s.t. .
![Page 39: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/39.jpg)
Open Problems
Our algorithm and algorithm of [IQS `15b] are both white box.
Design hitting sets for SINGULAR.Set of tuples of dimension matrices s.t. for
any non-singular , there exist s.t. .Captures perfect matching for bipartite
graphs and hitting sets for non-commutative ABPs as special cases.
Also related to NNL for the left-right action.
![Page 40: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/40.jpg)
Open Problems
Syntactic proofs of rational expressions equivalent to
[Cohn-Reutenauer `99]: If is equivalent to , then by syntactic manipulations can convert into .
Example (Hua’s identity):
![Page 41: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/41.jpg)
Open Problems
= = == =
Natural proof system.Proofs always polynomial in size?Connections to other proof systems?
![Page 42: Ankit Garg Princeton Univ. Joint work with Leonid Gurvits Rafael Oliveira CCNY Princeton Univ. Avi Wigderson IAS Noncommutative rational identity testing](https://reader036.vdocuments.mx/reader036/viewer/2022062413/5a4d1b727f8b9ab0599b5ce9/html5/thumbnails/42.jpg)
Thank You