Posts Tagged ‘EricVigoda’

Eric Vigoda, Analyzing Markov Chains using Belief Propagation

Wednesday, December 7th, 2016
Analyzing Markov Chains using Belief Propagation
Eric Vigoda
School of Computer Science, Georgia Institute of Technology, Atlanta, Georgia, USA
2016/12/16 Friday 3PM-4PM
For counting weighted independent sets weighted by a parameter λ (known as the hard-core model) there is a beautiful connection between statistical physics phase transitions on infinite, regular trees and the computational complexity of approximate counting on graphs of maximum degree D. For λ below the critical point there is an elegant algorithm devised by Weitz (2006). The drawback of his algorithm is that the running time is exponential in log D. In this talk we’ll describe recent work which shows O(n log n) mixing time of the single-site Markov chain when the girth>6 and D is at least a sufficiently large constant. Our proof utilizes BP (belief propagation) to design a distance function in our coupling analysis. This is joint work with C. Efthymiou, T. Hayes, D. Stefankovic, and Y. Yin which appeared in FOCS ’16.

[FYI] KAIST Theory Day (May 31, 2015)

Monday, May 11th, 2015

FYI: (KAIST Theory Day organized by Jinwoo Shin and Eric Vigoda)

KAIST Theory Day
2015/5/31 Sun 10AM-5PM (Building N1, room 102, KAIST)
9:30 – Coffee and refreshments
10:00 – Daniel Stefankovic (Rochester):  Spin models: connections between complexity, phase transition, belief propagation, and induced matrix norms
11:00 – Yitong Yin (Nanjing)Phase transition of hypergraph matchings
12:00 – Lunch break
1:30 – Euiwoong Lee (CMU):  Hardness of Graph Pricing through Generalized Max-Dicut
2:30 – Sewoong Oh (UIUC):  Data processing inequality for differential privacy and applications
3:30 – Coffee break
4:00 – Martin Ziegler (TU Darmstadt):  Algebraic Complexity Theory and Quantum Logic

Speaker: Daniel Stefankovic

Title: Spin models: connections between complexity, phase transition, belief propagation, and induced matrix norms

What are the typical configurations of a spin model (for example, Ising model, or Potts model) on a random regular graph? We show that the answer to this question is characterized by tree recursions (belief propagation) and p->q operator matrix norms.

Understanding the typical configurations allows us to show hardness of approximating the partition function for certain multispin models (for example, Potts model) on d-regular graphs in the non-uniqueness regime (that is, when the Gibbs measure on infinite d-regular tree is not unique). Joint work with Andreas Galanis, and Eric Vigoda.

Speaker: Yitong Yin

Title: Phase transition of hypergraph matchings

We study the problem of approximately counting weighted matchings in hypergraphs of bounded maximum edge size and maximum degree. The problem is expressed as evaluating the partition function, which is the weighted sum of all macthings in a hypergraph where each macthing M is assigned a weight λ|M| in terms of a fixed activity parameter λ. This model unifies two important problems in approximate counting arising from statistical physics: counting independent set (the hardcore model) and counting matchings (the monomer-dimer model).

We show that for hypergraph matchings, the critical activity λc= dd/k(d-1)(d+1) is the uniqueness threshold for the Gibbs measure on (d+1)-uniform (k+1)-regular hyper-tree, and when λ<λc, the hypergraphs of maximum edge size at most d+1 and maximum degree at most k+1 exhibit strong spatial mixing. As a consequence, there is an FPTAS for counting matchings in hypergraphs of bounded maximum edge size at most and bounded maximum degree as long as the uniqueness condition is satisfied.

As for the inapproximability, it can be easily shown that there is no FPRAS for the problem when λ>2λc, unless NP=RP. This left an intriguing gap between λc and 2λc. A key step towards tight inapproximability result is the local weak convergence from a sequence of finite graphs to the extremal measures for the uniqueness threshold on the infinite tree. For hypergraph matchings, we discover that such local weak convergence does not exist for any sequence of finite hypergraphs, which indicates that approximate counting on hypergraphs (or general CSPs) contains much richer structure yet to be understood.

Speaker: Euiwoong Lee

Title: Hardness of Graph Pricing through Generalized Max-Dicut

The Graph Pricing problem is among the fundamental problems whose approximability is not well-understood. While there is a simple combinatorial ¼-approximation algorithm, the best hardness result remains at ½ assuming the Unique Games Conjecture (UGC). We show that it is NP-hard to approximate within a factor better than ¼ under the UGC, so that the simple combinatorial algorithm might be the best possible.

This work is based on the effort to view the Graph Pricing problem as a Constraint Satisfaction Problem (CSP) simpler than the standard and complicated formulation. We propose the problem called Generalized Max-Dicut(T), which has a domain size T + 1 for every T ≥ 1 . Generalized Max-Dicut(1) is well-known Max-Dicut. Besides its connection to Graph Pricing, the hardness of Generalized Max-Dicut is interesting in its own right since in most arity two CSPs studied in the literature, SDP-based algorithms perform better than LP-based or combinatorial algorithms — for this arity two CSP, a simple combinatorial algorithm does the best.

Speaker: Sewoong Oh

Title: Data processing inequality for differential privacy and applications

We provide a hypothesis testing interpretation to differential privacy and derive natural forward and reverse data processing inequalities. These inequalities are very useful in deriving tight impossibility results, as demonstrated by the following two applications: composing multiple queries and multi-party computation. The impossibility results hold for arbitrary parameter settings (privacy levels, number of queries, etc) and for both standard and approximate differential privacy settings. Further, these impossibility results cannot be improved upon.

Speaker: Martin Ziegler

Title: Algebraic Complexity Theory and Quantum Logic

Algebraic models of computation (like register machines) make one operation per step regardless of the value processed. They underly algorithms for sorting or in computational geometry. As opposed to bit models, algebraic methods permit to establish non-trivial lower bounds:

We recall Morgenstern’s elegant proof that the fast fourier transform is optimal; then proceed to the structural complexity theory and prove the quantum satisfiability problem complete for NP_R^0: a well-known discrete complexity class between NP and PSPACE. (Joint work with Christian Herrmann.)

Eric Vigoda, Computational Phase Transitions for the Potts Model

Monday, March 30th, 2015
Computational Phase Transitions for the Potts Model
Eric Vigoda
College of Computing, Georgia Institute of Technology, Atlanta, GA, USA
2015/4/14 Tue 4PM-5PM
This is a followup talk to my CS colloquium on March 2. In that talk I discussed the problems of counting independent sets and colorings. Those problems are examples of antiferromagnetic systems in which neighboring vertices prefer different assignments. In this talk we will look at ferromagnetic systems where neighboring vertices prefer the same assignment. We will focus on the ferromagnetic Potts model. We will look at the phase transitions in this model, and their connections to the complexity of associated counting/sampling problems and the performance of related Markov chains.
The talk is based on joint works with Andreas Galanis, Daniel Stefankovic, and Linji Yang.

[Lecture Series] Eric Vigoda, Approximating the Permanent

Friday, February 27th, 2015

FYI (Lecture Series)

Approximating the Permanent
Eric Vigoda
College of Computing, Georgia Institute of Technology, Atlanta, GA, USA
2015/3/11 Wed 9AM-10:15AM (E3-1, Room 1501)
I’ll explain the canonical paths method for bounding the mixing time of a
Markov chain. I’ll show the analysis of a Markov chain for generating a
random matching of a graph and its extension for the estimating the
number of perfect matchings of a bipartite graph.

[Lecture Series] Eric Vigoda, Introduction to Markov Chain Monte Carlo Methods

Friday, February 27th, 2015

FYI (Lecture Series)

Introduction to Markov Chain Monte Carlo Methods
Eric Vigoda
College of Computing, Georgia Institute of Technology, Atlanta, GA, USA
2015/3/6 Fri 9AM-10:15AM (E3-1, Room 1501)
I’ll introduce Markov chains and their key properties. Then I’ll explain the PageRank algorithm of Brin and Page which is the basis of the Google search engine.