Chaitin's Constant

In the computer science subfield of algorithmic information theory the Chaitin constant or halting probability is a construction by Gregory Chaitin which describes the probability that a randomly generated program for a given model of computation or programming language will halt. It is usually denoted Ω. It is a normal and transcendental number which can be defined but cannot be computed. This means one can prove that there is no algorithm which produces the digits of Ω. The proof of Ω's uncomputability relies on an algorithm, which, given the first n digits of Ω, solves Turing's halting problem for programs of length up to n. Since the halting problem is undecidable, Ω can not be computed. As Ω depends on the program encoding used it should be called Chaitin construction instead of Chaitin constant when not referring to any specific encoding.

Definition

To define Ω formally, we first need to fix a (Turing-complete) model of computation, for instance Turing machines or Lisp or Pascal programs. We then need to specify an unambiguous encoding of programs (or machines) as bit strings. This encoding must have the property that if w encodes a syntactically correct program, then no proper prefix of w encodes a syntactically correct program. This can always be achieved by using a special end symbol. We only consider programs that don't require any input (any program that does require input is equivalent to one that does not, having instead the input as part of its initial data). Let P be the set of all programs which halt. Ω is then defined as:
\Omega = \sum_{p \in P} 2^{-|p|}.
This is an infinite sum which has one summand for every syntactically correct program which halts. |p| stands for the length of the bit string of p. The above requirement that programs be prefix-free ensures that this sum converges to a real number between 0 and 1.

Notes

It can then be shown that Ω represents the probability that a randomly produced bit string will encode a halting program. This means that if you start flipping coins, always recording a head as a one and a tail as a zero, the probability is Ω that you will eventually reach the encoding of a syntactically correct halting program. If you fix, in addition to the computation model and encoding mentioned above, a specific consistent axiomatic system for the natural numbers, say Peano's axioms, then there exists a constant N such that no bit of Ω after the N-th can be proven to be one or zero within that system. (The constant N heavily depends on the encoding choices and does not reflect the complexity of the axiomatic system in any way.) This is an incompleteness result akin to Gdel's incompleteness theorem and Chaitin's own result mentioned under algorithmic information theory. Ω is also uncompressible.

Calculation of the start of a Chaitin Ω

Cristian S. Calude, Michael J. Dinneen, and Chi-Kou Shu http://www.expmath.org/expmath/volumes/11/11.3/Calude361_370.pdf have calculated the first 64 bits of a Chaitin ΩU for a particular machine: they in fact calculated 84 bits, but only the first 64 are reliable. These are (in binary)
0.0000001000000100000110001000011010001111110010111011101000010000...
Translating this to decimal gives a number which starts
0.078749969978123844...

 

<< PreviousWord BrowserNext >>
christoph ludwig agricola
claudius
cardinal
cantor set
cardinal number
cardinality
cecil b. demille
chinese islamic cuisine
cantonese cuisine
chiuchow cuisine
co np
chuck yeager
cajun cuisine
cologne
buddhist cuisine
charles v
constantin von tischendorf
chester a. arthur
calvin coolidge
clanking replicator
convention on biological diversity
convention on fishing and conservation of living resources of the high seas
convention on long range transboundary air pollution
convention on the international trade in endangered species of wild flora and fauna
convention on the prevention of marine pollution by dumping wastes and other matter
convention on the prohibition of military or any other hostile use of environmental modification techniques
computable number
current (electricity)
charles ancillon
clark ashton smith
context sensitive grammar
context sensitive language
cruithne
chinese room
charon
circle
cantigas de santa maria
claudio monteverdi
central intelligence agency
celtic tribes in the british isles
colossus computer
canadian shield
comic book
crusade