views:

411

answers:

5

First some background (based on my understanding)..

The Von-Neumann architecture describes the stored-program computer where instructions and data are stored in memory and the machine works by changing it's internal state, i.e an instruction operates on some data and modifies the data. So inherently, there is state maintained in the system.

The Turing machine architecture works by manipulating symbols on a tape. i.e A tape with infinite number of slots exists, and at any one point in time, the Turing machine is in a particular slot. Based on the symbol read at that slot, the machine can change the symbol and move to a different slot. All of this is deterministic.

My questions are

  1. Is there any relation between these two models (Was the Von Neuman model based on or inspired by the Turing model)?
  2. Can we say that Turing model is a superset of Von Newman model?
  3. Does functional Programming fit into Turing model. If so how? (I assume FP does not lend itself nicely to the Von Neuman model)
+1  A: 

Turing model defines computational capabilities without getting deep into implementation, no one will ever create computer that will look like Turing Machine literally. (Except enthusiasts http://www.youtube.com/watch?v=E3keLeMwfHY ).

Turing model is not architecture.

Von Neuman is guidance how to build computers. It says nothing about the computation capabilities. Depending on instruction set the produced computer may or may not be Turing complete (means can solve same tasks as Turing Machine)

Functional programming (lambda calculus) is another computational model that is Turing complete but can't be natively fit into Von Neumann architecture.

Andrey
+8  A: 

Turing machines are theoretical concepts invented to explore the domain of computable problems mathematically and to obtain ways of describing these computations.

The Von-Neumann architecture is an architecture for constructing actual computers (which implement what the Turing machine describes theoretically).

Functional programming is based on the lambda-calculus, which is a another method of describing computations or - more precisely - computable functions. Though it uses a completely different approach, it is equally powerful to Turing machine (it's said to be turing complete).

Every lambda-calculus program (term) T is written just using a combination of

  • variables like x
  • anonymous functions like λx. T
  • function applications T T

Despite being stateless, this is sufficient for every computation a computer can do. Turing machines and lambda terms can emulate each other, and a Von-Neumann computer can execute both (apart from technical restrictions like providing infinite storage, which a turing machine could require).

But due to their stateless and more abstract nature, functional programs might be less efficient and less "intuitive" on Von-Neumann computers compared to imperative programs which follow it's style of binary, memory and update.

Dario
Crisp Expanation. However, can a Von Neuman architecture implement everything that a Turing machine can describe?
Santhosh
@Santosh: Theoretically, no actual real computer can do that and none ever will - because a Turing machine requires an *infinite* amount of storage.
Michael Borgwardt
@Santhosh, Michael: Well, good point. Edited the answer.
Dario
Any Turing computable function is necessarily described by a Turing machine *which halts*. A Turing machine which halts cannot require infinite storage (how could it read or write infinitely much data in finite time?). Therefore, anything computable by a theoretical Turing machine can be computed by a practical computer with sufficient storage. The storage required may be arbitrarily large, but it will not be infinite.
Tyler McHenry
@Tyler: Isn't an infinite loop turing-computable too? And of course it doesn't halt ...
Dario
@Dario: Not in the formal sense of "computable" it isn't. A Turing computable function is *defined* as a function `f` for which for every input `n` there exists a Turing machine that halts and outputs `f(n)`. It's pretty much synonymous with "algorithm", and one of the parts of the definition of an algorithm is that it must have finitely many steps, which an infinite loop does not.
Tyler McHenry
@Tyler: shouldn't that be "there exists a Turing machine that, for every `n` in the domain of `f`, halts and outputs `f(n)`"? I don't think that `f` is allowed to have a separate Turing machine for each input.
Michael E
@Michael Yes, you're correct; I got my wording mixed up. Good catch.
Tyler McHenry
+1  A: 

I do not know what historical relationship there is between Turing machines and von Neuman architectures. I am sure, however, that von Neuman was aware of Turing machines when he developed the von Neuman architecture.

As far as computational capability, however, Turing machines and von Neuman machines are equivalent. Either one can emulate the other (IIRC, emulating a von Neuman program on a Turing machine is an O(n^6) operation). Functional programming, in the form of the lambda calculus, is also equivalent. In fact, all known computational frameworks at least as powerful as Turing machines are equivalent:

  • Turing machines
  • Lambda calculus (functional programming)
  • von Neuman machines
  • Partial recursive functions

There is no difference in the set of functions that can be computed with any of these models.

Functional programming is derived from the lambda calculus, so it doesn't map directly to either Turing or von Nemuan machines. Either of them can run functional programs, hoewver, via emulation. I think that the mapping for Turing machines is likely more tedious than the mapping for von Neuman machines, so my answer to the 3rd question would be "no, in fact it's worse."

Michael E
+3  A: 

Generally one refers to the Von Neumann architecture, as contrasted with the Harvard architecture. The former has code and data stored in the same way, whereas the latter has separate memory and bus pathways for code and data. All modern desktop PCs are Von Neumann, most microcontrollers are Harvard. Both are examples of real-world designs that attempt to emulate a theoretical Turing machine (which is impossible because a true Turing machine requires infinite memory).

rmeador
Thanks for bringing up the contrast w.r.t Harvard Architecture as opposed to Turing Machines
Santhosh
@Santhosh: perhaps it was just a typo, but I did _not_ bring up any such contrast. As I said in my answer, both Von Neumann and Hardvard architectures are Turing machines. The contrast between them is their memory layout.
rmeador
A: 

The Turing "model" is not an architectural model at all. It was just a non-existent machine that Turing hypothesized to serve as the vehicle for his proof of the decision problem.

Dinah