I'm not sure, but I think they were making a joke. Germany created the Enigma machine. Turing et al did some seminal work as a result of the need to quickly decrypt Enigma messages. Ergo, we wouldn't have computers without the Germans.

Zuse built the arguably first electronically programmable computer or something like that.

I wouldn't go as far as to say that without germans we wouldn't have computers today. What he is probably referencing is the Zuse Z3, which can be considered one of the first computers.

The main argument against it being the first is that it's a mechanical design rather than electronic and that turing completeness was only achieved on it much later using a trick which the designer had not intended. Interestingly, ENIAC, which is considered the first computer by many, uses a decimal design. The Z3 on the other hand was already using binary.

I took this info from the german wikipedia article on the Z3. I'm not sure if the english article goes into similar detail on those points.

The person that is credited with designing the architecture is named John Von Neumann.

If you're thinking of the stored program concept it wasn't Von Neumann, but it's a common misconception. Von Neumann himself credited Turing for it. Independently, the concept was described in a patent application by Konrad Zuse as early as 1936.

How did Germany contribute to computers?

Zuse is widely considered the inventor of the modern computer because of his Z3 model. It never achieved recognition during the war she went largely unnoticed, not even being used by the government in secrecy like the British Colossus.

For the longest time the British early computers went unknown too during the secrecy, we only credit them today because they were eventually declassified.

American computers enjoyed the largest recognition during the '40s. The ENIAC is probably the most widely known and had a major contribution to the world of computing not only because it proved the concept of a general purpose computer, but also because its creators held the Moore School Lectures which taught the ENIAC design principles.

Another very important computer was the ABC, but not for its design (it wasn't Turing complete) but for an indirect reason: its patent on the design of a computer was challenged and invalidated in the landmark case Honeywell v Sperry Rand which resulted in the modern electronic computer entering public domain, which was an enormous boost for the industry.

Konrad Zuse actually invented the computer at the same time as Turing, and in complete intellectual isolation from Turing.