If your solutions.scm included a function called solve-formula, we ran it. If your solve-formula had the wrong interface, Norman fixed it.
We also validated every test case submitted, and if the formula was well formed and the solution was correct, we ran that test case against every solver. For every solver that did not handle the test case correctly, the test case earned "failure francs." The better your tests are at getting other people's solvers to fail, the more francs you earn. Each solver distributes the same number of francs, but only tests that make it fail earned francs. Earning more francs shows a more challenging test.
To avoid revealing any private information, each student is identified by a number chosen at random. You should have received your number by email.
The table below shows the number of "failure francs" earned by each test case (a row) from each solver (a column). An empty entry means the solver handled the test case correctly. A dash means that the solver and the test case came from the same student—and you can't earn francs by making your own code fail.
| Test | Earned | Formula | 1 | 2 | 3 | 4 | 5 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | 22 | 23 | 24 | 26 | 27 | 29 | 30 | 31 | 33 | 34 | 35 | 36 | 38 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 (test 1) | 19.45 | (not∨(and∧or)∨and)∧or | — | 2.8 | 1.0 | 1.2 | 1.1 | 1.0 | 12.3 | ||||||||||||||||||||||||||
| 1 (test 2) | 6.22 | !(a∧b∧c)∨!(a∨b∨c) | — | 1.0 | 1.2 | 1.9 | 1.1 | 1.0 | |||||||||||||||||||||||||||
| 1 (test 3) | 5.12 | !x∧x | — | 1.0 | 1.2 | 1.9 | 1.0 | ||||||||||||||||||||||||||||
| 2 (test 1) | 7.30 | x∧y∧!z∧(!x∨!y∨z∨(x∧!y∧!z)) | 2.2 | — | 1.0 | 1.9 | 1.1 | 1.0 | |||||||||||||||||||||||||||
| 2 (test 2) | 5.95 | x | — | 2.8 | 1.0 | 1.1 | 1.0 | ||||||||||||||||||||||||||||
| 2 (test 3) | 19.45 | and∧or | — | 2.8 | 1.0 | 1.2 | 1.1 | 1.0 | 12.3 | ||||||||||||||||||||||||||
| 3 (test 1) | 16.18 | (x∨y)∧!x∧y | 2.2 | — | 2.8 | 1.0 | 1.2 | 2.5 | 1.9 | 1.1 | 1.0 | 2.5 | |||||||||||||||||||||||
| 3 (test 2) | 37.36 | !(x∨!x) | — | 2.8 | 3.5 | 3.9 | 1.0 | 1.2 | 2.5 | 5.3 | 3.9 | 1.9 | 1.0 | 2.5 | 3.9 | 3.9 | |||||||||||||||||||
| 3 (test 3) | 31.13 | !(x∧!x) | — | 2.8 | 3.5 | 3.9 | 1.0 | 1.2 | 2.5 | 3.9 | 1.1 | 1.0 | 2.5 | 3.9 | 3.9 | ||||||||||||||||||||
| 4 (test 1) | 9.27 | ((x∨y)∧!x)∨y | 2.2 | — | 2.8 | 1.0 | 1.2 | 1.1 | 1.0 | ||||||||||||||||||||||||||
| 4 (test 2) | 88.78 | !(x∨(y∧!z)∨z) | — | 2.8 | 2.8 | 37.0 | 10.6 | 3.5 | 3.9 | 1.0 | 1.2 | 2.5 | 5.3 | 3.9 | 1.9 | 1.1 | 1.0 | 2.5 | 3.9 | 3.9 | |||||||||||||||
| 4 (test 3) | 5.35 | x∧(y∨!x)∧!y | 2.2 | — | 1.0 | 1.1 | 1.0 | ||||||||||||||||||||||||||||
| 5 (test 1) | 13.94 | (!x∨z∨!y)∧x | — | 2.8 | 1.0 | 1.2 | 2.5 | 1.9 | 1.1 | 1.0 | 2.5 | ||||||||||||||||||||||||
| 5 (test 2) | 4.27 | ((!x∧z∧!y)∨z) | — | 1.0 | 1.2 | 1.1 | 1.0 | ||||||||||||||||||||||||||||
| 5 (test 3) | 5.41 | x∧y∧z∧x∧!y∧z | 2.2 | — | 1.0 | 1.2 | 1.0 | ||||||||||||||||||||||||||||
| 7 (test 1) | 5.35 | (x∨y)∧x∧y∧!x | 2.2 | — | 1.0 | 1.1 | 1.0 | ||||||||||||||||||||||||||||
| 7 (test 3) | 43.45 | !(x∧y)∧!(!x∨y) | 2.2 | 2.8 | — | 2.8 | 3.5 | 3.9 | 1.0 | 1.2 | 2.5 | 5.3 | 3.9 | 1.9 | 1.1 | 1.0 | 2.5 | 3.9 | 3.9 | ||||||||||||||||
| 9 (test 1) | 16.18 | (x∨y)∧!x | 2.2 | 2.8 | — | 1.0 | 1.2 | 2.5 | 1.9 | 1.1 | 1.0 | 2.5 | |||||||||||||||||||||||
| 9 (test 2) | 19.93 | !!x∧!x | 2.2 | 2.8 | — | 10.6 | 1.0 | 1.2 | 1.1 | 1.0 | |||||||||||||||||||||||||
| 9 (test 3) | 103.36 | !((!a∧!b)∨a) | 2.2 | 2.8 | 2.8 | — | 37.0 | 10.6 | 3.5 | 3.9 | 1.0 | 1.2 | 2.5 | 5.3 | 3.9 | 1.9 | 1.1 | 1.0 | 12.3 | 2.5 | 3.9 | 3.9 | |||||||||||||
| 10 (test 1) | 5.35 | (x∨y)∧x∧y∧!x | 2.2 | — | 1.0 | 1.1 | 1.0 | ||||||||||||||||||||||||||||
| 10 (test 2) | 43.45 | !(x∧y)∧!(!x∨y) | 2.2 | 2.8 | 2.8 | — | 3.5 | 3.9 | 1.0 | 1.2 | 2.5 | 5.3 | 3.9 | 1.9 | 1.1 | 1.0 | 2.5 | 3.9 | 3.9 | ||||||||||||||||
| 11 (test 1) | 15.44 | — | 2.8 | — | 3.5 | 1.0 | 1.2 | 2.5 | 1.1 | 1.0 | 2.5 | ||||||||||||||||||||||||
| 12 (test 2) | 5.35 | (x∨y)∧x∧y∧!x | 2.2 | — | 1.0 | 1.1 | 1.0 | ||||||||||||||||||||||||||||
| 13 (test 1) | 43.45 | !(x∧y)∧!(!x∨y) | 2.2 | 2.8 | 2.8 | — | 3.5 | 3.9 | 1.0 | 1.2 | 2.5 | 5.3 | 3.9 | 1.9 | 1.1 | 1.0 | 2.5 | 3.9 | 3.9 | ||||||||||||||||
| 13 (test 2) | 5.35 | (x∨y)∧x∧y∧!x | 2.2 | — | 1.0 | 1.1 | 1.0 | ||||||||||||||||||||||||||||
| 14 (test 1) | 7.02 | (x∧!x)∨x | 2.8 | — | 1.0 | 1.2 | 1.1 | 1.0 | |||||||||||||||||||||||||||
| 14 (test 2) | 16.79 | !!!x | — | 10.6 | 1.0 | 1.2 | 1.9 | 1.1 | 1.0 | ||||||||||||||||||||||||||
| 14 (test 3) | 37.36 | !(x∨!x) | 2.8 | — | 3.5 | 3.9 | 1.0 | 1.2 | 2.5 | 5.3 | 3.9 | 1.9 | 1.0 | 2.5 | 3.9 | 3.9 | |||||||||||||||||||
| 15 (test 1) | 4.27 | (x∨y∨(x∧y))∧x∧z | — | 1.0 | 1.2 | 1.1 | 1.0 | ||||||||||||||||||||||||||||
| 15 (test 2) | 38.46 | !(x∨y∨z)∧(x∨y∨z) | 2.8 | — | 3.5 | 3.9 | 1.0 | 1.2 | 2.5 | 5.3 | 3.9 | 1.9 | 1.1 | 1.0 | 2.5 | 3.9 | 3.9 | ||||||||||||||||||
| 15 (test 3) | 8.10 | (x∨!y)∧(x∨y∨z)∧(!x∨z) | 2.2 | 2.8 | — | 1.0 | 1.1 | 1.0 | |||||||||||||||||||||||||||
| 16 (test 3) | 4.27 | x∧(x∨y∨z∨w∨(u∧l)∨v) | — | 1.0 | 1.2 | 1.1 | 1.0 | ||||||||||||||||||||||||||||
| 17 (test 1) | 6.22 | !(x∧!y∧(z∨a)) | — | 1.0 | 1.2 | 1.9 | 1.1 | 1.0 | |||||||||||||||||||||||||||
| 17 (test 2) | 16.18 | (x∨y)∧!x | 2.2 | 2.8 | — | 1.0 | 1.2 | 2.5 | 1.9 | 1.1 | 1.0 | 2.5 | |||||||||||||||||||||||
| 18 (test 1) | 43.45 | (x∨y∨z)∧!(x∨y∨!z) | 2.2 | 2.8 | 2.8 | 3.5 | 3.9 | — | 1.0 | 1.2 | 2.5 | 5.3 | 3.9 | 1.9 | 1.1 | 1.0 | 2.5 | 3.9 | 3.9 | ||||||||||||||||
| 18 (test 2) | 6.52 | (x∨y)∧!x∧!y | 2.2 | — | 1.0 | 1.2 | 1.1 | 1.0 | |||||||||||||||||||||||||||
| 18 (test 3) | 19.45 | (or∨not)∧not | 2.8 | — | 1.0 | 1.2 | 1.1 | 1.0 | 12.3 | ||||||||||||||||||||||||||
| 19 (test 1) | 15.18 | (a∨b)∧!a | 2.2 | 2.8 | — | 1.2 | 2.5 | 1.9 | 1.1 | 1.0 | 2.5 | ||||||||||||||||||||||||
| 19 (test 2) | 5.22 | !a∧!b∧(a∨b) | — | 1.2 | 1.9 | 1.1 | 1.0 | ||||||||||||||||||||||||||||
| 19 (test 3) | 40.98 | and∧(or∨not)∧!not | 2.8 | 2.8 | 10.6 | 3.5 | — | 2.5 | 1.9 | 1.1 | 1.0 | 12.3 | 2.5 | ||||||||||||||||||||||
| 20 (test 1) | 5.05 | (!x∧x)∨(!y∧y) | 1.0 | — | 1.9 | 1.1 | 1.0 | ||||||||||||||||||||||||||||
| 21 (test 1) | 6.52 | (x∧!x)∧y∧!y | 2.2 | 1.0 | 1.2 | — | 1.1 | 1.0 | |||||||||||||||||||||||||||
| 21 (test 2) | 8.97 | (!x∧x)∨y∨z∨f | 2.8 | 1.0 | 1.2 | — | 1.9 | 1.1 | 1.0 | ||||||||||||||||||||||||||
| 21 (test 3) | 5.41 | x∧!x | 2.2 | 1.0 | 1.2 | — | 1.0 | ||||||||||||||||||||||||||||
| 22 (test 1) | 31.13 | !!!!!(x∧!x) | 2.8 | 3.5 | 3.9 | 1.0 | 1.2 | 2.5 | — | 3.9 | 1.1 | 1.0 | 2.5 | 3.9 | 3.9 | ||||||||||||||||||||
| 22 (test 2) | 4.27 | C∧O∧M∧P∧S∧C∧I | 1.0 | 1.2 | — | 1.1 | 1.0 | ||||||||||||||||||||||||||||
| 22 (test 3) | 5.41 | eggs∧salt∧flour∧bread∧!salt∧sugar | 2.2 | 1.0 | 1.2 | — | 1.0 | ||||||||||||||||||||||||||||
| 23 (test 1) | 6.22 | !(x∧y∧z) | 1.0 | 1.2 | — | 1.9 | 1.1 | 1.0 | |||||||||||||||||||||||||||
| 23 (test 2) | 6.52 | !x∧y∧z∧a∧b∧(c∨d)∧!y | 2.2 | 1.0 | 1.2 | — | 1.1 | 1.0 | |||||||||||||||||||||||||||
| 23 (test 3) | 7.12 | z∧!(x∧y∧!z) | 2.8 | 1.0 | 1.2 | — | 1.1 | 1.0 | |||||||||||||||||||||||||||
| 24 (test 2) | 4.27 | !(y∧x) | 1.0 | 1.2 | — | 1.1 | 1.0 | ||||||||||||||||||||||||||||
| 26 (test 1) | 40.39 | !and∧!not∧!or | 2.8 | 10.6 | 3.5 | 1.0 | 1.2 | 2.5 | 1.9 | — | 1.1 | 1.0 | 12.3 | 2.5 | |||||||||||||||||||||
| 26 (test 2) | 17.69 | !!!!!!!!!!x | 2.8 | 10.6 | 1.0 | 1.2 | — | 1.1 | 1.0 | ||||||||||||||||||||||||||
| 26 (test 3) | 8.46 | (x∧!x)∨(!y∧y) | 2.2 | 1.0 | 1.2 | 1.9 | — | 1.1 | 1.0 | ||||||||||||||||||||||||||
| 27 (test 1) | 13.94 | (!x∨y)∧x | 2.8 | 1.0 | 1.2 | 2.5 | 1.9 | — | 1.1 | 1.0 | 2.5 | ||||||||||||||||||||||||
| 27 (test 2) | 31.13 | !(x∧!x) | 2.8 | 3.5 | 3.9 | 1.0 | 1.2 | 2.5 | 3.9 | — | 1.1 | 1.0 | 2.5 | 3.9 | 3.9 | ||||||||||||||||||||
| 27 (test 3) | 6.52 | (x∧!x)∨(y∧!y) | 2.2 | 1.0 | 1.2 | — | 1.1 | 1.0 | |||||||||||||||||||||||||||
| 29 (test 1) | 5.12 | !x | 1.0 | 1.2 | 1.9 | — | 1.0 | ||||||||||||||||||||||||||||
| 29 (test 2) | 5.12 | !(x∧y) | 1.0 | 1.2 | 1.9 | — | 1.0 | ||||||||||||||||||||||||||||
| 29 (test 3) | 37.36 | !(x∨y) | 2.8 | 3.5 | 3.9 | 1.0 | 1.2 | 2.5 | 5.3 | 3.9 | 1.9 | — | 1.0 | 2.5 | 3.9 | 3.9 | |||||||||||||||||||
| 31 (test 1) | 38.46 | !(!a∨b∨c∨!d∨e∨f) | 2.8 | 3.5 | 3.9 | 1.0 | 1.2 | 2.5 | 5.3 | 3.9 | 1.9 | 1.1 | 1.0 | — | 2.5 | 3.9 | 3.9 | ||||||||||||||||||
| 31 (test 2) | 13.94 | (!x∨y)∧x | 2.8 | 1.0 | 1.2 | 2.5 | 1.9 | 1.1 | 1.0 | — | 2.5 | ||||||||||||||||||||||||
| 31 (test 3) | 38.75 | (x∨y)∧!(x∨y) | 2.2 | 2.8 | 3.5 | 3.9 | 1.0 | 1.2 | 2.5 | 5.3 | 3.9 | 1.1 | 1.0 | — | 2.5 | 3.9 | 3.9 | ||||||||||||||||||
| 33 (test 1) | 11.21 | x∧(!x∨!y) | 2.2 | 2.8 | 1.0 | 1.2 | 1.9 | 1.1 | 1.0 | — | |||||||||||||||||||||||||
| 33 (test 2) | 6.52 | x∧y∧z∧(!x∨!y∨!z) | 2.2 | 1.0 | 1.2 | 1.1 | 1.0 | — | |||||||||||||||||||||||||||
| 34 (test 1) | 16.18 | (a∨b)∧!a | 2.2 | 2.8 | 1.0 | 1.2 | 2.5 | 1.9 | 1.1 | 1.0 | 2.5 | — | |||||||||||||||||||||||
| 34 (test 2) | 5.95 | a | 2.8 | 1.0 | 1.1 | 1.0 | — | ||||||||||||||||||||||||||||
| 35 (test 1) | 16.18 | (x∨y)∧y∧!x | 2.2 | 2.8 | 1.0 | 1.2 | 2.5 | 1.9 | 1.1 | 1.0 | 2.5 | — | |||||||||||||||||||||||
| 35 (test 2) | 5.95 | x | 2.8 | 1.0 | 1.1 | 1.0 | — | ||||||||||||||||||||||||||||
| 35 (test 3) | 32.39 | !(x∨y)∧x∧z∧(y∨z) | 2.8 | 3.5 | 3.9 | 1.0 | 1.2 | 5.3 | 3.9 | 1.9 | 1.0 | 3.9 | — | 3.9 | |||||||||||||||||||||
| 36 (test 1) | 6.22 | !(x∧(y∨z)∧a∧b∧!c) | 1.0 | 1.2 | 1.9 | 1.1 | 1.0 | — | |||||||||||||||||||||||||||
| 36 (test 2) | 9.27 | (x∧!x)∨(y∧!y)∨z | 2.2 | 2.8 | 1.0 | 1.2 | 1.1 | 1.0 | — | ||||||||||||||||||||||||||
| 36 (test 3) | 4.27 | x | 1.0 | 1.2 | 1.1 | 1.0 | — | ||||||||||||||||||||||||||||
| 38 (test 1) | 31.13 | !(x∧!x) | 2.8 | 3.5 | 3.9 | 1.0 | 1.2 | 2.5 | 3.9 | 1.1 | 1.0 | 2.5 | 3.9 | 3.9 | — | ||||||||||||||||||||
| 38 (test 2) | 38.46 | !(x∨y∨z) | 2.8 | 3.5 | 3.9 | 1.0 | 1.2 | 2.5 | 5.3 | 3.9 | 1.9 | 1.1 | 1.0 | 2.5 | 3.9 | 3.9 | — | ||||||||||||||||||
| 38 (test 3) | 38.17 | (x∨y)∧!(x∧y) | 2.2 | 2.8 | 2.8 | 3.5 | 3.9 | 1.0 | 1.2 | 2.5 | 3.9 | 1.9 | 1.1 | 1.0 | 2.5 | 3.9 | 3.9 | — |