Overview

This assignment will help you learn about type systems and polymorphism. You will understand how a type checker works, and you will be able to translate formal type-system rules into code for a type checker. You will add typed primitives to an interpreter. And you will write a couple of explicitly typed, polymorphic functions.

Setup

If you have not done so already, clone the book code:

  git clone linux.cs.tufts.edu:/comp/105/build-prove-compare

You will modify two interpreters: build-prove-compare/bare/tuscheme/tuscheme.sml and build-prove-compare/bare/timpcore/timpcore.sml. You will compile your work with, e.g.,

  mosmlc -o timpcore timpcore.sml
  mosmlc -o tuscheme tuscheme.sml

Dire warnings

Your modified timpcore.sml and tuscheme.sml must compile using mosmlc without errors or warnings.

As in the ML homework, you must not use the functions null, hd, and tl. Use pattern matching.

Your typed-funs.scm must load into tuscheme without warnings or errors, as in

  tuscheme -q < typed-funs.scm

All the homework problems

Reading comprehension (10 percent)

These problems will help guide you through the reading. We recommend that you complete them before starting the other problems below. You can download the questions.

  1. Read Section 6.3, which describes how Typed Impcore is extended with arrays. Examine code chunk 411, which shows the cases that have to be added to the type checker. For each case, write down exactly one choice for a rule name (A-D) and exactly one choice for a prose description (1-4) below the case. No rule names or prose descriptions should be repeated.

    Your choices for rule names are:
    1. MakeArray
    2. ArraySize
    3. ArrayPut
    4. ArrayAt
    Your choices for prose descriptions are:
    1. This rule first checks that expression a has type “array of tau,” that expression i has type int, and that expression e has that same type tau. It then says that the type of the whole expression has type “tau.”

    2. This rule first checks that expression a has type “array of some tau,” and then determines that the type of the whole epxression is int.

    3. This rule first checks that expression len has type int, and then determines that expression init has some type tau. It then determines that the whole expression has type “array of tau.”

    4. This rule first checks the expression a has type “array of some tau” and that expression i has type int. It then says that the type of the whole expression is tau.

    For each of the following cases, indicate your selections immediatley below the text “The rule for case…”
    • The rule for case | ty (AAT (a, i)) = ... is:

    • The rule for case | ty (APUT (a, i, e)) = ... is:

    • The rule for case | ty (AMAKE (len, init)) = ... is:

    • The rule for case | ty (ASIZE a) = ... is:

    You are now ready for exercise 2 in the pair problems.

  2. Read Section 6.6.3 on quantified types in Typed μScheme.

    1. Assume variable syms holds a list of symbols. What expression do you write to compute its length? Pick exactly one of the options below.

      1. (length syms)
      2. ((o length sym) syms)
      3. ((@ length sym) syms)
      4. ((length sym) syms)
    2. You are given a function larger? of type (int -> bool). Using the predefined function o, what code do you write to compose larger? with not?

    3. In testing, we sometimes use a three-argument function third that ignores its first two arguments and returns its third argument. Such a function has type

      (forall ('a 'b 'c) ('a 'b 'c -> 'c))

      There is only one sensible function that has this type. Using a val definition, define function third in Typed μScheme.

    You are ready for exercise TD.

  3. Read about type equivalence starting on page 438 and page 439.

    You are given ML values tau1 and tau2, which represent the respective Typed μScheme types (forall ['a] 'a) and (forall ['b] 'b). Semantically, these types are equivalent. For each of the two ML expressions below, say whether the expression produces true or produces false. Write each answer immediately below the expression.

    1. tau1 = tau2

    2. eqType tau1 tau2

    You will soon be ready for Exercise 23, but you first need to complete the next comprehension question.

  4. Read Section 6.6.5 on typing rules for expressions in Typed μScheme. For each of the expressions below, say if it is well typed, and if so what its type is. If the expression is not well typed, say what typing rule fails and why.

    ; (a)
    (if #t 1 #f)
    
    ; (b)         
    (let ([x 1]
          [y 2])
       (+ x y))
    
    ; (c)
    (lambda ([x : int]) x)
    
    ; (d)
    (lambda ([x : 'a]) x)
    
    ; (e)
    (type-lambda ['a] (lambda ([x : 'a]) x))

    You are now ready for Exercise 23.

  5. Exercise 24 on page 466 calls for you to add a primitive queue type to Typed μScheme. Read it. Then read “Primitive type constructors of Typed uScheme” in Section 6.6.9.

    1. Which existing primitive type most resembles a queue type?

    2. When you add a primitive type constructor for queues, what chunk of the source code do you intend to add it to? (Give the page number, and if applicable, the letter. For example, page 448 has two chunks—448a and 448d—and the letter is the simplest way to distinguish the two.)

    Read “Primitives of Typed μScheme” in Section M.4, which starts on page 1224.

    1. Which set of primitive functions most resembles the functions you will need to add for queues?

    2. When you add primitives functions that operate on queues, what chunk of the source code do you intend to add it to? (Just like we asked above, give the page number, and if applicable, the letter.)

    You are ready for Exercise 24.

Problems to do by yourself (27 percent)

On your own, please work Exercise 8 on page 460 of Ramsey and problem TD described below.

8. Adding lists to Typed Impcore. Do Exercise 8 on page 460 of Ramsey. The exercise requires you to design new syntax and to write type rules for lists.

Your typing rules must be deterministic. This means that in any given typing environment, any given expression has at most one type, and the type must be computable by a function that is given the abstract syntax and the typing environment as inputs.

Related reading:

  • Study the new abstract syntax for arrays in Section 6.3.2, which starts on page 408. Specifically, the new abstract syntax starts on page 410. Be sure you understand that you are seeing new syntactic forms, not functions.

  • Each new form in code chunk 410a comes with a typing rule, which can be found in Section 6.3.3, which starts on page 411. As long as you keep in mind the differences between lists and arrays, this section will help you imagine the sorts of rules you will need to write for lists.

  • For another example of new forms and corresponding rules, study the sum-introduction forms left and right in Section 6.4 near page 414.

  • Finally, for help classifying rules, see the sidebar on “Formation, introduction, and elimination” on page 412.

Hint: This exercise is more difficult than it first appears. I encourage you to scrutinize the lecture notes for similar cases, and to remember that you have to be able to type check every expression at compile time. I recommend that you do Pair Exercise 2 first. It will give you more of a feel for monomorphic type systems.

Here are some things to watch out for:

TD. Polymorphic functions in Typed uScheme. To hold your solution, create a file typed-funs.scm. Implement, in Typed μScheme, fully typed versions of the following function:

The problem has two parts:

  1. Write, in a check-type, the polymorphic type you expect take to have.

  2. Write a definition of take.

Related reading: Read Section 6.6.3 on quantified types. Look especially at the definitions of list2, list3, length, and revapp. If you are not yet confident, go to Section M.5 in Appendix M and study the definitions of append, filter, and map. Appendix M starts on page 1219.

Problems you can work on with a partner (63 percent)

Please complete Exercise 2 on page 457, Exercise 23 on page 466, Exercise T described below, and Exercise 24 on page 466. You may work by yourself or with a partner. (Most students prefer to work with a partner.)

2. Type-checking arrays in Typed Impcore. Do Exercise 2 on page 457 of Ramsey. My solution to this problem is 21 lines of ML.

Related reading:

  • Study Section 6.2.1, which starts on page 400. Understand the structure of function typeof, which takes three explicit typing environments, and internal function ty, which has access to those environments even though it takes only one parameter. Study the cases for SET, IFX, EQ, and PRINT. Develop an idea how typing rules and code are related.

  • Look at how the ARRAYTY value constructor is defined in chunk 392g. An ML value constructed with ARRAYTY represents an array type in Typed Impcore. When you need to recognize an array type, you will pattern match using ARRAYTY. When you need to construct an array type, you will apply ARRAYTY to another ML value of type ty.

  • Understand the typing rules in Section 6.3.3, which starts on page 411.

  • For a broader view of how Typed Impcore is extended with arrays, study Section 6.3, which starts on page 408.

23. Type checking Typed uScheme. Do Exercise 23 on page 466 of Ramsey: write a type checker for Typed uScheme. You will submit a modified interpreter and a file containing regression tests. Don’t worry about the quality of your error messages, but do remember that your ML code must compile without errors or warnings.

Follow the step-by-step instructions listed below under the heading “How to build a type checker,” which tells you how to build both the type checker and the regression tests.

My type checker is about 120 lines of ML. It is very similar to the type checker for Typed Impcore that appears in the book. The code could have been a little shorter, but I put some effort into error messages.

Related reading:

  • Study Section 6.6.5, which starts on page 430—it gives the typing rules for expressions and definitions. You will implement each of these rules.

  • Section 6.6.6, which starts on page 438, contains a long song and dance about type equivalence. You do not need to understand any of the song and dance—you will get the important aspects later in the term—but you do need to understand functions eqType and eqTypes well enough to know how to use them.

  • In Section 6.6.7, which starts on page 443, there is even more song and dance. To implement your type checker successfully, you need to know only how to use functions freetyvarsGamma and instantiate.

  • In Section 6.6.9, which starts on page 448, you need to know how to use function asType.

  • Study the instructions “How to build a type checker” below.

T. Unit tests for type checkers. Create a file type-tests.scm, and in that file, write three unit tests for Typed μScheme type checkers. Each test must use either check-type or check-type-error. If you wish, your file may include val bindings or val-rec bindings of names used in the tests. Your file must load and pass all tests using the reference implementation of Typed μScheme:

  tuscheme -q < type-tests.scm

If you submit more than three tests, we will use only the first three.

Here is a complete example type-tests.scm file, with five tests:

  (check-type cons (forall ('a) ('a (list 'a) -> (list 'a))))
  (check-type (@ car int) ((list int) -> int))
  (check-type
     (type-lambda ['a] (lambda ([x : 'a]) x))
     (forall ('a) ('a -> 'a)))
  (check-type-error (+ 1 #t))                        ; extra example
  (check-type-error (lambda ([x : int]) (cons x x))) ; another extra example

You may, if you wish, submit any of these example tests, provided you attribute them properly to me. But your tests will be evaluated on how well they find bugs in the type checkers everyone writes—so new tests are more likely to earn high grades.

Related reading: To be able to write check-type and check-error tests, you need to know the concrete syntax for unit-test and type-exp, which is shown in Figure 6.2 on page 418.

24. Polymorphic queue primitives for Typed μScheme. Do Exercise 24 on page 466 of Ramsey: extend Typed uScheme with a type constructor for queues and with primitives that operate on queues. As it says in the exercise, do not change the abstract syntax, the values, the eval function, or the type checker. If you change any of these parts of the interpreter, your solution will earn No Credit.

Parts (a) and (b) ask you to write a kind and a type. The answers will appear in your code, but so we can find them, please also put the answers in your README file. Even if the code isn’t perfect, you’ll get partial credit for a good kind and good types.

I recommend that you represent each queue as a list constructed using the PAIR and NIL value constructors of Typed μScheme’s value type. If you do this, you will be able to use the following primitive implementation of put:

  let fun put (x, NIL)          = PAIR (x, NIL)
        | put (x, PAIR (y, ys)) = PAIR (y, put (x, ys))
        | put (x, _)            = raise BugInTypeChecking "non-queue passed to put"
  in  put
  end

Hint: you will modify two parts of the code that build the initial basis. Both parts are shown under “Building the initial basis” on page 451. Your definitions of empty?, put, get-first, and get-rest can go next to primitives null?, cons, car, and cdr. But because empty-queue is not a function, you will add its definition in a different place, as primitives that aren’t functions, for Typed μScheme :: 1283e. In the code, look for the comment

  (* primitives that aren't functions, for \tuscheme\ [[::]] 1283e *)

A couple of lines below, you will see an empty list. Edit the list to add a triple containing the name, value, and type of empty-queue.

My solution to this problem, including the implementation of put above, is under 20 lines of ML.

Related reading: Read “Primitive type constructors of Typed μScheme” in Section 6.6.9, which starts on page 448. Look at “Primitives of Typed μScheme” in section M.4 of Appendix M on page 1224 of Ramsey. Focus on primitives that manipulate NIL and PAIR values, such as null?, cons, car, and cdr in code chunk 1225c.

What and how to submit: Individual problems

You should submit these files:

As soon as you have the files listed above, run submit105-typesys-solo to submit a preliminary version of your work. Keep submitting until your work is complete; we grade only the last submission.

What and how to submit: Pair problems

For your joint work with your partner, one of you should submit these files:

As soon as you have the files listed above, run submit105-typesys-pair to submit a preliminary version of your work. Keep submitting until your work is complete; we grade only the last submission.

How your work will be evaluated

We will evaluate the functional correctness of your code by extensive testing.

We will evaluate your test cases by using them to look for bugs in other people’s code. The more bugs your tests find, the better they are.

We will evaluate the structure and organization of your Typed μScheme code using the same criteria as used in previous homework assignments. We will evaluate the structure and organization of your ML code using similar criteria for naming and documentation. For indentation and layout, we’ll look for conformance to the Style Guide for Standard ML Programmers, within the constraints imposed by the code from the book.

General advice about type-related code

Here’s some generic advice for writing any of the type-checking code, but especially the queues:

  1. Compile early (you could use the command mosmlc -o tuscheme tuscheme.sml).
  2. Compile insanely often.
  3. Compile from within your editor, and use an editor that can jump straight to the location of the first error. With Vim, use :make, and with Emacs, use M-x compile.
  4. Come up with examples in Typed μScheme.
  5. Figure out how those examples are represented in ML.
  6. Keep in mind the distinction between the term language (values of queue type, values of function type, values of list type) and the type language (queue types, function types, list types).
  7. If you’re talking about a thing in the term language, you should be able to give its type.
  8. If you’re talking about a thing in the type language, you should be able to give its kind.

How to build a type checker

Building a type checker is the first COMP 105 exercise of significant scope. You must approach it systematically. Do not copy and paste the Typed Impcore code into Typed μScheme. Copying and pasting would be a grave strategic error. You will be much better off adding a brand new type checker to the tuscheme.sml interpreter, one step at a time.

Writing the whole type checker before running any of it will make you miserable. Use the techniques presented in class, start small, and build one piece at a time.

Follow these steps:

  1. The initial basis contains code for predefined functions that you will not be able to typecheck until your work is complete. Your first step should therefore be to disable those functions. I suggest that you find the line in the source code that corresponds to the binding of value fundefs on page 451 of the book:

    val fundefs   =
    (* predefined {\tuscheme} functions, as strings (generated by a script) *)

    Replace the line val fundefs = with these two lines:

    val predefined_included = false
    val fundefs = if not predefined_included then [] else

    Verify that your modified interpreter compiles with mosmlc.

  2. Start function typeof. I recommend defining an internal function ty, just as in the type checker for Typed Impcore. Create the first draft of ty by writing a clausal definition that has one case for each syntactic form of Typed μScheme. On the right-hand side of each clause, raise the LeftAsExercise exception.

    Verify that your modified interpreter compiles with mosmlc.

  3. Write a function literal that computes the type of a literal value. Start with just numbers, Booleans, and symbols—you can add types for list literals later.

    Verify that your modified interpreter compiles with mosmlc.

  4. Write the case for typeof/ty that handles LITERAL expressions—it should call literal.

  5. Create a test file regression.scm containing a comment and three unit tests:

    ;; step 5
    
    (check-type 3 int)
    (check-type #t bool)
    (check-type 'hello sym)

    Verify that your modified interpreter compiles with mosmlc.

    Verify that your interpreter correctly typechecks the literals used in the tests above. Run

    ./tuscheme -q < regression.scm

    You must remember the ./ in ./tuscheme, or otherwise you will be testing my code, not your own code.

    If you are working on a departmental server, you can try the command

    regression-test-tuscheme

    As you build your type checker, you will continually add “regression” tests to file regression.scm. They are called “regression” tests because they are designed to prevent regressions—a regression is a bug introduced into previously working code.

  6. Write the case for typeof that handles IF-expressions, which I plan to show in class. Add regression tests for a few IF-expressions that have different types. Also add tests for some IF-expressions that are ill-typed.

    • Add the comment ;; step 6 to your regression.scm file.

    • Add some check-type unit tests for if to your regression.scm file.

    • Add some check-type-error unit tests for if to your regression.scm file.

    • Verify that your interpreter compiles and passes all its unit tests. If something goes wrong with a unit test, make sure the unit test is OK—test it by running /comp/105/bin/tuscheme -q < regression.scm.

  7. Implement the VAR rule. Add commented regression tests that check the types of some primitive functions.

    Verify that your interpreter compiles and passes all its regression tests.

  8. Now turn your attention to function elabdef, which is right next to typeof. It takes a true definition, a kind environment, and a typing environment, and it returns a new typing environment and a string.

    • The new typing environment contains a binding for whatever name is defined.

    • The string shows the type of whatever name is defined, which you get by applying function typeString to the type.

    Write four clauses for elabdef, each to raise LeftAsExercise. There should be one clause each for VAL, VALREC, EXP, and DEFINE.

    Verify that your interpreter compiles and passes all its regression tests.

  9. Continuing work with elabdef, implement the VAL rule for definitions. Then the EXP rule.

    Add a “step 9” comment and a couple of val bindings to your regression-test file, along with check-type and check-error tests that use those bindings.

    Verify that your interpreter compiles and passes all its regression tests.

  10. Return to typeof. Implement the rule for function application. Add regression tests that apply functions. Include both check-type and check-type-error tests. You should be able to apply some primitive arithmetic and comparison functions.

    Verify that your interpreter compiles and passes all its regression tests.

  11. Implement LET binding. The Scheme version is slightly more general than what I plan to cover in class. Be careful with your contexts.

    Verify that your interpreter compiles and passes all its regression tests.

  12. Once you’ve got LET working, LAMBDA should be quite similar.

    Add suitable regression tests, and verify that your interpreter compiles and passes its regression tests.

  13. Knock off SET, WHILE, and BEGIN.

    Add suitable regression tests, and verify that your interpreter compiles and passes its regression tests.

  14. There are a couple of different ways to handle LETSTAR. As usual, the simplest way is to treat it as syntactic sugar for nested LETs. Implement type checking for LETSTAR.

    Add suitable regression tests, and verify that your interpreter compiles and passes its regression tests.

  15. Go back to elabdef, and knock off the definition forms VALREC and DEFINE. (Remember that DEFINE is syntactic sugar for VALREC.)

    Don’t overlook the side condition; in

      (val-rec x e)

    it is necessary to be sure that e can be evaluated without evaluating x. Many students forget this side condition, which can be implemented very easily with the help of the function appearsUnprotectedIn, which should be listed in the code index of your book.

    Add val-rec and define definitions to your regression-test file, and add regression tests for the names you define.

    Verify that your interpreter compiles and passes all its regression tests.

    Your elabdef is now complete.

  16. Return to typeof and implement TYAPPLY and TYLAMBDA. Save these cases for after the last class lecture on the topic. (Those are the only parts that have to wait until the last lecture; you can have your entire type checker, except for those two constructs, finished before the last class.)

    Add suitable regression tests, and verify that your interpreter compiles and passes its regression tests.

  17. Complete your literal function by making sure it handles list literals formed with PAIR or NIL.

    Add suitable regression tests, and verify that your interpreter compiles and passes its regression tests.

    Your typeof function is now complete.

    Your entire type checker is now complete.

  18. Return to the code you modified in step 1. Bind

    val basis_included = true

    Verify that your interpreter compiles and that it can typecheck the predefined functions of Typed μScheme.

Avoid common mistakes

In Exercise 8, it’s a common mistake to try to create a type system that prevents programmers from applying car or cdr to the empty list. Don’t do this! Such a type system is too complicated for COMP 105. As in ML, taking car or cdr of the empty list should be a well-typed term that causes an error at run time.

In Exercise 8, it’s common to write a nondeterministic type system by accident. The rules, typing context, and syntax have to work together to determine the type of every expression. But you’re free to choose whatever rules, context, and syntax you want.

In Exercise 8, it’s inexplicably common to forget to write a typing rule for the construct that tests to see if a list is empty.

There are already interpreters on your PATH with the same name as the interpreters you are working on. So remember to get the version from your current working directory, as in

  ledit ./timpcore

Just plain timpcore will get the system version.

ML equality is broken! The = sign gives equality of representation, which may or may not be what you want. For example, in Typed uScheme, you must use the eqType function to see if two types are equal. If you use built-in equality, you will get wrong answers.

It’s a common mistake to call ListPair.foldr and ListPair.foldl when what you really meant was ListPair.foldrEq or ListPair.foldlEq.

It’s not a common mistake, but it can be devastating: when you’re writing the type of a polymorphic primitive function, write the type variable with an ASCII quote mark, as in 'a, not with a Unicode right quote mark, as in ’a.

It’s not a common mistake, but don’t define any new exceptions. And don’t raise any exceptions besides TypeError. (If you don’t finish, you might also raise LeftAsExercise.)

What is and is not hard or time-consuming

In Exercise 8 on page 460, I am asking you to create new type rules on your own. Many students find this exercise easy, but many find it very difficult. The “difficult” people have my sympathy; you haven’t had much practice creating new rules of your own. You’ll get it now.

Problem TD, writing take in Typed μScheme, requires that you really understand instantiation of polymorphic values. Once you get that, the problem is not difficult, but the type checker is persnickety. A little of this kind of programming goes a long way.

Exercise 2, type-checking arrays in Typed Impcore, has a lot of related reading—you’ll fill in any ideas or details that you missed in class. But aside from the amount of reading, this exercise is probably the easiest exercise on the homework. You need to be able to duplicate the kind of reasoning and programming that we will do in class for the language of expressions with LET and VAR.

Exercise 23, the full type checker for Typed µScheme, presents two kinds of difficulty:

For the first item, we’ll talk a lot in class about the concepts and the connection between type theory and type checking. For the second item, it’s not so difficult provided you remember what you’ve learned about building big software: don’t write it all in one go. Instead, start with a tiny language and grow it very slowly, testing at each step—just as instructed in the guide above. As in yoga, the slow way is the fastest.

Exercise 24, adding queues to Typed μScheme, requires you to understand how primitive type constructors and values are added to the initial basis. And it requires you to write ML code that manipulates μScheme representations. The task is not inherently difficult, but there are two challenges:

To address these challenges, your best bets are to study the way the existing primitives are implemented and to emulate the code that you see.