I also set the permissions on the the SetupProcess component to the groups I wanted access to see this stuff. Is that something you have to do for ever workflow or is there a default config some place?
This is something that you set up for each workflow. However, if you have a certain group that you want to be able to view all processes you can add the ProcessData.ViewAll permission to the group.
Primary Contact and Assignees are two different things in a workflow. Assignments happen on tasks, like when you have a Dialog Workflow component. You can set the assignment there or after the fact with components. Being a contact doesn't really mean much in a workflow by itself. I think it may give the contact access to the process but other than that any usage would be up to your application. Contacts can also be set by components.
If you're using a form start workflow then you probably wouldn't have any assignments (unless you have other Dialog Workflow components). In this case there's not really a task since the user is starting a completing the dialog in one step.