How do I set up automatic reloads when I make changes to configuration or code?

You could try http://codespeak.net/svn/z3/z3reload/trunk/README.txt

Otherwise there is nothing like Django or CherryPy?'s inbuilt automatic reload for development.

Correct me if I'm wrong.