Advice please...

What should I do when my boss makes a comment like, "You two must have been brother and sister in a previous life, the way you carry on..?" Back off and leave the guy alone or just ignore it and keep up the banter?