Apparently, you can: http://news.yahoo.com/blogs/technology-blog/nasa-spots-chilled-stars-cooler-human-body-004551421.html
At least temperature-wise. Don't know about the gravity...
If the brown dwarf is that cool, though, wouldn't it still be a gassy object, too tenuous to walk?