ugh

We had one of these chaps on our floor a while ago, and I thought it was a one-off, but the other day I saw another one crawling into the lift shaft. They are MOST unnerving, but apparently they eat roaches, so I'm in something of a bind. Do I sweep them out because they have millions of legs and scuttle very VERY fast, or do I let them stay because they're less numerous than the likewise-disgusting roaches? We don't personally have a roach problem at the moment, but this is New York, there's bound to be one sooner or later.