I've just purchased a X100 which should hopefully be with me on Thursday.
Spent a fair bit of time weighing up getting one, I've twice reserved one previously but ended up cancelling it due to doubts.. the big wall for me was price and for some reason they have come down to a reasonable price 2nd hand, i think it may be down to the sticky blades or general issues in functionality..
I used to have a DSLR but ended up selling due to financial reasons plus towards the end of ownership I was finding myself leaving the DSLR at home, a lot of the time i just couldn't face carrying it around for a day.. plus it wasn't discrete in any way..
I never felt comfortable using it in public or at parties etc, low key social do's etc didn't really suit a big camera, I ended up getting an LX3 at the time as it was ultimately the best available and since then it has done me very well, infact i will definitely keep it!
I spent time looking at options in the X100 price range, and after reading a shed load of reviews I decided nothing was going to beat the X100 in terms of image quality and looks, but a lot of what I have read people find it hard work, not straight forward making you work for the photos you're used to getting easily with other cameras.. end of the day I want picture quality, I don't mind working for it.. I just didn't feel like the micro 4/3rds could cut it in comparison..
I will be back once I've tamed the beast to hopefully share my experience with the X100

(or sell it if the love affair does not pursue)