How to implement it to skip characters

How to implement it to skip characters

How to implement it to skip characters like: ! : \ & ' in any position?
preg_match_all('/#(\w+)/', $string, $matches);