minor tweaks to the tokenization regex

Author: Nat Taylor

README.md

@@ -14,4 +14,12 @@ Basically create an instance of `Teaser()` then pass it either a URL or a text/t
 - I tried to carefully document the class, but it needs more detail.  This is coming soon.
 - (Obviously) This relies on the source text having some good sentences that summarize it.  Without that, our summary will suck.
 - Based on https://github.com/xiaoxu193/PyTeaser based on http://www.textteaser.com/
-- What would make this a lot better?  Tweaking the scoring, duh!
+- What would make this a lot better?  Tweaking the scoring, duh!
+
+##TODO##
+- Add synonyms to the headline list
+- Try to do some NLP like:
+  -- Stemming: https://github.com/camspiers/porter-stemmer 
+  -- Morphology: https://github.com/heromantor/phpmorphy
+  -- WordNet: http://www.foxsurfer.com/wordnet/
+

class.phpteaser.php

@@ -212,7 +212,7 @@ function splitSentences($text) {
 		$re = '/# Split sentences on whitespace between them.
 		    (?<=                # Begin positive lookbehind.
 		      [.!?]             # Either an end of sentence punct,
-		    | [.!?][\'"]        # or end of sentence punct and quote.
+		    | [.!?][\'"”]        # or end of sentence punct and quote.
 		    )                   # End positive lookbehind.
 		    (?<!                # Begin negative lookbehind.
 		      Mr\.              # Skip either "Mr."
@@ -223,10 +223,11 @@ function splitSentences($text) {
 		    | Prof\.            # or "Prof.",
 		    | Sr\.              # or "Sr.",
 		    | T\.V\.A\.         # or "T.V.A.",
+		    | [A-Z]\.           # or Middle Initial
 		                        # or... (you get the idea).
 		    )                   # End negative lookbehind.
 		    \s+                 # Split on whitespace between sentences.
-		    /ix';
+		    /x';
 
 		$sentences = preg_split($re, $text, -1, PREG_SPLIT_NO_EMPTY);
 		return $sentences;