Joseph Durfee was born in Fall River (then known as Freetown) on 27 April 1750. A newspaper clipping refers to a 50 page file located in the National Archives that contains letters and depositions from friends and fellow citizens regarding the quality of Durfee's military service.
The article outlines the Battle of Fall River, the Battle of Long Island, and describes him as a "Freedom Fighter."
The New York State Archives may also hold the key to finding information about the Battle of White Plains and the involvement of Joseph Durfee.
I recommend you start with Joseph, in his own words.
While Joseph's "Reminiscences" are valuable, he mentions White Plains only once. I also recommend you contact the National Archives.