Ok - final thought - I have also found a middle name associated with a very close friend who was a neighbour (found by accident on a census). You may want to examine the census listings for 1851/61/71 and see if any of the neighbours of James' parents had the surname DALLAS.  Yes, its not likely, but I guess you are looking for any line of enquiry. Good luck!
Regards
Stuart