James Gallatin was the son of Albert Gallatin, the man who helped broker the Treaty of Ghent, which ended the War of 1812 between Britain and the United States. James acted as his father's personal secretary during this diplomatic trip. His journal entries from this voyage were published in the September 1914 issue of Scribner's Magazine and include a detailed historical account of the negotiations and infighting between the American representatives as well as with the British delegates. However, Raymond Walters, biographer of Albert Gallatin, and other historians believe the diary to be a forgery. Walters wrote "... I reached the conclusion that the diary is a complete fraud." Walters notes that no manuscript for the diary has survived or was ever known to have been seen by anybody other than James Francis Gallatin. James Francis styled himself Count Gallatin, though his right to the title was disputed, but he was known to his own family as "bad Jimmy". After the success at Ghent, the Gallatins traveled to France just as Napoleon arrived at Cannes after escaping Elba. James' diary includes a detailed look into the lives of the nobles as they faced the threat of Napoleon's return. At one point, he is asked by the famous artist Jacques-Louis David to sit as a cherub for his painting l'Amour et Psyche:
3 March 1815. — We were received privately this morning by the King, only the Duchesse d'Angouleme was present. She looked very sad. The King moved to the embrasure of a window, motioning to Father to follow him, they remained in conversation for a quarter of an hour. Amongst other things His Majesty intimated a wish that Father would be sent as Minister to Paris adding, "you must not forget that your family belonged to France, before you belonged to America." The Duchess talked to me most graciously, asked me about my Mother and said "You are too young to begin political life. I assured her I was 18; she exclaimed "Mais c'est un bebe." Monsieur David the great Artist has requested Father to allow me to pose to him for Cupid, Father has consented and I sit tomorrow.
James Gallatin succeeded his father as the president of the Gallatin National Bank in 1839. After his retirement in 1868 he resided in Paris, where he died.