The death of the Weekly's publisher, Fletcher Harper, in 1877 resulted in a changed relationship between Nast and his editor George William Curtis. His cartoons appeared less frequently, and he was not given free rein to criticize Hayes or his policies. Beginning in the late 1860s, Nast and Curtis had frequently differed on political matters and particularly on the role of cartoons in political discourse. Curtis believed that the powerful weapon of caricature should be reserved for "the Ku-Klux Democracy" of the opposition party, and did not approve of Nast's cartoons assailing Republicans such as Carl Schurz and Charles Sumner who opposed policies of the Grant administration. Nast said of Curtis: "When he attacks a man with his pen it seems as if he were apologizing for the act. I try to hit the enemy between the eyes and knock him down." Fletcher Harper consistently supported Nast in his disputes with Curtis. After his death, his nephews, Joseph W. Harper Jr. and John Henry Harper, assumed control of the magazine and were more sympathetic to Curtis's arguments for rejecting cartoons that contradicted his editorial positions.
Between 1877 and 1884, Nast's work appeared only sporadically in Harper's, which began publishing the milder political cartoons of William Allen Rogers. Although his sphere of influence was diminishing, from this period date dozens of his pro-Chinese immigration drawings, often implicating the Irish as instigators. Nast blamed U.S. Senator James G. Blaine (R-Maine) for his support of the Chinese Exclusion Act and depicted Blaine with the same zeal used against Tweed. Nast was one of the few editorial artists who took up for the cause of the Chinese in America.