It's just as difficult, and definitely more for the patient, and there are two sides of the story. He is probably thinking deep, about life, the past, and the future. When diagnosed with cancer, all of a sudden you think, prepare for death years before many of your peers, significant others will, and that can be difficult, and some don't understand.
Maybe he is being treated differently than before. If he worked, now he is home all the time, which takes some getting used to for both parties. Maybe you would see each other a few hours each day, work, come home and sleep. Now it's 24/7. Maybe his or your routine is now disrupted, and now either has to cater to the other, compromise their routine, which can cause problems.
Maybe he doesn't like all the special attention you or anyone else is giving him, even tine of voice, and just wants to be treated normally. Sometimes it's the opposite, some friends may have disappeared, afraid to talk or visit, treating one like it's the plague.
I go to all my dr visits, tests, diagnosis, surgery by myself, always did. A few times a sibling went with me when I was in very critical condition, and I did not like it at all! They would speak on my behalf, dr speaking to them, like I was invalid or something, asking questions out of line, saying things that were not true, were misinformed, misinformed me, exaggerating, etc. I took back control real quick, and had a few arguments when one stepped out of line, argued with health providers, effecting my treatment or care. I can speak for myself, and more in tune with my needs than anyone is. There is a difference in being on the sideline to help, when asked or planned, but someone taking total control of everything without me involved, asking is not me, and many others, and would not let it happen.
Maybe he is worried about future finances, how the bills will paid. What if he can't work? how will you both manage, including continuation of health insurance.
Sometimes you just want to be left alone, and rest. If he needs something, he will ask or try to do himself.