Source generator relying on additional file packaged as nuget gets cached

[octabit]

There is a great possibility that I have misunderstood how this should work, but here we go:

Project A is a source generator.
Project A relies on additional files for its output.
Project A is packaged as a NuGet package.

Project B references project A's NuGet package.
Project B defines additional files, wich influences project A's output.
Project A's source generating code does not execute because project A's version hasn't changed and Project A's NuGet package is being cached.

Fail?

In this scenario caching of project A's NuGet package doesn't make sense in my opinion. There should at least be a mechanism to turn caching off for NuGet packages containing generators.

Any thoughts? Is there a solution for this scenario?