Good point. But considering the frequent retraining, the environmental impacts can only be spread on a finite number of queries.
Is this for inferencing only? Do you include training?
Good point. But considering the frequent retraining, the environmental impacts can only be spread on a finite number of queries.