this question refers to definition of dualizing complex $\omega_A ^{\bullet}$ presented in Stacks as an object satisfying following properties:
(1)$ω^∙_A$ has finite injective dimension,
(2)$H^i(ω^∙_A)$ is a finite A-module for all i, and
(3) $A→RHomA(ω^∙_A,ω^∙_A)$ is a quasi-isomorphism.
my rudimetary question is what is the double complex $RHomA(ω^∙_A,ω^∙_A)$ and how is can it be calulated at each degree? what is the $l$-degree value of $RHomA(ω^∙_A,ω^∙_A)$ concretely? if we fix $A$-modules $M,N$ then $RHom(M,N)$ can be calculated in two way: take injective resolution $N \to I^{\bullet}$ for $N$(respectively projectlive resolution for $M$: $R^{\bullet} \to M$), apply the $Hom(M,-)$ functor (resp $Hom(,N)$) and take first homology. what is going on $RHomA(ω^∙_A,ω^∙_A)$?
In the Derived Hom section from the Stacks project, we have the following definition for the derived hom:
In your case (I'm going to use $R$ instead of $A$ for the ring) $\omega_R^\bullet \in D(R)$ has finite injective dimension, so it's a finite complex and in particular is bounded below. Since the category of $R$-modules is an abelian category, by Lemma 13.29.4 from this Stacks article $\omega_R^\bullet$ is a K-injective complex. Taking $I^\bullet, L^\bullet = \omega_R^\bullet$ we can then calculate the derived hom at each degree.