I am sorry if this is too silly but I can't, for the life of me, understand how this works. This is the definition I am working with.
Definition. Let $G$ be an arbitrary group and $H$ be a subgroup with a representation $V$. Then the induced representation from $H$ to $G$ is the vector space $$Ind_H^G=\{f:G\rightarrow V∣f(gh^{-1})=hf(g) \;\;\forall g\in G, h\in H\}$$ with action defined by $$gf(x)=f(g^{-1}x).$$
Why should this be a well-defined action? Wouldn't this require $$f(abx)=(b^{-1}a^{1}f)(x)=f(bax)?$$
Edit: This was a stupid question, I was doing $$f(abx)=(ab)^{-1}f(x)=b^{-1}a^{-1}f(x)=b^{-1}f(ax)=f(bax)$$ and now I realize I was just applying it in the wrong order. Sorry for wasting your time.
Where did you get $f(abx)=(abf)(x)$ from? That's not how the action is defined. In fact $(abf)(x)=f((ab)^{-1}x)=f(b^{-1}a^{-1}x)$. And that's the reason why you have $g^{-1}$ inside: precisely for associativity to work.
In order to check correctness we need the following two things: