ASoC: meson: axg-tdm-interface: Fix formatters in trigger"

ASoC: meson: axg-tdm-interface: Fix formatters in trigger"

This reverts commit e9d141b7dcd3de5e346ef16d6ebcc5582c7be489 because
the following and required commit 136d8a37e312c9412255304ded34362987abe006
causes the following system crash when using audio:
 BUG: sleeping function called from invalid context at kernel/locking/mutex.c:282

Fixes: e9d141b7dcd3de5e346ef16 ("ASoC: meson: axg-tdm-interface: manage formatters in trigger")
Reported-by: Dmitry Shmidt <dimitrysh@google.com>
Signed-off-by: Neil Armstrong <narmstrong@baylibre.com>
Acked-by: Jerome Brunet <jbrunet@baylibre.com>
Link: https://lore.kernel.org/r/20220421155725.2589089-1-narmstrong@baylibre.com
Signed-off-by: Mark Brown <broonie@kernel.org>