0.5.2 DML 2x to 4x Slower than 0.4.0 (Big regression)

[elephantpanda]

genai 0.5.2 appears to be between 2x and 4x slower than genai 0.4.0, in fact it is only about 50% faster than CPU mode.

If have just tested both 0.4.0 and 0.5.2 and it definitely is a vast difference in DML mode.

GPU Quadro P5000.

model: microsoft/Phi-3-mini-4k-instruct-onnx
c#
BTW, I checked it is not the new DirectML.dll library causing this.

[hanbitmyths]

@elephantpanda, can you share genai_config.json and benchmark steps to repro?