MAIN BRANCH CONTAINS API CHANGES

[aciddelgado]

Currently, main branch contains API changes from this pr (continuous decoding). Code samples within the main branch of the repository reflect these API changes... this means sample scripts in main don't work with the current release (0.5.2). For sample scripts that work with the current release, see the release branch.

[souviksv]

@kunal-vaishnavi by when we can expect #1126 this error will resolved?

[souviksv]

@aciddelgado please check this out.

[kunal-vaishnavi]

@kunal-vaishnavi by when we can expect #1126 this error will resolved?

As mentioned above, there are API changes that have been made. If you are using a stable release of ONNX Runtime GenAI, please use the examples in the stable release branch. If you are building ONNX Runtime GenAI from source, please use the examples in the main branch. The examples in the branches use the APIs that are available in their respective packages.

A new stable release is scheduled to come out this month. Once released, the examples in the main branch will work with the stable release again.