vitisai : add VitisAI Plugin for AMD Ryzen AI NPU encoder offload (#3608)
* Add VitisAI Plugin
* Added VitisAI encoder module placeholder files
* VitisAI build integration
* VitisAI encoder offload functional
* Clean up vitisai integration
* Add c++17 requirement for Windows
* Enabled preemption for windows runs
* Add model cache override option
* Remove vitisai premature log message
* Add rai support through file mapping
* Fixed flatbuffer loading
* Fixed Windows file mapping issue
* Update FlexmlRT resolution
* Use Flexmlrt wheel pkg to build VitisAI plugin
* Clean up
* Remove prints
* Change flexmlrt target from Shared to Interface
* Add c++17 requirement for Windows
* Enabled preemption for windows runs
* Add rai support through file mapping
* Fixed flatbuffer loading
* Fixed Windows file mapping issue
* Update FlexmlRT resolution
* Use Flexmlrt wheel pkg to build VitisAI plugin
* Clean up
* Remove prints
* Change flexmlrt target from Shared to Interface
* Cleanup FlexmlRT integration
* format fix
* Adding AMD Licenses
* Update CMakeLists.txt
Co-authored-by: Kumawat, Sachin <sachin.kumawat@amd.com>
* Update src/CMakeLists.txt
Co-authored-by: Kumawat, Sachin <sachin.kumawat@amd.com>
* Update whisper.cpp
* Added VitisAI encoder readme section
* Remove license headers from common files to whisper.cpp
---------
Co-authored-by: Sachin Kumawat <sachink@amd.com>
Co-authored-by: Jeff Lin <jeffylin@xilinx.com>
Co-authored-by: Lin <jefflin@amd.com>
Co-authored-by: Lin, Jeff (DCG-ENG) <jeff.lin@amd.com>
Co-authored-by: Iswarya Alex <iswaryaalex96@gmail.com>
Co-authored-by: Alex, Iswarya <Iswarya.Alex@amd.com>
* Update README.md
- RAI EULA Links
- Updated for RAI Whisper instructions
* Cleanup and add runtime print debug guard
* turn off profiling
* Add VitisAI Plugin
* Added VitisAI encoder module placeholder files
* VitisAI build integration
* VitisAI encoder offload functional
* Clean up vitisai integration
* Add c++17 requirement for Windows
* Enabled preemption for windows runs
* Add model cache override option
* Remove vitisai premature log message
* Add rai support through file mapping
* Fixed flatbuffer loading
* Fixed Windows file mapping issue
* Update FlexmlRT resolution
* Use Flexmlrt wheel pkg to build VitisAI plugin
* Clean up
* Remove prints
* Change flexmlrt target from Shared to Interface
* Add c++17 requirement for Windows
* Enabled preemption for windows runs
* Add rai support through file mapping
* Fixed flatbuffer loading
* Fixed Windows file mapping issue
* Update FlexmlRT resolution
* Use Flexmlrt wheel pkg to build VitisAI plugin
* Clean up
* Remove prints
* Change flexmlrt target from Shared to Interface
* Cleanup FlexmlRT integration
* format fix
* Adding AMD Licenses
* Update CMakeLists.txt
Co-authored-by: Kumawat, Sachin <sachin.kumawat@amd.com>
* Update src/CMakeLists.txt
Co-authored-by: Kumawat, Sachin <sachin.kumawat@amd.com>
* Update whisper.cpp
* Added VitisAI encoder readme section
* Remove license headers from common files to whisper.cpp
---------
Co-authored-by: Sachin Kumawat <sachink@amd.com>
Co-authored-by: Jeff Lin <jeffylin@xilinx.com>
Co-authored-by: Lin <jefflin@amd.com>
Co-authored-by: Lin, Jeff (DCG-ENG) <jeff.lin@amd.com>
Co-authored-by: Iswarya Alex <iswaryaalex96@gmail.com>
Co-authored-by: Alex, Iswarya <Iswarya.Alex@amd.com>
* Cleanup and add runtime print debug guard
* Update README.md
- RAI EULA Links
- Updated for RAI Whisper instructions
* turn off profiling
* Let flexmlrt detect device type
* Add VitisAI model download scripts
* Add encoder + cross projection layer offload
* Add self hosted runner for amd npu
* Update runner
* Update workflow for linux
* Update workflow for linux
* Update flexmlrt packages for linux
* Update flexmlrt packages for linux
* Updated README
* readme: clarify xrt
* readme: clarify xrt
* ci: update test config
* Added supported plarform details with python 3.12 requirement for Linux
* Use refactored helpers
* Deprecate cross_proj .rai naming and cleanup
* Remove stale function code
* Fix: formatting
---------
Co-authored-by: Jeff Lin <jeffylin@xilinx.com>
Co-authored-by: Lin <jefflin@amd.com>
Co-authored-by: Lin, Jeff (DCG-ENG) <jeff.lin@amd.com>
Co-authored-by: Iswarya Alex <iswaryaalex96@gmail.com>
Co-authored-by: Alex, Iswarya <Iswarya.Alex@amd.com>
Co-authored-by: Iswarya Alex <47045679+iswaryaalex@users.noreply.github.com>
52dec9d889