Hi there,
Thank you for reaching out before,
I saw you have an interesting project running llm on orangepi, I think I have sufficient knowledge to work a RK3588npu based modified qwen3.c or llama2.c, are you interested in testing it with the rk3588 npu? Do you have other llm architecture in mind?
You may also want to have a look to https://github.com/moonshine-ai/ai_in_a_box. It could be helpful to your project,
Reference
https://github.com/adriancable/qwen3.c
Hi there,
Thank you for reaching out before,
I saw you have an interesting project running llm on orangepi, I think I have sufficient knowledge to work a RK3588npu based modified qwen3.c or llama2.c, are you interested in testing it with the rk3588 npu? Do you have other llm architecture in mind?
You may also want to have a look to https://github.com/moonshine-ai/ai_in_a_box. It could be helpful to your project,
Reference
https://github.com/adriancable/qwen3.c