CVT, a Computer Vision Toolkit.
-
Updated
Aug 24, 2022 - C
#
int8-quantization
Here are 25 public repositories matching this topic...
Winner solution of mobile AI (CVPRW 2021).
-
Updated
May 14, 2022 - Python
A header-only neural network library for microcontrollers, with partial bare-metal & native-os support.
arduino avr attiny microcontrollers neural-network simple tensorflow lstm gru mnist neural-networks rnn mnist-dataset mlp maths quantization mnist-model mnist-handwriting-recognition int8-quantization quantization-efficient-network
-
Updated
Mar 6, 2026 - C++
FrostNet: Towards Quantization-Aware Network Architecture Search
computer-vision deep-learning pytorch style-transfer classification object-detection quantization network-architecture semantic-segmentation optimizers quantization-aware-training int8-quantization post-quantization quantization-efficient-network
-
Updated
May 3, 2024 - Python
Quantization Aware Training
-
Updated
Jan 13, 2024 - Python
将端上模型部署过程中，常见的问题以及解决办法记录并汇总，希望能给其他人带来一点帮助。
-
Updated
Aug 17, 2022 - Python
ATtiny85 arduino example, running an RNN MNIST model via the (internal) 512-Byte EEPROM with ~95% accuracy
microcontrollers cpp11 mnist rnn mnist-classification mnist-dataset attiny85 eeprom mnist-model int8-quantization
-
Updated
Mar 6, 2026 - C++
-
Updated
Jun 8, 2023
VB.NET api wrapper for llm-inference chatllm.cpp
bindings api-wrapper llama vb-net vbnet gemma mistral int8 int8-inference int8-quantization cpu-inference chatllm ggml llm-inference qwen
-
Updated
Nov 26, 2024 - Visual Basic .NET
C# api wrapper for llm-inference chatllm.cpp
csharp inference bindings api-wrapper llama gemma mistral int8 int8-inference int8-quantization cpu-inference llm llms chatllm ggml llm-inference qwen
-
Updated
Nov 20, 2024 - C#
Generating tensorrt model using onnx
pytorch quantization tensorrt onnx int8-inference onnxruntime post-training-quantization int8-quantization tensorrt-inference ptq
-
Updated
Jun 22, 2023 - C++
Corrects your grammar in 5 languages directly in your browser. Powered by an open-source AI model.
javascript chrome-extension nlp machine-learning browser-extension collaborate student-project grammar-checker onnx int8-quantization t5-model github-copilot
-
Updated
Jul 12, 2025 - JavaScript
Garuda: CVXIF coprocessor optimizing batch-1 attention microkernels with 7.5-9× lower p99 latency. RISC-V INT8 MAC accelerator for transformer inference.
machine-learning neural-network inference simd low-latency systemverilog attention-mechanism risc-v int8 systemverilog-hdl systolic-arrays edge-ai hardware-accelerator int8-quantization cva6 custom-instructions ai-hardware cvxif
-
Updated
Jan 23, 2026 - SystemVerilog
TinyML project. This system monitors your room or surrounding with an onboard microphone of Arduino nano BLE sense. Still Under Developement
arduino machine-learning deep-learning quantization tf-data audio-processing spectrograms tflite-conversion tflite-models arduino-nano-33-ble-sense int8-quantization tflite-micro
-
Updated
Oct 18, 2021 - Jupyter Notebook
A fork of convert_to_quant that adds QuIP quantization for INT‑8 models.
-
Updated
Feb 25, 2026 - Python
gemma-2-2b-it int8 cpu inference in one file of pure C#
csharp inference quantization gemma int8 inference-engine model-serving int8-inference int8-quantization cpu-inference llm llms llm-serving llm-inference gemma2 gemma2-2b-it
-
Updated
Jun 14, 2025 - C#
Translation API using Meta's NLLB-200 model with 200+ languages
docker django docker-compose django-rest-framework celery redis-cache int8-quantization translationapi ctranslate2 nllb200
-
Updated
Dec 5, 2025 - Python
Post-Training quantization perfomed on the model trained with CLIC dataset.
-
Updated
Sep 1, 2025 - Jupyter Notebook
High-performance LLM inference platform with vLLM continuous batching achieving 12.3K+ req/sec, 42ms P50/178ms P99 latency, INT8/INT4 quantization (70% memory savings), tensor parallelism across 4 GPUs, and comprehensive monitoring serving 1500+ concurrent users.
-
Updated
Oct 3, 2025 - Python
Hardware-verified SNN-equivalent intrusion detection system (IDS) on STM32N6 Neural-ART NPU. INT8 quantized MLP achieving 0.4561ms inference at 800MHz. First publicly documented IDS on a commodity MCU NPU with T=1 SNN-ANN equivalence validation.
cybersecurity iot-security network-security intrusion-detection-system nsl-kdd neuromorphic-computing onnx embedded-ai edge-ai spiking-neural-network ann-snn-conversion tinyml post-training-quantization int8-quantization cortex-m55 real-time-inference stm32n6 qcfs neural-art-npu mcu-npu
-
Updated
Mar 9, 2026 - Python
Improve this page
Add a description, image, and links to the int8-quantization topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the int8-quantization topic, visit your repo's landing page and select "manage topics."