Add 4 bit inference capability#280

snowclipsed wants to merge 11 commits intovikhyat:mainvikhyat/moondream:mainfrom

snowclipsed:int4snowclipsed/moondream:int4Copy head branch name to clipboard