- clone the git repo
- go to the docker directory "cd littool/requirements/docker"
- start the docker container on a server with command : "docker-compose up -d" NOTE: the docker compose orchestration will always try to restart the container in case of any failure. Use step 5 to debug.
- Go to the browser and type ip address followed by port number(6789 default for flask): http://w.x.y.z:6789
- To check the logs of docker: "docker-compose logs"
- To bring down the container: "docker-compose down"
- open docker with docker exec and install ollama with command "curl -fsSL https://ollama.com/install.sh | sh"
- serve ollama with command "ollama serve" inside docker
- pull relevant llava model i.e. for our case "ollama pull lamma3"
vinash85/AgentAI_litgene
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|