Skip to content

[BUG] ollama docker cpu install fails due to gpu expectation #1315

@dude2040

Description

@dude2040

tried to install ollama without GPU for docker with

dcker compose -f docker-compose.ollama.yml --profile cpu --profile setup up -d

but resulted in an error message shown below and ollama docker status is unhealthy

Here the result from command

✔ model-setup Pulled 479.1s
✔ db Pulled 151.5s
✔ ollama Pulled 479.0s
✔ ollama-cpu Pulled 479.0s

WARN[0479] Docker Compose is configured to build using Bake, but buildx isn't installed
[+] Building 29.6s (11/30) docker:default
[+] Building 1168.0s (54/54) FINISHED docker:default
=> [realtime internal] load build definition from realtime.Dockerfile 0.1s
=> => transferring dockerfile: 1.46kB 0.0s
=> [migrations internal] load build definition from db.Dockerfile 0.2s
=> => transferring dockerfile: 1.03kB 0.0s
=> [simstudio internal] load metadata for docker.io/oven/bun:alpine 5.0s
=> [migrations internal] load .dockerignore 0.3s
=> => transferring context: 158B 0.0s
=> [realtime internal] load .dockerignore 0.4s
=> => transferring context: 158B 0.0s
=> [migrations internal] load build context 1.5s
=> => transferring context: 8.69MB 0.3s
=> [simstudio base 1/1] FROM docker.io/oven/bun:alpine@sha256:02564b43c26a0dc156ff4b70d7ccb68ebae5c48 22.3s
=> => resolve docker.io/oven/bun:alpine@sha256:02564b43c26a0dc156ff4b70d7ccb68ebae5c486771d699ed1520c4 0.1s
=> => sha256:02564b43c26a0dc156ff4b70d7ccb68ebae5c486771d699ed1520c42e6ac5cb0 1.61kB / 1.61kB 0.0s
=> => sha256:fc6f07fe63615d31c5a546a6fa7efbc4365400358045668adbf64636a49e5bd1 1.43kB / 1.43kB 0.0s
=> => sha256:780a7e8f6bf76895b38fd6f39e90720bd8c0edb0bf8be4a1d3c692a715b59c8a 4.03kB / 4.03kB 0.0s
=> => sha256:59c772f2b7a1dd8885cd9a83ec322b3ca5681c074302f27d94c1067c806c8e7e 37.80MB / 37.80MB 17.7s
=> => sha256:01d036902a3ca86e8793073c8094cba44d83a38953a489ac0641f3de017fe2d2 3.62MB / 3.62MB 2.8s
=> => sha256:22692eecefd80feda6f2d15ae98cfd529d01eb05ebd54b03f88ed7e9337ced00 295B / 295B 1.3s
=> => sha256:89903a090bf9a90cb0a9ab27809718f42e8ae70731884f2ef34188c24f73a040 185B / 185B 2.6s
=> => sha256:4926b633e47783e48028633c5529b118b4f15e3995d68472a60705e5695cf4e1 3.35MB / 3.35MB 6.8s
=> => sha256:088ee8517ceed03364d6d7aba574ebf7f63efda4682d257836606b1f664d4880 144B / 144B 4.7s
=> => extracting sha256:01d036902a3ca86e8793073c8094cba44d83a38953a489ac0641f3de017fe2d2 0.3s
=> => extracting sha256:59c772f2b7a1dd8885cd9a83ec322b3ca5681c074302f27d94c1067c806c8e7e 1.5s
=> => extracting sha256:22692eecefd80feda6f2d15ae98cfd529d01eb05ebd54b03f88ed7e9337ced00 0.0s
=> => extracting sha256:89903a090bf9a90cb0a9ab27809718f42e8ae70731884f2ef34188c24f73a040 0.1s
=> => extracting sha256:4926b633e47783e48028633c5529b118b4f15e3995d68472a60705e5695cf4e1 0.1s
=> => extracting sha256:088ee8517ceed03364d6d7aba574ebf7f63efda4682d257836606b1f664d4880 0.0s
=> [realtime internal] load build context 7.6s
=> => transferring context: 360.78MB 6.8s
=> CACHED [simstudio deps 1/7] RUN apk add --no-cache libc6-compat 5.8s
=> CACHED [simstudio builder 1/9] WORKDIR /app 0.3s
=> [migrations deps 3/5] COPY package.json bun.lock turbo.json ./ 0.6s
=> [migrations deps 4/5] COPY apps/sim/package.json ./apps/sim/db/ 0.2s
=> [migrations deps 5/5] RUN bun install --omit dev --ignore-scripts && bun install --omit dev - 207.4s
=> CACHED [simstudio deps 2/7] WORKDIR /app 0.4s
=> CACHED [simstudio deps 3/7] RUN bun install -g turbo 31.7s
=> [realtime deps 4/7] COPY package.json bun.lock ./ 0.5s
=> [realtime deps 5/7] RUN mkdir -p apps 0.5s
=> [realtime deps 6/7] COPY apps/sim/package.json ./apps/sim/package.json 0.2s
=> [realtime deps 7/7] RUN bun install --omit dev --ignore-scripts 175.8s
=> [migrations runner 3/8] COPY --from=deps /app/node_modules ./node_modules 5.8s
=> [migrations runner 4/8] COPY apps/sim/drizzle.config.ts ./apps/sim/drizzle.config.ts 0.3s
=> [migrations runner 5/8] COPY apps/sim/db ./apps/sim/db 1.3s
=> [migrations runner 6/8] COPY apps/sim/package.json ./apps/sim/package.json 0.2s
=> [migrations runner 7/8] COPY apps/sim/lib/env.ts ./apps/sim/lib/env.ts 0.2s
=> [migrations runner 8/8] WORKDIR /app/apps/sim 0.6s
=> [migrations] exporting to image 12.7s
=> => exporting layers 12.6s
=> => writing image sha256:c58ad0e213af617ee3ba1bf889fd5885af2525bdd53334a58c7753cef91aa9d2 0.0s
=> => naming to docker.io/library/sim-with-ollama-migrations 0.0s
=> [migrations] resolving provenance for metadata file 0.0s
=> [realtime builder 2/3] COPY --from=deps /app/node_modules ./node_modules 18.1s
=> [realtime builder 3/3] COPY . . 6.4s
=> [realtime runner 2/4] COPY --from=builder /app/apps/sim ./apps/sim 0.8s
=> [realtime runner 3/4] COPY --from=builder /app/node_modules ./node_modules 17.8s
=> [realtime runner 4/4] COPY --from=builder /app/package.json ./package.json 0.2s
=> [realtime] exporting to image 36.8s
=> => exporting layers 36.7s
=> => writing image sha256:4d0653a0ef8a930c4af8e0bef8b4617b18c4ef5767340a30ab15d9427b18fa25 0.0s
=> => naming to docker.io/library/sim-with-ollama-realtime 0.0s
=> [realtime] resolving provenance for metadata file 0.0s
=> [simstudio internal] load build definition from app.Dockerfile 0.3s
=> => transferring dockerfile: 1.64kB 0.0s
=> [simstudio internal] load .dockerignore 0.1s
=> => transferring context: 158B 0.0s
=> [simstudio internal] load build context 0.8s
=> => transferring context: 200.22kB 0.7s
=> [simstudio builder 2/9] RUN bun install -g turbo 8.1s
=> CACHED [simstudio deps 4/7] COPY package.json bun.lock ./ 0.0s
=> CACHED [simstudio deps 5/7] RUN mkdir -p apps 0.0s
=> CACHED [simstudio deps 6/7] COPY apps/sim/package.json ./apps/sim/package.json 0.0s
=> CACHED [simstudio deps 7/7] RUN bun install --omit dev --ignore-scripts 0.0s
=> [simstudio builder 3/9] COPY --from=deps /app/node_modules ./node_modules 20.1s
=> [simstudio builder 4/9] COPY . . 3.3s
=> [simstudio builder 5/9] RUN bun install --omit dev --ignore-scripts 21.3s
=> [simstudio builder 6/9] WORKDIR /app/apps/sim 0.3s
=> [simstudio builder 7/9] RUN bun install sharp 29.0s
=> [simstudio builder 8/9] WORKDIR /app 0.6s
=> [simstudio builder 9/9] RUN bun run build 690.3s
=> [simstudio runner 2/4] COPY --from=builder /app/apps/sim/public ./apps/sim/public 0.2s
=> [simstudio runner 3/4] COPY --from=builder /app/apps/sim/.next/standalone ./ 3.6s
=> [simstudio runner 4/4] COPY --from=builder /app/apps/sim/.next/static ./apps/sim/.next/static 1.3s
=> [simstudio] exporting to image 4.8s
=> => exporting layers 4.7s
=> => writing image sha256:ea01138250bd986c421dde55d3237264d13403d98ac9d7b10690b2a6a38eed2b 0.0s
=> => naming to docker.io/library/sim-with-ollama-simstudio 0.0s
=> [simstudio] resolving provenance for metadata file 0.0s
[+] Running 12/13
✔ migrations Built 0.0s
✔ realtime Built 0.0s
✔ simstudio Built 0.0s
✔ Network sim-with-ollama_default Created 0.5s
✔ Volume "sim-with-ollama_ollama_data" Created 0.0s
✔ Volume "sim-with-ollama_postgres_data" Created 0.0s
✔ Container sim-with-ollama-db-1 Started 1.2s
⠙ Container sim-with-ollama-ollama-1 Starting 1.3s
✔ Container sim-with-ollama-ollama-cpu-1 Started 1.3s
✔ Container sim-with-ollama-realtime-1 Created 0.2s
✔ Container sim-with-ollama-model-setup-1 Created 0.2s
✔ Container sim-with-ollama-migrations-1 Created 0.2s
✔ Container sim-with-ollama-simstudio-1 Created 0.1s
Error response from daemon: could not select device driver "nvidia" with capabilities: [[gpu]]

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions