Skip to content

Commit 77864df

Browse files
Green-Skyolexiyb
authored andcommitted
flake : update flake.lock for newer transformers version + provide extra dev shell (ggml-org#3797)
* flake : update flake.lock for newer transformers version + provide extra dev shell with torch and transformers (for most convert-xxx.py scripts)
1 parent c233b37 commit 77864df

File tree

2 files changed

+10
-3
lines changed

2 files changed

+10
-3
lines changed

Diff for: flake.lock

+3-3
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.

Diff for: flake.nix

+7
Original file line numberDiff line numberDiff line change
@@ -51,6 +51,9 @@
5151
};
5252
llama-python =
5353
pkgs.python3.withPackages (ps: with ps; [ numpy sentencepiece ]);
54+
# TODO(Green-Sky): find a better way to opt-into the heavy ml python runtime
55+
llama-python-extra =
56+
pkgs.python3.withPackages (ps: with ps; [ numpy sentencepiece torchWithoutCuda transformers ]);
5457
postPatch = ''
5558
substituteInPlace ./ggml-metal.m \
5659
--replace '[bundle pathForResource:@"ggml-metal" ofType:@"metal"];' "@\"$out/bin/ggml-metal.metal\";"
@@ -126,5 +129,9 @@
126129
buildInputs = [ llama-python ];
127130
packages = nativeBuildInputs ++ osSpecific;
128131
};
132+
devShells.extra = pkgs.mkShell {
133+
buildInputs = [ llama-python-extra ];
134+
packages = nativeBuildInputs ++ osSpecific;
135+
};
129136
});
130137
}

0 commit comments

Comments
 (0)