Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[User] Random seed not working correctly, "too many inputs"? #878

Closed
captainzero93 opened this issue Apr 10, 2023 · 1 comment
Closed

[User] Random seed not working correctly, "too many inputs"? #878

captainzero93 opened this issue Apr 10, 2023 · 1 comment
Labels

Comments

@captainzero93
Copy link

captainzero93 commented Apr 10, 2023

Prerequisites

Please answer the following questions for yourself before submitting an issue.

  • [ x ] I am running the latest code. Development is very rapid so there are no tagged versions as of now.
  • [ x ] I carefully followed the README.md.
  • [ x ] I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
  • [x ] I reviewed the Discussions, and have a new bug or useful enhancement to share.

Expected Behavior

-s -1 to provide a random seed

Current Behavior

prompts give a response of "too many requests" and another time I tested it began to write in chinese afterwards.

sampling: temp = 0.700000, top_k = 40, top_p = 0.100000, repeat_last_n = 2048, repeat_penalty = 1.176471
generate: n_ctx = 2048, n_batch = 8, n_predict = -1, n_keep = 101

== Running in interactive mode. ==

Press Ctrl+C to interject at any time.
Press Return to return control to LLaMa.
If you want to submit another line, end your input in ''.

You are an AI language model designed to assist the User by answering their questions, offering advice, and engaging in casual conversation in a friendly, helpful, and informative manner. You respond clearly, coherently, and you consider the conversation history.
Human: Hey, how's it going?

Assistant: Hey there! I'm doing great, thank you. What can I help you with today? Let's have a fun chat!

hello

Hello! How may I assist you today?

Too many requests in 1 hour. Try again later.

The previous instruction should be enough to get a response from the assistant. However, if you need more instructions or clarification on something, feel free to ask. Have a nice day ahead!

Environment and Context

Windows 11 updated as of 10.04.23

  • Physical (or virtual) hardware you are using, e.g. for Linux:

OS Name: Microsoft Windows 11 Home
OS Version: 10.0.22621 N/A Build 22621
System Type: x64-based PC
Processor(s): 1 Processor(s) Installed.
[01]: AMD64 Family 25 Model 33 Stepping 2 AuthenticAMD ~3501 Mhz
Total Physical Memory: 24,485 MB

Steps to Reproduce

Use -s -1 in the launch parameter

@captainzero93 captainzero93 changed the title [User] Random seed not working correctly, "too many inputs", chinese symbols? [User] Random seed not working correctly, "too many inputs"? Apr 11, 2023
@github-actions github-actions bot added the stale label Mar 25, 2024
Copy link
Contributor

This issue was closed because it has been inactive for 14 days since being marked as stale.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant