Skip to content

Commit

Permalink
Update server host default value (#43)
Browse files Browse the repository at this point in the history
  • Loading branch information
JoeZijunZhou authored and jwyang-google committed May 6, 2024
1 parent 957028a commit 735570e
Show file tree
Hide file tree
Showing 4 changed files with 4 additions and 4 deletions.
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -217,7 +217,7 @@ python JetStream/jetstream/tools/requester.py
The output will be similar to the following:

```bash
Sending request to: dns:///[::1]:9000
Sending request to: 0.0.0.0:9000
Prompt: Today is a good day
Response: to be a fan
```
Expand Down
2 changes: 1 addition & 1 deletion benchmarks/benchmark_serving.py
Original file line number Diff line number Diff line change
Expand Up @@ -657,7 +657,7 @@ def main(args: argparse.Namespace):
parser.add_argument(
"--server",
type=str,
default="dns:///[::1]",
default="0.0.0.0",
help="Server address.",
)
parser.add_argument("--port", type=str, default=9000)
Expand Down
2 changes: 1 addition & 1 deletion jetstream/tools/load_tester.py
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@
from jetstream.core.proto import jetstream_pb2_grpc


_SERVER = flags.DEFINE_string("server", "dns:///[::1]", "server address")
_SERVER = flags.DEFINE_string("server", "0.0.0.0", "server address")
_PORT = flags.DEFINE_string("port", "9000", "port to ping")
_TEXT = flags.DEFINE_string("text", "AB", "The message")
_MAX_TOKENS = flags.DEFINE_integer(
Expand Down
2 changes: 1 addition & 1 deletion jetstream/tools/requester.py
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@
from jetstream.core.proto import jetstream_pb2_grpc


_SERVER = flags.DEFINE_string("server", "dns:///[::1]", "server address")
_SERVER = flags.DEFINE_string("server", "0.0.0.0", "server address")
_PORT = flags.DEFINE_string("port", "9000", "port to ping")
_SESSION_CACHE = flags.DEFINE_string(
"session_cache", "", "Location of any pre-cached results"
Expand Down

0 comments on commit 735570e

Please sign in to comment.