Skip to content

Expose Mallet's --optimize-interval argument to `pycistopic topic_m… #220

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
ghuls wants to merge 1 commit into
base: pycistopic_v3
Choose a base branch
from
Open

Expose Mallet's --optimize-interval argument to `pycistopic topic_m… #220

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 11 additions & 1 deletion src/pycisTopic/cli/subcommand/topic_modeling.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -91,6 +91,7 @@ def run_topic_modeling_with_mallet(args):
eta = args.eta
eta_by_topic = args.eta_by_topic
n_iter = args.iterations
optimize_interval = args.optimize_interval
n_cpu = args.parallel
random_state = args.seed
memory_in_gb = f"{args.memory_in_gb}G"
Expand All @@ -111,6 +112,7 @@ def run_topic_modeling_with_mallet(args):
print(f" - Eta: {eta}")
print(f" - Divide eta by the number of topics: {eta_by_topic}")
print(f" - Number of iterations: {n_iter}")
print(f" - Optimize interval: {optimize_interval}")
print(f" - Number threads Mallet is allowed to use: {n_cpu}")
print(f" - Seed: {random_state}")
print(f" - Amount of memory Mallet is allowed to use: {memory_in_gb}")
Expand All @@ -132,7 +134,7 @@ def run_topic_modeling_with_mallet(args):
eta=eta,
eta_by_topic=eta_by_topic,
n_cpu=n_cpu,
optimize_interval=0,
optimize_interval=optimize_interval,
iterations=n_iter,
topic_threshold=0.0,
random_seed=random_state,
Expand Down Expand Up @@ -629,6 +631,14 @@ def add_parser_topic_modeling(subparsers: _SubParsersAction[ArgumentParser]):
default=150,
help="Number of iterations. Default: 150.",
)
parser_topic_modeling_mallet_run.add_argument(
"--optimize-interval",
dest="optimize_interval",
type=int,
required=False,
default=0,
help="Optimize hyperparameters every `optimize_interval` iterations. Default: 0.",
)
parser_topic_modeling_mallet_run.add_argument(
"-a",
"--alpha",
Expand Down