Update to Python 3.12, new API, new code and Ubuntu 24.10 (#16)

* Update to new API, code and Ubuntu 24.10
* mathicsdoc corretions for USER_HOME=/home/ubuntu
* git pull Packages, set env var COLORFGBG... COLORFGBG is used to make sure we have a compatible display style in trepan when Breakpoint[] is used.
* Bump version number
* pip install PyQt6
* Spell correct ChangeLog.
* Ignore mathics.pdf createdoutside
* Go over pkginfo and NEWS.md
* Go over README.rst

Author: rocky

.gitignore

@@ -8,6 +8,7 @@
 .vscode
 /.cache
 /.python-version
+/ChangeLog-spell-corrected
 /Mathics_omnibus.egg-info
 /__pycache__
 /build

ChangeLog-spell-corrected.diff

@@ -0,0 +1,77 @@
+--- ChangeLog	2025-01-28 08:11:48.318713212 -0500
++++ ChangeLog-spell-corrected	2025-01-28 08:12:51.006747114 -0500
+@@ -36,7 +36,7 @@
+ 
+ 2025-01-17  rocky <[email protected]>
+ 
+-	* docker/entrypoint.sh, script/dmathicsserver: mathicsdoc corretions
++	* docker/entrypoint.sh, script/dmathicsserver: mathicsdoc corrections
+ 	for USER_HOME=/home/ubuntu
+ 
+ 2025-01-16  rocky <[email protected]>
+@@ -76,7 +76,7 @@
+ 
+ 2024-01-17  rocky <[email protected]>
+ 
+-	* docker/Dockerfile, docker/Dockerfile-dev, docker/Dockerfile-git: 
++	* docker/Dockerfile, docker/Dockerfile-dev, docker/Dockerfile-git:
+ 	Use newer software versions in dev dockerfile
+ 
+ 2024-01-15  rocky <[email protected]>
+@@ -163,7 +163,7 @@
+ 
+ 2022-07-17  rocky <[email protected]>
+ 
+-	* docker/Dockerfile, docker/requirements.txt, script/dmathicsscript: 
++	* docker/Dockerfile, docker/requirements.txt, script/dmathicsscript:
+ 	Everything roughly working again.  * dmathicsscript * dmathicsserver * dmathicsdoc * dmathicsdoccopy However there are still some small rough edges
+ 
+ 2022-07-16  rocky <[email protected]>
+@@ -251,7 +251,7 @@
+ 
+ 2021-09-12  rocky <[email protected]>
+ 
+-	* : Add plots to Parital Diff Eqns 2.1
++	* : Add plots to Partial Diff Eqns 2.1
+ 
+ 2021-09-11  rocky <[email protected]>
+ 
+@@ -300,7 +300,7 @@
+ 2021-08-08  rocky <[email protected]>
+ 
+ 	* script/dmathicsscript, script/dmathicsserver,
+-	script/term-background.sh: Better persistance via setting Env
++	script/term-background.sh: Better persistence via setting Env
+ 	variables Better help for dmathicsscript and dmathicssserver Fix bug in term-background Revise symja example in mathics.sqlite
+ 
+ 2021-08-03  rocky <[email protected]>
+@@ -336,7 +336,7 @@
+ 
+ 	* README.rst, __pkginfo__.py, docker/Dockerfile,
+ 	docker/Dockerfile-dev, docker/Dockerfile-dev+debug,
+-	docker/entrypoint.sh, script/dmathicsdoc, script/dmathicsdoccopy: 
++	docker/entrypoint.sh, script/dmathicsdoc, script/dmathicsdoccopy:
+ 	Revise docker to allow PDF viewing and copy New scripts dmathicsdoc and dmathicsdoccopy perform the new
+ 	functions Document this in README.rst, and add these scripts in PyPI
+ 	packaging.  entrypoint.sh needs to multiplex dmathicsdoccpy and
+@@ -647,7 +647,7 @@
+ 2021-02-20  rocky <[email protected]>
+ 
+ 	* .gitignore, README.rst, admin-tools/git2cl,
+-	admin-tools/make-dist.sh, admin-tools/pyenv-versions, setup.py: 
++	admin-tools/make-dist.sh, admin-tools/pyenv-versions, setup.py:
+ 	Administrivia
+ 
+ 2021-02-20  R. Bernstein <[email protected]>
+@@ -1912,10 +1912,9 @@
+ 	mathics/web/templates/base_html.html, mathics/web/urls.py,
+ 	mathics/web/views.py, pymathics/natlang/natlang.py, setup.py,
+ 	test/test_evaluation.py, test/test_file.py,
+-	test/test_parser/test_tokeniser.py, tmp/README.rst, travis.py: 
++	test/test_parser/test_tokeniser.py, tmp/README.rst, travis.py:
+ 	Squash unrelated Docker items
+ 
+ 2020-12-25  rocky <[email protected]>
+ 
+ 	* Initial
+-

Makefile

@@ -70,3 +70,4 @@ rmChangeLog:
 #: Create a ChangeLog from git via git log and git2cl
 ChangeLog: rmChangeLog
 	git log --pretty --numstat --summary | $(GIT2CL) >$@
+	patch ChangeLog < ChangeLog-spell-corrected.diff

NEWS.md

@@ -1,3 +1,14 @@
+8.0.0
+-----
+
+Jan 28, 2025
+
+* Synchronize version number up with major API release in Mathics Kernel
+* Add `dmathics3-tokens` interface to `mathics3-tokens` (from mathics-scanner)
+* Use newer versions of everything, Ubuntu, Python, SymPy, etc.
+* Remove lots of copies of old wheels from source; we can now get everything resonably fast from inside docker
+
+
 4.0.1
 -----
 

README.rst

@@ -1,8 +1,8 @@
 |Pypi Installs| |Latest Version| |Supported Python Versions|
 
-Mathics is a general-purpose computer algebra system (CAS). It is an open-source alternative to Mathematica. It is free both as in "freedom" and as in "free beer".
+Mathics3 is a general-purpose computer algebra system (CAS). It is an open-source alternative to Mathematica. It is free both as in "freedom" and as in "free beer".
 
-`Mathics <https://mathics.org>`_ consists of a number of separable components so that those pieces that are desired can be used without the burden of dependencies of the other parts.
+`Mathics3 <https://mathics.org>`_ consists of a number of separable components so that those pieces that are desired can be used without the burden of dependencies of the other parts.
 
 For example if you are interested in just running a command-line interface, you might not be interested in having Django and what that entails and vice versa.
 If you are just interested in the computational library, there is no need for either the Web parts or the command-line library parts.
@@ -11,6 +11,7 @@ But what if you want both command-line interface, Web interface, all of the Pyma
 
 That's what this repository is about. Here we have a PyPI installable package that pull in the various components and offer commands:
 
+* ``mathics3-tokens`` utility to show how an input stream is tokenized by Mathics3
 * ``mathicsscript`` to run the command-line interface,
 * ``mathicsserver`` to run the Django-Web server,
 * ``dmathicsscript`` and ``dmathicsserver`` which runs the docker version of these,
@@ -46,7 +47,7 @@ By default, we use a SQLite database that has examples that you can
 load and use. This data comes from
 `mathics-omnibus/django-db/mathics.sqlite <https://github.com/Mathics3/mathics-omnibus/tree/master/docker/django-db>`_.
 
-Since this is tied to the docker image, any changes made won't survice
+Since this is tied to the docker image, any changes made won't survive
 across restarting the docker image.
 
 If you would like to save your own you can set the environment

__pkginfo__.py

@@ -5,6 +5,7 @@
 author_email = "[email protected]"
 scripts = [
     "script/dmathics",
+    "script/dmathics3-tokens",
     "script/dmathicsdoc",
     "script/dmathicsdoccopy",
     "script/dmathicsserver",
@@ -28,36 +29,36 @@ def read(*rnames):
 
 # Setup in EXTRAS_REQUIRE various install options:
 #  mathicsscript_full, etc.
-django_full = {"ujson",}
-mathics_core_full = {"psutil", "scikit-image", "lxml", "wordcloud", "cython",}
-mathicsscript_full = {"PyYAML", "PyQT5", "cairosvg", "ujson",}
-pymathics_full = {"pymathics-natlang >= 6.2.0", "pymathics-graph >= 6.2.0",}
-full = mathicsscript_full | django_full | pymathics_full
+django_full = {"ujson"}
+mathics_core_full = {"psutil", "scikit-image", "lxml", "wordcloud", "cython"}
+mathicsscript_full = {"PyYAML", "PyQT5", "cairosvg", "ujson"}
+full = mathicsscript_full | django_full
 
 EXTRAS_REQUIRE = {}
-for field in "mathics_core_full mathicsscript_full pymathics_full full".split():
+for field in "mathics_core_full mathicsscript_full".split():
     EXTRAS_REQUIRE[field] = locals()[field]
 
 IS_PYPY = "__pypy__" in sys.builtin_module_names
 
 install_requires = [
-    "Mathics3 >= 7.0.0.dev0,<7.1.0",
-    "mathicsscript >= 6.2.0",
-    "Mathics-Django >= 6.2.0",
-    "pymathics-natlang >= 6.2.0",
-    "pymathics-graph >= 6.2.0",
+    "Mathics3 >= 8.0.0",
+    "mathicsscript >= 8.0.0",
+    "Mathics-Django >= 8.0.0",
+    "Mathics3-Trepan >= 1.0.2",
+    "pymathics-natlang >= 8.0.0",
+    "pymathics-graph >= 8.0.0",
 ]
 
-packages=["mathics_omnibus", "script"]
+packages = ["mathics_omnibus", "script"]
 py_modules = None
-short_desc = "A Collection Mathics components to provide the full Mathics experience"
+short_desc = "A Collection Mathics components to provide the full Mathics3 experience"
 url = "http://github.com/Mathics3/mathics-omnibus"
 
 classifiers = [
     "Operating System :: OS Independent",
-    "Programming Language :: Python :: 3.7",
     "Programming Language :: Python :: 3.8",
     "Programming Language :: Python :: 3.9",
     "Programming Language :: Python :: 3.10",
     "Programming Language :: Python :: 3.11",
+    "Programming Language :: Python :: 3.12",
 ]

admin-tools/pyenv-versions

@@ -5,4 +5,4 @@ if [[ $0 == ${BASH_SOURCE[0]} ]] ; then
     echo "This script should be *sourced* rather than run directly through bash"
     exit 1
 fi
-export PYVERSIONS='3.6.15 3.7.17 3.8.17 pyston-2.3.5 pypy3.10-7.3.12 3.9.17 3.10.12'
+export PYVERSIONS='3.8 3.9 3.10 3.11 3.12 3.13'

docker/Dockerfile

@@ -1 +1 @@
-Dockerfile-dev
+Dockerfile-release