Pyzo: Difference between revisions
(publish initial version) |
mNo edit summary |
||
Line 128: | Line 128: | ||
=== Debugging Start-Up of FreeCAD Modules === |
=== Debugging Start-Up of FreeCAD Modules === |
||
To debug the init script of a FreeCAD Mod, e.g. files such as <kbd><nowiki>Mod/Draft/Init.py</nowiki></kbd> or <kbd><nowiki>Mod/Draft/InitGui.py</nowiki></kbd> using |
To debug the init script of a FreeCAD Mod, e.g. files such as <kbd><nowiki>Mod/Draft/Init.py</nowiki></kbd> or <kbd><nowiki>Mod/Draft/InitGui.py</nowiki></kbd> using breakpoints, we need to set a breakpoint in the codefile. These init script files are not directly executed. |
||
During startup, FreeCAD runs the Python scripts <kbd><nowiki>src/App/FreeCADInit.py</nowiki></kbd> and <kbd><nowiki>src/Gui/FreeCADGuiInit.py</nowiki></kbd>, and each of these reads the correspondig init scripts (App and Gui) of the Mod and executes them as a string with the code contents: |
During startup, FreeCAD runs the Python scripts <kbd><nowiki>src/App/FreeCADInit.py</nowiki></kbd> and <kbd><nowiki>src/Gui/FreeCADGuiInit.py</nowiki></kbd>, and each of these reads the correspondig init scripts (App and Gui) of the Mod and executes them as a string with the code contents: |
Revision as of 20:36, 9 September 2023
General Information
Motivation
Pyzo is a free and open-source Python IDE focused on interactivity and introspection, which makes it well-suited for engineering and scientific applications. This page describes how to use it in conjunction with FreeCAD.
Pyzo
- website: https://pyzo.org
- GitHub Repository: https://github.com/pyzo/pyzo
- free and open-source (BSD)
- fully coded in Python
- available for Linux, MS Windows and macOS
Versions
Unless otherwise noted, this page assumes the following software versions:
- Pyzo 4.13.3
- FreeCAD 0.21.1
Set-Up and Configuration
Preparing a FreeCAD AppImage in Linux
- download the AppImage --> e.g.: FreeCAD_0.21.1-Linux-x86_64.AppImage
- $ chmod +x ./FreeCAD_0.21.1-Linux-x86_64.AppImage
- $ ./FreeCAD_0.21.1-Linux-x86_64.AppImage --appimage-extract
- $ mv ./squashfs-root FreeCAD
- [some older Linux systems require: export FREECAD_USER_HOME=$HOME]
- create a bash script "python_freecad.sh" in ./FreeCAD (in the same directory as bash script "AppRun")
#!/bin/bash HERE="$(dirname "$(readlink -f "${0}")")" ${HERE}/AppRun python "$@"
Installing Pyzo
- use the installer or extract the compressed archive from https://github.com/pyzo/pyzo/releases
- or install it as a Python module: pip install pyzo (but the version on PyPI is currently not up to date)
Shell Configuration
Start Pyzo and enter the shell configuration dialog via the Menu:
Shell -> Edit shell configurations...
Press the button "Add config" on the top right corner and fill out the form:
- name
- freecad (or something else)
- exe [for Windows]
- C:\ProgramData\FreeCAD\bin\python.exe
- exe [for Linux]
- /home/.../FreeCAD/python_freecad.sh
- exe [for macOS]
- /Applications/FreeCAD.app/Contents/Resources/bin/python
- gui
- PySide2
- pythonPath [for Windows and Linux]
- [leave empty]
- pythonPath [for macOS]
- /Applications/FreeCAD.app/Contents/Resources/lib
- startupScript
- select radio button "Code to run at startup"
- enter the following code in the text field:
from PySide2 import QtCore, QtWidgets
QtCore.QCoreApplication.setAttribute(QtCore.Qt.AA_ShareOpenGLContexts, True)
# optional switches:
# QtWidgets.QApplication.setAttribute(QtCore.Qt.AA_EnableHighDpiScaling, True)
# QtCore.QCoreApplication.setAttribute(QtCore.Qt.AA_UseHighDpiPixmaps, True)
# AFTER_GUI - code below runs after integrating the GUI
import os, sys
if sys.platform == 'linux': # ... and using the (extracted) AppImage
sys.path.append(os.environ['PATH_TO_FREECAD_LIBDIR'])
# some older Linux systems require the following line:
# os.environ['FREECAD_USER_HOME'] = os.environ['HOME']
import FreeCAD as App
import FreeCADGui as Gui
__stdout_backup = sys.stdout
Gui.showMainWindow()
sys.stdout = __stdout_backup
# do not delete __stdout_backup, otherwise FreeCAD might crash
- environ
- enter the following environment variables:
PYZO_PROCESS_EVENTS_WHILE_DEBUGGING=1
LC_NUMERIC=C
Finally, press button "Done" in the shell configuration dialog. Run a new "freecad" shell via Pyzo's "Shell" menu. This will start the FreeCAD Gui and a will open a FreeCAD Python shell in Pyzo.
On Linux, when not using an (extracted) AppImage, change sys.path.append(os.environ['PATH_TO_FREECAD_LIBDIR'])
in the text field "startupScript" to e.g. sys.path.append('/builds/freecad-source/build/lib')
, specifying the directory to the library files "FreeCAD.so" and "FreeCADGui.so". This library directory path could also be added to the field "pythonPath" in the Pyzo shell configuration dialog instead.
The environment variable entry PYZO_PROCESS_EVENTS_WHILE_DEBUGGING=1
will tell Pyzo to periodically update FreeCAD's Qt-GUI while FreeCAD is stopped during a breakpoint.
Do not remove the # AFTER_GUI
comment in the startup code -- this is a separator used by Pyzo to split the code into two blocks.
General Pyzo Usage
See https://pyzo.org/guide.html and run the Pyzo Wizard (Menu: Help -> Pyzo Wizard) to get a short introduction.
Noteworthy information:
- You can enter some "magic" commands in the Pyzo's Python shell, for example "pip install pyerclip". This also works with FreeCAD.
- Ctrl+I in the shell (or clicking on the flash symbol) will send a KeyboardInterrupt. Ctrl+C is used for the normal copy function.
- Press F5 or Ctrl+E to execute the whole file. But do not use "Run file as script" as this will restart the shell together with FreeCAD.
- Press F9 to execute just the selected code.
- Press Ctrl+Return to execute the current cell.
- Right click on an editor tab will open a context menu.
- Many keyboard shortcuts are similar to MATLAB.
- The "Logger" tool (widget) has a shell to the Pyzo GUI's Python interpreter. You can fully access all objects there, for example copying a shell configuration via
pyzo.config.shellConfigs2.insert(0, pyzo.config.shellConfigs2[1].copy())
. - When there is a printed stack trace in Python shell, double click the filename to open the file at the specific line number.
- When dealing with performance critical code, avoid printing too much to the shell as stream outputs directed to the Pyzo IDE will slow down the execution.
- There is no
__file__
variable defined in the interactive mode, but as a workaround you can runimport inspect; __file__ = inspect.getfile(inspect.currentframe())
to get it. - In Pyzo's "About" dialog (Help -> About Pyzo) you can see the folder where Pyzo stores the settings.
- Pyzo can be configured to be portable, e.g to run it from a usb pen-drive with encapsulated settings. To enable this, rename the folder "_settings" in Pyzo's application folder to "settings".
- You can directly modify Pyzo's source code even in the binary distribution because the binary is just a Python-Interpreter that runs the Python source code in the installation directory.
Example Work Flows
A normal workflow to automate FreeCAD operations is similar to using just FreeCAD. The shell in Pyzo has access to the same Python interpreter as the "Python console" panel in the FreeCAD GUI. Both can be used in a mixed fashion, whatever is more convenient in the situation.
Pyzo brings very nice features to this workflow, just to list some of them:
- Write a new function in the editor, set a breakpoint and run the code. You can now work inside the function's scope and continue your workflow even manipulating objects manually in FreeCAD.
- If you started an (almost) endless loop, you can easily interrupt the execution by pressing Ctrl+I in Pyzo or Shell -> Interrupt in the menu.
- You can have some code fragments prepared in the Pyzo editor tabs and execute individual cells. Try new commands and add them to the code editor to grow your new script.
- The command history in the Pyzo shell is not cluttered with auto-generated commands but you can still access the automatically inserted comments in the FreeCAD Python panel.
- If there was an exception which made your code abort execution, just do a post-mortem debug and watch all the variables in different stack layers to find out the cause of the error.
Have a look here and here to see this in action (with an older version where the FreeCAD start was not yet included in the Pyzo shell configuration).
Advanced Topics
Debugging Start-Up of FreeCAD Modules
To debug the init script of a FreeCAD Mod, e.g. files such as Mod/Draft/Init.py or Mod/Draft/InitGui.py using breakpoints, we need to set a breakpoint in the codefile. These init script files are not directly executed.
During startup, FreeCAD runs the Python scripts src/App/FreeCADInit.py and src/Gui/FreeCADGuiInit.py, and each of these reads the correspondig init scripts (App and Gui) of the Mod and executes them as a string with the code contents:
with open(file=InstallFile, encoding="utf-8") as f:
exec(f.read())
The interpreter has no more information about the filepath of the executed code. To include the filepath, we need to patch the lines above, as proposed for newer FreeCAD versions.
This is not all. The scripts src/App/FreeCADInit.py and src/Gui/FreeCADGuiInit.py are not individual files anymore but resource files in libraries in the distributed binary versions of FreeCAD. Therefore we will extract them into files and replace the data in the libraries with a short Python script that will call our new out-sourced scripts. So we could also open these new files and set breakpoints there.
The following code will extract the scripts from the libraries, patch them and place the caller code back in the libraries:
import os
import sys
import shutil
lib_dirpath = '/home/.../FreeCAD/usr/lib' # example for linux os
# lib_dirpath = r'C:\ProgramData\FreeCAD\bin' # example for windows os
restore_original_libs = False
# restore_original_libs = True
lib_dirpath = os.path.abspath(lib_dirpath)
for appgui in ['App', 'Gui']:
if sys.platform == 'linux':
fp = os.path.join(lib_dirpath, 'libFreeCAD{}.so'.format(appgui))
elif sys.platform == 'win32':
fp = os.path.join(lib_dirpath, 'FreeCAD{}.dll'.format(appgui))
else: raise NotImplementedError()
fp_backup = fp + '.orig'
if restore_original_libs:
shutil.copy(fp_backup, fp)
continue
if not os.path.isfile(fp_backup):
shutil.copy(fp, fp_backup)
with open(fp_backup, 'rb') as fd:
dd = fd.read()
if appgui == 'App':
needle = b'\n# FreeCAD init module\n'
fp_py = fp + '.FreeCADInit.py'
else:
needle = b'\n# FreeCAD gui init module\n'
fp_py = fp + '.FreeCADGuiInit.py'
i_needle = dd.index(needle)
assert dd.find(needle, i_needle + 1) == -1
i_start = i_needle - dd[:i_needle][::-1].index(b'\x00')
i_end = dd.index(b'\x00', i_needle)
dd_code = dd[i_start:i_end]
fp_py_orig = fp_py + '.orig'
with open(fp_py_orig, 'wb') as fd:
fd.write(dd_code)
loader_code = '\n'.join([
'fp = ' + repr(fp_py),
'with open(fp, "rt", encoding="utf-8") as fd: source = fd.read()',
'exec(compile(source, fp, "exec"))',
]).format(repr(fp_py))
dd_code_new = loader_code.encode('utf-8')
assert len(dd_code_new) <= len(dd_code)
dd_code_new += b'\x00' * (len(dd_code) - len(dd_code_new))
dd_new = dd[:i_start] + dd_code_new + dd[i_end:]
assert len(dd_new) == len(dd)
with open(fp, 'wb') as fd:
fd.write(dd_new)
tt_code = dd_code.decode('utf-8')
needle = """
with open(file=InstallFile, encoding="utf-8") as f:
exec(f.read())
"""
needle_patched = """
with open(InstallFile, 'rt', encoding='utf-8') as f:
exec(compile(f.read(), InstallFile, 'exec'))
"""
if needle in tt_code:
# older FreeCAD versions need to be patched
tt_code = tt_code.replace(needle, needle_patched)
else:
assert needle_patched in tt_code
with open(fp_py, 'wt', encoding='utf-8') as fd:
fd.write(tt_code)
We can now, for example, open Mod/Draft/Init.py in Pyzo, set a breakpoint there in line 26 and start the FreeCAD shell in Pyzo. Execution will be interrupted at the breakpoint. We can switch the stack frames, view and manipulate variables and step/continue the code execution.
Known Limitations and Issues
... generally, when importing FreeCAD as a module in Python:
- auto backups are not enabled --> save often
- custom FreeCAD Qt-GUI color themes are not available
Feedback
To ask questions about this topic, share ideas, give input, point out mistakes, etc, please write a message to the initial topic in the FreeCAD forum or create a new one.