Tags: xingkongcwb/micropython
Tags
New mpy 6 file format with improved bytecode, addition of renesas-ra … …port In this release of MicroPython the .mpy file format has been significantly reworked and bumped to version 6. The new format now contains data and bytecode organised to be mostly static and ready to run in-place. To achieve this, qstr references from bytecode (and native machine code) now go through a lookup table, to convert from local qstr number in the module to global qstr number in the runtime that the module executes within. This means bytecode (and most native code) does not need rewriting when it is imported. Along with this change, the jump opcodes have been optimised to emit 1-byte jump offsets when possible, which gives a good reduction in bytecode size, saving RAM and reducing the size of .mpy files. The change to the bytecode means that code constants (like long strings, bytes objects and floats) are now shared and de-duplicated across the whole module, rather than each code object having a separate constant table. The parser can also now turn a tuple of constants into a constant object, so the tuple doesn't need to be built at runtime each time it is used. Furthermore, any constant object can now be used in "X = const(obj)" statements. With these bytecode changes, .mpy files see around a 10% reduction in size and frozen .mpy code sees about a 5% size reduction. Heap memory use after import is also down by around 5% (more savings are seen if the code uses lots of constants). Due to the qstr indirection performance of the VM is slightly reduced on some benchmarks by a few percent, but the benefits of smaller code and reduced RAM usage are deemed to outweigh this. See commit f2040bf for more details. In the runtime, support has been added for multiple *args and **args in a function call, following PEP 448. Built-in modules can now have (optional) mutable attributes, and this is used to implement sys.ps1/sys.ps2 which allow the user to customise the REPL prompt. This can be useful, for example, to configure a different REPL for different boards so they can be easily distinguished. The sys module has also had the MicroPython git version and build date appended to sys.version, sys.implementation._machine has been added, and sys.implementation.mpy renamed to sys.implementation._mpy. The sys module can now be used to fully identify the MicroPython version and target it is running on (and the platform module provides additional information when it's available). The MP_REGISTER_MODULE macro is now used to register all built-in C modules and the third argument to this macro has been removed. Any user-C-modules will need to be updated. Also support for MICROPY_PORT_BUILTIN_MODULES is removed because this is no longer needed, and should be replaced by usage of MP_REGISTER_MODULE (see commit 0a92469 for example). The MP_REGISTER_MODULE macro is now used to register all built-in C modules and the third argument to this macro has been removed. Also support for MICROPY_PORT_BUILTIN_MODULES is removed because this is no longer needed. mpy-cross now supports the -march=armv6m option, which can be used with the rp2 port. The -mno-unicode has been removed. The littlefs2 library has been updated to v2.5.0 which includes some performance improvements and minor fixes. At the REPL, a tab will now insert an indent when it follows whitespace, and auto-indent is automatically disabled if a space or tab follows an auto-indent. This means that Python code can be pasted into the standard REPL without messing up the indentation. mpremote is now at version 0.3.0, with a progress indicator shown when copying large files, and recursive copy fixed on Windows. It also has the following commands added: --help, --version, version, resume, soft-reset, umount. The esp32 port has a new machine.ADCBlock class and updated ADC class. Fixes have been made to ADC2 channel mapping, low PWM frequencies, UART initialisation of unspecified parameters, and RMT channel on S2/S3/C3 variants. The Pin.PULL_HOLD constant has been replaced by a "hold" keyword argument to the Pic constructor, and it's now possible to configure pin drive strength. I2C write-then-read transfers have been optimised to be faster. WLAN.config() now supports setting/getting the txpower. New boards include LOLIN C3 MINI ESP32-C3, LilyGO LoRa32, and UM ESP32-S3 based boards. The mimxrt port has updated the nxp_driver to v2.10 and fixed USB CDC RX handling to not block. Pin drive constants have been renamed to DRIVE_x to match other ports, and the machine.I2S class has been added. New boards include Olimex RT1010 and MIMXRT1015_EVK. The nrf port now includes uasyncio in the default board manifest, and additional features have been enabled on nrf52840 and nrf9160 boards to match the features on stm32, rp2 and esp32. This includes enabling the json, re, zlib and framebuf modules. There is a new renesas-ra port which targets Renesas RA4M1, RA4W1, RA6M1 and RA6M2 MCUs, with board definitions for evaluation kits for these MCUs, along with RA4M1 clicker. This port currently supports Pin, ADC, SoftI2C, I2C, SoftSPI, SPI, UART, Timer and RTC classes in the machine module, along with the VFS and an internal flash filesystem. The rp2 port now has optional USB MSC support, and optional dupterm support. The machine.UART class has init and deinit methods added, and the ucryptolib module is now available. The lwIP network stack has been integrated, along with mbedtls for the ssl module, and these can be used with the new Wiznet driver to provide Ethernet support. The Wiznet W5100S-EVB-Pico board has been added which makes use of this driver. The day-of-week value reported by time.localtime() has been fixed, memory corruption when a thread is created on core1 has been fixed, and the UART now uses a mutex when reading/writing to prevent character duplication in code that uses both cores. The stm32 port has added support for G0, G4 and WL MCUs. The new boards for these MCUs are NUCLEO_G0B1RE, NUCLEO_G474RE and NUCLEO_WL55. The ARDUINO_PORTENTA_H7 board has also been added, with full WiFi and BLE support. The rfcore on WB55 MCUs has been improved by removing an extra layer of buffering, and the restriction on the use of address resolution has been removed, meaning that the rfcore WS firmware should be updated to v1.12.0 or later; see commit 26b1d31. The board-level configuration of mboot has been significantly improved to allow more control over system clocks, more hooks into the start up process, and a hook for state change. And the CRC32 of DFU files is now verified before writing them. The pyb.CAN class has been improved to support FD frames and buses with mixed classic/extended-ID nodes, allowing extended IDs to be specified on a per-message basis. CAN.recv also now returns a value indicating if the received message had an extended ID or not. And CAN.initfilterbanks has been removed, replaced with the num_filter_banks keyword argument to CAN.init. These are all breaking changes to the pyb.CAN class API and code will need to be updated accordingly; see commit 5cdf964 for details. The unix port now shows compiler information in the REPL banner to make it consistent with how bare-metal ports work, and the "-X realtime" command-line option has been added for macOS to get improved timing. All variants have switched to use the VFS subsystem, and use the VfsPosix class for mounting the host's filesystem. The os module has been consolidated with all other ports and the minimal and standard variants gain the unlink, chdir, getcwd and listdir functions. The windows port has also switched to the VFS subsystem and VfsPosix. It adds support for micropython.schedule and uasyncio on the dev variant. And BCryptGenRandom has been used to implement os.urandom. The zephyr port upgraded Zephyr to v3.0.0. The change in code size since the previous release for various ports is (absolute and percentage change in the text section): bare-arm: +792 +1.394% minimal x86: +2091 +1.286% unix x64: +10231 +1.995% unix nanbox: +9777 +2.162% stm32: +184 +0.047% PYBV10 cc3200: +904 +0.493% esp8266: -1240 -0.177% GENERIC esp32: +6464 +0.425% GENERIC nrf: +11288 +6.472% pca10040 rp2: +14432 +2.929% PICO samd: +1352 +0.970% ADAFRUIT_ITSYBITSY_M4_EXPRESS The changes that dominate these numbers are: - bare-arm, minimal, cc3200, samd: reworked bytecode and mpy format, optimisation of jump opcodes to use 1-byte offsets, de-duplication of constants at the module level, and PEP 448 support - unix: switching to use VFS, and new mpy format and related changes - esp8266: removal of esp.info and machine.WDT.deinit - esp32: addition of machine.ADCBlock, and new mpy format changes - nrf: enabling uasyncio, enabling MICROPY_PY_IO - rp2: enabling ucryptolib with mbedtls Note that the stm32 port's size remained roughly unchanged. This is because it has a decent amount of frozen Python code and the reduction in frozen code size due to the reworked bytecode has offset the increase in runtime/VM size due to this change. Ports like bare-arm, minimal, cc3200 and samd do not have any frozen code so only see the increase in runtime/VM size. Production-level projects that have a significant amount of frozen code have seen around a 4% overall reduction in their firmware size. Thanks to everyone who contributed to this release: Algy Tynan, Andrew Leech, Andrew Scheller, Artyom Skrobov, Asensio Lorenzo Sempere, Bradley Wogsland, Cem Eliguzel, Chris Wilson, Christian Decker, Christian Zietz, Christophe Priouzeau, Clayton Mills, Damien George, Daniel Jour, Daniël van de Giessen, Dave Hylands, David Lechner, Emil Kondayan, Herwin Grobben, iabdalkader, IhorNehrutsa, Jan, Jared Hancock, jason, Jeff Epler, Jeremy Herbert, Jim Mussared, Jon Bjarni Bjarnason, Jonathan Hogg, Jos Verlinde, Kattni Rembor, Lars Kellogg-Stedman, Luiz Brandao, marcidy, Martin Fischer, Maureen Helm, Meriç SARIIŞIK, Michael Himing, Michael O'Cleirigh, MikeTeachman, Peter D. Gray, Peter Hinch, Peter Züger, Phil Howard, Philipp Ebensberger, Rob Knegjens, robert-hh, Sean Coates, Seon Rozenblum, Stephane Smith, stijn, Takeo Takahashi, ubi de feo, Waterlens, wemos, YoungJoon Chun, Yukai Li. What follows is a detailed list of changes, generated from the git commit history, and organised into sections. Main components =============== all: - fix MICROPY_OBJ_REPR_D compilation with msvc - update Python formatting to latest Black version 22.1.0 - use mp_obj_malloc everywhere it's applicable - reformat remaining C code that doesn't have a space after a comma - remove third argument to MP_REGISTER_MODULE - rename MICROPY_PY_WIZNET5K to MICROPY_PY_NETWORK_WIZNET5K py core: - objstr: support '{:08}'.format("Jan") like Python 3.10 - modmath: add math.tau, math.nan and math.inf constants - qstr: separate hash and len from string data - qstr: use `const` consistently to avoid a cast - gc: update debug code to compile with changes to qstr pool types - rework bytecode and .mpy file format to be mostly static data - bc.h: fix C++ compilation of public API - objmodule: support delegating failed attr lookups - modsys: add optional attribute delegation - modsys: add optional sys.tracebacklimit attribute - modsys: add optional mutable attributes sys.ps1/ps2 and use them - parse: simplify handling of const int parse nodes - parse: put const bytes objects in parse tree as const object - parse: handle check for target small-int size in parser - showbc: remove global variables and make DECODE_PTR work correctly - smallint: introduce MP_SMALL_INT_BITS macro - objgenerator: fix unused variables when native gen extracts prelude - change jump opcodes to emit 1-byte jump offset when possible - emitbc: add check for bytecode jump offset overflow - change jump-if-x-or-pop opcodes to have unsigned offset argument - builtinimport: alias sys to usys if import weak links aren't enabled - bc.h: fix C++20 compilation with "volatile" - compile: only show raw code that is bytecode - asmxtensa: fix use of l32i/s32i when offset won't fit in encoding - emitnative: don't store prelude at end of machine code if not needed - vm: prevent array bound warning when using -MP_OBJ_ITER_BUF_NSLOTS - runtime: allow multiple **args in a function call - runtime: allow multiple *args in a function call - runtime: do not overallocate when len is known - runtime: drop new_alloc < 4 check - runtime: use size_t/ssize_t instead of uint/int - emitbc: assert that a small int fits its encoding when emitting one - fix compiling and decoding of *args at large arg positions - runtime: remove unnecessary check for kw_value == MP_OBJ_NULL - makeqstrdefs: cleanup and extend source file classification - emitinlinethumb: use 16 bit encodings for PUSH LR and POP PC - scheduler: add support for scheduling static C-based callbacks - emitnative: revert "don't store prelude at end of machine code if..." - persistentcode: define enum values for obj types instead of letters - parse: factor obj extract code to mp_parse_node_extract_const_object - parse: print const object value in mp_parse_node_print - parse: add MICROPY_COMP_CONST_TUPLE option to build const tuples - persistentcode: support loading and saving tuples in .mpy files - objtype: convert result of user __contains__ method to bool - modsys: append MicroPython git version and build date to sys.version - modsys: rename sys.implementation.mpy to sys.implementation._mpy - modsys: introduce sys.implementation._machine constant - emitcommon: don't implicitly close class vars that are assigned to - obj: introduce mp_obj_malloc macro to allocate, and set object type - objfloat: explain why mp_obj_malloc isn't used - malloc: introduce m_tracked_calloc, m_tracked_free functions - objmodule: move stray #include to top of file - persistentcode: remove obsolete comment about qstr window size - persistentcode: remove unicode feature flag from .mpy file - asmx64: support full range of regs in asm_x64_lea_disp_to_r64 - bc: provide separate code-state setup funcs for bytecode and native - emitnative: put a pointer to the native prelude in child_table array - compile: allow new qstrs to be allocated at all compiler passes - compile: de-duplicate constant objects in module's constant table - parse: allow all constant objects to be used in "X = const(o)" - makemoduledefs.py: allow multiple ways to register a module - make builtin modules use MP_REGISTER_MODULE - remove support for MICROPY_PORT_BUILTIN_MODULES - asmthumb: fix PC relative load by sign extending the constant - emitnative: simplify generation of code that loads prelude pointer - emitnative: provide dedicated local for exception unwind handler ptr - asmthumb: fix offset variable name in ldr, ldrh and strh functions - asmthumb: add asm_thumb_ldrh_reg_reg_i12_optimised() helper func - asmarm: add asm_arm_ldrh_reg_reg_offset() helper func - asm: add ASM_LOAD16_REG_REG_OFFSET macro for load-u16 with offset - emitnative: access qstr values using indirection table qstr_table - asmthumb: make ARMv7-M instruction use dynamically selectable - persistentcode: select ARMV6M as maximum when __thumb2__ not defined - dynruntime.mk: add basic support for armv6m architecture - asmthumb: provide implementations of clz/ctz for msvc - builtin: clean up and simplify import_stat and builtin_open config - emitinlinethumb: make ARMv7-M instruction use dynamically selectable - emitinlinethumb: make float instruction use dynamically selectable - change makemoduledefs process so it uses output of qstr extraction - persistentcode: remove remaining native qstr linking support - bc: remove unused mp_opcode_format function - compile: give the compiler a hint about num nodes being non-zero - makemoduledefs.py: remove shebang line and adjust style of comment - parse: work around xtensa esp-2020r3 compiler bug - dynruntime: add macros to create a new dict and store to dicts - dynruntime: add macros to access more types and mp_const_empty_bytes - makemoduledefs.py: emit useful error for legacy MP_REGISTER_MODULE extmod: - network_ninaw10: implement MP_STREAM_POLL in ioctl - modusocket: make setsockopt return if NIC is not connected - modusocket: add makefile() method and common socket options - modusocket: create new sockets in blocking mode - modusocket: support additional args to getaddrinfo - machine_i2c: increase default SoftI2C timeout to 50ms - modubinascii: add newline keyword to b2a_base64 function - moduplatform: move platform PP definitions into a header - moduzlib: fix parsing zlib header dict size - moduos: create general uos module to be used by all ports - modure: set subject begin_line so ^ doesn't match interior - uasyncio: allow task state to be a callable - uasyncio: fix gather cancelling and handling of exceptions - extmod.cmake: add micropy_lib_mbedtls component - modusocket: implement optional socket.listen backlog argument - modusocket: provide config macro for socket.listen backlog deflt - uasyncio: make Python Task match C version with use of asserts - uasyncio: fix bug with task ending just after gather is cancel'd - uasyncio: rename and merge TaskQueue push/pop methods - move font_petme128_8x8.h from ports/stm32 to extmod - make extmod modules use MP_REGISTER_MODULE - make port-included extmod modules use MP_REGISTER_MODULES - revert accidental usocket->socket rename - webrepl: fix setting password in foreground mode and factor code - modusocket: fix polling of a new socket - modusocket: bind unconnected socket to default NIC in setsockopt - modusocket: fix errcode returned from socket read/write - modusocket: add socket type print function - modusocket: add support for socket events callback - modusocket: fix socket_make_new argument parsing - modusocket: add timeout and callback to socket object - modusocket: add sendall function - network_ninaw10: add support for socket events callback - machine_i2c: add optional support for write-then-read transfers - uasyncio: fix edge case for cancellation of wait_for - nimble: add support for reading whole HCI UART packets - network_wiznet5k: add Wiznet Ethernet network interface - modussl_mbedtls: poll EVENT_POLL_HOOK in ssl handshake loop - modurandom: fix missing void in empty argument list - extmod.cmake: require components to be explicitly enabled - modusocket: add socket state to track new/listening/conn/closed - modusocket: fix polling of closed sockets - extmod.cmake: fix hard-coded mbedtls config file path shared: - readline: make tab insert an indent when it follows whitespace - readline: disable auto-indent if space/tab follows added indent drivers: - ninaw10: add function to check socket state/data availability - ninaw10: fix timeout handling to match modusocket - ninaw10: return standard error numbers - ninaw10: add NIC-level ioctl function - sdcard: allow setting the final SPI baudrate - codec: add driver for the WM8960 codec - ninaw10: fix isconnected to return False when inactive - dht/dht.py: change default import module as machine - ninaw10: update driver to support firmware 1.5.0 - bus: rename MP_SPI_ADDR_IS_32B to MICROPY_HW_SPI_ADDR_IS_32BIT - lsm6dsox: add support for SPI mode - sdcard: fix CSD version 1.0 device size calculation - sdcard: make ioctl(4), ioctl(5) return num blocks, block size - sdcard: fix address calculation on v2 SDSC cards mpy-cross: - add armv6m architecture option lib: - re1.5: distinguish between subject start-of-line and start-of-srch - stm32lib: update library for G0 v1.5.1 - fsp: add renesas fsp git repository as submodule - littlefs: update littlefs2 to v2.5.0 - littlefs: guard lfs2_file_rawopen with LFS2_NO_MALLOC - littlefs: remove assignment of variables to themselves - nxp_driver: update nxp_driver to v2.10 - wiznet5k: add submodule for Wiznet Ethernet drivers Support components ================== docs: - library: specify additional ADC methods and new ADCBlock class - esp32: document expanded ADC API in quickref - differences: update differences now that math.tau/inf/nan exist - differences: update python_36 now that b2a_base64 accepts newline - remove reference to obsolete neopixel_write function - develop/porting.rst: fix build and import problems in the example - reference/isr_rules.rst: fix inconsistent variable name in example - esp32/quickref: update ADC documentation - reference/isr_rules.rst: describe uasyncio-IRQ interface - library/collections.rst: use class for deque and OrderedDict - use the correct * keyword-only notation - library/socket.rst: document socket as a class - library/pyb.Timer.rst: add pyb.Timer class constants - library/pyb.rst: add pyb.hid_mouse and pyb.hid_keyboard constants - library/pyb.DAC.rst: add DAC class constants - library/machine.SPI.rst: add class constant SoftSPI.MSB and .LSB - library/machine.WDT.rst: use correct case for WDT.feed - library/esp.rst: document the osdebug function - library/pyb.SPI.rst: document default for prescaler argument - library/machine.Pin.rst: document defaults for Pin.init - library/uasyncio.rst: fix description of ThreadSafeFlag.wait - library/machine.UART.rst: add details for `invert` parameter - differences/python_35: mark PEP 486 as not applicable - library/esp32.rst: mark esp32.Partition as not taking kw args - esp32/quickref: document GPIO drive strength - library/machine.Pin: update to use preferred DRIVE_x constants - esp32/quickref: refine deep-sleep power-saving notes - library/machine.I2S: clarify what rate refers to - library/pyb.CAN: update CAN docs to match revised API - add quickref and docs for mimxrt, including network.LAN docs - reference/mpremote: add details about mount usage over soft reboot - differences: update Python 3.5 diff, with optional listen backlog - reference: update constrained docs now that tuples can be const - library/network.WLAN: add "txpower" to list of known WLAN configs - renesas-ra: add renesas-ra docs files - update files for renesas-ra port - renesas-ra: remove unused image files - reference/mpyfiles: remove docs about mpy flags and qstr win size - mimxrt: add i.MX RT1015 to general.rst, and a few clarifications - mimxrt: move the pinout tables to a separate document - reference/manifest: add link to details about opt-level for freeze - reference/mpyfiles: update .mpy description to match latest format - update Raspberry Pi URLs from .org to .com examples: - embedding: fix build with updated sys and os modules - natmod/features3: add example to test more natmod features tests: - run-multitests.py: ignore lld_pdu_get_tx_flush_nb msgs from IDF - run-multitests.py: set HOST_IP so tests work between PC and board - multi_net: add testing key/cert to SSL server/client test - multi_net: close accepted sockets when tests are done - multi_net/udp_data.py: allow reusing port before bind - multi_net/udp_data.py: make UDP test more reliable - run-perfbench.py: allow a test to SKIP, and to have a .exp file - perf_bench: add perf tests for qstr interning and importing .mpy - perf_bench: add perf test for yield-from execution - run-perfbench.py: use SKIP consistently, and increase print width - extmod/vfs_fat_finaliser.py: make finalisation more robust - run-tests.py: skip repl tests when running windows underneath - perf_bench: skip bm_chaos test if random.randrange is unavailable - unix: add coverage test for freezing various objects - basics: add test for creating small-ints in nan-box builds - run-tests.py: include test files ending in _set as set tests - micropython: switch from set.pop to raise-0 to test exc strings - extmod/vfs_posix.py: only test statvfs if it exists - cmdline/cmd_showbc: fix spelling of sequence - extmod: add test for machine.I2S data rate - extmod: update I2S rate test to work on mimxrt - basics/fun_callstardblstar: add coverage test - basics/fun_callstardblstar: add test for large arg allocation - pyb: update CAN tests to match revised CAN API - inlineasm: add test for PUSH LR and POP PC - perf_bench: update import tests for changes to .mpy consts - micropython: add tests that const tuples don't use the heap - extmod/uasyncio_gather: make double-raise gather test reliable - run-tests.py: add timeout for running PC-based MicroPython test - cmdline: add test for REPL auto-indent - renesas-ra: add tests for renesas-ra port - run-tests.py: update for renesas-ra port - renesas-ra: remove unsupported feature test of Pin - extmod: increase timing on uasyncio tests to make more reliable - fix tests to use sys.implementation._mpy - perf_bench: update .mpy file header to remove old unicode flag - run-perfbench.py: return error code if any test fails on target - thread: use less resources for stress_aes if settrace enabled - run-tests.py: exclude settrace tests when using native emitter - multi_net: skip SSL test if relevant modules aren't available - micropython: fully unlink nested list in extreme exc test - extmod: use bytearray instead of bytes for uctypes test - micropython: add more test cases for native generators - run-tests.py: allow running tests via mpy-cross on remote targets - run-perfbench.py: allow running tests via mpy and native emitter - basics: unlock heap if skipping nanbox small-int test - run-tests.py: handle case where mpy-cross fails to compile script - run-tests.py: enable `-X realtime` option for macOS tests - extmod: change expected errno code from 36 to 30 in VfsLfs2 test - multi_net: fix TCP accept test when using system error numbers - run-multitests.py: use LAN for IP address if WLAN doesn't exist - micropython: make import_mpy_native_gc run on ARMv6-M and above - micropython: make import_mpy_native test run on all architectures - run-tests.py: add rp2 test target - move native while test from pybnative to micropython - net_inet: remove broken api.telegram.org from tests - run-multitests.py: read IP address from boot nic if available - basics: add .exp file for sys.tracebacklimit test - stress: adjust bytecode_limit test so it can SKIP if no memory tools: - mpremote: use machine instead of umachine in commands - ci: test math constants with MICROPY_OBJ_REPR_D - uf2conv.py: update to latest version - autobuild: provide .uf2 images for esp32 builds when available - mpremote: fix "fs cp -r" on Windows - mpremote: make ConsolePosix work without .raw attribute - mpremote: during soft reboot wait long enough for 115200 data - mpremote: accept both --help and help to show usage - mpremote: correctly manage mounted flag during soft-reset - mpremote: fix special handling of ctrl-D when host FS is mounted - verifygitlog.py: ignore line length in body if it's a URL - ci.sh: update IDF v4.4 build to use v4.4 tag - ci.sh: run urandom test scripts as part of native module tests - mpremote: add "resume" and "soft-reset" commands - mpremote: add "umount" command - upip.py: remove unused op_basename() function - mpy-tool.py: fix frozen comment generation to escape chars - ci.sh: run performance benchmark as part of all unix test runs - mpremote: bump version to 0.2.0 - gen-cpydiff: skip Black fmt comments - mpremote: support any prompt string when detecting soft reset - mpremote: allow running mpremote with `python -m` - mpremote: improve reliability of mount after soft reboot - mpremote: show progress indicator when copying large files - mpremote: add option to mount cmd to allow "unsafe" symlinks - mpy-tool.py: support loading tuples from .mpy files - mpy-tool.py: support freezing tuples and other consts - mpy-tool.py: optimise freezing of ints that can fit a small int - mpy-tool.py: optimise freezing of empty str and bytes objects - mpy-tool.py: make global qstr list a dedicated class - mpy-tool.py: optimise freezing of str when str data is a qstr - mpy-tool.py: intern more strings when freezing - codeformat.py: remove ports/unix/*.py from exclusion list - codeformat.py: include more ports .c/.h files in formatting - ci.sh: don't run uasyncio_gather test on macOS - ci.sh: update for ports/renesas-ra - uncrustify: make sure a space exists after a comma - autobuild: update for ports/renesas-ra - mpy_ld.py: remove obsolete QSTR_WINDOW_SIZE constant - ci.sh: run full test suite on stackless and settrace builds - ci.sh: for esp8266 CI install esptool 3.3.1 - mpy-tool.py: remove obsolete unicode flag in .mpy header - ci.sh: add build of W5100S_EVB_PICO board to rp2 CI - mpy-tool.py: rework .mpy merging feature - ci.sh: add test for mpy-tool's merging feature - mpy-tool.py: improve generated frozen identifiers - mpremote: add command to print the version - mpremote: bump version to 0.3.0 - ci.sh: build NUCLEO_H743ZI with -O2 optimisation level - mpy_ld.py: support R_XTENSA_PDIFF32 relocation - ci.sh: build native .mpy examples for armv7emsp, xtensawin in CI - mpy_ld.py: support GOT entries that reference inside mp_fun_table CI: - workflows: show context for qemu-arm test failures - workflows: add new workflow to test .mpy file format and tools - workflows: add new workflow to test embedding example - workflows: add workflow for renesas-ra port The ports ========= all ports: - consolidate inclusion of umachine module in built-ins - recompile bytecode tests now that .mpy format changed - allow boards to define additional network interfaces - recompile bytecode tests now that .mpy format changed - reformat more C and Python source code - rename thread_t to mp_thread_t - use default VFS config for import_stat and builtin_open bare-arm port: no changes specific to this component/port cc3200 port: - make port-specific modules use MP_REGISTER_MODULE esp8266 port: - moduos: convert module to use extmod version - mpconfigport.h: remove config values that are the defaults - modesp: remove esp.info() function - make port-specific modules use MP_REGISTER_MODULE - machine_wdt: remove deinit method for watchdog - etshal.h: remove unneeded function declaration esp32 port: - machine_adcblock: add new machine.ADCBlock class and update ADC - pin MicroPython to core 1 again - esp32_rmt: call rmt_driver_install directly if running on core 1 - main: allocate at most 1/2 of available IDF heap for MP heap - README.md: fix URL for esp-idf installation - modnetwork: fix test for WIFI_AUTH_MAX for IDF v4.3.0 - main: use heap_caps_get_info on IDF <4.1 to compute total heap - boards: provide custom deploy_c3.md for ESP32-C3 boards - partitions: increase size of app-part from 0x180000 to 0x1F0000 - machine_pwm: fix PWM not allowing frequencies < 611 Hz - machine_pwm: clean up macro names and their use - esp32_rmt: select correct last RMT channel on S2, S3, C3 variants - main: automatically size SPIRAM heap when allocated using malloc - adc: fix wrong mapping between ADC2 channel and GPIO number - remove unneeded modesp.h - create .uf2 binaries for S2 and S3 chips - partitions-16MiB.csv: increase 14MiB filesystem to maximum size - machine_adcblock: fix ADC bit width for ESP32-S3 - machine_adc: fix configuration of default ADC atten value - boards: add three UM ESP32-S3 based boards - mpconfigport.h: use the "extra" feature level - mpconfigport.h: enable remaining features to get to "extra" level - esp32_partition: add support for specifying block_size - modules: create ffat partition object with block_size=512 - README.md: update list of supported IDF versions - boards: add specific deploy instructions for S3 variant - uart: correctly init low-level UART driver for REPL - machine_uart: allow limited configuration of REPL UART - sleep one tick in MICROPY_EVENT_POLL_HOOK - machine_pwm: always set the duty cycle when setting the frequency - machine_uart: make UART.init preserve unspecified parameters - machine_pin: add support for pin drive strength - moduos: convert module to use extmod version - machine_pin: add new hold keyword argument and remove PULL_HOLD - modesp32: add new gpio_deep_sleep_hold function - boards/UM_TINYPICO: remove use of PULL_HOLD - boards: add LOLIN C3 MINI ESP32-C3 based board - machine_hw_spi: use automatic DMA channel selection for SPI on C3 - boards: add support for LilyGO LoRa32 boards - machine_pin: expose pin 20 for ESP32 - allow overriding cmake frozen manifest from the command line - boards: add test manifest to test freezing during build - add MICROPY_HW_ENABLE_UART_REPL and enable on generic S2/S3 - boards: compile GENERIC_SPIRAM and UM_TINYPICO with -Os - machine_pin: don't expose pins 33-37 when octal SPIRAM is enabled - modesp32: properly define RTC_VALID_EXT_PINS on S2/S3 variants - network_wlan: support setting/getting txpower in WLAN.config() - modnetwork: fix build when MICROPY_PY_NETWORK_WLAN is disabled - make port-specific modules use MP_REGISTER_MODULE - boards/UM_FEATHERS3: use correct sdkconfig.board - boards/LILYGO_TTGO_LORA32: remove ID from TTGO Lora32 board json - machine_pin: fix ESP32C3 IDFv4.4.1 build - track allocated iRAM and free it on soft reset - machine_i2c: implement write-then-read I2C transfers - machine_pin: only expose IO20 on esp32 for IDF 4.3.2 and above javascript port: - make port-specific modules use MP_REGISTER_MODULE mimxrt port: - support gaps in the SPI an I2C device numbers - allow for board-specific flash driver files - compensate for a bug in the fsl_lpspi.c file - remove two files from the Seeed Arch Mix directory - replace Pin-config constants by a function call - allow to select cs0 or cs1 for SPI - add USB ID elements - add support for the Olimex RT1010 board - simplify Makefile in selection of flash type - machine_pin: change pin drive constants to DRIVE_x naming - machine_spi: add omitted GPIO config - boards: add board files for MIMXRT1015 and MIMXRT1015_EVK - eth: fix an Ethernet transmit error - boards/TEENSY41: use the same SPI1 pins for Teensy 4.0 and 4.1 - boards: support using an optional board-specific manifest.py - eth: avoid a race condition for Ethernet - hal/pwm_backport: make PWM symmetric, and round division calcs - moduos: convert module to use extmod version - mbedtls: add NULL pointer check in m_free_mbedtls - machine_i2s: add I2S protocol support - boards: add board.json file for OLIMEX RT1010Py - modules: append /flash/lib to the default sys.path - machine_rtc: start RTC at boot and set datetime if not set - machine_spi: improve handling of busy SPI peripheral - mphalport: fix USB CDC RX handling to not block when unprocessed - mbedtls: use core-provided tracked alloc instead of custom funcs - make port-specific modules use MP_REGISTER_MODULE - boards/OLIMEX_RT1010: document the initial deploy procedure - boards: extend the deploy_teensy.md instructions - mphalport: fix strict aliasing error with unique id - update port to work with new nxp_driver v2.10 - machine_uart: fix an inconsistency for UART.init() arg handling minimal port: no changes specific to this component/port nrf port: - drivers/usb: fix background events/scheduling while at USB REPL - drivers/usb: fix MP_STREAM_POLL_RD support on USB CDC - modules: include uasyncio in default board manifest - make port-specific modules use MP_REGISTER_MODULE - mpconfigport: set MICROPY_CONFIG_ROM_LEVEL defines for each MCU - mpconfigport: enable extra features as defined by ROM levels - mpconfigport: fix MICROPY_VFS IO build support - modules/uos/microbitfs: fix MICROPY_MBFS build to use mp_obj_malloc pic16bit port: - make port-specific modules use MP_REGISTER_MODULE - use 1 byte for qstr hash len and include header to fix build powerpc port: no changes specific to this component/port qemu-arm port: - add tests for freezing viper and asm_thumb code - moduos: convert module to use extmod version - test-frzmpy: add test for freezing constant tuples - mpconfigport: define MICROPY_PY_SYS_PLATFORM renesas-ra port: - add new port to Renesas RA - boards: change device name information to show properly - rename pyb_uart_ to machine_uart_ - rename pyb_rtc_ to machine_rtc_ - make port-specific modules use MP_REGISTER_MODULE - modmachine: add missing MP_REGISTER_MODULE for umachine - machine_pin: remove code for unsupported Pin features rp2 port: - machine_i2c: provide more specific error codes from I2C transfer - mpconfigport.h: use internal error numbers - mphalport: add optional dupterm support - machine_uart: add machine.UART init/deinit methods - machine_i2c: use soft I2C only for len=0, and increase timeout - modutime: fix time.localtime day-of-week value - machine_uart: fix UART RTS behaviour so RTS is deasserted - Makefile: add FROZEN_MANIFEST Makefile option, to override default - mpthreadport: fix memory corruption when thread is created in core1 - add USB MSC support - allow Overriding cmake frozen manifest from the command line - enable ucryptolib, using mbedtls for backend functions - mphalport: fix USB CDC RX handling to not block when unprocessed - Makefile: add mbedtls to GIT_SUBMODULES list and use it in CI func - machine_uart: use read/write mutex to prevent char duplication - mpconfigport: enable execfile, NotImplemented and REPL EMACS keys - make port-specific modules use MP_REGISTER_MODULE - mpconfigport.h: enable static scheduler nodes - mpconfigport.h: allow boards to override internal errno config - boards/ARDUINO_NANO_RP2040_CONNECT: disable internal errno - boards/ARDUINO_NANO_RP2040_CONNECT: enable webrepl - mbedtls: add support for ssl module with MICROPY_SSL_MBEDTLS - machine_pin: add mp_hal_pin_interrupt C interface - Makefile: use cmake for "make submodules" task when needed - integrate lwIP network stack - add support for using Wiznet hardware as an Ethernet NIC - boards/W5100S_EVB_PICO: add Wiznet W5100S-EVB-Pico board - Makefile: build in debug mode with "make DEBUG=1" - boards/ARDUINO_NANO_RP2040_CONNECT: update USB PID - mpnetworkport: fix lwip alarm callback timing to use microseconds - CMakeLists: simplify qstr sources when enabling extmod components samd port: - moduos: convert module to use extmod version - make port-specific modules use MP_REGISTER_MODULE stm32 port: - mbedtls: enable MBEDTLS_TLS_DEFAULT_ALLOW_SHA1_IN_KEY_EXCHANGE - mboot: remove custom HAL_RCC_GetHCLKFreq and use HAL provided one - pin: change remaining uses of "af" to "alt" - dac: deinit all DACs on soft reset - fdcan: fix FIFO1 usage and handling of error interrupts - fdcan: fix naming with regards to G4 series - usbd_conf: set lpm_enable and battery_charging_enable on all MCUs - powerctrlboot: set HAL uwTickPrio variable when needed - powerctrl: write bootloader-state as 64-bit word to work on H7 - mboot: use PLL3 for USB clock source on H7 MCUs - mboot: include hal_rcc_ex.c in source file list - mboot: support H7 MCUs in fwupdate.py - mboot: compute and check CRC32 of dfu file in fwupdate.py - add support for G4 MCUs, and add NUCLEO_G474RE board defn - mboot: allow HSI to be used as the main clock source - mboot: add MBOOT_BOARD_ENTRY_INIT for a board to add entry code - mboot: add support for F469/479 MCUs in fwupdate.py - rtc: use LL_RTC functions to simplify some MCU-specific code - Makefile: make stm32lib configurable - add initial support for STM32WL MCUs - boards/NUCLEO_WL55: add new board definition - system_stm32: make SystemClock_Config() a weak symbol - adc: fix L4 ADC channel numbers - adc: remove obsolete FIRST/LAST GPIO channel macros - boards/NUCLEO_L432KC: disable MICROPY_OPT_COMPUTED_GOTO - boards/NUCLEO_WB55: add Arduino pin alias definitions - mboot: allow a board to fully configure system clocks - mboot: allow a board more control over entry initialisation - moduos: convert module to use extmod version - boards: convert F4xx and F7xx to new flash FS config - mbedtls: add NULL pointer check in m_free_mbedtls - sdcard: use mp_hal_pin_input instead of HAL function - sdcard: add sdcard_select_sd/mmc functions - main: support SD cards without a partition table - dma: add option to disable auto-DMA-turn-off - mboot: add pragma for GCC to ignore array bounds warning - mboot: always check the magic number to enter filesystem loading - mboot: add support for 64-bit mboot address space for reads - mboot: add support for reading from SD card - boards/PYBD_SF2: turn on SD card in mboot init if SD enabled - mboot/fwupdate.py: simplify calculation of CRC32 - mboot: verify signature of fsload packed DFU files before writing - mboot: verify CRC32 of fsload DFU files before writing - support building for STM32F745 - machine_i2s: set FullDuplexMode to disabled on F4 - machine_i2s: allow I2S.deinit to be called multiple times - machine_i2s: fix 16-bit stereo i2s_frame_map - sdio: use runtime calculation for clock divider of sdio on H7 - modmachine: add deepsleep support to reset_cause() for WB55 - pyb_can: enable CAN FD frame support and BRS - pyb_can: add support for CAN FD extended frame ID - pyb_can: add support for bus with mixed Classic/FD nodes - pyb_can: return the filter ID and type of received messages - pyb_can: define the maximum bit timing parameters - pyb_can: replace CAN.initfilterbanks with CAN.init keyword arg - Makefile: allow overriding COPT in Makefile - mpconfigport.h: let MICROPY_PY_IO_FILEIO take its default value - machine_bitstream: include all clobbered regs in Cortex-M0 impl - mboot: consolidate all UI and add general state change hooks - mboot: add macros for use in led_state_all() - sdram: add function to enable SDRAM power-down mode - Makefile: add H747 to Makefile's MCU flags - system_stm32: add H7 switched-mode-power-supply support - system_stm32: set voltage scaling level 0 for H7 Rev-V devices - system_stm32: allow boards to configure PLL VCI, VCO and FRACN - system_stm32: improve H7 PLL and OSC configuration - boards/PYBD_SFx: allow FROZEN_MANIFEST to be overridden - mpbthciport: switch scheduling callback to use node scheduler - boards/SPARKFUN_MICROMOD_STM32: fix incorrect UART and I2C config - mphalport: fix I/O glitches when switching GPIO mode to alt-func - boards/ADAFRUIT_F405_EXPRESS: use external SPI flash for storage - boards/LEGO_HUB_NO6: exclude BTstack code from formatting - qspi: support common flash sizes in MPU configuration - qspi: wait for a free FIFO location before writing to DR - qspi: workaround for SR set immediately after setting AR - ulpi: add USB3320 ULPI low-power functions - ulpi: include missing py/mperrno.h header - boards/ARDUINO_PORTENTA_H7: add support for Arduino Portenta H7 - storage: add support for internal storage on Cortex-M0 MCUs - add support for G0 MCUs - boards/NUCLEO_G0B1RE: add NUCLEO_G0B1RE board definition - mbedtls: use core-provided tracked alloc instead of custom funcs - make port-specific modules use MP_REGISTER_MODULE - rfcore: revert "intercept addr-resolution HCI cmd to work arou..." - mboot: move remaining led_state_all call into mboot_state_change - mboot: add update_app_elements to return mboot fsload elements - mboot: make 0x70ad0000 values named constants with macros - mboot: pass initial_r0 to early-init and get-reset-mode funcs - boards/LEGO_HUB_NO6: make all SPI flash transfers use 32-bit addr - boards/LEGO_HUB_NO6: add support for mboot to access SPI flash - boards/LEGO_HUB_NO6: use multi-colour LED for mboot status - boards/LEGO_HUB_NO6: implement robust filesystem-load updates - boards/LEGO_HUB_NO6: add helper scripts to update app firmware - rfcore: remove extra layer of buffering on BLE IPCC - flash: remove FLASH_OPTR_DBANK condition in L4, H7 get_bank func - machine_i2c: enable timingr constructor keyword on H7 MCUs - powerctrl: disable sys tick interrupt in stop mode on some STM32s - usbd_conf: remove disable of SYSCFG clock - mboot: add board-configurable SysTick hook - mboot: remove MP_WEAK on led funcs and make some of them static - boards/LEGO_HUB_NO6: add comment to readme about powering off - mboot: only include UI code if at least one board LED is defined teensy port: - make port-specific modules use MP_REGISTER_MODULE - mpconfigport.h: remove obsolete macros unix port: - Makefile: remove explicit addition of -std=c++ flag - show compiler info in REPL banner - .gitignore: remove *.py from ignore list - moduos: convert module to use extmod version - mpconfigport.h: collect together config options from extra level - variants: use rom feature config for standard, dev, coverage - variants: enable a few optimisations and features on dev, coverage - make port-specific modules use MP_REGISTER_MODULE - implement `-X realtime` command-line option on macOS - factor out code that generates random bytes to a new func - variants: enable seeding random module on import in dev, coverage windows port: - README.md: fix broken mingw link - add micropython.schedule support - mingw: include extmod/shared/lib sources properly - uselect: enable micropython select in dev variant - uasyncio: add support for uasyncio to windows dev variant - appveyor: fix printing of test failures - Makefile: specify CXXFLAGS in the Makefile - unify project file headers - switch to VFS subsystem and use VfsPosix - consolidate all sleep-related functions into windows_mphal.c - avoid busy loop when using scheduler - use BCryptGenRandom to implement os.urandom - factor out code that generates random bytes to a new func zephyr port: - update include path to disk_access.h - upgrade to Zephyr v3.0.0 - prj.conf: enable CONFIG_BUILD_OUTPUT_HEX to generate .hex output - moduos: convert module to use extmod version - make port-specific modules use MP_REGISTER_MODULE - modusocket: fix function object wrapper for listen method
Boosted performance, board.json metadata, more mimxrt, rp2, samd feat… …ures This release of MicroPython sees a boost to the overall performance of the VM and runtime. This is achieved by the addition of an optional cache to speed up general hash table lookups, as well as a fast path in the VM for the LOAD_ATTR opcode on instance types. The new configuration options are MICROPY_OPT_MAP_LOOKUP_CACHE and MICROPY_OPT_LOAD_ATTR_FAST_PATH. As part of this improvement the MICROPY_OPT_CACHE_MAP_LOOKUP_IN_BYTECODE option has been removed, which provided a similar map caching mechanism but with the cache stored in the bytecode, which made it not useful on bare metal ports. The new mechanism is measured to be at least as good as the old one, applies to more map lookups, has a constant RAM overhead, and applies to native code as well as bytecode. These performance options are enabled on the esp32, mimxrt, rp2, stm32 and unix ports. For esp32 and mimxrt some code is also moved to RAM to further boost performance. On stm32, performance increases by about 20% for benchmarks that are heavy on name lookups, like misc_pystone.py and misc_raytrace.py. On esp32 performance can increase by 2-3x, and on mimxrt it is up to 6x. All boards in all ports now have a board.json metadata file, which is used to automatically build firmware and generate a webpage for that board (among other possibilities). Auto-build scripts have been added for this purpose and they build all esp32, mimxrt, rp2, samd and stm32 boards. The generated output is available at https://micropython.org/download. Support for FROZEN_DIR and FROZEN_MPY_DIR has been deprecated for some time and was finally removed in this release. Instead of these, FROZEN_MANIFEST can be used. The io.resource_stream() function is also removed, replaced by the pure Python version in micropython-lib. The search order for importing frozen Python modules is now controlled by the ".frozen" entry in sys.path. This string is added by default in the second position in sys.path. User code should adjust sys.path depending on the desired behaviour. Putting ".frozen" first in sys.path will speed up importing frozen modules. A bug in multiple precision integers with bitwise of -0 was fixed in commit 2c139bb. The platform module has been added to allow querying the compiler and underlying SDK/HAL/libc version. This is enabled on esp32, mimxrt and stm32 ports. The mpremote tool now supports seek, flush, mkdir and rmdir on PC-mounted filesystems. And a help command has been added. The documentation has seen many additions and improvements thanks (for a second time) to the Google Season of Docs project. The rp2 documentation now includes a reference for PIO assembly instructions, a PIO quick reference and a PIO tutorial. The random and stm modules have been documented, along with sys.settrace, manifest.py files and mpremote. There is also now more detail about the differences between MicroPython and standard Python 3.5 and above. The esp32 port sees support for ESP32-S3 SoCs, and new boards GENERIC_S3, ESP32_S2_WROVER, LOLIN_S2_MINI, LOLIN_S2_PICO and UM_FEATHERS2NEO. The PWM driver has been improved and now supports all PWM timers and channels, and the duty_u16() and duty_ns() methods, and it keeps the duty constant when changing frequency. The machine.bitstream() function has been improved to use RMT, with an option to select the original bit-banging implementation. The mimxrt port gained new hardware features: SDRAM and SD card support, as well as network integration with a LAN driver. The machine.WDT class was added along with the machine.reset_cause(), machine.soft_reset(), machine.unique_id() add machine.bitstream() functions. DHT sensor support was added, and f-strings were enabled. The rp2 port now has support for networking, and bluetooth using NimBLE. The Nina-W10 WiFi/BT driver is fully integrated and supported by the new Arduino Nano RP2040 connect board. I2S protocol support is added along with a machine.bitstream() driver and DHT sensor support. The PWM driver had a bug fix with the accuracy of setting/getting the frequency, and the duty value is now retained when changing the frequency. On the samd port there is now support for the internal flash being a block device, and for filesystems and the os module. Pin and LED classes have been implemented. There are more time functions, more Python features enabled, and the help() function is added. SEEED_WIO_TERMINAL and SEEED_XIAO board definitions are now available. The stm32 port now has support for F427, F479 and H7A3(Q)/H7B3(Q) MCUs, and new board definitions for VCC_GND_H743VI, OLIMEX_H407, MIKROE_QUAIL, GARATRONIC_PYBSTICK26_F411, STM32H73B3I_DK. A bug was fixed in the SPI driver where a SPI transfer could fail if the CYW43 WiFi driver was also active at the same time. On the windows port the help() function has been enabled, and support for build variants added, to match the unix port. The zephyr port upgraded Zephyr to v2.7.0. The change in code size since the previous release for various ports is (absolute and percentage change in the text section): bare-arm: -1520 -2.605% minimal x86: -2256 -1.531% unix x64: -457 -0.089% unix nanbox: -925 -0.204% stm32: +312 +0.079% PYBV10 cc3200: -176 -0.096% esp8266: +532 +0.076% GENERIC esp32: +27096 +1.820% GENERIC nrf: -212 -0.121% pca10040 rp2: +9904 +2.051% PICO samd: +35332 +33.969% ADAFRUIT_ITSYBITSY_M4_EXPRESS The changes that dominate these numbers are: - bare-arm, minimal: use of new MICROPY_CONFIG_ROM_LEVEL_MINIMUM option and subsequent disabling of remaining optional features - unix, cc3200, nrf: general code size reductions of the core - stm32: performance improvements, addition of platform module - esp8266: enabling f-strings - esp32: use of -O2 instead of -Os - rp2: machine.I2S and other new hardware features - samd: filesystem support and other new hardware features Thanks to everyone who contributed to this release: Alan Dragomirecký, Alexey Shvetsov, Andrew Leech, Andrew Scheller, Antoine Aubert, Boris Vinogradov, Chris Boudacoff, Chris Fiege, Christian Decker, Damien George, Daniel Gorny, Dave Hylands, David Michieli, Emilie Feral, Frédéric Pierson, gibbonsc, Henk Vergonet, iabdalkader, Ihor Nehrutsa, Jan Hrudka, Jan Staal, jc_.kim, Jim Mussared, Jonathan Hogg, Laurens Valk, leo chung, Lorenzo Cappelletti, Magnus von Wachenfeldt, Matt Trentini, Matt van de Werken, Maureen Helm, Michael Bentley, Michael Buesch, Mike Causer, Mike Teachman, Mike Wadsten, Ned Konz, NitiKaur, oli, patrick, Patrick Van Oosterwijck, Peter Boin, Peter Hinch, Peter van der Burg, Philipp Ebensberger, Pooya Moradi, retsyo, robert-hh, roland van straten, Scott Armitage, Sebastian Wicki, Seon Rozenblum, Sergei Silnov, Simon Baatz, Stewart Bonnick, stijn, Tobias Thyrrestrup, Tomas Vanek, YoungJoon Chun. What follows is a detailed list of changes, generated from the git commit history, and organised into sections. Main components =============== all: - remove MICROPY_OPT_CACHE_MAP_LOOKUP_IN_BYTECODE - update Python formatting to latest Black version 21.12b0 - remove support for FROZEN_DIR and FROZEN_MPY_DIR py core: - parse: simplify parse nodes representing a list - emitnative: ensure load_subscr does not clobber existing REG_RET - mpconfig.h: define initial templates for "feature levels" - vm: add a fast path for LOAD_ATTR on instance types - map: add an optional cache of (map+index) to speed up map lookups - builtinimport: forward all debug printing to MICROPY_DEBUG_PRINTER - add wrapper macros so hot VM functions can go in fast code location - runtime: fix crash when exc __new__ doesn't return an exc instance - mpconfig.h: define the "extra" feature level - mpconfig.h: revert MICROPY_REPL_INFO to disabled at all levels - gc: add hook to run code during time consuming GC operations - showbc: print unary-op string when dumping bytecode - modsys: replace non-ASCII quote char with ASCII char - runtime: allow types to use both .attr and .locals_dict - lexer: support nested [] and {} characters within f-string params - objfun.h: remove obsolete comments about entries in extra_args - builtinimport: refactor module importing - showbc: fix printing of raw bytecode header on nanbox builds - modio: remove io.resource_stream function - only search frozen modules when '.frozen' is found in sys.path - mkrules.cmake: set frozen preprocessor defs early - runtime: allow initialising sys.path/argv with defaults - mpstate.h: only include sys.path/argv objects in state when enabled - mpz: fix bugs with bitwise of -0 by ensuring all 0's are positive - qstr: reset mpstate.qstr_last_chunk before raising an error - modbuiltins: add additional macro for extending builtins - mpconfig.h: define MICROPY_PY_USSL_FINALISER only if not defined extmod: - machine_i2c: make SoftI2C configurable via macro option - machine_spi: make SoftSPI configurable via macro option - modonewire: make _onewire module configurable via macro option - machine_pwm: factor out machine.PWM bindings to common code - move modnetwork and modusocket from stm32 to extmod - modnetwork: add STA_IF and AP_IF constants - modnetwork: add extended socket state - modusocket: add read/write stream methods to socket object - modnetwork: define network interfaces in port config files - network_cyw43: make consistent use of STA and AP constants - modnetwork: remove STM32 references - modnetwork: remove modnetwork socket u_state member - mpbthci.h: add mp_bluetooth_hci_uart_any prototype - nimble: add nimble CMake fragment file - add platform module - moduplatform: improve implementation for PC ports - vfs_posix_file: support MP_STREAM_POLL in vfs_posix_file_ioctl - modbluetooth: add connection interval to gap_connect - nimble: update to NimBLE v1.4 - nimble: remove workaround for OS_ENOMEM - uasyncio: fix gather returning exceptions from a cancelled task - uplatform: remove unused definitions - uplatform: use generic custom platform string - network_ninaw10: fix scan list order to match other NICs - modbluetooth: support gap_connect(None) to cancel a connection - modure: redirect regex debug printing to mp_printf - network_ninaw10: fix config of AP mode - network_ninaw10: disable active connections before connecting - network_ninaw10: make NIC state persistent - network_ninaw10: return -1 on timeout from recv/send - network_ninaw10: make recv/recvfrom interchangeable - moduplatform: detect xtensa arch - modusocket: allow setting timeout on unbound sockets - modusocket: initialise accepted socket state - network_ninaw10: use socket timeout preset in modusocket - modbluetooth: fix conditional compilation of ringbuf_put_uuid - modbluetooth: put declaration of connect_cancel in correct place shared: - libc/string0: don't include string.h, and provide __memcpy_chk - runtime/pyexec: cleanup EXEC_FLAG flag constants drivers: - ninaw10: add ublox Nina-W10 WiFi/BT module driver - lsm6dsox: add LSM6DSOX driver and examples - neopixel: avoid heap alloc in fill() - ninaw10: fix BSSID byte order, and add null byte to ESSID - ninaw10/nina_wifi_drv: fix DNS resolution mpy-cross: no changes specific to this component/port lib: - mynewt-nimble: switch to the MicroPython fork of NimBLE - asf4: point submodule to latest commit on circuitpython branch - update pico-sdk to 1.3.0 and tinyusb to 0.12.0 - stm32lib: update library for L4 v1.17.0, new G4, WL, and MMC fixes - stm32lib: update library for fix to F7 USB HS Support components ================== docs: - library/os.rst: clarify littlefs requirements for block erase - library/bluetooth.rst: update incorrect link to gatts_write - make.bat: change Windows output dir from '_build' to 'build' - library/machine.I2S.rst: specify that I2S.shift args are kw-only - esp32: explain ESP32 PWM modes, timers, and channels - rp2: add reference for PIO assembly instructions, and PIO tutorial - library/random.rst: document the random module - reference/mpremote.rst: add docs for mpremote - reference/manifest.rst: add docs for manifest.py files - library/stm.rst: document the stm module - esp32/tutorial: add an example of peripheral control via regs - rp2/general.rst: fix typo with missing spaces - library/framebuf.rst: adjust dimensions in example - library/rp2.rst: update function asm_pio_encode to add sideset_opt - reference/filesystem.rst: add detail on how to use littlefs fuse - rp2/quickref.rst: add section on PIO - library/sys.rst: add docs for sys.settrace - esp8266/tutorial: fix comments of FrameBuffer examples - library/uasyncio.rst: detail exception behaviour in cancel/timeout - library/machine.Timer.rst: document 'id' as positional-only arg - library/machine.SPI.rst: add example SPI usage - library/machine.Timer.rst: document `period` and `callback` args - library/machine.Pin.rst: add Pin.ANALOG mode constant - remove trailing spaces and convert tabs to spaces - library/sys.rst: add note about '.frozen' as an entry in sys.path - differences: document details of new PEPs/features in Python 3.5+ - update copyright year range to include 2022 - esp32: update RMT quickref example to match latest code examples: no changes specific to this component/port tests: - perf_bench: use math.log instead of math.log2 - basics: add tests for type-checking subclassed exc instances - micropython/const.py: add comment about required config for test - cpydiff: clarify f-string diffs regarding concatenation - basics/int_big_cmp.py: add more tests for big-int comparison - extmod: skip uselect_poll_udp when poll() is not available tools: - autobuild: add auto build for GENERIC_C3_USB - ci.sh: use IDF v4.4 as part of esp32 CI and build GENERIC_S3 - autobuild: add the MIMXRT1010_EVK board to autobuild - ci.sh: use a specific ESP IDF v4.4 commit - autobuild: add script to generate website board metadata - dfu.py: make tool work with python3 when parsing DFU files - autobuild: automatically build all mimxrt, rp2 and samd boards - autobuild: automatically build all stm32 boards - mpremote: implement seek and flush in ioctl method - autobuild: automatically build all esp32 boards - upip.py: support == to specify exact package version - makemanifest.py: make str conversion compatible with Python 2 - makemanifest.py: merge make-frozen.py - mpremote: add mkdir and rmdir to RemoteFS - mpremote: add help command - mpremote: add link to mpremote docs URL in help message - upip.py: skip '.frozen' entry in sys.path for install path - autobuild: build esp8266 OTA image with GENERIC_1M board - ci.sh: upgrade Zephyr docker image to v0.21.0 - ci.sh: build zephyr nucleo_wb55rg to test zephyr bluetooth build CI: - workflows: use Python 3.8 for macos workflow - workflows: add new workflow to build ports download metadata The ports ========= all ports: - add board.json for all boards - add images, features and urls to board.json - add '.frozen' as the first entry in sys.path - move '.frozen' to second entry in sys.path bare-arm port: - mpconfigport.h: use MICROPY_CONFIG_ROM_LEVEL_MINIMUM - mpconfigport.h: disable remaining optional features cc3200 port: no changes specific to this component/port esp8266 port: - boards/GENERIC: enable f-strings - extract qstr from object when comparing keys in config() - etshal.h: remove unneeded function declarations - allow building a board to any dest directory esp32 port: - boards: add new FeatherS2-Neo board definition - machine_timer: use tx_update member for IDF 4.4 and above - add support for ESP32-S3 SoCs - boards: add new GENERIC_S3 board definition - machine_hw_spi: fix hardware SPI DMA channels for S2/S3 - boards: add board definition for ESP32-S2-WROVER module - boards: add LOLIN_S2_MINI ESP32-S2 board - machine_pwm: add support for all PWM timers and channels - README: updated readme with req IDF vers for ESP32-S2, C3 and S3 - usb: add USB host connection detection for CDC serial output - machine_pin: block out IO16 and IO17 when using SPIRAM on ESP32 - mpthreadport: fix TCB cleanup function so thread_mutex is ready - main: add option for a board to hook code into startup sequence - split out WLAN code from modnetwork.c to network_wlan.c - enable optimisations and move code to iRAM to boost performance - usb: improve speed of USB CDC output - add specific deploy_s2.md instructions for esp32-s2 - boards/LOLIN_S2_MINI: add image to board.json - boards: update board and deploy metadata for UM_xxx boards - usb: further improve speed of USB CDC output - boards/LOLIN_S2_PICO: add LOLIN_S2_PICO board definition files - boards/ESP32_S2_WROVER: link to specific deploy_s2 instructions - support building with latest IDF v5 - in machine_i2s, send null samples in underflow situations - in machine_i2s, make object reference arrays root pointers - add SDCard support for S3, and a GENERIC_S3_SPIRAM board - boards/GENERIC_S3: enable BLE on ESP32 S3 - machine_pwm: implement duty_u16() and duty_ns() PWM methods - extract qstr from object when comparing keys in config() - machine_pin: make GPIO 26 usable for S2,S3 if SPIRAM not config'd - machine_hw_spi: fix SPI default pins reordering on ESP32-S2/S3 - machine_hw_spi: set proper default SPI(id=1) pins on S2,S3 and C3 - machine_hw_spi: set proper default SPI(id=2) pins on S2 and S3 - boards: remove SPI pin defaults from GENERIC S2/S3 boards - modnetwork: synchronize WiFi AUTH_xxx constants with IDF values - machine_pwm: keep duty constant when changing frequency - machine_bitstream: replace bit-bang code with RMT-based driver - machine_i2s: add support for ESP-IDF 4.4 - machine_bitstream: fix signal duplication on output pins - esp32: enable platform module with IDF version - boards/GENERIC_D2WD: build with -Os optimisation - esp32_rmt: install RMT driver on core 1 - machine_bitstream: reinstate bitstream bit-bang implementation javascript port: no changes specific to this component/port mimxrt port: - sdcard: implement SDCard driver - machine_bitstream: add bitstream function to machine module - rework flash configuration - sdram: add SDRAM support - eth: add LAN support and integrate the network module - modmachine: implement machine.WDT() and machine.reset_cause() - boards: fix the D14/D15 pin assignment of MIMXRT1050/60/64_EVK - hal: remove duplicate definitions from flexspi_hyper_flash.h - dma_channel: fix the DMA channel management - fix cycle counter for time.ticks_cpu() and machine.bitstream() - add dht_readinto() to the mimxrt module, and freeze dht.py - extend the help() message and README.md - mpconfigport.h: enable f-strings - modmachine: implement soft_reset() and unique_id() functions - boards/make-pins.py: allow empty lines and comments in pins.csv - optimize the runtime speed - enable the platform module - boards: add the Seeed ARCH MIX board - boards: update the board.json files and add deploy_xx.md files - fix mp_hal_quiet_timing_enter()/exit() so timer still runs - support PWM using the FLEXPWM and QTMR modules - define UART 0 on MIMXRT boards - support selection of PHY type and address - re-enable eth checksum creation by HW - fix a tiny unnoticed bug in sdcard.c - add a driver for the DP83848 PHY device - refactor the reading of the machine id - enable ticks_cpu at boot time for NDEBUG builds only - use -Og instead of -O0 for DEBUG builds - tidy up the board flash related files - hal: allow readSampleClkSrc to be configured by a board - enable MICROPY_PY_USSL_FINALISER minimal port: - mpconfigport.h: use MICROPY_CONFIG_ROM_LEVEL_MINIMUM - Makefile: don't force a 32-bit build - mpconfigport.h: disable features that are not needed nrf port: - Makefile: improve Black Magic Probe commands - main: use VFS helper function to mount fs and chdir pic16bit port: no changes specific to this component/port powerpc port: no changes specific to this component/port qemu-arm port: no changes specific to this component/port rp2 port: - mpconfigport.h: enable heapq module - add support for bluetooth module using NimBLE - add framework for networking - mpconfigport.h: use the "extra" feature level - enable optimisations (comp goto, map cache, fast attr) - machine_i2s: add I2S protocol support - add support for Nina-W10 WiFi/BT module - boards: add support for Arduino Nano RP2040 - machine_bitstream: implement the machine.bitstream driver - boards: add neopixel.py to manifest.py - rp2_pio: support exec with sideset - boards/PIMORONI_PICOLIPO_16MB: fix 16MB flash size - boards: add PYBSTICK26 RP2040 board definition - machine_uart: handle and clear UART RX timeout IRQ - boards/ARDUINO_NANO_RP2040_CONNECT: set default I2C pins - machine_pwm: fix PWM frequency setting - machine_pwm: keep duty value when changing the frequency - add support for DHT11 and DHT22 sensors - CMakeLists.txt: allow a board to override PICO_BOARD - boards/GARATRONIC_PYBSTICK26_RP2040: use correct pico-sdk board cfg samd port: - integrate latest asf4, add help, more time funcs and uPy features - samd_soc: allow a board to configure the low-level MCU config - add internal flash block device, filesystem and uos support - add Pin and LED classes, and machine.unique_id - boards/ADAFRUIT_FEATHER_M0_EXPRESS: update for flash and pins - boards/ADAFRUIT_ITSYBITSY_M4_EXPRESS: update for flash and pins - boards/MINISAM_M4: update for flash and pins - boards/ADAFRUIT_TRINKET_M0: update for flash and pins - boards/SAMD21_XPLAINED_PRO: update for flash and pins - boards/SEEED_WIO_TERMINAL: add new board definition - boards/SEEED_XIAO: add new board definition - README.md: update README to reflect new features and boards stm32 port: - pin: enable GPIO clock of pin if it's constructed without init - main: don't unconditionally enable GPIO A,B,C,D clocks - boards/VCC_GND_H743VI: add board definition for VCC_GND_H743VI - boards/OLIMEX_E407: add Ethernet RMII support - boards/LEGO_HUB_NO6: remove user paths from cc2564 init file - boards: remove trailing spaces, and add newline at end of file - add basic support for STM32H750 - add support for H7A3(Q)/H7B3(Q), and STM32H73B3I_DK board defn - suggest putting code in main.py not boot.py - boards/make-pins.py: allow a CPU pin to be hidden - boards/make-pins.py: allow empty lines and comments in pins.csv - dma: add functions for external users of DMA to enable clock - enable LOAD_ATTR fast path, and map lookup caching on >M0 - boards: add OLIMEX H407 board definition - enable platform module - extended flash filesystem space to 512K on H743 boards - boards/NUCLEO_H743ZI: enable VfsLfs2 on NUCLEO_H743ZI(2) boards - boards: add PF11-BOOT0 to stm32f091_af.csv - machine_i2c: use hardware I2C for STM32H7 - sdram: enforce gcc opt, and use volatile and DSB in sdram_test - usbd_cdc_interface: allow a board to hook into USBD CDC RX events - mpbthciport: allow a board to hook BT HCI poll functions - pendsv: allow a board to add entries for pendsv_schedule_dispatch - boards: add images to board.json for Adafruit and VCC_GND boards - uart: fix race conditions and clearing status in IRQ handler - mpconfigport.h: use the "extra" feature level - in machine_i2s, send null samples in underflow situations - in machine_i2s, make object reference arrays root pointers - led: support an extra 2 LEDs in board configuration - boards/MIKROE_CLICKER2_STM32: add more detail to board.json - boards: add new board MikroElektronika Quail, and F427 support - main: run optional frozen module at boot - sdio: don't explicitly disable DMA2 on deinit of SDIO - dma: make DMA2_Stream3 exclusive to SDIO when CYW43 enabled - boards: build NUCLEO_WB55 and STM32F769DISC without mboot enabled - boards: add PYBSTICK26 F411 board definition - boards/NADHAT_PYBF405: rename board to GARATRONIC_NADHAT_F405 - usb: use a table of allowed values to simplify usb_mode get/set - boards/NUCLEO_WB55: update rfcore_firmwre for new WS - flashbdev: support generic flash storage config via link symbols - boards: convert F413,F439,H743,L4xx,WB55 to new flash FS config - add support for F479 MCUs - include HAL MMC code in F4 builds - boards/make-pins.py: use cpu pins to define static alt-fun macros - boards/NUCLEO_WB55: fix LED ordering - boards/LEGO_HUB_NO6: set filesystem label as HUB_NO6 - boards: remove stray '+' characters at start of lines in ld files - boards: remove unused MICROPY_HW_ENABLE_TIMER config - boards: enable MICROPY_HW_ENABLE_SERVO on various boards - update L4 code to build with latest stm32lib and L4 HAL 1.17.0 - main: call sdcard_init when only MICROPY_HW_ENABLE_MMCARD enabled - sdcard: support 8-bit wide SDIO bus - sdcard: add config option to force MM card capacity - factoryreset: init vfs flags before calling pyb_flash_init_vfs - qspi: fix typo in address comment - boards/make-pins.py: generate empty ADC table if needed - boards/OLIMEX_H407: fix typo in OLIMEX H407 board.json - network_wiznet5k: fix build error with wiznet5k and lwip enabled - enable MICROPY_PY_USSL_FINALISER teensy port: - switch to use manifest.py instead of FROZEN_DIR unix port: - enable LOAD_ATTR fast path, and map lookup caching - modusocket: support MP_STREAM_POLL in unix socket_ioctl - modos: add support for uos.urandom(n) - coverage: change remaining printf to mp_printf - Makefile: use -Og instead of -O0 for debug builds windows port: - README: remove unsupported Python instructions for Cygwin - mpconfigport.h: enable help and help("modules") - add support for build variants to windows port - run tests via Makefile - appveyor: build both standard and dev variants - appveyor: build mpy-cross only once for mingw-w64 - msvc: run qstr preprocessing phase in parallel zephyr port: - mphalport.h: remove unused and unimplemented C-level pin API - increase minimum CMake version to 3.20.0 - update include path to reboot.h - get UART console device from devicetree instead of Kconfig - use CONFIG_USB_DEVICE_STACK for conditional USB device support - upgrade to Zephyr v2.7.0 - modbluetooth_zephyr: provide dummy connect_cancel function
F-strings, new machine.I2S class, ESP32-C3 support and LEGO_HUB_NO6 b…
…oard
This release of MicroPython adds support for f-strings (PEP-498), with a
few limitations compared to normal Python. F-strings are essentially
syntactic sugar for "".format() and make formatting strings a lot more
convenient. Other improvements to the core runtime include pretty printing
OSError when it has two arguments (an errno code and a string), scheduling
of KeyboardInterrupt on the main thread, and support for a single argument
to the optimised form of StopIteration.
In the machine module a new I2S class has been added, with support for
esp32 and stm32 ports. This provides a consistent API for transmit and
receive of audio data in blocking, non-blocking and asyncio-based
operation. Also, the json module has support for the "separators" argument
in the dump and dumps functions, and framebuf now includes a way to blit
between frame buffers of different formats using a palette. A new,
portable machine.bitstream function is also added which can output a stream
of bits with configurable timing, and is used as the basis for driving
WS2812 LEDs in a common way across ports.
There has been some restructuring of the repository directory layout, with
all third-party code now in the lib/ directory. And a new top-level
directory shared/ has been added with first-party code that was previously
in lib/ moved there.
The docs have seen further improvement with enhancements and additions to
the rp2 parts, as well as a new quick reference for the zephyr port.
The terms master/slave have been replaced with controller/peripheral,
mainly relating to I2C and SPI usage. And u-module references have been
replaced with just the module name without the u-prefix to help clear up
the intended usage of modules in MicroPython.
For the esp8266 and esp32 ports, hidden networks are now included in WLAN
scan results. On the esp32 the RMT class is enhanced with idle_level and
write_pulses modes. There is initial support for ESP32-C3 chips with
GENERIC_C3 and GENERIC_C3_USB boards.
The javascript port has had its Makefile and garbage collector
implementation reworked so it compiles and runs with latest the Emscripten
using asyncify.
The mimxrt port sees the addition of hardware I2C and SPI support, as well
as some additional methods to the machine module. There is also support
for Hyperflash chips.
The nrf port now has full VFS storage support, enables source-line on
traceback, and has .mpy features consistent with other ports.
For the rp2 port there is now more configurability for boards, and more
boards added.
The stm32 port has a new LEGO_HUB_NO6 board definition with detailed
information how to get this LEGO Hub running stock MicroPython. There is
also now support to change the CPU frequency on STM32WB MCUs. And USBD_xxx
descriptor options have been renamed to MICROPY_HW_USB_xxx.
Thanks to everyone who contributed to this release: Amir Gonnen, Andrew
Scheller, Bryan Tong Minh, Chris Wilson, Damien George, Daniel Mizyrycki,
David Lechner, David P, Fernando, finefoot, Frank Pilhofer, Glenn Ruben
Bakke, iabdalkader, Jeff Epler, Jim Mussared, Jonathan Hogg, Josh Klar,
Josh Lloyd, Julia Hathaway, Krzysztof Adamski, Matúš Olekšák, Michael
Weiss, Michel Bouwmans, Mike Causer, Mike Teachman, Ned Konz, NitiKaur,
oclyke, Patrick Van Oosterwijck, Peter Hinch, Peter Züger, Philipp
Ebensberger, robert-hh, Roberto Colistete Jr, Sashkoiv, Seon Rozenblum,
Tobias Thyrrestrup, Tom McDermott, Will Sowerbutts, Yonatan Goldschmidt.
What follows is a detailed list of changes, generated from the git commit
history, and organised into sections.
Main components
===============
all:
- fix signed shifts and NULL access errors from -fsanitize=undefined
- update to point to files in new shared/ directory
py core:
- mpstate: make exceptions thread-local
- mpstate: schedule KeyboardInterrupt on main thread
- mperrno: add MP_ECANCELED error code
- makeqstrdefs.py: don't include .h files explicitly in preprocessing
- mark unused arguments from bytecode decoding macros
- objexcept: pretty print OSError also when it has 2 arguments
- makeversionhdr: add --tags arg to git describe
- vm: simplify handling of MP_OBJ_STOP_ITERATION in yield-from opcode
- objexcept: make mp_obj_exception_get_value support subclassed excs
- support single argument to optimised MP_OBJ_STOP_ITERATION
- introduce and use mp_raise_type_arg helper
- modsys: optimise sys.exit for code size by using exception helpers
- objexcept: make mp_obj_new_exception_arg1 inline
- obj: fix formatting of comment for mp_obj_is_integer
- emitnative: reuse need_reg_all func in need_stack_settled
- emitnative: ensure stack settling is safe mid-branch
- runtime: fix bool unary op for subclasses of native types
- builtinimport: fix condition for including do_execute_raw_code()
- mkrules: automatically build mpy-cross if it doesn't exist
- implement partial PEP-498 (f-string) support
- lexer: clear fstring_args vstr on lexer free
- mkrules.mk: do submodule sync in "make submodules"
extmod:
- btstack: add missing call to mp_bluetooth_hci_uart_deinit
- btstack: check that BLE is active before performing operations
- uasyncio: get addr and bind server socket before creating task
- axtls-include: add axtls_os_port.h to customise axTLS
- update for move of crypto-algorithms, re1.5, uzlib to lib
- moduselect: conditionally compile select()
- nimble: fix leak in l2cap_send if send-while-stalled
- btstack/btstack.mk: use -Wno-implicit-fallthrough, not =0
- utime: always invoke mp_hal_delay_ms when >= to 0ms
- modbluetooth: clamp MTU values to 32->UINT16_MAX
- nimble: allow modbluetooth binding to hook "sent HCI packet"
- nimble: add "memory stalling" mechanism for l2cap_send
- uasyncio: in open_connection use address info in socket creation
- modujson: add support for dump/dumps separators keyword-argument
- modlwip: fix close and clean up of UDP and raw sockets
- modbluetooth: add send_update arg to gatts_write
- add machine.bitstream
- modframebuf: enable blit between different formats via a palette
lib:
- tinyusb: update to version 0.10.1
- pico-sdk: update to version 1.2.0
- utils/stdout_helpers: make mp_hal_stdout_tx_strn_cooked efficient
- axtls: switch to repo at micropython/axtls
- axtls: update to latest axtls 2.1.5 wih additional commits
- re1.5: move re1.5 code from extmod to lib
- uzlib: move uzlib code from extmod to lib
- crypto-algorithms: move crypto-algorithms code from extmod to lib
- update README's based on contents of these dirs
drivers:
- neopixel: add common machine.bitstream-based neopixel module
- neopixel: optimize fill() for speed
- neopixel: reduce code size of driver
- cyw43: fix cyw43_deinit so it can be called many times in a row
- cyw43: make wifi join fail if interface is not active
mpy-cross:
- disable stack check when building with Emscripten
Support components
==================
docs:
- library: document new esp32.RMT features and fix wait_done
- library: warn that ustruct doesn't handle spaces in format strings
- esp8266/tutorial: change flash mode from dio to dout
- replace master/slave with controller/peripheral in I2C and SPI
- rp2: enhance quickref and change image to Pico pinout
- rp2: update general section to give a brief technical overview
- library/utime.rst: clarify behaviour and precision of sleep ms/us
- library/uasyncio.rst: document stream readexactly() method
- library/machine.I2S.rst: fix use of sd pin in examples
- zephyr: add quick reference for the Zephyr port
- library/zephyr: add libraries specific to the Zephyr port
- templates: add unix and zephyr quickref links to top-index
- rename ufoo.rst to foo.rst
- replace ufoo with foo in all docs
- library/index.rst: clarify module naming and purpose
- library/builtins.rst: add module title
- library/network.rst: simplify socket import
- add docs for machine.bitstream and neopixel module
- library: fix usage of :term: for frozen module reference
- esp8266: use monospace for software tools
- reference: mention that slicing a memoryview causes allocation
examples: no changes specific to this component/port
tests:
- extmod: make uasyncio_heaplock test more deterministic
- cpydiff/modules_struct_whitespace_in_format: run black
- extmod/ujson: add tests for dump/dumps separators argument
- run-multitests.py: add broadcast and wait facility
- multi_bluetooth/ble_subscribe.py: add test for subscription
- extmod/vfs_fat_finaliser.py: ensure alloc at never-used GC blocks
- basics: split f-string debug printing to separate file with .exp
- pybnative: make while.py test run on boards without pyb.delay
tools:
- autobuild: add scripts to build release firmware
- remove obsolete build-stm-latest.sh script
- ci.sh: run apt-get update in ci_powerpc_setup
- makemanifest.py: allow passing flags to mpy-tool.py
- autobuild: add mimxrt port to build scripts for nightly builds
- pyboard.py: add cmd-line option to make soft reset configurable
- mpremote: swap order of PID and VID in connect-list output
- ci.sh: build unix dev variant as part of macOS CI
- ci.sh: build GENERIC_C3 board as part of esp32 CI
- autobuild: use separate IDF version to build newer esp32 SoCs
- autobuild: add FeatherS2 and TinyS2 to esp32 auto builds
- mpremote: add seek whence for mounted files
- mpremote: raise OSError on unsupported RemoteFile.seek
- autobuild: add the MIMXRT1050_EVKB board to the daily builds
- ci.sh: add mpy-cross build to nrf port
- codeformat.py: include ports/nrf/modules/nrf in code formatting
- gen-cpydiff.py: don't rename foo to ufoo in diff output
- autobuild: add auto build for Silicognition wESP32
- mpremote: fix connect-list in case VID/PID are None
- mpremote: add "devs" shortcut for "connect list"
- mpremote: remove support for pyb.USB_VCP in/out specialisation
- autobuild: don't use "-B" for make, it's already a fresh build
- pyboard.py: move --no-exclusive/--soft-reset out of mutex group
- pyboard.py: make --no-follow use same variable as --follow
- pyboard.py: add --exclusive to match --no-exclusive
- pyboard.py: make --no-soft-reset consistent with other args
- uncrustify: force 1 newline at end of file
- mpremote: bump version to 0.0.6
CI:
- workflows: add workflow to build and test javascript port
- workflows: switch from Coveralls to Codecov
- workflows: switch from lcov to gcov
- workflows: add workflow to build and test unix dev variant
The ports
=========
all ports:
- use common mp_hal_stdout_tx_strn_cooked instead of custom one
- update for move of crypto-algorithms, uzlib to lib
- rename USBD_VID/PID config macros to MICROPY_HW_USB_VID/PID
bare-arm port: no changes specific to this component/port
cc3200 port: no changes specific to this component/port
esp8266 port:
- add __len__ to NeoPixel driver to support iterating
- Makefile: add more libm files to build
- include hidden networks in WLAN.scan results
- replace esp.neopixel with machine.bitstream
- remove dead code for end_ticks in machine_bitstream
esp32 port:
- boards/sdkconfig.base: disable MEMPROT_FEATURE to alloc from IRAM
- add __len__ to NeoPixel driver to support iterating
- main: allow MICROPY_DIR to be overridden
- esp32_rmt: fix RMT looping in newer IDF versions
- esp32_rmt: enhance RMT with idle_level and write_pulses modes
- add new machine.I2S class for I2S protocol support
- machine_spi: calculate actual attained baudrate
- machine_hw_spi: use a 2 item SPI queue for long transfers
- machine_dac: add MICROPY_PY_MACHINE_DAC option, enable by default
- machine_i2s: add MICROPY_PY_MACHINE_I2S option, enable by default
- fix use of mp_int_t, size_t and uintptr_t
- add initial support for ESP32C3 SoCs
- boards/GENERIC_C3: add generic C3-based board
- modmachine: release the GIL in machine.idle()
- mphalport: always yield at least once in delay_ms
- machine_uart: add flow kw-arg to enable hardware flow control
- boards: add Silicognition wESP32 board configuration
- mpconfigport.h: enable reverse and inplace special methods
- include hidden networks in WLAN.scan results
- makeimg.py: get bootloader and partition offset from sdkconfig
- enable MICROPY_PY_FSTRINGS by default
- machine_hw_spi: release GIL during transfers
- machine_pin: make check for non-output pins respect chip variant
- replace esp.neopixel with machine.bitstream
- remove dead code for end_ticks in machine_bitstream
- boards: add GENERIC_C3_USB board with USB serial/JTAG support
javascript port:
- rework Makefile and GC so it works with latest Emscripten
- Makefile: suppress compiler errors from array bounds
- Makefile: change variable to EXPORTED_RUNTIME_METHODS
mimxrt port:
- move calc_weekday helper function to timeutils
- machine_spi: add the SPI class to the machine module
- moduos: seed the PRNG on boot using the TRNG
- boards: set vfs partition start to 1 MBbyte
- main: skip running main.py if boot.py failed
- main: extend the information returned by help()
- mimxrt_flash: remove commented-out code
- modmachine: add a few minor methods to the machine module
- machine_led: use mp_raise_msg_varg helper
- machine_i2c: add hardware-based machine.I2C to machine module
- add support for Hyperflash chips
- boards: add support for the MIMXRT1050_EVKB board
- machine_pin: implement ioctl for Pin
minimal port:
- Makefile: add support for building with user C modules
nrf port:
- modules: replace master/slave with controller/peripheral in SPI
- boards/common.ld: calculate unused flash region
- modules/nrf: add new nrf module with flash block device
- drivers: add support for using flash block device with SoftDevice
- mpconfigport.h: expose nrf module when MICROPY_PY_NRF is set
- README: update README.md to reflect internal file systems
- mpconfigport.h: tune FAT FS configuration
- Makefile: add _fs_size linker script override from make
- modules/uos: allow a board to configure MICROPY_VFS_FAT/LFS1/LFS2
- mpconfigport.h: enable MICROPY_PY_IO_FILEIO when an FS is enabled
- qstrdefsport.h: add entries for in-built FS mount points
- main: add auto mount and auto format hook for internal flash FS
- boards: enable needed features for FAT/LFS1/LFS2
- facilitate use of freeze manifest
- boards: set FROZEN_MANIFEST blank when SD present on nrf51 targets
- modules/scripts: add file system formatting script
- Makefile: set default manifest file for all targets
- mphalport: add dummy function for mp_hal_time_ns()
- boards: enable MICROPY_VFS_LFS2 for all target boards
- modules/uos: add ilistdir to uos module
- modules/nrf: add function to enable/disable DCDC
- enable source line on tracebacks
- set .mpy features consistent with documentation and other ports
pic16bit port: no changes specific to this component/port
powerpc port: no changes specific to this component/port
qemu-arm port: no changes specific to this component/port
rp2 port:
- use 0=Monday datetime convention in RTC
- machine_rtc: in RTC.datetime, compute weekday automatically
- CMakeLists.txt: suppress compiler errors for pico-sdk and tinyusb
- tusb_config.h: set CFG_TUD_CDC_EP_BUFSIZE to 256
- machine_uart: add hardware flow control support
- machine_uart: allow overriding default machine UART pins
- machine_i2c: allow boards to configure I2C pins using new macros
- machine_spi: allow boards to configure SPI pins using new macros
- machine_uart: fix poll ioctl to also check hardware FIFO
- machine_uart: fix read when FIFO has chars but ringbuf doesn't
- tusb_port: allow boards to configure USB VID and PID
- boards/ADAFRUIT_FEATHER_RP2040: configure custom VID/PID
- boards/ADAFRUIT_FEATHER_RP2040: configure I2C/SPI default pins
- boards/SPARKFUN_PROMICRO: configure UART/I2C/SPI default pins
- boards/SPARKFUN_THINGPLUS: configure I2C/SPI default pins
- boards: add Adafruit ItsyBitsy RP2040
- boards: add Adafruit QT Py RP2040
- boards: add Pimoroni Pico LiPo 4MB
- boards: add Pimoroni Pico LiPo 16MB
- boards: add Pimoroni Tiny 2040
- CMakeLists.txt: allow a board's cmake to set the manifest path
- enable MICROPY_PY_FSTRINGS by default
- Makefile: add "submodules" target, to match other ports
- rp2_flash: disable IRQs while calling flash_erase/program
- CMakeLists.txt: add option to enable double tap reset to bootrom
- mpconfigport.h: allow boards to add root pointers
samd port:
- add support for building with user C modules
stm32 port:
- softtimer: add soft_timer_reinsert() helper function
- mpbthciport: change from systick to soft-timer for BT scheduling
- provide a custom BTstack runloop that integrates with soft timer
- usb: make irq's default trigger enable all events
- boardctrl: skip running main.py if boot.py had an error
- sdio: fix undefined reference to DMA stream on H7
- dma: add DMAMUX configuration for H7 to fix dma_nohal_init
- main: call mp_deinit() at end of main
- adc: allow using ADC12 and ADC3 for H7
- adc: define the ADC instance used for internal channels
- adc: simplify and generalise how pin_adcX table is defined
- add new machine.I2S class for I2S protocol support
- boards/NUCLEO_F446RE: fix I2C1 pin assignment to match datasheet
- replace master/slave with controller/peripheral in I2C and SPI
- systick: always POLL_HOOK when delaying for milliseconds
- sdram: make SDRAM test cache aware, and optional failure with msg
- boards/NUCLEO_F446RE: enable CAN bus support
- boards: add support for SparkFun STM32 MicroMod Processor board
- uart: fix LPUART1 baudrate set/get
- uart: support low baudrates on LPUART1
- boards/STM32F429DISC: set correct UART2 pins and add UART3/6
- boards/NUCLEO_F439ZI: add board definition for NUCLEO_F439ZI
- boards/LEGO_HUB_NO6: add board definition for LEGO_HUB_NO6
- Makefile: update to only pull in used Bluetooth library
- README.md: update supported MCUs, and submodule and mboot use
- usbd_desc: rename USBD_xxx descriptor opts to MICROPY_HW_USB_xxx
- usbd_cdc_interface: rename USBD_CDC_xx opts to MICROPY_HW_USB_xx
- powerctrl: support changing frequency on WB MCUs
- boards/NUCLEO_H743ZI2: add modified version of NUCLEO_H743ZI
- mbedtls: fix compile warning about uninitialized val
- enable MICROPY_PY_FSTRINGS by default
- add implementation of machine.bitstream
- Makefile: allow GIT_SUBMODULES and LIBS to be extended
- stm32_it: support TIM17 IRQs on WB MCUs
- disable computed goto on constrained boards
- storage: make extended-block-device more configurable
- boards/LEGO_HUB_NO6: change SPI flash storage to use hardware SPI
- boards/LEGO_HUB_NO6: skip first 1MiB of SPI flash for storage
- boards/LEGO_HUB_NO6: add make commands to backup/restore firmware
teensy port: no changes specific to this component/port
unix port:
- modffi: add option to lock GC in callback, and cfun access
- Makefile: add back LIB_SRC_C to list of object files
- variants: enable help and help("modules") on standard and dev
- Makefile: disable error compression on arm-linux-gnueabi-gcc
windows port:
- Makefile: add .exe extension to executables name
- appveyor: update to VS 2017 and use Python 3.8 for build/test
zephyr port:
- machine_spi: add support for hardware SPI
New mpremote tool, and the mimxrt port gets Pin, ADC, UART, RTC and VFS This release of MicroPython includes a new command-line tool called "mpremote", which is intended to be the main way to remotely control a MicroPython-based device from the command line. It features a serial terminal, filesystem access, support to mount a local directory on the remote device, and a macro language to define custom commands. This tool can be installed from PyPI via "pip3 install mpremote", and it works on Linux, Windows and Mac. As part of this, improvements were made to pyboard.py including opening serial ports in exclusive mode to more easily manage multiple devices. In the Python core, OSError exceptions now support the ".errno" attribute, and an option was added to compile MicroPython without error messages to further reduce code size where needed. The REPL was improved so that it does not tab-complete private methods (those starting with underscore, if no underscore has been typed yet), and it also now tab completes built-in module names after "import" is typed. There has been a minor breaking change to a relative import exception: what was previously a ValueError was changed to ImportError, following the same change in CPython. See commit 53519e3. In the extmod components, uctypes has a fix for the size and offset calculation for ARRAY of FLOAT32, uhashlib now raises an exception if a hash is reused after digest is called, and urandom supports passing 0 to getrandbits (following the CPython change). In uasyncio, the readinto method is added to the Stream class, and two race conditions were fixed: one with start_server and wait_closed, and the other with cancelling a task waiting on finished task; see de2e081 and 514bf1a respectively. The esp32 port now supports specifying FROZEN_MANIFEST with new CMake build system, has NeoPixel support on GPIO32 and GPIO33, network.LAN support in IDF v4.1 and above, and a new "reconnects" option in the WLAN STA interface to configure how many (if any) reconnection attempts are made if the WiFi goes down. Many features have been added to the mimxrt port, including: VFS filesystem support with internal flash storage, Pin, Pin.irq and ADC support, UART, SoftI2C and SoftSPI bus support, Timer and RTC classes, and floating point numbers. The rp2 port now has the machine.RTC class to configure the RTC, as well as new board definition files for SparkFun's Thing Plus RP2040 and Pro Micro boards. The stm32 port now supports static soft timers with a C-based callback, and mboot has been made more configurable, in particular the LEDs and reset mode selection can now be fully customised by a board. Two new boards have been added: VCC_GND_F407VE and VCC_GND_F407ZG. A bug fix was made to the SDIO driver to make sure DMA doesn't turn off mid-transfer; this affected WLAN operation when certain SPI buses were being used. See commit a96afae for details. Pin configuration of UART has been modified so pull-up is now configured only on RX and CTS, not TX and RTS; see 748339b. The USB_VCP class has a new irq method to set a callback on USB data RX events. The Ethernet driver now supports low-power mode, and has a fix so the link status is reported correctly. On the zephyr port, scheduled callbacks are now run at idle REPL and during sleeps, and there is an initial ubluetooth module which supports BLE scanning and advertising. Configuration is provided for the nucleo_wb55rg board. What follows is a detailed list of changes, generated from the git commit history, and organised into sections. Thanks to everyone who contributed to this release! Main components =============== all: - rename mp_keyboard_interrupt to mp_sched_keyboard_interrupt - replace busses with buses py core: - objexcept: support errno attribute on OSError exceptions - add option to compile without any error messages at all - dynruntime.h: add mp_obj_get_array() function - profile: use mp_handle_pending() to raise pending exception - scheduler: add mp_sched_exception() to schedule a pending exception - scheduler: add optional port hook for when something is scheduled - runtime: remove commented-out code from mp_deinit() - scheduler: add missing MICROPY_WRAP_MP_SCHED_EXCEPTION usage - repl: filter private methods from tab completion - repl: enter four spaces when there are no matches - repl: refactor autocomplete to reduce nesting - repl: refactor autocomplete, extracting reusable parts - repl: autocomplete builtin modules - gc: make gc_lock_depth have a count per thread - mkenv.mk: don't emit info about BUILD_VERBOSE if it's set - objarray: prohibit comparison of mismatching types - objarray: implement more/less comparisons for array - objarray: use mp_obj_memoryview_init helper in mp_obj_new_memoryview - objarray: fix constructing a memoryview from a memoryview - nlraarch64: add underscore prefix to function symbols for Darwin ABI - nlrx64: correct the detection of Darwin ABI - asmx64: support use of top 8 regs in src_r64 argument - emitnative: fix x86-64 emitter to generate correct 8/16-bit stores - mkrules.cmake: add MPY_LIB_DIR and BOARD_DIR to makemanifest call - asmarm: use builtin func to flush I- and D-cache on ARM 7 archs - compile: raise an error on async with/for outside an async function - gc: access the list of root pointers in an asan-compatible way - repl: don't read past the end of import_str - builtinimport: change relative import's ValueError to ImportError - emitglue: always flush caches when assigning native ARM code - stackctrl: prevent unused-var warning when stack checking disabled - gc: only use no_sanitize_address attribute for GCC 4.8 and above extmod: - uasyncio: use .errno instead of .args[0] for OSError exceptions - remove old comments used for auto-doc generation - moductypes: remove double blank lines and debugging printf's - moductypes: replace numbers with macro constants - moductypes: fix size and offset calculation for ARRAY of FLOAT32 - moduhashlib: put hash obj in final state after digest is called - modurandom: add error message when getrandbits has bad value - modurandom: support an argument of bits=0 to getrandbits - uasyncio: fix start_server and wait_closed race condition - uasyncio: add readinto() method to Stream class - uasyncio: fix race with cancelled task waiting on finished task - nimble: remove TODO comment about notify_custom freeing om lib: - utils: remove unused PYEXEC_SWITCH_MODE from pyexec.h - utils: add ARM semihosting utility functions - lwip: switch to use GitHub mirror repo - mbedtls: switch to currently latest commit of LTS branch v2.16 drivers: - sdcard: add sleep_ms(1) delay in SDCard.readinto sync loop - cyw43/cyw43_ctrl: use new sdio enable API functions - cyw43/cywbt: add compile option for RF switch - cyw43/cywbt: remove hard-coded UART6 alternate function setting - display/ssd1306.py: add rotate method - display/ssd1306.py: add support for 72x40 displays mpy-cross: no changes specific to this component/port Support components ================== docs: - library/machine: specify initial machine.PWM class - library/machine: add machine.bootloader docs - esp8266: add note about simultaneous use of STA_IF and AP_IF - esp8266: add instructions on entering programming mode manually - esp8266: clarify limitations of SSL in esp8266 and fix typos - fix some spelling mistakes - pyboard: fix typo in pyb.Switch tutorial - esp32: add UART to quickref - esp32: add WDT to quickref - esp32: add SDCard to quickref - esp8266: add WDT to quickref - library: add initial API reference for rp2 module and its classes - library/rp2.rst: fix typo overriden->overridden - esp32: add APA106 to quickref - esp32: mention Signal in GPIO section of quickref - esp8266: mention Signal in GPIO section of quickref - esp8266: add SSD1306 to quickref and tutorial - library: clarify what type of algorithm is implemented in heapq - library: add a blank line to fix formatting for ussl docs - library/pyb.Pin.rst: update the arguments for Pin.init() - rp2: add skeleton docs for the rp2 port - library/machine.RTC.rst: document datetime method and fix ex code - esp32: document WLAN "reconnects" config option examples: no changes specific to this component/port tests: - use .errno instead of .args[0] for OSError exceptions - run-multitests.py: provide some convenient serial device shorcuts - multi_bluetooth: add performance test for gatt char writes - thread: make stress_create.py test run on esp32 - thread: make stress_aes.py test run on bare-metal ports - thread: make exc1,exit1,exit2,stacksize1,start1 tests run on rp2 - run-perfbench.py: fix native feature check - run-multitests.py: flush stdout for each line of trace output - run-tests.py: parallelize running tests by default - cpydiff: add test and workaround for function.__module__ attr - make float and framebuf tests skip or run on big-endian archs - extmod/btree_gc.py: close the database to avoid a memory leak - basics: split out literal tests that raise SyntaxWarning on CPy - run-multitests.py: allow to work without sys.stdout on target - multi_bluetooth/ble_gap_advertise.py: allow to work without set - unix: add ffi test for integer types - cpydiff: add test for array constructor with overflowing value - float: make bytes/bytearray construct tests work with obj repr C tools: - metrics.py: add rp2 port to table of ports that can be built - upip.py: use .errno instead of .args[0] for OSError exceptions - pyboard.py: support opening serial port in exclusive mode - gen-cpydiff.py: fix formatting of doc strings for new Black - makemanifest.py: show directory name if there is a FreezeError - mpy_ld.py: support R_X86_64_GOTPCREL reloc for x86-64 arch - pydfu.py: remove default VID/PID values - ci.sh: update zephyr docker image to v0.17.3 - ci.sh: use FROZEN_MANIFEST in an esp32 build to test feature - mpy-tool.py: support relocating ARMv6 arch - tinytest-codegen.py: add command-line option to exclude tests - ci.sh: build Cortex-A9 sabrelite board as part of qemu-arm CI - pyboard.py: track raw REPL state via in_raw_repl variable - pyboard.py: add "soft_reset" option to Pyboard.enter_raw_repl() - mpremote: add new CLI utility to interact with remote device - ci.sh: build mpy-cross as part of ci_mimxrt_build - mpremote: use available ports instead of auto-connect list - mpremote: use signal to capture and handle ctrl-C on Windows CI: - workflows: add CI workflow for mimxrt port - workflows: add workflow to build and run unix port on MIPS - workflows: add workflow to build and run unix port on ARM The ports ========= bare-arm port: - switch to use MICROPY_ERROR_REPORTING_NONE to reduce size cc3200 port: no changes specific to this component/port esp8266 port: - modnetwork: use mp_handle_pending() to raise pending exception - boards/GENERIC_512K: add custom manifest without FS modules - update manifest to point to new dirs in micropython-lib - boards/GENERIC_512K: add custom minimal _boot.py esp32 port: - CMakeLists.txt: require CMake version 3.12 - restore FROZEN_MANIFEST support with new CMake build system - esp32_rmt: clear config struct before filling it out - mpthreadport: don't explicitly free thread struct in TCB cleanup - mpthreadport: use binary semaphore instead of mutex - extend support for S2 series, and S3 where applicable - boards: rename TINYPICO board to UM_TINYPICO - boards: add UM_FEATHERS2 and UM_TINYS2 board definitions - boards/UM_TINYPICO: fix include of sdkconfig fragment - machine_i2c: allow boards to configure I2C pins using new macros - boards: set default I2C and SPI pins on UM_xxx boards - boards: fix spelling mistakes in comments for UM_xxx boards - update manifest to point to new dirs in micropython-lib - boards: add M5STACK_ATOM board definition - espneopixel: add support for GPIO32 and GPIO33 - Makefile: fix wrong target for partition-table.bin - makeimg.py: load sizes from partition table and verify data fits - partitions-2MiB.csv: update table so firmware fits - README: describe how to select compatible version of existing IDF - network_lan: add Ethernet support for IDF v4.1 and above - modnetwork: add "reconnects" option to WLAN STA interface - machine_hw_spi: allow None for unused pins in initializer - machine_sdcard: use deinit_p to deinit SD bus in SPI mode javascript port: no changes specific to this component/port mimxrt port: - improve ticks and sleep functions using GPT - implement machine.Pin class - enable built-in help - extend the Pin module for SoftI2C, SoftSPI support - add custom help text and enable help("modules") - enable frozen modules - add flash storage support with VFS and littlefs filesystem - boards/TEENSY40: re-create the flash FS after deploy - add the Timer class to the machine module - remove __WFE() from MICROPY_EVENT_POLL_HOOK - machine_timer: reuse any existing timer objects - machine_timer: leave the Timer clock source at IPG clock - machine_rtc: add the RTC class to the machine module - add floating point support - enable many Python and some extmod features - machine_adc: add the ADC class to the machine module - boards: add board configuration files for Teensy 4.1 - machine_rtc: change RTC.datetime() tuple to match other ports - machine_rtc: maintain microsecond offset - machine_uart: add the UART class to the machine module - machine_pin: implement pin.irq() functionality - modutime: extend the time module minimal port: no changes specific to this component/port nrf port: - boards/microbit: use mp_sched_exception() where appropriate - add machine.memXX, and allow boards to customise some features - boards: add support for evk_nina_b3 board - add more math sources to Makefile, and enable log2 implementation pic16bit port: - Makefile: make the XC compiler version user-configurable powerpc port: no changes specific to this component/port qemu-arm port: - add support for Cortex-A9 via sabrelite board rp2 port: - boards: add board definition for SparkFun Thing Plus RP2040 - boards: add board definition for SparkFun Pro Micro board - tusb_port: add the device unique-id to the USB id - move manifest.py to boards directory - mpthreadport: add mp_thread_deinit to reset core1 on soft reset - CMakeLists.txt: include tinyusb_common in PICO_SDK_COMPONENTS - machine_rtc: add initial support for RTC - machine_rtc: check return value from rtc_set_datetime samd port: no changes specific to this component/port stm32 port: - boards/pllvalues.py: support wider range of PLL values for F413 - machine_timer: improve usability of Timer constructor and init - mboot: allow unpacking dfu without secret key - correct typos in project README files - uart: fix H7 UART clock source configuration - softtimer: add support for having a C-based callback - softtimer: support static soft timer instances - boardctrl: add constants for reset mode values - boardctrl: show first reset-mode state on LEDs when selecting - mboot: allow a board to add source files to the build - adc: allow mboot to use basic ADC functions - mboot: fix mp_hal_delay_us() and add mp_hal_ticks_ms() - mboot: allow a board to customise the linker scripts - mboot: allow mboot to be placed at any location in flash - sdcard: allow configuring the SDMMC periph used for SD/MMC card - uart: enable HW flow control for UART 1/5/7/8 - sdio: add functions to re/enable SDIO/SDIOIT - boards/PYBD_SF2: enable RF switch compile option - sdio: allow configuring the SDMMC periph used for SDIO - boards: change default LSI_VALUE to 32000 for F4 MCUs - powerctrl: add MICROPY_HW_ENTER_BOOTLOADER_VIA_RESET option - boardctrl: adjust logic for running boot.py, main.py - mboot: add MBOOT_LEAVE_BOOTLOADER_VIA_RESET option - mboot: make LEDs and reset-mode selection more configurable - boards: add VCC_GND_F407VE board - boards: add VCC_GND_F407ZG board - sdio: fix case of SDIO DMA turning off mid transfer - uart: configure pull-up only on RX and CTS, not TX and RTS - mboot: leave bootloader from thread mode, not from IRQ - boards/NUCLEO_L432KC: fix FS size and enable LFS1 filesystem - boards/PYBD_SF2: disable GCC 11 warnings for array bounds - usb: add USB_VCP.irq method, to set a callback on USB data RX - boards: enable MICROPY_HW_SPIFLASH_ENABLE_CACHE on VCC_GND boards - sdram: prevent array-bounds warnings with GCC 11 - eth: add low-power mode configuration option - eth: fix eth_link_status function to use correct BSR bit teensy port: - provide own implementation of gc_collect, to not use stm32 - correct typos in project README files unix port: - modffi: use a union for passing/returning FFI values - main: increase stack limit on ARM architectures - modffi: fix conversion between Python integers and ffi types - fix build on arm64-darwin due to integer cast windows port: - mpconfigport.h: enable features also present in unix port zephyr port: - run scheduled callbacks at REPL and during mp_hal_delay_ms - modmachine: add machine.idle() - boards: add config for nucleo_wb55rg board - update disk access configuration for Zephyr v2.6.0 - disable CONFIG_NET_SOCKETS_POSIX_NAMES - update to Zephyr v2.6.0 - add initial ubluetooth module integration - boards: enable ubluetooth on nucleo_wb55rg board
The esp32 port moves to CMake and has S2 support, new features for rp2 This release of MicroPython adds general support in the core for using CMake as a build system. The rp2 port is consolidated to use the new CMake files, and the esp32 and zephyr ports have switched to build as pure CMake projects. These three ports have SDKs which are built around CMake and this change should make them easier to maintain and use. As part of this work, CMake based ports now have support for user C modules. Authors of user C modules should now provide both .mk and .cmake configuration files (following the documentation and examples). A bug was fixed in the multiple precision integer library, an arithmetic overflow in the long division routine. Prior to this fix certain integer divisions would take excessive time and produce incorrect results. See commit 0a59938 for details. There was also a fix for regular expressions, to check and report byte overflow errors when compiling expressions. See commit 172fb52. In the uasyncio library, a new MicroPython extension has been added, ThreadSafeFlag, which can be set from outside the asyncio event loop, such as other threads, IRQs or scheduler context. It allows preemptive code like IRQs to signal asyncio tasks, which are by nature cooperative (non-preemptive). asyncio.current_task() has also been added, with the same semantics as CPython. As mentioned above, the esp32 port has switched to a full CMake-based project, and traditional make capability has been removed (although a simple helper Makefile remains to keep top-level build/deploy commands consistent with other ports). Because of the move to CMake, network.LAN support has been removed, to be added back in the future (use a prior release if LAN is needed). Basic support for Non-Volatile-Storage is added to the esp32 module. And there is also preliminary support for ESP32S2 SoCs and USB, with a GENERIC_S2 board defined. On the mimxrt and samd ports, USB CDC TX handling has been fixed so that it now works reliably. The rp2 port has had many more core Python features enabled, along with the enabling of ubinascii.crc32(), the uos.VfsFat and machine.Signal classes, and the uerrno module. uos.urandom() has been added and machine.freq() can now change the CPU clock frequency. The machine.UART class now has support for timeout/timeout_char, inverted TX/RX lines, and buffered TX/RX with configurable sized buffers. For PIO, StateMachine has added restart(), rx_fifo() and tx_fifo() helper functions, and support for FIFO joining. There is now support for user C modules (via CMake) and for building different board configurations (the default remains the PICO board). USB reliability has been improved. For the stm32 port, there is now more configuration options for boards, such as USBD VID/PID and fine-grained selection of modules. The UART class now supports LPUART on L0, L4, H7 and WB MCUs. WB MCUs have a fix for a race condition accessing the BLE ACL free buffer list, and a workaround for a low-level BLE bug. The zephyr port has been updated to use zephyr v2.5.0, and now builds MicroPython as a CMake target. What follows is a detailed list of changes, generated from the git commit history, and organised into sections. Main components =============== all: - rename BYTES_PER_WORD to MP_BYTES_PER_OBJ_WORD - add .git-blame-ignore-revs for fixing up git blame output py core: - gc: don't include mpconfig.h and misc.h in gc.h - remove BITS_PER_WORD definition - rename BITS_PER_BYTE to MP_BITS_PER_BYTE - rename WORD_MSBIT_HIGH to MP_OBJ_WORD_MSBIT_HIGH - gc: change include of stdint.h to stddef.h - mpz: fix overflow of borrow in mpn_div - add core cmake rule files - expand lists in core cmake custom commands - mkrules.cmake: rename QSTR_DEFS variables to QSTRDEFS - mkrules.cmake: add MICROPY_QSTRDEFS_PORT to qstr build process - nlr: implement NLR for AArch64 - nlrx64: fix typo in comment - vm: for tracing use mp_printf, and print state when thread enabled - rename remaining object types to be of the form mp_type_xxx - py.cmake: move qstr helper code to micropy_gather_target_properties - py.cmake: introduce MICROPY_INC_CORE as a list with core includes - profile: resolve name collision with STATIC unset - runtime: make sys.modules preallocate to a configurable size extmod: - vfs_posix_file: allow closing an already closed file - btstack: add HCI trace debugging option in btstack_hci_uart - btstack: add stub functions for passkey, l2cap bindings - btstack: enable SYNC_EVENTS, PAIRING_BONDING by default - uasyncio: add asyncio.current_task() - add core cmake rule files - nimble: ensure handle is set on read error - moduselect: fix unsigned/signed comparison for timeout!=-1 - uasyncio: add ThreadSafeFlag - nimble/hal/hal_uart: fix HCI_TRACE format specifiers - modbluetooth: allow NimBLE to use Zephyr static address - modussl: fix ussl read/recv/send/write errors when non-blocking - btstack: use MICROPY_HW_BLE_UART_BAUDRATE for first UART init - modbluetooth: separate enabling of "client" from "central" - extmod.cmake: add modonewire.c to MICROPY_SOURCE_EXTMOD list - modbluetooth: free temp arrays in gatts register services - re1.5: check and report byte overflow errors in _compilecode - extmod.cmake: add support to build btree module with CMake lib: - tinyusb: update to version 0.8.0 - mbedtls: switch to currently latest commit of LTS branch v2.16 - utils/gchelper_generic: implement AArch64 support - pico-sdk: update to latest version 1.1.0 drivers: no changes specific to this component/port mpy-cross: no changes specific to this component/port Support components ================== docs: - library/uasyncio.rst: add docs for ThreadSafeFlag - develop/cmodules.rst: document C-modules and micropython.cmake - develop: improve user C modules to properly describe how to build examples: - usercmodule: add micropython.cmake to the C and CPP examples - usercmodules: simplify user C module enabling - embedding: fix example so it compiles again tests: - extmod/vfs_posix.py: add more tests for VfsPosix class - extmod: add test for ThreadSafeFlag - multi_bluetooth: add basic performance tests - rename run-tests to run-tests.py for consistency - run-tests.py: reformat with Black - multi_bluetooth: skip tests when BLE features are unsupported - extmod/vfs_fat_fileio2.py: close test file at end of test - run-tests.py: provide more info if script run via pyboard crashes - feature_check: check for lack of pass result rather than failure - net_inet: add 'Strict-Transport-Security' to exp file tools: - add filesystem action examples to pyboard.py help - ci.sh: change esp32 CI to work with idf.py and IDF v4.0.2 - makemanifest.py: allow passing option args to include() - ci.sh: update zephyr docker image to v0.11.13 - verifygitlog.py: show required format regexp in error message - pydfu.py: support DFU files with elements of zero size - ci.sh: add CI for CMake USER_C_MODULE support - ci.sh: build user C modules for esp32 - metrics.py: fix esp32 output filename due to move to CMake - ci.sh: build esp32 using IDF v4.0.2 and v4.3 The ports ========= all ports: - remove def of MP_PLAT_PRINT_STRN if it's the same as the default - update to build with new tinyusb bare-arm port: - clean up the code, make it run on an F405, and add a README cc3200 port: no changes specific to this component/port esp8266 port: - modules: fix fs_corrupted() to use start_sec not START_SEC esp32 port: - add support to build using IDF with cmake - esp32_rmt: don't do unnecessary check for unsigned less than zero - add explicit initialisers to silence compiler warnings - remove traditional "make" capability - boards: remove old IDF v3 sdkconfig values - boards: enable BLE on all boards - README: update based on new IDF v4 cmake build process - add support to build with ESP-IDF v4.1.1 - add support to build with ESP-IDF v4.2 - remove obsolete IDF v3 code wrapped in MICROPY_ESP_IDF_4 - modsocket: remove unix socket error code translation - set MICROPY_USE_INTERNAL_ERRNO=0 to use toolchain's errno.h - boards: enable size optimisation for builds - add support to build with ESP-IDF v4.3 pre-release - add basic support for Non-Volatile-Storage in esp32 module - make machine.soft_reset() work in main.py and reset_cause() - define MICROPY_QSTRDEFS_PORT to include special qstrs - Makefile: specify port and baud on erase_flash command - machine_hw_spi: use default pins when making SPI if none given - restore USER_C_MODULE support with new CMake build system - fix multiple definition errors with mp_hal_stdout_tx functions - enable btree module - modsocket: correctly handle poll/read of unconnected TCP socket - add initial support for ESP32S2 SoCs - add support for USB with CDC ACM - boards: add GENERIC_S2 board definition - machine_pin: use rtc_gpio_deinit instead of gpio_reset_pin javascript port: no changes specific to this component/port mimxrt port: - fix USB CDC handling so it works reliably - boards: add MIMXRT1050_EVK board, based on MIMXRT1060_EVK - enable CPYTHON_COMPAT, PY_ASYNC_AWAIT, PY_ATTRTUPLE options minimal port: no changes specific to this component/port nrf port: - drivers/usb: add USBD_IRQHandler which calls tud_int_handler pic16bit port: no changes specific to this component/port powerpc port: no changes specific to this component/port qemu-arm port: no changes specific to this component/port rp2 port: - machine_adc: only initialise the ADC periph if not already enabled - micropy_rules.cmake: fix makemoduledefs vpath to work with abs path - use local tinyusb instead of the one in pico-sdk - enable MICROPY_PY_UBINASCII_CRC32 to get ubinascii.crc32() - enable VfsFat class for FAT filesystem support - machine_uart: add timeout/timeout_char to read and write - machine_uart: add support for inverted TX and RX lines - rp2_pio: allow more than 8 consecutive pins for PIO out/set/sideset - rp2_pio: fix sm.get(buf) to not wait after getting last item - modmachine: allow changing CPU clock frequency - modmachine: re-init UART for REPL on frequency change - rp2_flash: prevent MICROPY_HW_FLASH_STORAGE_BASE being set negative - enable uerrno module - enabled more core Python features - modmachine: enable machine.Signal class - use core-provided cmake fragments instead of custom ones - mpthreadport.h: cast core_state to _mp_state_thread_t - add support for USER_C_MODULES to CMake build system - don't advertise remote wakeup for USB serial - CMakeLists.txt: enable USB enumeration fix - import uarray instead of array in rp2 module - rp2_pio: validate state machine frequency in constructor - moduos: implement uos.urandom() - rp2_pio: add StateMachine restart,rx_fifo,tx_fifo helper functions - machine_uart: add buffered transfer of data with rxbuf/txbuf kwargs - add support for building different board configurations - rp2_pio: add fifo_join support for PIO samd port: - mphalport: fix USB CDC tx handling to work reliably stm32 port: - uart: add uart_set_baudrate function - mpbthciport: only init the uart once, then use uart_set_baudrate - mboot: add unpack-dfu command to mboot_pack_dfu.py tool - usb: allow a board to configure USBD_VID and all PIDs - make pyb, uos, utime, machine and onewire modules configurable - boards: disable onewire module on boards with small flash - mpbthciport: fix initial baudrate to use provided value - mpbthciport: use mp_printf instead of printf for error message - mpbtstackport: allow chipset and secondary baudrate to be set - mboot: after sig verify, only write firmware-head if latter valid - uart: add support for LPUART1 on L0, L4, H7 and WB MCUs - boards/NUCLEO_WB55: enable LPUART1 on PA2/PA3 - enable MICROPY_PY_UBINASCII_CRC32 to get ubinascii.crc32() - rfcore: allow BLE settings to be changed by a board - storage: prevent attempts to read/write invalid block addresses - make-stmconst.py: allow "[]" chars when parsing source comments - main: fix passing state.reset_mode to init_flash_fs - powerctrl: save and restore EWUP state when configuring standby - spi: fix baudrate calculation for H7 series - boardctrl: add MICROPY_BOARD_STARTUP hook - Makefile: fix C++ linker flags when toolchain has spaces in path - Makefile: allow QSTR_DEFS,QSTR_GLOBAL_DEPENDENCIES to be extended - include .ARM section in firmware for C++ exception handling - powerctrl: allow a board to configure AHB and APB clock dividers - powerctrl: support using PLLI2C on STM32F413 as USB clock source - boards/pllvalues.py: relax PLLQ constraints on STM32F413 MCUs - mpconfigport.h: add support for a board to specify root pointers - boardctrl: give boards control over execution of boot.py,main.py - boards/NUCLEO_L476RG: add 5 remaining UARTs - rfcore: fix race condition with C2 accessing free buffer list - rfcore: intercept addr-resolution HCI cmd to work around BLE bug - boards: split UARTx_RTS_DE into UARTx_RTS/UARTx_DE in pin defs - uart: use LL_USART_GetBaudRate to compute baudrate - sdram: make MICROPY_HW_FMC_BA1,MICROPY_HW_FMC_A11 optional pins teensy port: no changes specific to this component/port unix port: - mpbtstackport_common: implement mp_bluetooth_hci_active - moduselect: don't allow both posix and non-posix configurations - improve command line argument processing - main: make static variable that's potentially clobbered by longjmp windows port: no changes specific to this component/port zephyr port: - update to zephyr v2.5.0 - disable frozen source modules - remove unused build files - build MicroPython as a cmake target - boards: add support for the nucleo_h743zi board - modusocket: fix parameter in calls to net_context_get_XXX()
New rp2 port, BLE pairing, bonding and l2cap APIs, and docs on internals This release of MicroPython sees the addition of a new "rp2" port for the new Raspberry Pi RP2040 microcontroller, a dual-core Cortex-M0+ MCU with programmable IO. This port is built on the pico-sdk and MicroPython sits very close to the bare metal. The programmable IO is supported via the @rp2.asm_pio decorator which allows writing inline assembler to be run on the PIO state machines. The ubluetooth module has seen significant improvements, fixes and additions. BLE events are now synchronous on unix and stm32 so that user Python callbacks are called directly from the BLE stack (from NimBLE). This helps with the new pairing and bonding API. There is also a new l2cap API for much faster raw data transfer between BLE devices. Many new sections have been added to the existing "Developing and building MicroPython" chapter to make it all about the internals of MicroPython, including details about the MicroPython compiler, and how to port to a new system. This documentation work was done as part of Google's Season of Docs 2020. The native emitter and inline assembler now fully support ARMv6M, for Cortex-M0+ CPUs. There is also support added for C++ user modules on unix, stm32 and esp32. And reproducible builds can now be achieved by setting SOURCE_DATE_EPOCH in the shell build environment. Qstr preprocessing is now done in parallel to speed up building, and there is a new tools/ci.sh script with all functionality to run the continuous integration tests. The machine.I2C and machine.SPI classes have been modified so they no longer construct both software- and hardware-based peripheral instances. Such construction is now split to explicit soft and non-soft types by the introduction of machine.SoftI2C and machine.SoftSPI classes. See below for more information. The wait_for function in uasyncio now handles cancellation correctly, VfsLfs supports mounting in read-only mode, and the urandom module will randomise its seed on import on stm32, esp8266, esp32 and rp2 ports. A new raw-paste mode is added to the REPL which includes flow control between the device and host, as well as a mechanism where the device pulls in data from the host as it parses the input. This makes pasting code faster, more reliable and use less memory. This feature is supported on all ports that have a raw REPL and still supports previous REPL behaviour. See the documentation for more detail on this raw-paste mode. The stm32 port sees improved rfcore support for WB MCUs, including flash locking for writes when BLE is active, and a script for automatic update of FUS/WS firmware. New hooks are added for boards to configure the top level behaviour of the system in stm32_main, and there is now support for Ethernet on H7 processors. Mboot now allows signed and encrypted firmware updates. Breaking changes in this release are: - The "sys" module is renamed to "usys". Ports that do not enable module weak links must replace "import sys" with "import usys as sys". See commit 40ad8f1 - machine.I2C and machine.SPI constructors are changed when using software-based I2C and SPI. Code that constructed I2C/SPI peripherals in the following way will need to be changed (or else their use will emit a warning which will eventually be an error): machine.I2C(-1, ...) -> machine.SoftI2C(...) machine.I2C(scl=scl, sda=sda) -> machine.SoftI2C(scl=scl, sda=sda) machine.SPI(-1, ...) -> machine.SoftSPI(...) machine.SPI(sck=sck, mosi=mosi, miso=miso) -> machine.SoftSPI(sck=sck, mosi=mosi, miso=miso) Code which uses machine.I2C and machine.SPI classes to access hardware peripherals does not need to change. See commits 39d50d1 and 98182a9 - In ubluetooth, the BLE.irq() method now has positional only arguments. See commit 6a6a5f9 - In ubluetooth, arguments passed to the BLE.irq() callback that were previously bytes objects are now memoryview objects. See commit 81f2162 What follows is a detailed list of changes, generated from the git commit history, and organised into sections. Main components =============== all: - rename "sys" module to "usys" - rename absolute time-based functions to include "epoch" py core: - objfloat: fix handling of negative float to power of nan - fix handling of NaN in certain pow implementations - showbc: pass in an mp_print_t struct to all bytecode-print functions - parse: pass in an mp_print_t to mp_parse_node_print - dynruntime.h: add mp_import_* and mp_load/store_* - objstr: make bytes(bytes_obj) return bytes_obj - objarray.h: add mp_obj_memoryview_init() helper function - makeversionhdr.py: match only git tags which look like versions - parse: expose rule-name printing as MICROPY_DEBUG_PARSE_RULE_NAME - objdict: add mp_const_empty_dict_obj, use it for mp_const_empty_map - objtype: handle __dict__ attribute when type has no locals - scope: name and use id_kind_type_t - objexcept: compare mp_emergency_exception_buf_size signed - use unsigned comparison of chars - add explicit initializers for default values - vmentrytable: ignore GCC -Woverride-init - introduce and use MP_FALLTHROUGH macro - makeqstrdefs.py: fix beaviour when scanning non-C preprocessed files - makeqstrdefs.py: process C++ files as well - mkrules.mk: add target for compiling C++ files - makeqstrdefs.py: support preprocessing C++ files for QSTR generation - workaround clang error when building misc.h with C++ compiler - py.mk: support C++ code for user C modules - mpz: do sign extension in mpz_as_bytes for negative values - binary: fix sign extension setting wide integer on 32-bit archs - mpprint: prevent case fall-through when assert is disabled - mpprint: fix length calculation for strings with precision-modifier - modmath: simplify handling of positional args to reduce code size - mkrules.mk: remove stray vpath and unused -Itmp, add $(Q) for $(AR) - objfun: support fun.__globals__ attribute - asmthumb: add support for ARMv6M in native emitter - emitnative: ensure encoding to load prelude_offset doesn't change sz - emitinlinethumb: exclude code using #if when ARMV7M disabled - emitnative: support binary ops on ARMv6M without use of ite instr - qstr.h: remove QSTR_FROM_STR_STATIC macro - gc: fix debug printing of pointer - persistentcode: introduce MICROPY_PERSISTENT_CODE_SAVE_FILE option - makeversionhdr: honor SOURCE_DATE_EPOCH if present extmod: - modbluetooth: rename logging macro to be just DEBUG_printf - modbluetooth: refactor stack/hci/driver/port bindings - nimble: set struct alignment correctly on 64-bit arch - nimble: make nimble_malloc work with allocated size - nimble: implement NimBLE mutex - modbluetooth: implement configuration of address modes - modbluetooth: allow using mp_hal_get_mac as a static address - btstack: add btstack support for _IRQ_GATTS_READ_REQUEST - btstack: detect HCI UART init failure - nimble: add timeout for HCI sync on startup - modussl_axtls: reduce size of code that makes exception - modbluetooth: fix handling of optional data/uuid args - modbluetooth: make BLE.irq() method positional only - modbluetooth: print UUIDs correctly - modbluetooth: implement MTU - vfs: fix lookup of entry in root dir so it fails correctly - modbluetooth: change module-owned bytes objects to memoryview - modure: allow \\ in re.sub replacements - machine_i2c: rename type to SoftI2C and add custom print method - machine_i2c: remove "id" arg in SoftI2C constructor - machine_spi: remove "id" arg in SoftSPI constructor - utime_mphal: add generic utime.time_ns() function - add explicit initializers for default values - disable -Wmissing-field-initializers for lfs2 - introduce and use MP_FALLTHROUGH macro - vfs_lfs: support mounting LFS filesystems in read-only mode - modurandom: support urandom.seed() without an argument - btstack/btstack.mk: add -Wimplicit-fallthrough=0 - nimble/nimble.mk: add -Wno-old-style-declaration - moductypes: fix storing to (U)INT64 arrays on 32-bit archs - machine_mem: only allow integers in machine.memX subscript - modbluetooth: make UUID type accessible outside modbluetooth.c - modbluetooth: combine gattc-data-available callbacks into one - nimble: poll startup directly rather than using NimBLE sem - modbluetooth: re-instate optional no-ringbuf modbluetooth - nimble: make stm32 and unix NimBLE ports use synchronous events - machine_i2c: add init protocol method for generic I2C bindings - modbluetooth: add API for L2CAP channels - nimble/modbluetooth_nimble: fix build when l2cap unavailable - uasyncio: delay calling Loop.call_exception_handler by 1 loop - uasyncio: add Task.done() method - uasyncio: fix cancellation handling of wait_for - nimble: fail read if the characteristic is too big - modbluetooth: add _IRQ_CONNECTION_UPDATE event - modbluetooth: allow setting char/desc enc/auth options - modbluetooth: allow user-specified reason in read request IRQ - modbluetooth: add compile-config flag to enable pairing/bonding - modbluetooth: add _IRQ_ENCRYPTION_UPDATE event - modbluetooth: allow configuration of pairing/bonding parameters - modbluetooth: add gap_pair(conn_handle) func to intiate pairing - modbluetooth: add support for bonding (key persistence) - modbluetooth: simplify synchronous invoke_irq_handler signature - modbluetooth: add support for passkey authentication - nimble: generate and persist a unique IRK - modubinascii: update code, docs for hexlify now CPython has sep - vfs: raise OSError(ENODEV) if mounting bdev without a filesystem - nimble: reset NimBLE BSS in mp_bluetooth_init - nimble: don't assert on save-IRK failure - modbluetooth: add ble.hci_cmd(ogf, ocf, req, resp) function - vfs: check block 0 and 1 when auto-detecting littlefs - modframebuf: change int to unsigned int in format methods args - modonewire: use pin_od_high/pin_od_low instead of pin_write - nimble: improve the flow control for l2cap recv path lib: - libm: reduce size of static two_over_pi array - utils/mpirq: add mp_irq_init func, and clean up unused init method - utils/pyexec: add MICROPY_BOARD hooks before/after executing code - utils/pyexec: add stdin-reader on raw REPL with flow control - littlefs: update littlefs2 to v2.3.0 - littlefs: guard lfs2_mlist_isopen with LFS2_NO_ASSERT - stm32lib: update library for WB v1.10.0 - libhydrogen: add new libhydrogen submodule - timeutils: provide simple impl of extra funcs when Epoch is 1970 - pico-sdk: add new pico-sdk submodule, for the rp2 port - utils/pyexec: remove obsolete LCD initialization - pico-sdk: update to latest version v1.0.1 drivers: - memory/spiflash: add MICROPY_HW_SPIFLASH_ENABLE_CACHE option mpy-cross: - enable more warnings Support components ================== docs: - library/ubluetooth.rst: document BLE address modes - library/ubluetooth.rst: clarify position/kw arguments - library/ubluetooth.rst: clarify peripheral/central vs server/client - library/ubluetooth.rst: add docs for MTU API - develop: add notes on prerequisite tools for building native .mpy - reference/packages.rst: fix typo, remove duplicate "port" - update I2C and SPI docs to add reference to SoftI2C and SoftSPI - library/btree.rst: correct method typo: __detitem__ to __delitem__ - library/machine.rst: correct minor typo: timout to timeout - library/machine.Signal.rst: correct typo: usecases to use cases - library/machine.Timer.rst: add mention of constructor arguments - reference/glossary.rst: fix minor grammar error, An -> A - fix reference to QSTR_GEN_CFLAGS Makefile flag - develop/cmodules.rst: add link to source code for user C example - library/ubluetooth.rst: add docs for L2CAP channels - reference/repl.rst: add information about new raw-paste mode - library/ubluetooth.rst: add _IRQ_CONNECTION_UDPATE docs - library/ubluetooth.rst: update char/desc flags - library/ubluetooth.rst: update read request IRQ docs - library/ubluetooth.rst: add pairing/bonding config docs - library/ubluetooth.rst: add gap_pair() docs - library/ubluetooth.rst: add bonding docs - library/ubluetooth.rst: add passkey docs - develop: add MicroPython Internals chapter - fix minor typos in RTC docs, and->an - esp8266/quickref: add warning block about NeoPixel timing - develop/natmod: fix a small typo, con->can - update copyright year range to include 2021 examples: - bluetooth: update to use positional-only args to irq() - add example code for user C modules, both C and C++ - bluetooth: add bonding/passkey demo - rp2: add pio_uart_rx.py example tests: - multi_bluetooth: update to new config('mac') behaviour - multi_bluetooth: make ble_gap_connect robust against event timing - multi_bluetooth: update UUID format in .exp files - run-multitests.py: show test/truth diff - multi_bluetooth/ble_mtu.py: add multitest for BLE MTU - basics: enable == and != special-method tests now that they work - basics: add test for MICROPY_PY_ALL_INPLACE_SPECIAL_METHODS ops - run-tests: use -BS flags when running CPython - thread/stress_schedule.py: assign globals before running test - micropython/extreme_exc.py: unlink alloc'd lists earlier in chain - run-multitests.py: fix diff order, show changes relative to truth - multi_bluetooth: improve reliability of event waiting - run-multitests.py: add a -p flag to run permutations of instances - multi_bluetooth: change dict index-and-del to pop, to clear event - multi_bluetooth: add a test for WB55 concurrent flash access - multi_bluetooth: add L2CAP channels multi-test - extmod: add vfs_posix.py test for uos.VfsPosix class - run-tests: update skipped tests on CI for GitHub Actions - multi_bluetooth: add multitests for BLE pairing and bonding - misc/sys_settrace_features.py: ignore CPython zipimport traces - extmod: add test to try and mount a block device directly - misc/sys_settrace: make test output independent of invoked path - misc/sys_settrace_features.py: fix running with non-dflt encoding - extmod: add test for the precision of utime functions - move native for test from pybnative to micropython - extmod/utime_time_ns.py: relax bounds on time_ns measurement - run-tests: change default Python command used on Windows tools: - mpy-tool.py: fix merge of multiple mpy files to POP_TOP correctly - write msvc-compatible frozen content - upip.py: support explicit port number in host - makeqstrdefs.py: run qstr preprocessing in parallel - ci.sh: add helper script to run CI tasks - pyboard.py: add fast raw-paste mode - ci.sh: put echo of CI path in a separate function - ci.sh: use pip-install to get latest version of esptool.py - ci.sh: pip install pyhy for stm32 builds - ci.sh: for code size build, fetch history of master branch only - ci.sh: for ci_code_size_setup, update apt to install gcc-multilib - mpy-tool.py: list frozen modules in MICROPY_FROZEN_LIST_ITEM - verifygitlog.py: add script for verifying commit message format - makemanifest.py: add check that freeze path is a directory - remove obsolete upip bootstrap script CI: - install setuptools for black code formatting - update zephyr build to v2.4.0 - stop using Travis for CI - workflows: add workflows for all CI tasks, builds and tests - workflows: run unix and qemu-arm workflows when tests change - workflows: fix code-size CI workflow - workflows: add CI workflow for rp2 port - workflows: add workflow to verify commit message format - workflows/ports_unix.yml: add job for a reproducible build The ports ========= all ports: - add utime.gmtime() function - add SoftI2C and SoftSPI to machine module where appropriate - support legacy soft I2C/SPI construction via id=-1 arg - use correct in/out endpoint size in TUD_CDC_DESCRIPTOR cc3200 port: - ftp: add quotes to PWD response and allow FEAT prior to login - fix debug build esp8266 port: - remove release-specific manifest, disable osdebug by default - mpconfigport.h: seed the urandom module on import - remove "FAT" from warning message in inisetup.py - modules/neopixel.py: add timing param to NeoPixel constructor esp32 port: - pin MicroPython and NimBLE tasks to core 0 - mpconfigport.h: remove duplicate uhashlib registration - boards/sdkconfig.base: set default IDF log level to ERROR - modnetwork: re-enable PPP support for IDF-SDK >=v4 - use path relative to root for netutils/timeutils headers - mpconfigport.h: enable MICROPY_PY_DELATTR_SETATTR - mpconfigport.h: seed the urandom module on import - support building C++ code - machine_pin: reset pin if init sets mode - remove "FAT" from warning message in inisetup.py - modnetwork: synchronize WiFi AUTH_xxx constants with IDF values javascript port: no changes specific to this component/port mimxrt port: - boards: add MIMXRT1064_EVK board minimal port: no changes specific to this component/port nrf port: - main: make mp_builtin_open signature match that in py/builtin.h - remove unnecessary includes of mpconfigport.h and its header guard - README: describe Pin numbering scheme for nRF52840 - boards: update memory.ld to include bootloader offsets - Makefile: add bootloader specific section - Makefile: add support for flashing with nrfutil - boards: add linker script for nrf52840 Open Bootloader 1.2.0 - change selected boards to utilize pre-flashed bootloader - README: add use of "make submodules" in alternative build paragraph pic16bit port: no changes specific to this component/port powerpc port: no changes specific to this component/port qemu-arm port: no changes specific to this component/port rp2 port: - add new port to Raspberry Pi RP2 microcontroller - machine_pin: change N_GPIOS to NUM_BANK0_GPIOS for pico-sdk compat - memmap_mp.ld: update for latest SDK - rp2_pio: add JMP PIN support for PIO - modmachine: implement additional functions incl unique_id and idle samd port: no changes specific to this component/port stm32 port: - mpconfigport.h: enable MICROPY_PY_REVERSE_SPECIAL_METHODS - uart: allow static IRQ handler registration - modbluetooth_hci: use a static mp_irq_obj_t for BT HCI UART IRQ - mpbthciport: increase char timeout of BT HCI UART - make-stmconst.py: add support for WB55 header files - rfcore: update rfcore.c to match how ST examples work - boards/USBDONGLE_WB55: add USE_MBOOT support - powerctrlboot: acquire HSEM5 on STM32WB during SystemClock_Config - rfcore: fix length matching in HCI parser - rfcore: refactor some helper funcs, and remove some magic numbers - rfcore: enable RX IRQ on BLE IPCC channel for better performance - boards/NUCLEO_WB55: add Python helper code for rfcore - usb: don't nul pyb_hid_report_desc if MICROPY_HW_USB_HID disabled - rtc.h: include py/obj.h to make header self contained - servo: fix angle and speed methods to work again with -ve args - led: support PWM output without TIM3 - rfcore: fix FUS layout and size of ipcc_device_info_table_t - Makefile: allow boards to extend SRC_C, SRC_O and OBJ variables - sdio: don't change any DMA2 settings on H7 MCUs - sdcard: fix H7 build when using SDMMC2 - rfcore: add Python API for basic rfcore operations - boards/NUCLEO_WB55: add standalone WB55 FUS/WS firmware updater - rfcore: update to support WS=1.9.0.0.4 - boards/NUCLEO_WB55/rfcore_firmware.py: fix flash unlock - boards/NUCLEO_WB55/rfcore_firmware.py: fix bad variable name - boards/NUCLEO_WB55/rfcore_firmware.py: increase GET_STATE timeout - fix broken build when FAT FS multi-partition is disabled - usbd_cdc_interface: check and handle CDC TX wrap-overflow - machine_adc: fix ADC auto-calibration to run when ADC not enabled - mpconfigport.h: seed the urandom module on import - rng: use SysTick+RTC+unique-id to seed pRNG for MCUs without RNG - boards: factor out common data/bss/heap/stack linker sections - support C++ code and user C modules written in C++ - main: move update_reset_mode to outside the soft-reset loop - add MICROPY_BOARD calls in various places in stm32_main - boardctrl: define MICROPY_BOARD_EARLY_INIT alongside others - Makefile: make the generation of `firmware.bin` explicit - Makefile: allow boards to extend all SRC variables - rtc: validate the RTC prescaler on boot and change if incorrect - rfcore: make RX IRQ schedule the NimBLE handler - flash: implement WB55 flash locking - rfcore: don't send HCI ACL cmds while another is pending - rfcore: depend on NimBLE only when BLE enabled - modmachine: add device and revision ids to machine.info() - Makefile: disable text compression in debug builds - powerctrl: define RCC_SR_SFTRSTF flag for H747 - powerctrl: fix STOP mode voltage scaling on H7 REV V devices - powerctrl: on H7, re-enable disabled OSCs/PLLs on exit from STOP - powerctrl: disable RTC write protection before changing flags - powerctrl: set H7 RTC wakeup flags - powerctrl: ensure SysTick is disabled on STOP mode entry for H7 - i2c: factor I2C finding code to i2c_find_peripheral function - add support for a board to reserve certain peripherals - Makefile: change -O0 to -Og for DEBUG=1 builds - boards/stm32h743.ld: enable D2 RAM and add eth-buffer section - eth: add support for H7 processors - boards/NUCLEO_H743ZI: enable ethernet peripheral - mboot: enable LFS2_READONLY for mboot builds with littlefs - usb: allocate 128 bytes to CDC data out EPs on non-multi-OTG MCUs - pyb_can: add ability to calculate CAN bit timing from baudrate - system_stm32: enable DBGMCU in low-power modes for debug builds - sdram: add SDRAM enter/leave self-refresh mode functions - adc: deselect VBAT after reading to prevent battery drain - main: do extended readblocks call when auto-detecting littlefs - boards/PYBD_SF2: disable SPIFLASH_ENABLE_CACHE for mboot builds - mboot/gzstream: fix lost data decompressing final part of file - mboot: add support for signed and encrypted firmware updates - boards/NUCLEO_WB55: enable MBOOT with packing mode - Makefile: use MBOOT_PACK_KEYS_FILE as depedency of .pack.dfu - main: check block 0 and 1 when auto-detecting littlefs - mboot: don't auto-detect littlefs block size - mboot: add ELEM_TYPE_STATUS element so application can get status - mboot: introduce MBOOT_ERRNO_xxx constants and use them - mboot/fwupdate.py: refactor update_mpy with support for STATUS - main: introduce MICROPY_HW_FLASH_MOUNT_AT_BOOT config option - rfcore: fix flow control for IPCC RX IRQ - fix minor typos in RTC docs, and->an - usbd_cdc_interface: don't wait in usbd_cdc_tx_always if suspended - mboot: change debug compiler optimisation from -O0 to -Og teensy port: - fix build errors and warnings and enable -Werror unix port: - Makefile: always enable -f*-sections regardless of DEBUG setting - implement BLE H4 HCI UART for btstack/nimble - implement mp_hal_time_ns using gettimeofday - variants: enable MICROPY_DEBUG_PARSE_RULE_NAME on coverage build - mpconfigport.h: enable MICROPY_PY_DELATTR_SETATTR - enable more warnings - support building C++ code - Makefile: move coverage.c and coveragecpp.cpp to coverage variant - handle pending events/scheduler in MICROPY_EVENT_POLL_HOOK - make mp_hal_delay_ms run MICROPY_EVENT_POLL_HOOK - modtime: fix time() precision on unix ports with non-double floats windows port: - msvc: support freezing modules - Makefile: support freezing modules - show test failures in the Appveyor builds - update build instructions in README - implement mp_hal_time_ns using gettimeofday - msvc: use same default python command as core zephyr port: - replace zephyr integer types with C99 types - const-ify struct device instance pointers - update build instructions to v2.4.0 - replace broken shell_net_iface() with more general shell_exec() - guard I2C code with appropriate ifdef config - add basic UART functionality to machine module - machine_uart: fix arg of machine_uart_ioctl to make it uintptr_t
New uasyncio module, code formatting, BTstack bindings with unix support This release of MicroPython includes a new implementation of the uasyncio module which aims to be more compatible with CPython's asyncio module. The main change is to use a Task object for each coroutine, allowing more flexibility to queue tasks in various places, eg the main run loop, tasks waiting on events, locks or other tasks. It no longer requires pre-allocating a fixed queue size for the main run loop. A pairing heap is used to queue Tasks, and the core is optionally implemented in C. Most code in this repository is now auto-formatted using uncrustify for C code and Black for Python code. The tools/codeformat.py script is used to apply this formatting. Options for uncrustify were chosen to match as closely as possible the existing C style, but there were nevertheless quite a few changes to make the code style consistent. BlueKitchen BTstack bindings have been added for the ubluetooth module, as an optional alternative to the NimBLE stack. The unix port can now be built with BLE support using these bindings, which works with USB Bluetooth adaptors (this feature is enabled by default on the dev and coverage variants). Other Bluetooth additions include: new events for service/characteristic/ descriptor discovery complete; new events for read done and indicate acknowledgement; and support for active scanning in BLE.gap_scan(). See also below for breaking changes to the ubluetooth BLE API. PEP 526 has been implemented which adds new syntax for variable annotations, such as "x:int = 1". PEP 572 has also been implemented, which adds the ":=" operator for assignment expressions, such as "if x := 1:...". The whole code base now supports compressing error messages (those strings used as arguments to exception instances) using a "common word" scheme, which can be used to reduce code size. Other new features include: support for non-boolean results for equality and inequality tests; the addition of the micropython.heap_locked() function to test the state of the heap; binary operations for viper uint operands in the native emitter; and mtime support on littlefs v2 filesystems (which can be disabled if needed). There has been an important bug fix when importing ARM machine code from an .mpy file: the system now correctly tracks the executable memory allocated to the machine code so this memory is not reclaimed by the garbage collector. For testing, a multi-instance test runner has been added (see tests/run-multitests.py) which allows running a synchronised test across two or more MicroPython targets. This is currently used for network and BLE tests that require communication between multiple devices. In the unix port different builds are now organised into build variants, analogous to boards on bare-metal. And PEP 475 has been implemented which retries syscalls failing with EINTR. The stm32 port sees improved support for STM32WB MCUs, with ADC, SPI and DMA support, along with support in mboot for these MCUs. Mboot also adds optional littlefs support. The esp8266 port now includes three generic board definitions: GENERIC_512K, GENERIC_1M and GENERIC, with the latter for modules with 2M or more of flash. This port also changed the default filesystem to littlefs, and no longer supports hard pin IRQs. See breaking changes below for more details. The esp32 port now enables Bluetooth support (via NimBLE) on both IDF v3 and v4 builds. It also changes the default filesystem from FAT to littlefs v2 (but existing devices with FAT filesystems will continue to work without change). There is also a new mimxrt port which targets NXP i.MX RT series CPUs. Breaking changes in this release are: - async-for no longer await's on the result of __aiter__. The __aiter__ method should return an async-iterable object but is not itself awaitable. See commit 37e1b5c - In ubluetooth, the IRQ event constants have all changed value (from a bitfield to a sequential integer) and Python code should be updated accordingly by replacing the const definitions with the new ones, which can be found at https://docs.micropython.org/en/latest/library/ubluetooth.html#ubluetooth.BLE.irq See also commit e6881f0 - In ubluetooth, the IRQ data for the _IRQ_SCAN_RESULT event has had the "connectable" entry changed to "adv_type". The existing connectable value was a boolean and True now becomes 0x00, False becomes 0x02. See commit dd0bc26 - For esp8266, the default filesystem has changed from FAT to littlefs v2. And the flash layout of the firmware and filesystem has changed to give more space to the firmware and frozen bytecode. When upgrading an existing esp8266 device the filesystem will be reformatted so files should be backed up first. See commit e0905e8 - For esp8266, machine.Pin no longer supports configuring a pin IRQ with "hard=True" (because the interrupt handling code is moved to iRAM). Existing code using pin IRQs should remove any "hard=True" argument. See commit 0bd58a5 - For the unix port, binaries are renamed to micropython-variant (no longer micropython_variant). See commit 977b532 What follows is a detailed list of changes, generated from the git commit history, and organised into sections. Main components =============== all: - reformat C and Python source code with tools/codeformat.py - convert exceptions to use mp_raise_XXX helpers in remaining places - remove spaces between nested paren and inside function arg paren - remove spaces inside and around parenthesis - fix implicit casts of float/double, and signed comparison - use MP_ERROR_TEXT for all error messages - clean up error strings to use lowercase and change cannot to can't - fix implicit floating point promotion - fix implicit conversion from double to float - fix implicit floating point to integer conversions - enable extra conversion warnings where applicable - remove commented-out include statements - format code to add space after C++-style comment start - factor gchelper code to one place and use it for unix & ARM ports - fix auto-enable of MICROPY_GCREGS_SETJMP to select GC behaviour - update Python code to conform to latest black formatting py core: - remove commented-out debug printf's from emitbc and objlist - obj.h: remove comments about additional mp_buffer_info_t entries - objobject: add object.__setattr__ function - objobject: add object.__delattr__ function - nlrx86: silence possible warnings about unused nlr argument - asmx86: fix stack to be 16-byte aligned for entry and sub-call - asmx86: remove unused 5th argument facility - runtime: don't allocate iter buf for user-defined types - objsingleton: use mp_generic_unary_op for singleton objects - introduce MP_ROM_NONE macro for ROM to refer to None object - introduce MP_ROM_FALSE/MP_ROM_TRUE for ROM to refer to bool objects - objstr: don't use inline GET_STR_DATA_LEN for object-repr D - obj.h: use 32-bit shift in MP_OBJ_NEW_QSTR calc for obj-repr D - clean up commented-out code and comments about exception hierarchy - objslice: add support for indices() method on slice objects - objslice: inline fetching of slice paramters in str_subscr() - make mp_obj_get_type() return a const ptr to mp_obj_type_t - mkenv.mk: move usage of 32-bit flags to py.mk - unicode: add unichar_isalnum() - runtime: move MICROPY_PORT_INIT_FUNC near the end of mp_init() - nativeglue: use mp_const_X instead of &mp_const_X_obj - obj.h: redefine qstr object encoding to add immediate obj encoding - obj: add MICROPY_OBJ_IMMEDIATE_OBJS option to reduce code size - obj: optimise mp_obj_get_type for immediate objs with repr A and C - mpconfig.h: define BITS_PER_BYTE only if not already defined - objint: add mp_obj_int_get_uint_checked() helper - pairheap: add generic implementation of pairing heap data structure - gc: don't include or init gc_mutex when GIL is enabled - qstr: don't include or init qstr_mutex when GIL is enabled - objgenerator: use mp_obj_new_exception_arg1 to make StopIteration - objexcept: optimise mp_obj_new_exception[_arg1/_args] functions - obj.h: add and use mp_obj_is_bool() helper - release GIL during syscalls in reader and writer code - emitnative: use NULL for pending exception (not None) - emitnative: stop after finding an unwind target - mpthread.h: use strong type for mp_thread_set_state() argument - objtype: make mp_obj_type_t.flags constants public, moved to obj.h - support non-boolean results for equality and inequality tests - compile: allow 'return' outside function in minimal builds - scheduler: add "raise_exc" argument to mp_handle_pending - scheduler: move mp_keyboard_interrupt from lib/utils to py core - scheduler: allow a port to specify attrs for mp_keyboard_interrupt - scheduler: move clearing of kbd traceback to mp_keyboard_interrupt - expand type equality flags to 3 separate ones, fix bool/namedtuple - add mp_raise_type helper macro and use it where appropriate - add mp_raise_msg_varg helper and use it where appropriate - factor out definition of mp_float_union_t to one location - objexcept: rename mp_obj_new_exception_msg_varg2 to ..._vlist - objtuple: remove code that handles tuple-subclass equality test - objtype: allow mp_instance_cast_to_native_base to take native obj - dynruntime.h: add implementation of mp_obj_cast_to_native_base - objarray: turn on MP_TYPE_FLAG_EQ_CHECKS_OTHER_TYPE for memoryview - removing dangling "else" to improve code format consistency - bc0.h: shift comment to start of line to improve format consistency - builtinimport: adjust if-block order in find_file to clean up #if's - malloc: put { on separate line for funcs that have selective sigs - un-nest configuration #if/#endif's for selection of complex code - parse: add parenthesis around calculated bit-width in struct - builtinevex: support passing in a bytearray/buffer to eval/exec - objstr: remove duplicate % in error string - objstringio: expose tell() on StringIO and BytesIO objects - modmicropython: add heap_locked function to test state of heap - stream.h: include sys/types.h to get size_t and off_t for POSIX API - mpconfig.h: enable MICROPY_MODULE_GETATTR by default - pairheap: properly unlink node on pop and delete - pairheap: add helper function to initialise a new node - use preprocessor to detect error reporting level (terse/detailed) - dynruntime.mk: set MICROPY_ENABLE_DYNRUNTIME instead of per module - implement "common word" compression scheme for error messages - objexcept: allow compression of exception message text - parse: remove unnecessary check in const folding for ** operator - objexcept: remove optional TimeoutError exception - scheduler: fix race in checking scheduler pending state - scheduler: add assert that scheduler is locked when unlocking - makecompresseddata.py: don't prefix str with mark if not compressed - scope: add assert to check that low numbered qstrs do fit in uint8_t - always give noop defines when MICROPY_ROM_TEXT_COMPRESSION disabled - objarray: fix sign mismatch in comparison - objint: do not use fpclassify - makecompresseddata.py: make compression deterministic - objdict: fix popitem for ordered dicts - stream: remove mp_stream_errno and use system errno instead - modio: allow uio.IOBase streams to return errno for read/write error - scheduler: add option to wrap mp_sched_schedule in arbitrary attr - parse: support constant folding of power operator for integers - scheduler: convert mp_sched_full and mp_sched_num_pending to macros - parse: make mp_parse_node_extract_list return size_t instead of int - nativeglue.h: rename "setjmp" entry to "setjmp_" to avoid any clash - py.mk: use additional CFLAGS to compile string0.c - modmath: work around msvc float bugs in atan2, fmod and modf - ringbuf: fix compilation with msvc - modsys: use consistent naming pattern for module-level const objects - modbuiltins: fix getattr to work with class raising AttributeError - dynruntime.h: make mp_obj_str_get_str raise if arg not a str/bytes - objtype: add __dict__ attribute for class objects - objtype: use mp_obj_dict_copy() for creating obj.__dict__ attribute - obj.h: clarify comments about mp_map_t is_fixed and is_ordered - compile: convert scope test to SCOPE_IS_COMP_LIKE macro - compile: implement PEP 572, assignment expressions with := operator - grammar.h: consolidate duplicate sub-rules for :test and =test - compile: implement PEP 526, syntax for variable annotations - misc.h: add missing semi-colon in mp_float_union_t for big-endian - obj.h: add public mp_obj_is_dict_or_ordereddict() helper macro - objtype: support passing in an OrderedDict to type() as the locals - asm: add funcs/macros to emit machine code for logical-shift-right - asm: add condition codes for signed comparisons - emitnative: implement binary operations for viper uint operands - objcomplex: add mp_obj_get_complex_maybe for use in complex bin-op - obj.h: make existing MP_TYPE_FLAG_xxx macros sequential - rework mp_convert_member_lookup to properly handle built-ins - obj.h: fix mp_seq_replace_slice_no_grow to use memmove not memcpy - compile: don't await __aiter__ special method in async-for - persistentcode: maintain root ptr list of imported native .mpy code - runtime: fix builtin compile() in "single" mode so it prints exprs - mphal.h: introduce mp_hal_time_ns and implement on various ports extmod: - uzlib: explicitly cast ptr-diff-expr to unsigned - fix modbluetooth and modwebrepl to build in nanbox mode - modbluetooth: fix func prototype, empty args should be (void) - vfs_posix: release GIL during system calls - modbluetooth: implement config getter for BLE rxbuf size - modbluetooth.h: fix typo in comment about registering services - modbluetooth_nimble: fix wrong offset used for descriptor flags - modframebuf: allow blit source to be a subclass of FrameBuffer - modbluetooth_nimble: move nimble specific code, factor nimble.mk - modbluetooth: extract out gatts_db functionality from nimble - btstack: add empty modbluetooth implementation - btstack: implement advertising - btstack: implement service registration - btstack: implement gatts_db for btstack - btstack: implement scan and gatt client, connect and disconnect - btstack: implement notifications/indications for GATT clients - nimble: clarify active state and check for active in all methods - modbluetooth: unify error handling in remaining places - modbluetooth: change scan result's "connectable" to "adv_type" - nimble: when getting BLE MAC try public address if random fails - vfs: factor out vfs mount-and-chdir helper from stm32 - modlwip: fix polling of UDP socket so it doesn't return HUP - modlwip: properly handle non-blocking and timeout on UDP recv - vfs_posix_file: lock GIL when writing and allow stdio flush - vfs_posix_file: include unistd.h to get STD{IN,OUT,ERR}_FILENO - uasyncio: add new implementation of uasyncio module - uasyncio: add optional implementation of core uasyncio in C - uasyncio: add manifest.py for freezing uasyncio Py files - uasyncio: don't create a Loop instance in get_event_loop() - uasyncio: implement Loop.stop() to stop the event loop - uasyncio: add error message to Lock.release's RuntimeError - uasyncio: add StreamReader/StreamWriter as aliases of Stream cls - uasyncio: add global exception handling methods - modubinascii: make code private and module self-contained - btstack: pass through SCAN_RSP events - modbluetooth: provide FLAG_WRITE_NO_RESPONSE for characteristics - uasyncio: add Loop.new_event_loop method - uasyncio: change cannot to can't in error message, and test exp - nimble: update to work with NimBLE 1.3 - modbluetooth: don't hold atomic section during mp_sched_schedule - btstack: implement more robust init/deinit sequencing - modbluetooth: fix sign compare and unused variable warnings - modbtree: retain reference to underlying stream so it's not GC'd - vfs_lfsx: fix path handling in uos.stat() to consider cur dir - vfs_lfsx: normalize path name in chdir - vfs_lfsx: fix rename to respect cur dir for new path - modbluetooth: add support for changing the GAP device name - nimble: make error code mapping default to MP_EIO - vfs_lfsx: fix import_stat so it takes into account current dir - vfs: retain previous working directory if chdir fails - modbluetooth: make modbluetooth event not a bitfield - modbluetooth: add discover complete events for svc/char/desc - modbluetooth: allow discovery of svc/char by uuid - modbluetooth: implement read done event - modbluetooth: ensure status=0 always on success - modbluetooth: support bigger characteristic values - ure: use single function for match/search/sub - uasyncio: add asyncio.wait_for_ms function - modbluetooth: register default GATT service and fix esp32 init - moductypes: use mp_obj_is_dict_or_ordereddict to simplify code - vfs_lfs: fix littlefs bindings to build in nan-box mode - nimble: fix attr NULL ptr dereference in ble_gatt_attr_read_cb - btstack: schedule notify/indicate/write ops for bg completion - modbluetooth: ignore unused self_in in ble_gatts_indicate - modbluetooth: fix so it builds in peripheral-only mode - modbluetooth: add event for "indicate acknowledgement" - modussl: improve exception error messages - modussl_mbedtls: integrate shorter error strings - uasyncio: add StreamReader.readexactly(n) method - vfs_reader: fix mp_reader_new_file to open file in "rb" mode - uasyncio: truncate negative sleeps to 0 - vfs_lfs: add mtime support to littlefs files - btstack: implement GAP scan duration_ms parameter - modbluetooth: fix race between READ_REQUEST and other IRQs - bluetooth: support active scanning in BLE.gap_scan() - machine_i2c: fix buffer overrun if 'addrsize' is bigger than 32 - modlwip: fix error return for TCP recv when not connected - vfs: support larger integer range in VFS stat time fields - vfs: add option to use 1970 as Epoch lib: - utils/pyexec: introduce MICROPY_REPL_INFO, wrap debug prints in it - mp-readline: add an assert() to catch buffer overflows - mp-readline: add word-based move/delete EMACS key sequences - utils: change default value of pyexec_mode_kind to 0 to put in bss - utils/pyexec: handle pending exceptions after disabling kbd intrs - add BlueKitchen BTstack submodule - tinyusb: update to a6b916ba for i.MX support - btstack: update to latest master btstack commit - littlefs: update littlefs2 to v2.2.0 - mynewt-nimble: update submodule to NimBLE release 1.3.0 - btstack: update to c8b9823 for USB HCI reset timeout fix - nrfx: upgrade to nrfx v2.0.0 - utils: lock the scheduler when executing hard callback functions - utils/pyexec: add missing MP_ERROR_TEXT when compiler disabled - utils: protect all of mpirq.c with MICROPY_ENABLE_SCHEDULER - libc: add implementation of strncpy - mbedtls_errors: add code to patch mbedtls for shortened error strs - stm32lib: update library for H7 v1.6.0 and WB v1.6.0 - libm_dbl: add round.c source code - libc: fix string0's implementation of strncpy - timeutils: add helper functions to deal with nanosecs since 1970 drivers: - cyw43: fix to build in nanbox mode - cyw43: include stdio.h in files that use printf - cyw43: return early from cyw43_wifi_set_up if wifi_on fails - nrf24l01: change pipe addrs in test to match Arduino addrs - onewire: fix undefined variable errors - display/ssd1306.py: change the SET_COM_PIN_CFG setting - support SPI/QSPI flash chips over 16MB mpy-cross: - main: fix stderr_print_strn parameter type - main: print uncaught nlr jump to stderr Support components ================== docs: - more consistent capitalization and use of articles in headings - library/machine.I2C.rst: use positional-only arguments syntax - library/machine.UART.rst: detail timeout behaviour of read methods - README: add short paragraph about using readthedocs - library/machine: document machine.soft_reset() function - library: add / to indicate positional-only args in library docs - library/uos.rst: improve block devices section, and ioctl ret vals - esp8266: in TCP tutorial, add HTTP response code and content-type - unix: add a new new quickref page for the UNIX port - library: fix framebuf monochrome 1-bit modes, swapping HLSB/HMSB - develop: detail how to add symbols to mp_fun_table for native mods - library: add initial docs for uasyncio module - add docs and test for uasyncio custom exc handler methods - library: note that uasyncio.wait_for() can raise exception - library: document that char_data/notify_data are also references - library: note that machine.Pin.irq's hard arg may not be supported - library: fix docs for machine.WDT to specify millisecond timeout - develop: fix module/source name in Makefile of native example - reference: add note about multiple exceptions when heap is locked - library: update ubluetooth for new events and discover by uuid - fix Sphinx 3.x warnings, and enable warnings-as-errors on build - esp8266: add quickref documentation for UART on esp8266 - library: clarify that the arg to esp.deepsleep is in microseconds - esp32: add info about PWM duty cycle range to esp32 quickref - library: add gatts_indicate() doc to ubluetooth.rst - library: for ubluetooth, add docs for _IRQ_GATTS_INDICATE_DONE - library: update documentation of esp32's RMT - library: update pyb.SPI init method to add descr about "ti" arg - library: update pyb.Timer to add missing args and defaults to init - library: update pyb.UART to correct pyboard UART availability - esp32: fix machine.Timer quickref to specify HW timers - change `\*` to `*` in argument lists examples: - accellog.py: shift long comments to their own line - bluetooth/ble_temperature_central.py: shorten comment - natmod: add .gitignore to ignore generated example .mpy files - bluetooth: replace "connectable" parameter with "adv_type" - bluetooth: fix incorrect value of BR/EDR flag in advertising - bluetooth: fix event code in ble_temperature_central.py - bluetooth: in ble_advertising.py, skip appearance if not set - bluetooth: add simple UART demo with central and peripheral tests: - run-tests: add "--mpy-cross-flags" arg to specify mpy-cross flags - extmod: split out VfsFat finaliser tests to separate test file - micropython: add test for yield-from while heap is locked - run-tests: handle 'CRASH' return by float.py feature test - cpydiff: add CPy diff-test for using dict.keys() as a set - unix: make unix time test pass on more platforms - unix: add coverage test for new mp_obj_int_get_uint_checked func - make run-tests help and README be more descriptive of behaviour - extmod: add basic machine.Timer test - unix: add coverage tests for pairheap data structure - unix: add coverage test for mp_obj_new_exception_args - unix: add coverage tests for mp_obj_is_type() and variants - add boolean-as-integer formatting tests for fixed regression - add tests for generator throw and yield-from with exc handlers - basics: expand test cases for equality of subclasses - cmdline/repl_inspect: add new test for -i option - cmdline: add test for MICROPYINSPECT environment variable - cpydiff: add os module environ differences - move CPy diff test to real test now that subclass equality works - basics: move test for "return" outside function to own file - unix: add coverage tests for kbd-intr and scheduler - run-tests: auto-skip extmod/ticks_diff, extmod/time_ms_us tests - basics: add tests for equality between bool and int/float/complex - basics: add test for equality between tuple and namedtuple - basics: add test for tuple compare with class derived from tuple - basics/array1.py: add equality testing for array - run-multitests.py: add new test runner for multiple Py instances - multi_net: add initial set of multi-instance tests for network - multi_bluetooth: add initial tests for bluetooth BLE - run-tests: consider all tests as native when emit=native is used - run-multitests.py: print test summary and do exit(1) on failure - extmod: add uasyncio tests - run-tests: skip uasyncio if no async, and skip one test on native - make default MICROPYPATH include extmod to find uasyncio - multi_net: add uasyncio test for TCP server and client - net_inet: add uasyncio internet tests - basics/dict_pop.py: remove extra comma in call and fix grammar - micropython/heapalloc_fail_set.py: remove extra trailing comma - format all Python code with black, except tests in basics subdir - float: add new lexer test to test parsing of float without prefix - run-tests: add commands to print and clean *.exp,out files - extmod: update littlefs test output to match new library version - run-tests: make diff tool user configurable - float: fix cmath_fun_special for MICROPY_FLOAT_IMPL_FLOAT - extmod: add btree test for errors raised by btree DB library - run-multitests.py: allow filtering out lines from stdout - multi_bluetooth/ble_gap_advertise: fix bytes/str compare warning - run-multitests.py: add shortcuts for local Python instances - cpydiff: add cpydiff test for __all__ used in imported package - thread/thread_stacksize1.py: increase stack size for CPython - multi_bluetooth: fix typo printing wrong IRQ type - run-multitests.py: add TRACE banner and move TEST output to end - run-tests: skip REPL feature checks when running via pyboard.py - multi_bluetooth: update to work with new BLE events - run-multitests.py: allow passing unique env vars to each instance - basics: add tests for assignment operator := - cpydiff: add CPy diff test for assignment expression behaviour - basics: add tests for variable annotations - basics: split out memoryview slice-assign tests to separate file - move .mpy import tests from import/ to micropython/ dir - micropython: improve .mpy import tests to run on more targets - extmod: add test for uasyncio.sleep of a negative time - extmod: make uasyncio_fair test more reliable by adjusting sleeps - run-tests: use absolute paths where possible - run-tests: make test output directory configurable - split out complex reverse-op tests to separate test file - extmod: add tests for verifying FAT and littlefs mtime values tools: - gen-cpydiff.py: adjust subsections to sentence case - add metrics.py script to build and compute port sizes/metrics - pydfu.py: clean up syntax, update comments and docstrings - pyboard.py: add option --no-follow to detach after sending script - pyboard.py: use slice del instead of list.clear() for Py2 compat - pyboard.py: change shebang to use python3 - makemanifest.py: support freezing with empty list of mpy files - codeformat.py: add formatter using uncrustify for C, black for Py - makemanifest.py: fix build on Windows by adding .exe to mpy-cross - metrics.py: use check_call instead of run to error out on error - codeformat.py: eliminate need for sizeof fixup - pydfu.py: add args for VID/PID & exit with cleaner error handling - pydfu.py: display any error strings from device/mboot - codeformat.py: include all msvc C code in auto-format - pyboard.py: support setting device/baudrate from shell env vars - pyboard.py: add -d as an alias for --device - metrics.py: add option to diff to error if delta above threshold - metrics.py: don't build mpy-cross if not needed by any ports - metrics.py: use OrderedDict when reading build log - check_code_size.sh: remove unused script - codeformat.py: use -q option on uncrustify to make output quiet - codeformat.py: add verbose option to pass to uncrustify and black - uncrustify.cfg: remove deprecated sp_word_brace option - codeformat.py: remove sizeof fixup - uncrustify: update config for v0.71.0 - codeformat.py: include extmod/{btstack,nimble} in code formatting - uncrustify: enable more opts to remove space between func and '(' - makemanifest.py: support freezing a subdirectory recursively - pydfu.py: respect longer timeouts requested by DFU device/mboot - makemanifest.py: use errno.EEXIST instead of number 17 - makemanifest.py: print nicely formatted errors from mpy-cross - pyboard.py: replace eval() of received data with alternative - mpy-tool.py: fix offset of line number info - makemanifest.py: use os.makedirs to make path for generated files CI: - add new job to build and test unix coverage in 32-bit mode - add stm32 build in nanbox mode - update travis to specify which unix variant to build - add OSX build to CI - add CI job to check code formatting - build stm32 PYBD_SF6 with BTstack as bluetooth stack - run multi_net tests as part of coverage job - for unix tests use Makefile target instead of explicit commands - print errors out for OSX job - exclude some uasyncio tests on OSX - use custom PPA to get pre-built uncrustify - use grep with --text on qemu-arm output - build NUCLEO_L073RZ instead of B_L072Z_LRWAN1 for stm32 job - build full unix coverage build on osx job - build GENERIC_1M board as part of esp8266 job - make OSX build work again by not installing pkgconfig - split esp32 ESP-IDF v3 and v4 builds to separate jobs - decrease build duration by starting OSX build early - finish jobs early after test failure - use tools/metrics.py to compute size diff of minimal ports - make sure upstream/master exists when computing size-diff check - build more boards as part of nrf job - run apt commands once, to slightly speed up the CI - set build name so it appears in the web interfaces - for powerpc job, build both UART variants - change nrf pca10056 board to build with soft-device enabled - build qemu-arm with MP_ENDIANNESS_BIG=1 to test bigendian build - in stm32 job, build mboot for NUCLEO_WB55 - build mboot for PYBV10 with LFS2 enabled in stm32 job - install newer toolchain for nrf job - add pca10090 build to nrf job - change nrf pca10056 board to build with s140 SoftDevice - add zephyr build to CI - add GitHub action to build docs The ports ========= all ports: - allow overriding CROSS_COMPILE in a custom makefile - modify mp_hal_pin_write macro so it can be used as a function - add lib/libm/roundf.c to bare-metal Makefile's - enable error text compression for various ports, but not all - disable MICROPY_PY_ASSIGN_EXPR in bare-arm and minimal ports cc3200 port: no changes specific to this port esp8266 port: - modules: fix AttributeError in _boot.py if flash not formatted - modules/ntptime.py: add comment about configuring NTP host - put mp_keyboard_interrupt in IRAM - machine_pin: disable ets_loop_iter during hard IRQ handler - modmachine: implement machine.soft_reset() - README.md: add docker build instructions - modnetwork: add support for wlan.ifconfig('dhcp') - enable and freeze uasyncio - change from FAT to littlefs v2 as default filesystem - makeimg.py: print out info about RAM segments when building fw - machine_pin: move pin_intr_handler to iRAM, de-support hard IRQ - mpconfigport.h: add definitions for BEGIN/END_ATOMIC_SECTION - clean up Pin intr handler by moving all code to machine_pin.c - boards: move py/pairheap.c code from iRAM to iROM - esp_mphal: move most functions in esp_mphal.c from iRAM to iROM - uart: move a few functions from iRAM to iROM - boards: allow configuring btree/FAT/LFS2 support when building - esppwm: fix PWM glitch when setting duty on different channel esp32 port: - Makefile: assign result of $call to dummy var for older make - modmachine: add implementation of machine.soft_reset() - enable NimBLE support on all builds (IDF 3.3 and 4.0) - modnetwork: add max_clients kw-arg to WLAN.config for AP setting - Makefile: reorder includes to build with latest toolchain - uart: use core-provided mp_keyboard_interrupt, placed in IRAM - modsocket: convert EADDRINUSE error code from lwip return value - move to IDF 4.0 release version - deinitialize Bluetooth on soft reset - README.md: update build instructions for newer toolchain - modsocket: handle poll of a closed socket - enable and freeze uasyncio - README.md: fix typo in venv instructions - change from FAT to littlefs v2 as default filesystem - espneopixel: use integer arithmetic to compute timing values - update to ESP IDF v3.3.2 - modesp32: add idf_heap_info(capabilities) to esp32 module - consolidate check_esp_err functions and add IDF error string - improve support for OTA updates - partitions: update comments in files regarding offset - modsocket: fix getaddrinfo to raise on error - machine_sdcard: add "freq" keyword arg to SDCard constructor - modmachine: fix machine.reset_cause to use IDF's esp_reset_reason - mpthreadport: fix calculation of thread stack size - update IDF v4.0 supported hash to v4.0.1 - esp32_rmt: extend RMT to support carrier feature - esp32_rmt: call rmt_driver_install before rmt_config - esp32_rmt: properly fix looping behaviour of RMT - network_lan: add support for IP101 PHY - mphalport: fix mp_hal_time_ns offset javascript port: no changes specific to this port mimxrt port: - add new, minimal port to NXP i.MX RT series CPUs - add MIMXRT1010 board - add MIMXRT1060_EVK board - add initial impl of machine.LED class, and basic pin support - tusb_config.h: preliminary fix for TinyUSB HS endpoint overflow - boards: enable LED class for MIMXRT1060_EVK board - boards: integrate support for MIMXRT1020_EVK board - boards: set __heap_size__ to 0 in MIMXRT1011.ld minimal port: - make build more flexible and work as 64-bit build nrf port: - main: remove unnecessary repl_info(0) call - boards/common.ld: add ENTRY(Reset_Handler) in linker script - drivers: use mp_raise_msg where appropriate, and shorten exc msgs - drivers/bluetooth: fix variable initialisation error with older gcc - remove custom "random" module and use extmod version instead - use MICROPY_HW_ENABLE_RNG instead of MICROPY_PY_RANDOM_HW_RNG - Makefile: don't use -fno-builtin for Cortex-M0 builds - mphalport: remove need for "syntax unified" in mp_hal_delay_us - update to work with nrfx v2.0.0, to match TinyUSB - add openocd as a supported flasher - bluetooth: use MP_ERROR_TEXT for all error messages - bluetooth/ble_uart: fix implicit declaration of function - bluetooth: handle data length update request - bluetooth/ble_uart: add mp_hal_stdio_poll function - bluetooth/ble_uart: fix random advertisement name - bluetooth/ble_uart: swap end character on cooked strings - Makefile: disable ROM text compression when compiling for debug - add support for time.ticks_xxx functions using RTC1 - enable nrf tick support on all boards by default - boards: add initial support for Actinius Icarus - nrfx_config: disable RTC2 for nRF9160 targets - boards: enable RTCounter machine module for nrf9160 boards - add board definition for nRF52840-MDK-USB-Dongle - split mpconfigport.h into multiple files - enable more features for all targets - Makefile: improve user C modules support pic16bit port: no changes specific to this port powerpc port: - fix Makefile rule when linking - set better default compiler - uart: choose which UART to use at build time, not runtime qemu-arm port: - set default board as mps2-an385 to get more flash for tests - README: update link to toolchain - support building in debug mode with DEBUG=1 - Makefile: add CFLAGS_EXTRA to CFLAGS samd port: - fix to build with latest tinyusb stm32 port: - mbedtls: resize mbedtls output buffer from 16 down to 4 kiB - fix to build in nanbox mode - add configuration to build in nanbox mode - boards/PYBD: change RTC asynch prediv from 1 to 4 - softtimer: change linear linked list to a pairing heap - powerctrl: for F7, allow PLLM!=HSE when setting PLLSAI to 48MHz - Makefile: allow a board's .mk file to add things to CFLAGS - boards/STM32F769DISC: add config to use external SPI as filesys - powerctrl: disable HSI if not needed to save a bit of power - powerctrl: enable overdrive on F7 when waking from stop mode - boards/stm32f746_af.csv: add ADC alt functions to correct pins - sdio: add support for H7 MCUs - stm32_it: don't call __HAL_USB_HS_EXTI_CLEAR_FLAG on H7 MCUs - powerctrl: improve support for changing system freq on H7 MCUs - powerctrl: reenable PLL3 on H7 MCUs when waking from stop mode - sdram: expose the result of sdram startup test in stm32_main - usbd_conf: allow boards to configure USB HS ULPI NXT/DIR pins - usbd_cdc_interface: remove "interrupt_char != -1" check - sdram: fix compile issue from unused sdram startup test flag - mpconfigport.h: add option to have custom help text - modnetwork: remove redundant call to nimble_poll in lwip poll - refactor bluetooth stack/hci/driver bindings - add bindings for BTstack implementation - boards/PYBD: allow building with BTstack (via make command line) - refactor Bluetooth HCI RX to be independent of transport layer - main: fix bug mounting 3rd SD partition - mboot: allow overriding led_init and led_state in board folder - mboot: update dfu state/status flags to better match standard - mboot: protect against invalid address flash writes - mboot: update LED0 state from systick handler - mboot: remove unnecessary test for led being 1 in led_state - softtimer: initialise pairing-heap node before pushing to heap - enable and freeze uasyncio - mpconfigport.h: remove unused root pointer for BTstack bindings - mpconfigport.h: make most extended modules configurable by board - boards: disable pend_throw, uheapq, utimeq on small-flash boards - Makefile: add missing ordering dependency on generated headers - storage: fix start address of second, internal block device - mboot/README: clarify that mboot can access FAT formatted FS only - mboot: expose custom DFU USB VID/PID values at makefile level - Makefile: rename SRC_LIB to LIB_SRC_C to match other ports - main: peform a clean shutdown of btstack on soft reset - boards/PYBD_SF2: put BTstack library in external QSPI XIP flash - README: reorg DFU flashing instructions with addition for PYBD - add support for F412 MCUs - boards: add board config for Nucleo-F412ZG development board - machine_uart: retain attached-to-repl setting when init'ing UART - machine_uart: allow re-init'ing a static UART object - modmachine: allow changing AHB and APB bus frequencies on STM32WB - adc: add support to pyb.ADC for STM32WB MCUs - machine_adc: make setting of ADC1_COMMON->CCR clearer on STM32WB - dma: add support for DMA on STM32WB, with SPI settings provided - boards/xxx_WB55: enable pyb.ADC and hardware SPI on WB55 boards - Makefile: quote libgcc path so spaces are not an issue - boards/STM32F769DISC: use macro instead of const for flash size - factoryreset: provide empty create-FS function when FAT disabled - usb: add support for 2xVCP on L0, L432 and WB MCUs - rfcore: leave txpower level as default when initialising rfcore - boards/NUCLEO_WB55: add more CPU pins and aliases to SW1/2/3 - irq: clean up irq.h so it does not depend on core uPy defines - powerctrlboot: include irq.h to get definitions of IRQ priorities - flash: make flash C-API reusable, and funcs return an error code - i2cslave: add support for WB MCUs - flash: add flash_is_valid_addr, and extend sectors for 2MB F7 - mboot: use flash routines from main stm32 code rather than custom - mboot: use CMSIS system source code for SystemInit function - mboot: add support for using mboot with WB MCUs - boards: add build-time option for NUCLEO_WB55 to use mboot - mboot: set VTOR on start up to ensure it has the correct value - mboot: use additional CFLAGS to compile string0.c - mpconfigport.h: enable PY_IO_FILEIO when any VFS is enabled - timer: support TIM1 on WB MCUs - boards: enable LFS2 on PYBD_SF3 and PYBD_SF6 - mboot: don't search for firmware on FS, just attempt to open it - mboot: decouple stream, filesystem and top-level loading code - mboot: add support for littlefs - mboot: update README to describe WB and littlefs support - i2cslave: pass I2C instance to callbacks to support multi I2Cs - usbd_cdc_interface: remove full==size-1 limitation on tx ringbuf - timer: properly initialise timer deadtime/brk on WB MCUs - mboot: implement DFU mass erase - flash: update flash_get_sector_info to return -1 on invalid addr - mboot: add DFU logic to respond to DFU_GETSTATE request - mboot: remove the use of timeout in DFU_GETSTATUS - mboot: disable polling mode by default and use IRQ mode instead - fdcan: use the right FIFO to calc element address in can_receive - fdcan: use FDCAN_RXFxS_FxFL instead of hard-coded value - fdcan: support maximum timeout of HAL_MAX_DELAY in can_receive - pyb_can: handle timeout arg for FDCAN in pyb_can_send - usbdev: fix calculation of SCSI LUN size with multiple LUNs - pin_defs_stm32: fix pin printing to show IN mode correctly - powerctrl.h: include stdbool.h to get definition of bool teensy port: no changes specific to this port unix port: - modtime: add utime.mktime function, to complement utime.localtime - modos: add uos.rename and uos.rmdir - add build variants, analogous to boards on bare-metal - add placeholder DEV variant with settrace enabled - rename unix binaries to micropython-variant (not _variant) - Makefile: reserve CFLAGS_EXTRA/LDFLAGS_EXTRA for external use - release GIL during all system calls - unix_mphal: add compile check for incompatible GIL+ASYNC_KBD_INTR - main: print usage and NLR errors to stderr instead of stdout - main: add support for MICROPYINSPECT environment variable - main: add #if guard around -v option usage and document -i/-m opts - main: add command-line -h option for printing help text - modos: implement putenv and unsetenv to complement getenv - main: use OS-dependent path separator when searching path - Makefile: remove old variant targets that are no longer needed - variants/standard: fix role of PREFIX when used to install - Makefile: allow to install all variants of the executable - mpthreadport: use SIGRTMIN+5 instead of SIGUSR1 for thread-GC - mpthreadport: fix Mac build by using SIGUSR1 if SIGRTMIN not avail - mphalport.h: fix build when MICROPY_USE_READLINE=0 - unix_mphal: adjust #if in mp_hal_stdin_rx_chr to improve format - file: don't raise OSError(EINVAL) on sys.stdin/out/err.flush() - Makefile: detect and pass thru mpy-cross flags when running tests - remove custom file implementation to use extmod's VFS POSIX one - remove custom definition of MP_PLAT_PRINT_STRN - coverage: init all pairheap test nodes before using them - enable uasyncio C helper module on coverage build - mpthreadport: fix crash when thread stack size <= 8k - implement PEP 475 to retry syscalls failing with EINTR - mpthreadport: ensure enough thread stack to detect overflow - fix behaviour of COPT/NDEBUG for unix variants - implement MICROPY_BEGIN/END_ATOMIC_SECTION protection macros - Makefile: fix regression using install on non-GNU systems - modmachine: add machine.idle(), implemented using sched_yield - add support for modbluetooth and BLE using btstack - enable modbluetooth on the "dev" and "coverage" variants - add btstack to the unix submodules list - main: enter REPL when inspect active, even with stdin redirected - btstack_usb: allow choosing adaptor via environment variable - make manifest selection match other ports - enable uasyncio on dev variant - variants: enable VFS and all supported filesystems on dev variant - make the MICROPY_xxx_ATOMIC_SECTION mutex recursive - fatfs_port: implement get_fattime - variants: fix fast and freedos variants so they build again - modos: support larger integer range in uos.stat fields windows port: - support word-based move/delete key sequences for REPL - windows_mphal: release GIL during system calls - improve default search path - msvc: fix warnings regarding function declarations - remove custom definition of MP_PLAT_PRINT_STRN - windows_mphal: fix missing semicolon - update genhdr.targets to match makeqstrdefs.py args - make appveyor.yml self-contained zephyr port: - update include paths for Zephyr v2.0 - replace deprecated time conversion macro - remove reference to syscall_macros_h_target - implement block device protocol via zephyr disk access api - enable virtual file system and uos module - enable fatfs - implement block device protocol via zephyr flash map api - enable littlefs - mount a file system during init - enable usb mass storage class on mimxrt1050_evk - execute main.py file if it exists - update machine.Pin class to use new zephyr gpio api - use zephyr build system to merge configurations - fix and rename stacks_analyze function in zephyr module - fix floating point configuration - update for refactored zephyr device structures - update to new zephyr timeout API - convert DT_FLASH_AREA usages to new dts macros - increase minimum required cmake version to 3.13.1 - use cmake find_package to locate zephyr - implement machine.Pin.irq() for setting callbacks on pin change - make-minimal: disable FAT and LFS2 options to make it build - include storage/flash_map.h unconditionally - README: update required Zephyr version and mention new features
PYBD boards, BLE and littlefs, dynamic native modules, samd and powerpc This release sees a reduction in overall bytecode size due to compression of the bytecode prelude, saving 7 bytes of bytecode per function for roughly 80% of functions. The bytecode opcode values are also redefined to group them based on their argument size and format. Support is also added for the matrix multiplication operator "@" (PEP 465). The .mpy file format moved to version 5 to support the new bytecode encoding, and added support for relocation of native machine code, along with separate rodata and BSS sections. This allows a MicroPython system to import dynamic native modules, .mpy files that are generated from C code. Examples of this feature are provided in "examples/natmod/" and documentation in "docs/develop/natmod.rst". Some code-size saving optimisations were implemented leading to a reduction in size of minimal firmware: bare-arm reduced by 584 bytes, minimal x86 by 5476 bytes (partly due to changed compiler optimisation flags) and minimal ARM Thumb 2 by 1440 bytes (all measured with gcc 9.2.0). A new mechanism to freeze scripts into firmware is provided - a frozen manifest - whereby scripts to freeze are listed in a Python file (eg manifest.py). All ports are updated to use this new feature. When weak module links are enabled (via MICROPY_MODULE_WEAK_LINKS) an import will now automatically search for the built-in u-variant of a module if the non-u-variant fails (eg searches for "ufoo" if "foo" fails), so ports no longer provide an explicit list of these. The unix and windows ports now enable this feature. A performance benchmarking test suite is added which can be used to compare changes in absolute performance when optimising features, as well as compare across different ports. See "tests/run-perfbench.py". Bluetooth (BLE only) support is added via the "ubluetooth" module and provides the ability to implement the four BLE roles. The BLE stack is used is Mynewt Nimble and it currently runs on PYBD boards, STM32WB55 MCUs and ESP32 boards. Support for littlefs filesystems is added through the MicroPython VFS interface, and it works on the unix, stm32, esp8266 and esp32 ports. A new "machine.ADC.read_u16()" method is defined and implemented on stm32, esp8266, esp32 and nrf ports, providing a consistent way to read an ADC that returns a value in the range 0-65535. This new method should be preferred to the existing "ADC.read()" method. The stm32 port sees support for the new PYBD range of pyboards which include a fully integrated CYW43xx WiFi/BT chip. USB is enhanced to support VCP+MSC+HID mode and up to 3x simultaneous VCP interfaces. Support is also added for STM32WBxx MCUs including BLE. There is a new machine.ADC class which is compatible with other ports, along with a new machine.Timer class that implements a software timer with millisecond resolution and number of active timers only limited by RAM. Support for littlefs is available by default via uos.VfsLfs2. Documentation for using littlefs is found in "docs/reference/filesystem.rst". The esp8266 port has switched to use per-board configurations and builds, as well as the new frozen manifest feature. It also has optional littlefs support (requires a separate build). The esp32 port has the following new features: native code generation, machine.SDCard, hardware I2C, mDNS queries and responder, esp32.Partition, esp32.RMT, BLE (requires IDF v4), and built-in support for VfsLfs2. It has switched to use per-board configurations and builds, and frozen manifests. The default SSL output buffer is resized from 16kiB down to 4kiB to save RAM. There are new, minimal ports to Microchip SAMDxx microcontrollers, and the bare metal PowerPC architecture. A code-of-conduct based on the PSF's code is added in CODEOFCONDUCT.md. The following new Git submodules are added: mbedtls, asf4, tinyusb, mynewt-nimble. And a new third-party library: littlefs. A detailed list of changes follows. py core: - nativeglue: make private glue funs all static, remove commented code - nativeglue: remove dependency on mp_fun_table in dyn-compiler mode - obj: optimise small-int comparison to 0 in mp_obj_is_true - nlrthumb: save and restore VFP registers s16-s21 when CPU has them - mkrules.mk: use $(CPP) not $(CC) -E for preprocessor rule - define EMIT_MACHINE_CODE as EMIT_NATIVE || EMIT_INLINE_ASM - persistentcode: fix compilation with load and save both enabled - persistentcode: ensure prelude_offset is always initialised - asmarm: use __clear_cache on Linux/GCC when creating new asm code - nlrthumb: check __thumb2__ instead of __ARM_ARCH_6M__ - objgenerator: add missing #if guard for PY_GENERATOR_PEND_THROW - asmarm: use __builtin___clear_cache instead of __clear_cache - makeqstrdata.py: allow using \r\n as a qstr if a port requires it - scheduler: rename sched_stack to sched_queue - objstringio: guard bytesio_stream_p struct w/ MICROPY_PY_IO_BYTESIO - objdict: quote non-string types when used as keys in JSON output - builtinimport: populate __file__ when importing frozen or mpy files - runtime: allow to override builtins.__import__ with Python func - modio: call mp_import_name to do resource stream import - allow to pass in read-only buffers to viper and inline-asm funcs - showbc: fix off-by-one when showing address of unknown opcode - implement new sys.atexit feature - objarray: fix amount of free space in array when doing slice assign - modmath: implement math.isclose() for non-complex numbers - introduce MP_UNREACHABLE macro to annotate unreachable code - nlr: use MP_UNREACHABLE at the end of arch-specific nlr_jump funcs - compile: improve the line numbering precision for comprehensions - emitbc: rewrite switch in load_const_tok to reduce code size - emitbc: make all emit_write_bytecode_* funcs take a stack_adj arg - objgenerator: move defn of mp_const_GeneratorExit_obj here - vm: shorten error message for not-implemented opcode - vm: don't add traceback info for exc's propagated through a finally - vm: don't add traceback info for exceptions that are re-raised - add global default_emit_opt variable to make emit kind persistent - compile: improve the line numbering precision for lambdas - bc: factor out code to get bytecode line number info into new func - profile: add initial implementation of sys.settrace feature - integrate sys.settrace feature into the VM and runtime - profile: add debugging for sys.settrace feature - objtuple: allow compatible subclasses of tuple in mp_obj_tuple_get - modstruct: fix struct.unpack with unaligned offset of native type - modstruct: fix struct.pack_into with unaligned offset of native type - binary: change mp_uint_t to size_t for index, size, align args - bc: fix size calculation of UNWIND_JUMP opcode in mp_opcode_format - mkenv.mk: add GDB variable - vm: factor cached map lookup code to inline function - mkrules.mk: add QSTR_GLOBAL_REQUIREMENTS variable for qstr auto-gen - persistentcode: enable persistent code saving for Windows ports - lexer: reorder operator tokens to match corresponding binary ops - parse: use calculation instead of table to convert token to operator - compile: use calculation instead of switch to convert token to op - add support for matmul operator @ as per PEP 465 - bc0: order opcodes into groups based on their size and format - bc: replace big opcode format table with simple macro - introduce and use constants for multi-opcode sizes - split RAISE_VARARGS opcode into 3 separate ones - nlr.h: factor out constants to specific macros - emitnative: factor sizeof/offsetof calculations to macros - rename MP_QSTR_NULL to MP_QSTRnull to avoid intern collisions - nativeglue: make mp_fun_table fixed size regardless of config - persistentcode: bump .mpy version to 5 - ringbuf: add helpers for put16/get16 - bc: change mp_code_state_t.exc_sp to exc_sp_idx - add n_state to mp_code_state_t struct - compress first part of bytecode prelude - rework and compress second part of bytecode prelude - bc: don't include mp_decode_uint funcs when not needed - compile: disallow 'import *' outside module level - makeqstrdefs.py: remove unused blacklist - vm: fix handling of unwind jump out of active finally - runtime: fix PEP479 behaviour throwing StopIteration into yield from - emitnative: add support for archs with windowed registers - emitnative: add support for using setjmp with native emitter - emitnative: add support for archs that cannot read executable data - asmxtensa: add support for Xtensa with windowed registers - add new Xtensa-Windowed arch for native emitter - persistentcode: make .mpy more compact with qstr directly in prelude - objtype: add type.__bases__ attribute - mkrules.mk: add warning/error for invalid frozen config - objstr: size-optimise failure path for mp_obj_str_get_buffer - automatically provide weak links from "foo" to "ufoo" module name - modarray: rename "array" module to "uarray" - runtime: reorder some binary ops so they don't require conditionals - stream.h: add MP_STREAM_POLL_NVAL constant - nativeglue: remove unused mp_obj_new_cell from mp_fun_table - objgenerator: remove globals from mp_obj_gen_instance_t - objgenerator: allow pend_throw to an unstarted generator - persistentcode: move declarations for .mpy header from .c to .h file - modsys: report .mpy version in sys.implementation - emitnative: fix typo, REG_PARENT_ARG_RET should be REG_PARENT_RET - emitnx86: make mp_f_n_args table match order of mp_fun_kind_t - objdict: support ujson.dump() of OrderedDict objects - ringbuf: add peek16 method - compile: coalesce error message for break/continue outside loop - builtinimport: raise exception on empty module name - qstr: raise exception in qstr_from_strn if str to intern is too long - objstringio: slightly optimize stringio_copy_on_write for code size - objenumerate: check for valid args in enumerate constructor - persistentcode: add ability to relocate loaded native code - nativeglue: add new header file with native function table typedef - nativeglue: add funcs/types to native glue table for dynamic runtime - persistentcode: make ARM Thumb archs support multiple sub-archs - nativeglue: add float new/get functions with both single and double - dynruntime: add support for float API to make/get floats - dynruntime: implement uint new/get, mp_obj_len and mp_obj_subscr - persistentcode: move loading of rodata/bss to before obj/raw-code extmod: - add network-level class binding to cyw43 driver - factor out makefile rules from py.mk to new extmod.mk file - extmod.mk: integrate mbedTLS so it is built from source - modussl_mbedtls: allow to build with object representation D - extmod.mk: include mdns app source in lwIP build - uos_dupterm: add mp_uos_dupterm_poll to poll all dupterms - moduwebsocket: make close_resp static array const to not use RAM - modwebrepl: make prompt/ver static arrays const to not use RAM - modwebrepl: add config option to put filebuf[512] on stack/bss - modlwip: for TCP send keep trying tcp_write if it returns ERR_MEM - modlwip: use mp_sched_schedule to schedule socket callbacks - modlwip: implement raw sockets for lwIP - modure: make regex dump-code debugging feature optional - moducryptolib: use "static" not "STATIC" for inline functions - give vars/funcs unique names so STATIC can be set to nothing - modujson: support passing bytes/bytearray to json.loads - crypto-algorithms: add source to header and populate copyright - vfs_posix: include stdio.h for declaration of function 'rename' - nimble: add nimble bindings - modbluetooth: add low-level Python BLE API - modbluetooth_nimble: implement modbluetooth API with Nimble - modbluetooth_nimble: use random addr if public isn't available - modbluetooth: allow MP_BLUETOOTH_MAX_ATTR_SIZE in board config - modbluetooth: allow config of scan interval/window - modbluetooth: use us instead of ms for advertising interval - modbluetooth: increase maximum connections from 1 to 4 - modbluetooth: clear gap_advertise payload when data is empty - modbluetooth: fix order of params to IRQ_GATTS_WRITE event - modbluetooth: improve ringbuf handling - modbluetooth: make gap_disconnect not raise when disconnected - modbluetooth: in gap_advertise only accept None to stop adv - re1.5: support escaping within RE classes - modbluetooth: make UUID support the buffer protocol - modbluetooth: persist reference to NimBLE service instances - modbluetooth_nimble: use `data_alloc` length to truncate writes - modbluetooth: rename module to "ubluetooth" - factor out block-device struct to make independent of fatfs - vfs_blockdev: factor out block device interface code - vfs_blockdev: add extended read/write methods - add VFS littlefs bindings - vfs: rename BP_IOCTL_xxx constants to MP_BLOCKDEV_IOCTL_xxx - vfs: add MP_BLOCKDEV_IOCTL_BLOCK_ERASE constant - modbluetooth: add gatts_set_buffer - vfs_lfs: allow compiling in VfsLfs1 and VfsLfs2 separately - modlwip: unconditionally return POLLHUP when polling new socket - modlwip: make socket poll return POLLNVAL in case of bad file - modlwip: unconditionally return POLLHUP/POLLERR when polling - modussl_mbedtls: fix getpeercert to return None if no cert avail - modussl_mbedtls: check for invalid key/cert data - nimble: remove unneeded nimble_sprintf wrapper function - nimble: factor out stm32-specific HCI UART RX/TX code - modbtree: make FILEVTABLE const to put it in ROM - convert nlr_raise(mp_obj_new_exception_msg(x)) to mp_raise_msg(x) - vfs: add autodetect of littlefs filesystem when mounting - consolidate FAT FS config to MICROPY_VFS_FAT across all ports - modbluetooth: prioritise non-scan-result events - modbluetooth: create UUID from bytes and allow comparison ops - modbluetooth_nimble: make gap_scan_stop no-op if no scan ongoing - modbluetooh_nimble: fix UUID conversion for 16 and 32 bit values - modbluetooth: simplify management of pre-allocated event data - vfs_lfs: pass flag along to ioctl when init'ing bdev for lfs - vfs_lfs: fix bug when passing no args to constructor and mkfs - modbluetooth: simplify how BLE IRQ callback is scheduled - modbluetooth: remove limit on data coming from gattc data input - modbluetooth: add optional 4th arg to gattc_write for write mode - modbluetooth: allow setting ringbuf size via BLE.config(rxbuf=) - modbtree: use mp_printf instead of printf - add dynamic-runtime guards to btree/framebuf/uheapq/ure/uzlib - webrepl: move webrepl scripts to common place and use manifest lib: - cmsis: upgrade to CMSIS 5.5.1 - netutils: add DHCP server component - add new submodule for mbedtls, currently at v2.17.0 - utils/sys_stdio_mphal: add support to poll sys.stdin and sys.stdout - add asf4 as a submodule - add tinyusb as a submodule - stm32lib: update library for updated H7xx, new L0xx, new WBxx - lwip: update lwIP to v2.1.2, tag STABLE-2_1_2_RELEASE - mynewt-nimble: add Apache mynewt nimble as a submodule - littlefs: add littlefs v1.7.2 source - littlefs: add littlefs v2.1.3 source - littlefs: add README describing origin and how to gen lfs1/lfs2 - libc/string0: add simple implementations of strspn and strcspn drivers: - add driver for CYW43xx WiFi SoCs - memory/spiflash: add support to put SPI flash in sleep mode - cyw43: add low-level CYW43xx Bluetooth HCI UART driver - onewire/ds18x20.py: add support for DS1822 sensor - sdcard: raise exception on timeout of readinto - wiznet5k: allow selecting maximum fixed buffer size for MACRAW tools: - mpy-tool.py: fix linking qstrs in native code, and multiple files - mpy-tool.py: fix linking of qstr objects in native ARM Thumb code - add uf2conv.py from Microsoft/uf2 repository - pyboard.py: add filesystem commands to ls/cat/cp/rm remote files - mpy-tool.py: force native func alignment to halfword/word on ARM - mpy-tool.py: add initial support for frozen with settrace - mpy-tool.py: fix freezing of non-bytecode funcs with settrace - make-frozen.py: allow to run with no directory passed in - add mechanism to provide a manifest of frozen files - makemanifest.py: eval relative paths w.r.t. current manifest file - mpy-tool.py: use "@progbits #" attribute for native xtensa code - makemanifest.py: follow symlinks when freezing linked directories - makemanifest.py: skip freezing unsupported files with warning - makemanifest.py: use sys.executable when invoking Python scripts - mpy-tool.py: support qstr linking when freezing Xtensa native mpy - mpy-tool.py: add ability to merge multiple .mpy files into one - mpy_ld.py: add new mpy_ld.py tool and associated build files - mpy-tool.py: raise exception if trying to freeze relocatable mpy - pyboard.py: support executing .mpy files directly - tinytest-codegen.py: add extra newline and result message tests: - rename "bench" tests to "internal_bench" and run-internalbench.py - add performance benchmarking test-suite framework - perf_bench: add some benchmarks from python-performance - perf_bench: add some miscellaneous performance benchmarks - perf_bench: add some viper performance benchmarks - stress/recursive_iternext.py: increase large depth to 5000 - run-perfbench.py: add --emit option to select emitter for tests - add tests for overriding builtins.__import__ - misc/sys_atexit: add test for new sys.atexit feature - unix: update extra_coverage expected output with new atexit func - extmod: split json.loads of bytes/bytearray into separate test - split out test for optimisation level and line-no printing - add tests for sys.settrace feature - basics: add test for matmul operator - update tests for changes to opcode ordering - micropython: add test for native generators - basics: add test for getting name of func with closed over locals - basics: add test for throw into yield-from with normal return - perf_bench: add bm_fft test - run-perfbench.py: show error when truth check fails - run-perfbench.py: skip complex tests if target doesn't enable it - cpydiff: fix typo in types_bytes_keywords.py doc comments - rename "array" module to "uarray" - extmod: add littlefs tests - extmod: add test for blockdev with standard and extended protocol - basics: use str.format instead of % for formatting messages - basics/builtin_dir.py: look for "version" in dir(sys) - add feature check for bytearray and skip corresponding tests - basics: split out specific bytearray tests to separate files - basics: use bytes not bytearray when checking user buffer proto - add feature check for slice and skip corresponding tests - basics: split out specific slice tests to separate files - run-tests: add misc list of tests that use slice, to skip them - basics: automatically skip tests that use str/bytes modulo-format - add feature check for uio module and skip corresponding tests - basics: split sys.exit test to separate file so it can be skipped - extmod: add test for ussl when passing in key/cert params - stress: add test for maximum length limit of qstrs - import: add test for importing viper code with additional flags - add script to run dynamic-native-module tests - add .exp files for basics/parser and import/import_override - stress/qstr_limit: tune params to run with stm32 port - basics/memoryview_itemsize: make portable to 32- and 64-bit archs - extmod/vfs_lfs_error: use small ints in seek error test - pyb: refactor pyboard tests to work on PYBv1, PYBLITEv1 and PYBD mpy-cross: - do not automatically build mpy-cross, rather do it manually - main: only accept full emit cmdline options if native enabled - make mpconfigport.h compatible with msvc compiler - add msvc build of mpy-cross - set number of registers in nlr_buf_t based on native arch - enable Xtensa-Windowed native emitter - support armv7em, armv7emsp, armv7emdp architectures - README.md: add notes about -march and -O all ports: - provide mp_hal_stdio_poll for sys.stdio polling where needed - add new make target "submodules" which inits required modules minimal port: - use soft float for CROSS=1 Cortex-M4 target - frozentest: recompile now that mpy version has changed - set CSUPEROPT=-Os to get minimal firmware size unix port: - mpconfigport.mk: update comment about TLS implementations - unix_mphal: use CLOCK_MONOTONIC for ticks_ms/us when available - enable sys.atexit, triggered after the main script ends - main: only accept full emit cmd-line options if native enabled - coverage: add coverage tests for ringbuf - convert to use FROZEN_MANIFEST to specify frozen code - enable module weak links - enable uos.VfsLfs1, uos.VfsLfs2 on coverage build - modtermios: fix output speed setter in tcsetattr windows port: - mpconfigport.h: define empty MP_WEAK symbol - mpconfigport.h: don't define restrict/inline/alignof for C++ - msvc: treat compiler warnings as errors - Makefile: make use of CFLAGS_EXTRA, LDFLAGS_EXTRA and SRC_MOD - msvc: remove unneeded definitions for qstr generation - msvc: move build options from .vcxproj to .props files - msvc: enable overriding directories used in the build - msvc: change the way sources are listed - default to binary mode for files - enable module weak links qemu-arm port: - add testing of frozen native modules - convert to use FROZEN_MANIFEST to specify frozen code - add ldscript dependency in the final firmware.elf target - let tinytest.o be built by standard build rules - Makefile: allow overriding CROSS_COMPILE from another makefile stm32 port: - usb: refactor CDC VCP code to enable N CDC interfaces - usb: support up to 3 VCP interfaces on USB device peripheral - boards/make-pins.py: allow pins.csv to skip or hide board-pin name - boards/pllvalues.py: search nested headers for HSx_VALUE defines - boards: add board definition files for PYBD -SF2, -SF3, -SF6 - modpyb: add pyb.country() function to set the country - extint: add extint_set() function for internal C access to EXTI - mphalport: add support for having MAC in OTP region - add low-level SDIO interface for cyw43 driver - integrate in the cyw43 driver and network.WLAN class - boards/PYBD_SFx: enable CYW43 WLAN driver - modnetwork: replace generic netif NIC polling with specific code - integrate optional mbedTLS component for ussl module - boards/PYBD_SFx: enable ussl module using mbedTLS - support optional lwIP mDNS responder - lwip_inc: update to enable mDNS, TCP listen backlog, faster DHCP - usbd_msc: rework USBD MSC code to support multiple logical units - usbd_msc: provide custom irquiry processing by MSC interface - usbd_msc: provide Mode Sense response data in MSC interface - usb: use ARG_xxx enums to access kw args in pyb_usb_mode - usb: add "msc" kw-arg to pyb.usb_mode to select MSC logical units - usbd_msc: allow to compile when USB enabled and SD card disabled - in link script, define start of stack separately from heap end - boards: enable ussl module via mbedtls for boards with network - Makefile: print info messages about use of mboot/QSPI flash - enter bootloader via a system reset - boards/pllvalues.py: support HSx_VALUE defined without uint32_t - boards: add stm32??xx_hal_conf_base.h files with common settings - boards: rework all stm32??xx_hal_conf.h files to use common code - usb: fix regression with auto USB PID value giving PID=0xffff - boards: optimise flash and RAM allocation for L4 boards - mpu: add helper functions for configuring MPU - eth: use MPU helper functions to configure MPU for ETH use - sdram: use MPU helper functions to configure MPU for SDRAM use - qspi: use MPU to allow access to valid memory-mapped QSPI region - qspi: force a reset of the QSPI peripheral when initialising it - qspi: handle bus acquisition - powerctrl: add hooks for a board to perform actions on sleep/wake - boards/PYBD_SFx: put SPI flash to sleep during sleep modes - mpconfigport.h: enable useful networking modules if lwIP enabled - usb: add support to auto-detect USB interface, either FS or HS - usb: add "port" keyword argument to pyb.usb_mode, to select FS/HS - spi: factor out code to calculate SPI source frequency - extint: simplify bitband support config for different MCUs - modmachine: make RTC class available in machine module - boards/PYBD_SF2: put mbedtls library code in external QSPI flash - update components to work with new H7xx HAL - Makefile: remove Wno-attributes for ll_usb HAL file - Makefile: use startup_stm32*.s file from stm32lib - boards: remove startup_stm32*.s files now they are in stm32lib - mpu: include MPU functions when ETH is enabled - lwip_inc: define LWIP_NO_CTYPE_H=1 to use lwIP ctype funcs - modmachine: disable IRQs before entering bootloader - boards/PYBD_SFx: configure EN_3V3 pin as output on boot - sdcard: add hook for a board to power on SD/MMC - boards/PYBD_SFx: automatically turn on EN_3V3 when powering SD/MMC - add initial support for STM32L0xx MCUs - boards: add MCU support files for STM32L072 - mpconfigport.h: make "framebuf" module configurable by a board - boards/NUCLEO_L073RZ: add definition files for new board - powerctrl: move L0's SystemClock_Config to powerctrlboot.c file - powerctrl: move F0's SystemClock_Config to powerctrlboot.c - remove SystemInit funcs, use stm32lib versions instead - boards/NUCLEO_F446RE: enable DAC - add support for STM32L452 MCUs - boards/NUCLEO_L452RE: add definition files for new board - boards/NUCLEO_F413ZH: remove STARTUP_FILE, it's defined globally - mboot: make _estack an array to avoid compiler warnings - mboot: remove use of BSRRL/H for H7 MCUs due to stm32lib update - mboot: use STARTUP_FILE from stm32lib - mboot: update dependencies to enable parallel build with -j - boards/B_L072Z_LRWAN1: add definition files for new board - gccollect: always use MP_STATE_THREAD(stack_top) to get stack top - usb: add config options to disable USB MSC and/or HID - usbd_cdc_interface: make CDC TX/RX buffer sizes configurable - add support for USB on L0 MCUs - powerctrlboot: increase SYSCLK to 32MHz for L0 MCUs - mphalport: fix GPIO clock enable for L0 MCUs - Makefile: allow a board to disable float support - boards/B_L072Z_LRWAN1: enable USB VCP support - boards/STM32F769DISC: fix length of FLASH_APP section - make-stmconst.py: allow more variation in parens and int-suffix L - add initial support for STM32WBxx MCUs - boards: add MCU support files for STM32WB55 - boards/NUCLEO_WB55: add definition files for new board - boards/USBDONGLE_WB55: add definition files for new board - flashbdev: support internal filesystem on STM32F722/23/32/33 - boards/stm32f722.ld: provide memory regions for internal FS - boards/NUCLEO_F722ZE: add definition files for new board - dma: fix re-start of DMA stream by clearing all event flags - usbd_hid_interface: rewrite USB HID interface code - boards/xxx_WB55: enable USB HID now that it works on WB MCUs - usbd_hid_interface: include extra header to build with threading - lwip_inc: enable raw socket type - mpconfigport.h: enable lwIP raw sockets - sdcard: support configuring the SD/MMC bus width to 1 or 4 bits - modpyb: support building with PY_PYB_LEGACY on and HW_USB_HID off - usbd: introduce MICROPY_HW_USB_IS_MULTI_OTG to simplify USB config - usbd: support USB device mode on STM32L432 MCUs - boards/NUCLEO_L432KC: add config for USB VCP support - usbd: make USB device FIFO sizes dynamically configurable - i2c: fix generation of restart condition for hw I2C on F0/F7 - mphalport: put PYBD specific MAC code in board specific file - mboot/Makefile: define "BUILDING_MBOOT" when building mboot - boards/PYBD_SF2: exclude certain things when building mboot - extint: fix EXTI mapping of PVD and RTC events for H7 MCUs - stm32_it: include correct EXTI interrupt handlers for L0 MCUs - dma: fix DMA config for L0 MCUs - powerctrl: fix machine.bootloader() for L0 MCUs - machine_adc: add machine.ADC class - machine_adc: improve operation of ADC for H7, L4 and WB MCUs - boards/stm32wb55_af.csv: fix ADC pin-channel function mapping - mboot: support boards with only two LEDs - boards/NUCLEO_L073RZ: fix typo in MCU name - boards/MIKROE_CLICKER2_STM32: add MikroElektronika Clicker2 board - boards/STM32F769DISC: fix number of SDRAM row bits - board/NUCLEO_F746ZG: enable Ethernet periph, lwip and ussl - usb: add support for VCP+MSC+HID mode, incl 2xVCP and 3xVCP - usb: verify number of used endpoints doesn't exceed maximum - lwip_inc: allocate additional MEMP_SYS_TIMEOUT when mDNS enabled - lwip_inc: enable LWIP_NETIF_EXT_STATUS_CALLBACK for mDNS - machine_adc: fix build for F4 and L4 MCUs that only have ADC1 - modusocket: fix NULL deref when accept() an unbound socket - machine_i2c: add ability to specify I2C(4) by name - can: factor CAN driver into low-level and Python bindings - add support for FDCAN peripheral, exposed as pyb.CAN - boards/NUCLEO_H743ZI: enable FDCAN on this board - use mp_printf with MICROPY_ERROR_PRINTER for uncaught exceptions - can: guard header file by MICROPY_HW_ENABLE_CAN - usbd_cdc_interface: add CTS flow control option for USB VCP - support disabling the compiler - powerctrlboot: fix clock and PLL selection for HSI48 on F0 MCUs - powerctrlboot: add support for HSI at 8MHz on F0 MCUs - uart: add RTS/CTS pin configuration support to UART4 - provide port-specific implementation for Nimble on STM32 - mpconfigport.h: add modbluetooth module to stm32 - boards/PYBD: enable BLE for Pyboard D - system_stm32: support selection of HSE and LSI on L4 MCUs - boards: enable MICROPY_HW_RTC_USE_LSE on L4 boards - {adc,machine_adc}: change ADC clock and sampling time for F0 MCUs - usbdev: fix compile error if MICROPY_HW_USB_CDC_NUM is set to 2 - boards/PYBD_SF2: put nimble library in external QSPI XIP flash - extract port-specific Nimble implementation - mboot: add option to automatically reset when USB is disconnected - sdcard: support boards with no SD card detect pin - use hardware double sqrt on F7/H7 MCUs - boards: add new board ADAFRUIT_F405_EXPRESS - convert to use FROZEN_MANIFEST to specify frozen code - adc: update ADC driver to work with the new H7 HAL - adc: remove unused macro and channel check, and fix spacing - adc: use IS_CHANNEL_INTERNAL macro to check for internal channels - adc: fix sampling for internal channels on H7 MCUs - mpu: save and restore the IRQ state when configuring MPU - accel: rename MMA I2C macro constants to make it generic - accel: add support for KXTJ3 - boards: add NADHAT_PYB405 board - accel: fix Accel.read() method so it does read a byte - powerctrlboot: fix config of systick IRQ priority on F0/L0/WB MCU - sdram: fix to use new mpu_config_start/mpu_config_end signature - Makefile: only enable hardware sqrt on parts that support it - timer: fix Timer.freq() calc so mult doesn't overflow uint32_t - add soft timer implementation, using SysTick at 1ms resolution - add machine.Timer with soft timer implementation - add support for RF coprocessor on WB55 MCUs - boards: enable support for bluetooth on WB55 boards - mpthreadport: include runtime.h to get defn of mp_raise_msg - boards/stm32f405_af.csv: fix typo in ETH_RMII_REF_CLK on PA1 - nimble_hci_uart.c: prevent scheduler running during CYW-BT wakeup - generalise flash mounting code so it supports arbitrary FS - storage: make pyb.Flash configurable, and support ext block proto - main: auto detect block device used for main filesystem - moduos: add VfsLfs1 and VfsLfs2 to uos module, if enabled - boards: enable LFS2 on PYBv1.x and PYBD boards - storage: change storage_read/write_blocks to return int type - storage: make start/len args of pyb.Flash keyword only - qstrdefsport.h: remove unused qstrs and make USB ones conditional - boards/NUCLEO_L073RZ: skip board-pin names for CPU only pins - main: fix auto creation of pyb.Flash on boot with kw-only args - mpconfigport.h: use IRQ_PRI_PENDSV to protect bluetooth ringbuf - uart: add support for UART4/5 on L0 MCUs - boards/xxx_WB55: enable littlefs2 on WB55 boards - main: fix SKIPSD file detection so SD card is mounted by default - Makefile: enable max buffer size on W5200 NIC when used with lwIP - modusocket: handle case of NULL NIC in socket ioctl - boards/PYBD_SF2: configure LEDs as inverted, for LED.intensity() - boards/NUCLEO_F767ZI: add pins and config for using an SD card - boards/NUCLEO_F767ZI: update pins, peripherals and total flash - boards/NUCLEO_H743ZI: add extra pins and peripheral definitions - timer: add missing TIM 1/15/16/17 IRQ handlers for H7 MCUs - boards/PYBD: include webrepl helper scripts in frozen manifest esp8266 port: - uart: fix invalid ringbuf name when event driven REPL enabled - provide custom machine_time_pulse_us that feeds soft WDT - mpconfigport.h: enable lwIP raw sockets - machine_uart: allow remapping UART TX/RX pins from 1/3 to 15/13 - put new profile code in iROM - machine_adc: rename pyb_adc_* to machine_adc_* - machine_adc: add read_u16 method and refactor - add per-board configs, following other ports - modules/ntptime.py: always close socket, and set day-of-week - convert to use FROZEN_MANIFEST to specify frozen code - allow building without a manifest - boards: add manifest_release.py with files for a release - modules/flashbdev.py: support extended block protocol - moduos: add optional support for VfsLfs1 and VfsLfs2 esp32 port: - machine_timer: reuse Timer handles, deallocate only on soft-reset - add machine.SDCard class using built-in HW SD/MMC controller - update to use ESP IDF v3.3-beta3 - modnetwork: still try to reconnect to WLAN even with AUTH_FAIL - Makefile: include all driver/*.c source files in the build - network_ppp: add ppp_set_usepeerdns(pcb, 1) when init'ing iface - add support for hardware I2C - Makefile: fix path expansion for ESPIDF_DRIVER_O - Makefile: put OBJ and LIB rule additions in gen_espidf_lib_rule - Makefile: simplify include of IDF source by using wildcards - pin MicroPython tasks to a specific core - Makefile: include CFLAGS_EXTRA in CFLAGS definition - network_ppp: add authentication support to the PPP interface - add support for mDNS queries and responder - modules: on initial setup mount internal flash at root - add per-board configs, following other ports - add esp32.Partition class to expose partition and OTA funcs - add 'config' function to network.LAN, reusing network.WLAN - Makefile: fix subst->patsubst in ESPIDF_BOOTLOADER_SUPPORT_O - machine_adc: add ADC.read_u16() method - update to use ESP IDF v3.3 - boards/TINYPICO: switch to use QIO and 80MHz for SPI interface - add VFS FAT partition to partitions.csv and mount it as the FS - add support for ESP32-D2WD with 2MiB internal flash - modules/inisetup.py: use bdev.ioctl instead of bdev.SEC_SIZE - Makefile: add SDKCONFIG_H to QSTR_GLOBAL_REQUIREMENTS - support building with ESP IDF 4.0-beta1 - add check to Makefile for pyparsing version - add check to Makefile that the toolchain is in PATH - main: use both 3.3 and 4.0 config vars to enable SPIRAM - Makefile: fix printing of supported git hash - enable native emitter - implement BLE using Nimble from IDF 4.x - boards: enable BLE by default when building with IDF 4.x - add 4.x version of IDLE WDT config - run NimBLE on the app core - convert to use FROZEN_MANIFEST to specify frozen code - machine_uart: add ability to invert UART pins - boards: split out CPU frequency config, make 160MHz the default - machine_hw_spi: fix exception msg when host is already in use - Makefile: add correct arch to MPY_CROSS_FLAGS for native code - remove unused "esponewire.c" in favour of extmod/modonewire - esp32_partition: support extended block protocol - moduos: enable uos.VfsLfs2 for littlefs filesystems - boards/sdkconfig.base: resize SSL output buffer from 16 to 4kiB - rtc: set system microseconds when setting time via RTC.datetime() - machine_rtc: make RTC.memory size and availability configurable - machine_rtc: reduce memory footprint of user mem functionality - boards: enable ULP in base sdk configuration - boards/TINYPICO: add tinypico.py, dotstar.py with custom manifest - esp32_rmt: add initial support for RMT peripheral javascript port: - enable support for frozen bytecode via FROZEN_MPY_DIR nrf port: - led: adjust how board LEDs are defined - clean up source by removing tabs, trailing spaces, non-ASCII chars - machine/adc: add ADC.read_u16() method - add ADC channel mapping to alt function table - machine/adc: allow to pass a Pin object in to ADC constructor - machine/adc: fix mapping of ADC channel to pin - boards/make-pins.py: fix gen of board pins to use correct index - Makefile: add support for flashing with a Black Magic Probe - boards: add Particle Xenon board configuration (an nRF52840) - boards: add board definition for uBlox Nina B1 series BLE modules - i2c: add support for TWIM (EasyDMA) - temp: move module configuration guard - uart: add support for UARTE (EasyDMA) - flash: update flash driver to use nrfx_nvmc driver - led: expose public API for LED manipulation - main: update the way the LED is used on startup - add support to activate MICROPY_PY_SYS_STDFILES - device: correct SPIM3 IRQ handler entry for nrf52840 - add tinyusb support for nrf52840 - boards: add support for pca10059 - add nrf9160 base support - boards: add nrf9160 pca10090 board - main: execute boot.py/main.py frozen modules without a file system - boards/particle_xenon: enable USB CDC on Particle Xenon board powerpc port: - add initial port to bare metal PowerPC arch samd port: - add new port to Microchip SAMDxx microcontrollers - make common linker scripts, rename board.mk to mpconfigboard.mk - boards: add Adafruit Feather M0 Express board configuration - boards: add Mini SAM M4 board configuration - add minimum config for Atmel SAMD21-XPLAINED-PRO board zephyr port: - main: use mp_stack API instead of local pointer for stack top docs: - machine: add initial docs for new machine.SDCard class - library/framebuf: add missing module reference in example code - library/sys: add documentation for sys.atexit function - pyboard: update name of mounted volume to match code - pyboard: clarify initial files on pyboard and fix up formatting - library: document that sys.version_info returns a 3-tuple only - pyboard: emphasize the instructions for making a USB mouse - reference/speed_python: update that read-only buffers are accepted - reference/speed_python: add missing self to var caching example - library/pyb.DAC.rst: correct frequency for triangle mode output - rename machine.ADC docs to machine.ADCWiPy - library: specify new machine.ADC class - library/pyb.rst: update docs for pyb.usb_mode() function - library/pyb.rst: update pyb.usb_mode() to mention VCP+MSC+HID - library/pyb.USB_VCP.rst: add info about id and flow params - develop/qstr.rst: add documentation for string interning - library/bluetooth: add initial BLE documentation - reference/glossary.rst: add new terms and reduce complexity of old - library/bluetooth.rst: clarify gap_advertise adv_data behavior - library/bluetooth.rst: explain how to increase char buffer size - library/bluetooth.rst: fix typo in HR/UART services example - esp8266/tutorial: make http_get sample function self contained - library: clarify relation between machine and port-specific mods - esp8266: add ntptime usage to esp8266 quickref - fix spelling in various parts of the docs - wipy/tutorial: link Blynk examples to the official library - library: rename "array" module to "uarray" - library/bluetooth: rename to "ubluetooth" - move ubluetooth under "MicroPython-specific libraries" - library: add documentation for extended block device protocol - library/ubluetooth: add docs for gatts_set_buffer - conf.py: fix path to favicon.ico - templates/topindex.html: replace usage of deprecated defindex.html - library/machine.SDCard.rst: fix various typos - library/ubluetooth: fix name and link to FLAG_xxx constants - reference: add docs describing use of pyboard.py - library: add docs for pyb.Flash class - add littlefs docs and a filesystem tutorial - reference/filesystem: fix typo in block device code example - reference/filesystem: add note and example about using filesystem - library/ubluetooth: add note about API being under development - library/uos: add notes and links about littlefs failures - library/uos.rst: clarify why the extended interface exists - esp8266/quickref: add note that machine.RTC is not fully supported - reference: add documentation describing use of .mpy files - develop: add documentation on how to build native .mpy modules - esp32: add quickref and full docs for esp32.RMT class travis: - build PYBD_SF2 board as part of the stm32 job - selectively fetch git submodules only when needed - build esp8266 firmware as part of Travis CI - build esp32 firmware as part of Travis CI - enable performance benchmark tests on standard unix build - add samd port to Travis build - build stm32 mboot for PYBD_SF6 as part of CI - switch unix stackless build to use clang - build an stm32 board with threading enabled to test it with CI - add new job to test unix port with sys.settrace enabled - add ESP32 build with IDF v4 - build more stm32 boards to cover all supported MCUs - build unix nanbox with PYTHON=python2 - add BLE submodules to ESP32 IDF4 build - add esp8266 GENERIC_512K build to CI - use "make submodules" to init required modules for each port - add job to build and test unix minimal port - add tests for building and importing dynamic native modules - build urandom native module in coverage job examples: - bluetooth: add basic BLE peripheral examples - bluetooth: use UUIDs directly to add services to adv payload - bluetooth/ble_uart_peripheral.py: add usage demo - embedding: replace symlink of mpconfigport.h with real file - bluetooth/ble_uart_peripheral: use append mode for RX char - embedding: remove obsolete fatfs files from build - bluetooth: add helpers for decoding advertising payloads - bluetooth: add example for reading temperature sensor - natmod: add btree example - natmod: add uheapq example - natmod: add uzlib example - natmod: add framebuf example - natmod: add ure example - natmod: add features1 and features2 examples - natmod: add urandom native module example - network: add testing key/cert to SSL HTTP server example - natmod: add very simple features0 example to compute factorial miscellaneous: - top: add CODEOFCONDUCT.md document based on the PSF code of conduct - gitignore: put build-*/ pattern in top-level gitignore file - gitattributes: mark *.a files as binary
Improved mpy format with support for native code, and new JavaScript …
…port
In this release the mpy file format has been moved to version 4 and has
some significant improvements: mpy file size is reduced on average by about
35%, loading time of mpy files is reduced by about 40%, and they now have
support to save native, viper and inline assembler code (or machine code
generated from any other source). Size reduction of mpy files was achieved
by adding a qstr window to reuse past qstrs when encoding them, by packing
qstrs directly in the bytecode, and by defining a static qstr set.
Some VM opcodes were also changed to fix a bug when doing a break/continue
out of a finally block, and to make some simplifications. In particular
POP_BLOCK and POP_EXCEPT opcodes were replaced with POP_EXCEPT_JUMP.
Most uppercase macros have been converted to lowercase to make a more
consistent C API, including all MP_OBJ_IS_xxx and MP_xxx_SLOT_IS_FILLED
macros.
The default PYTHON makefile variable is now changed from "python" to
"python3", but Python 2 is still supported via "make PYTHON=python2".
The mpy-cross compiler supports the new mpy version 4 and has new command
line options: "-march=<arch>" to select the native emitter, and "--version"
to print the MicroPython version and the mpy version. Also mpy-tool.py has
support for freezing native code.
A module system for external, user C modules has been implemented and
documentation for this is available in the new "docs/develop" section.
A new "javascript" port has been added which targets JavaScript as the
machine via Emscripten. This allows to run MicroPython as an application
within node.js, and to run it within a browser (among other things).
All bare-metal ports have the following improvements: machine.sleep() is
now machine.lightsleep(), and both lightsleep() and deepsleep() now take an
optional argument which is the maximum time to sleep in milliseconds.
These ports also now allow freezing of boot.py and main.py using the usual
methods. And a new I2C method i2c.writevto(addr, vect) is added which can
be used to write a tuple/list of buffers all at once to an I2C device.
The stm32 port now has a fully integrated Ethernet MAC driver (see the
network.LAN class) using lwIP for the TCP/IP stack, and sockets were made
significantly more robust. Support for F413 MCUs was added. There are
also some minor user-facing changes to this port:
- machine.UART (and pyb.UART) now defaults to timeout=0 (was 1000ms) which
gives UARTs a non-blocking behaviour.
- The USB REPL is now configurable using uos.dupterm, and by default
pyb.USB_VCP(0) is put on dupterm slot 1 before boot.py is executed. To
disable the default REPL use: uos.dupterm(None, 1).
- pyb.DAC(id) will now only reset the DAC the first time it is called; to
get the old behaviour pass the bits parameter like: pyb.DAC(id, bits).
- pyb.DAC.noise() and pyb.DAC.triangle() now output at full scale.
- The system will not recreate boot.py if it's missing (it will only create
it if the filesystem is corrupt, or when doing a factory reset).
For the esp32 port, the build process has been updated to align better with
the ESP IDF and now uses sdkconfig to configure features. Dual core mode
is now enabled by default, SPIRAM is in memory-mapped mode so all of it can
be used for the MicroPython heap, there is support to change the CPU
frequency, and the WDT now panics and resets the device if it times out.
A detailed list of changes follows.
py core:
- remove calls to file reader functions when these are disabled
- add optional support for 2-argument version of built-in next()
- compile: swap order of pop_block/pop_except in "except as" handler
- warning: support categories for warnings
- builtinhelp: only print help re FS modules if external import enabled
- downcase all MP_OBJ_IS_xxx macros to make a more consistent C API
- downcase MP_xxx_SLOT_IS_FILLED inline functions
- mkenv.mk: change default PYTHON variable from "python" to "python3"
- qstr: evaluate find_qstr only once then pass to Q_GET_HASH macro
- obj.h: remove obsolete mp_obj_new_fun_viper() declaration
- objfun: make fun_data arg of mp_obj_new_fun_asm() a const pointer
- eliminate warnings about unused arguments when debugging disabled
- compile: fix handling of unwinding BaseException in async with
- compile: add optimisation to compile OrderedDict inplace
- objexcept: fix hash of exc str created in mp_obj_new_exception_msg
- py.mk: update lwip build config to work with latest lwip version
- fix VM crash with unwinding jump out of a finally block
- vm: remove currently_in_except_block variable
- replace POP_BLOCK and POP_EXCEPT opcodes with POP_EXCEPT_JUMP
- persistentcode: add a qstr window to save mpy files more efficiently
- persistentcode: pack qstrs directly in bytecode to reduce mpy size
- persistentcode: define static qstr set to reduce size of mpy files
- add independent config for debugging sentinel object values
- emitnative: consolidate where HASCONSTS is set to load-const-obj fun
- emitnative: provide concentrated points of qstr emit
- emitnative: adjust accounting of size of const_table
- emitglue: remove union in mp_raw_code_t to combine bytecode & native
- add support to save native, viper and asm code to .mpy files
- persistentcode: bump .mpy version to 4
- allow registration of modules at their definition
- implement a module system for external, user C modules
- update and rework build system for including external C modules
- move mp_native_type_from_qstr() from emitnative.c to nativeglue.c
- nativeglue: rename native convert funs to match other native helpers
- compile: add support to select the native emitter at runtime
- compile: support multiple inline asm emitters
- compile: check that arch is set when compiling native, viper or asm
- runtime: remove long-obsolete MICROPY_FSUSERMOUNT init code
- scheduler: convert micropythyon.schedule() to a circular buffer
- nlrthumb: add support for iOS where the C func is _nlr_push_tail
- makedefs: use io.open with utf-8 encoding when processing source
- runtime: optimise to not create temp float for int to power negative
- runtime: fix mp_unpack_ex so seq can't be reclaimed by GC during use
- mpprint: support printing %ld and %lu formats on 64-bit archs
- asmthumb: support asm_thumb code running on normal ARM processors
- native: improve support for bool type in viper functions
- remove "if (0)" and "if (false)" branches
- objgenerator: fix handling of None passed as 2nd arg to throw()
- objgenerator: remove unneeded forward decl and clean up white space
- misc.h: rename _MP_STRINGIFY to not use leading underscore in ident
- persistentcode: change "len" type to size_t for mp_obj_str_get_data
- objarray: add support for memoryview.itemsize attribute
- objarray: add decode method to bytearray
- update makefiles to use $(CAT) variable instead of hard coded "cat"
- update makefiles to use $(TOUCH) instead of hard coded "touch"
extmod:
- moduzlib: update to uzlib 2.9.2
- modlwip: add support for polling UDP sockets for writability
- moduhashlib: include implementation of sha256 only when required
- convert legacy uppercase macro names to lowercase
- moduwebsocket: refactor `websocket` to `uwebsocket`
- modlwip: change #ifdef to #if for check of MICROPY_PY_LWIP
- modlwip: fix bug when polling listening socket with backlog=1
- modlwip: add concurrency protection macros
- modwebrepl: fix logic to handle a put of file of size 0
- vfs_fat: update for new oofatfs version
- modlwip: fix case where concurrency lock isn't released on error
- moduselect: adjust select_select and poll_register to use size_t
- vfs_fat: fallback to FAT32 if standard FAT16/SFD format fails
- modlwip: handle case of connection closing while on accept queue
- modlwip: handle case of accept callback called with null PCB
- modlwip: protect socket.accept with lwIP concurrency lock
- modlwip: free any stored incoming bufs/connections on TCP error
- modlwip: use correct listening socket object in accept callback
- modlwip: abort TCP conns that didn't close cleanly in a while
- modurandom: add init method to seed the Yasmarang generator
- machine_signal: fix fault when no args are passed to Signal()
- modussl_mbedtls: support non-blocking handshake
- modussl_axtls: add non-blocking mode support
- moducryptolib: add optional AES-CTR support
- modujson: handle parsing of floats with + in the exponent
- machine_i2c: change C-level API to allow split I2C transactions
- machine_i2c: remove need for temporary memory in writemem() call
- machine_i2c: add i2c.writevto() that can write a vector of bufs
- modlwip: free any incoming bufs/connections before closing PCB
- modlwip: register TCP close-timeout callback before closing PCB
lib:
- utils/pyexec: implement paste mode with event driven REPL
- utils/printf: exclude __GI_vsnprintf alias for gcc 9 and above
- utils/gchelper_m3: add license header and clean up code
- utils/gchelper_m3: add gc_helper_get_sp() function
- utils/gchelper: add gchelper.h header file for assembler functions
- netutils: add function to print tracing info for Ethernet frames
- oofatfs: update oofatfs library to R0.13c working branch
- oofatfs: update ffconf.h config for new oofatfs version
- oofatfs: update oofatfs library to fix issue with logic not
- stm32lib: update library to fix F7 MMC capacity calculation
- utils/pyexec: add pyexec_file_if_exists() helper function
- utils: make pyexec_file_if_exists run frozen scripts if they exist
- utils/interrupt_char: invalidate interrupt char at start up
- stm32lib: update library to fix UART9/10 baudrate on F4 MCUs
- nrfx: upgrade nrfx to v1.7.1 plus a UART bug fix
drivers:
- memory/spiflash: rework wait_sr to fix uninit'd variable 'sr'
- display/ssd1306.py: change to use new i2c.writevto() method
tools:
- mpy-tool.py: add support for freezing native code
- upip.py: use "raise arg" instead of no-arg raise form, for native
- pyboard.py: add missing line from example usage comments
- mpy-tool.py: adjust use of super() to make it work with Python 2
- mpy-tool.py: fix init of QStrWindow, and remove unused variable
- pyboard.py: don't accumulate output data if data_consumer used
- upip.py: add support for multiple index URLs with custom default
tests:
- basics: add tests for try-except-else and try-except-else-finally
- run-tests: support running native tests via mpy
- import: add test for importing x64 native code
- extmod: add test for FAT filesystem on a very large block device
- run-tests: ignore exception in process kill when ending repl test
- micropython: add some tests for failed heap allocation
- skip tests needing machine module if (u)machine doesn't exist
- ussl_basic: disable setblocking() calls
- basics/sys1.py: add test for calling sys.exit() without any args
- pyb: update UART expected output now that default timeout is 0
- basics: add coverage tests for memoryview attributes
mpy-cross:
- enable building of x64 native .mpy files
- add "-march=<arch>" option to select native emitter
- support compiling with MICROPY_PY___FILE__ enabled
- automatically select ARMV6 arch when running on such a host
- add --version command line option to print version info
all ports:
- change PYB message prefix to MPY
- convert legacy uppercase macro names to lowercase
- update to work with new oofatfs version
- {stm32,esp8266}: set mpy-cross native arch for frozen native code
- convert to use pyexec_file_if_exists() to execute boot/main.py
unix port:
- mpthreadport: add thread deinit code to stop threads on exit
- mpthreadport: cleanup used memory on thread exit
- mpthreadport: remove busy wait loop in thread garbage collection
- modmachine: handle repeated /dev/mem open errors
- modffi: eliminate unused-argument warning when debugging disabled
- Makefile: update coverage tests to match those in Travis
- mpthreadport: use named semaphores on Mac OS X
- gcollect: make sure stack/regs get captured properly for GC
- coverage: add test for printing literal % character
- modusocket: fix use of setsockopt in usocket.settimeout impl
- modusocket: raise ETIMEDOUT when connect or accept has timeout
windows port:
- fix line wrapping behaviour on the REPL
qemu-arm port:
- rework to run bare-metal on boards with Cortex-M CPUs
- use gchelper code to get registers for GC scanning
stm32 port:
- implement machine.lightsleep()
- rtc: check RTCEN=1 when testing if RTC is already running on boot
- usbdev: add USB config option for board being self powered
- usbdev: add USB config option for max power drawn by the board
- main: make board-defined UART REPL use a static object and buffer
- boards/stm32f429_af.csv: fix typos in UART defs Tx->TX and Rx->RX
- mboot: add option to autodetect the USB port that DFU uses
- sdcard: don't use SD clock bypass on F7 MCUs
- usb: add flow control option for USB VCP data received from host
- boards/make-pins.py: add basic support for STM32H7 ADC periphs
- boards/stm32h743_af.csv: add ADC entries to pin capability table
- adc: add basic support for ADC on a pin on STM32H7 MCUs
- mboot: use USB HS as main USB device regardless of USB_HS_IN_FS
- mboot: add support for STM32F769 MCUs
- mboot: add support for GPIO ports G, H, I and J
- mboot: allow deploying via deploy-stlink
- usb: use USB HS as main USB device regardless of USB_HS_IN_FS
- usbd_conf: fully support USB HS with external PHY
- modmachine: make bootloader() enter custom loader if it's enabled
- boards/STM32F769DISC: support the use of USB HS with external PHY
- boards/STM32F769DISC: configure for use with mboot by default
- systick: rename sys_tick_XXX functions to systick_XXX
- systick: make periodic systick callbacks use a cyclic func table
- pendsv: clean up pendsv IRQ handler and eliminate duplicate code
- pendsv: add ability to schedule callbacks at pendsv IRQ level
- systick: provide better compile-time configurability of slots
- modnetwork: change lwIP polling to be based on background systick
- move gchelper assembler code to lib/utils for use by other ports
- gccollect: use gchelper.h header instead of explicit declaration
- pendsv: fix inline asm constant and prefix with # character
- mboot/Makefile: support specifying BOARD_DIR for custom board
- boards/NUCLEO_L476RG: add support for RNG, DAC and CAN1
- boards/make-pins.py: add cmdline options to support use by mboot
- mboot/Makefile: generate all pin header files from board pins.csv
- mboot/mphalport.h: include genhdr/pins.h for access to pin names
- qspi: use static af functions for pin configuration
- mboot: add support for loading gzip'd firmware from a filesystem
- mboot: move some BSS vars to new section that isn't zeroed out
- mboot: add support script which can program mboot and application
- modmachine: add ability to pass through user data to mboot
- mboot: add hook to run board-specific code early on startup
- boards/stm32f429.ld: increase uPy heap size by 64k for F429 MCU
- extint: fix ExtInt to work with non-GPIO pins
- extint: fix RTC Alarm/FS USB EXTI constants for L4
- make-stmconst.py: improve regex to parse more constants
- extint: add non-GPIO EXTI IRQ sources for F0
- extint: remove unused (and incorrect) EXTI defines
- stm32_it: fix RTC IRQ handler to handle all EXTI IRQs on F0 MCUs
- sdram: increase GPIO speed for SDRAM interface to "very high"
- boards/NUCLEO_F767ZI: fix up comments about HCLK computation
- mphalport: add mp_hal_get_mac() helper function
- eth: add low-level Ethernet MAC driver
- network_lan: add high-level network.LAN interface to ETH driver
- mpconfigport.h: enable lwIP concurrency protection mechanism
- modnetwork: don't call NIC callback if it's NULL
- boards/NUCLEO_F767ZI: enable lwIP and Ethernet peripheral
- boards/STM32F7DISC: enable lwIP and Ethernet peripheral
- boards/STM32F769DISC: enable lwIP and Ethernet peripheral
- boards/NUCLEO_F429ZI: enable lwIP and Ethernet peripheral
- qspi: enable sample shift and disable timeout counter
- Makefile: allow a board to specify its linker sections for FW
- boards/STM32F769DISC: use external QSPI flash to store some code
- use global lwip build config and support building without lwip
- boards: update to use new build config for lwip component
- add compile-time option to use HSI as clock source
- mboot: update to match latest oofatfs version
- allow to build with threading with the GIL disabled
- qspi: set pin speed to very-high and allow to config some options
- usb: allow to override USB strings & VID/PID in app and mboot
- stm32_it: guard UART7_IRQHandler with check for UART7 define
- mboot: set USE_MBOOT=1 by default in the Makefile
- system_stm32: provide default value for HSI calibration
- mpconfigport.h: remove malloc/free/realloc helper macros
- boards/STM32L476DISC: enable servo support on STM32L476DISC board
- Makefile: allow to override CROSS_COMPILE with included Makefile
- make default USB_VCP stream go through uos.dupterm for main REPL
- timer: expose the PWM BRK capability of Timer 1 and 8
- uart: handle correctly the char overrun case of RXNE=0 and ORE=1
- rename MICROPY_HW_HAS_SDCARD to MICROPY_HW_ENABLE_SDCARD
- add support for MMC driver, exposed via pyb.MMCard class
- moduos: allow to compile again without USB enabled
- network_wiznet5k: add ability to trace Ethernet TX and RX frames
- network_wiznet5k: add ability to set the MAC address
- network_wiznet5k: automatically set MAC if device doesn't have one
- i2cslave: add support for H7 MCUs
- usbd_conf: add support for USB HS peripheral on H7 MCUs
- mboot: add support for H7 MCUs, with H743 flash layout
- boards/NUCLEO_H743ZI: add config options to support mboot
- boards/NUCLEO_L432KC: disable complex nos and default frozen mods
- rtc: add auto-LSE-bypass detection with fallback to LSE then LSI
- rtc: remove unused LSE detection code
- rtc: remove non-ASCII mu-character from source code comment
- timer: correctly initialise extended break settings on F7/H7/L4
- system_stm32f0: enable PWR clock on startup
- system_stm32f0: add support for using HSE and PLL as SYSCLK
- powerctrl: enable EIWUP to ensure RTC wakes device from standby
- dac: rework DAC driver to use direct register access
- usbdev: make USB device descriptors at runtime rather than static
- usb: add USB device mode for VCP+VCP without MSC
- powerctrl: deselect PLLSAI as 48MHz src before turning off PLLSAI
- usb: remove mp_hal_set_interrupt_char now that it's reset at boot
- main: increase default UART REPL rx buffer from 64 to 260 bytes
- powerctrl: support changing frequency when HSI is clock source
- flash: fix bug computing page number for L432 page erase
- add support for F413 MCUs
- boards: add NUCLEO_F413ZH board configuration
- machine_uart: change default UART timeout to 0, for non blocking
- move factory reset files and code to separate source file
- usbd_cdc_interface: don't retransmit chars if USB is reconnected
- rtc: allow overriding startup timeouts from mpconfigboard
- dma: initialise all members of DMA structs for H7 MCUs
- dma: always reset and configure the H7 DMA peripheral
- spi: enable SPI IRQs and add IRQHandlers for H7 MCUs
- irq: fix IRQ_ENABLE_STATS stats config to work on all MCUs
- boards/NUCLEO_H743ZI: enable SPI3 on this board
- modmachine: create dedicated asm function to branch to bootloader
- adc: fix VBAT_DIV to be 4 for STM32F411
- machine_i2c: update to support new C-level I2C API
- i2c: make timeout for hardware I2C configurable
- machine_i2c: simplify ROM initialisation of static HW I2C objects
- i2c: support setting the I2C TIMINGR value via keyword arg
- sdcard: add switch break to ensure only correct SD/MMC IRQ is run
- sdram: update MPU settings to block invalid region, change attrs
- mboot/README: fix some typos, describe bootloader and fwupdate.py
- modmachine: in bootloader() disable caches before reset of periphs
cc3200 port:
- mods/modussl: fix ca_certs arg validation in mod_ssl_wrap_socket
- modmachine: rename machine.sleep to machine.lightsleep
- use common gchelper_m3.s code from lib/utils
- mpconfigport.h: disable compiler optimisation of OrderedDict
esp8266 port:
- modmachine: implement optional time_ms arg to machine.deepsleep
- modmachine: rename machine.sleep to machine.lightsleep
- modmachine: implement simple machine.lightsleep function
- modmachine: in lightsleep, only waiti if wifi is turned off
- modmachine: call ets_event_poll after waiti in machine.idle
- modmachine: handle overflow of timer to get longer periods
- fix ticks_ms to correctly handle wraparound of system counter
esp32 port:
- don't put py/scheduler.o in iRAM, it's no longer needed
- Makefile: put all IDF compenents in .a libs to use IDF ld script
- update to latest ESP IDF using sdkconfig and new ldgen procedure
- machine_timer: deinit all active timers on soft reset
- Makefile: make sure that directory exists for sdkconfig.h
- boards: use auto xtal freq config instead of default 40MHz
- modsocket: fix crashes when connect/bind can't resolve given addr
- modmachine: rename machine.sleep to machine.lightsleep
- use SPIRAM in mem-map mode so all of it can be used for uPy heap
- modmachine: add support for changing the CPU frequency
- modsocket: fix usocket.send to accept anything with buffer proto
- modsocket: change socket.socket to be socket type rather than fun
- network_lan: add arg to constructor to set clock mode for ETH PHY
- modnetwork: catch and report Ethernet events
- network_lan: make power arg to constructor optional
- modnetwork: fix wifi.isconnected to return False after disconnect
- modnetwork: implement RSSI for WiFi STA via WLAN.status('rssi')
- modnetwork: remove redundant esp_log include
- Makefile: add some missing IDF source files to bootloader and app
- mphalport: use ets_delay_us for mp_hal_delay_us_fast
- machine_pin: make it so None as pull value disables pull up/down
- machine_pin: add new PULL_HOLD pin pull mode
- machine_pin: rework pull mode config to fix GPIO hold feature
- mpthreadport: exit vPortCleanUpTCB early if threading not init'd
- boards: enable dual core support by default
- boards/sdkconfig: disable WDT check of idle task on CPU1
- README: add info about pyparsing and the correct Python version
- machine_wdt: add timeout arg to select interval, make WDT panic
- modnetwork: change type to size_t for uses of mp_obj_str_get_data
- machine_uart: implement UART.deinit() method
- network_ppp: add a timeout for closing PPP connection
- machine_touchpad: use HW timer for FSM to enable wake-on-touch
- modsocket: raise EAGAIN when accept fails in non-blocking mode
javascript port:
- add new port targeting JavaScript via Emscripten
- fix Emscripten async load, and to compile with modern clang
- library: use Buffer.alloc() since new Buffer() is deprecated
- pass (error) exit value out from script to process caller
- Makefile: fix unrepresentable float error by using clamp
- library: print data as raw bytes to stdout so unicode works
nrf port:
- modmachine: rename machine.sleep to machine.lightsleep
- uart: use formula instead of switch for baudrate calculation
- uart: remove unused machine.UART() parameters
- shrink "<peripheral> does not exist" error messages
- pin: cleanup Pin.__str__ to print relevant information
- pin: print pull information in Pin.__str__
- ticker: remove duplicate NRFX_IRQ_PRIORITY_SET
- timer: fix disabling Timer 1 when using soft PWM
- readme: update link to nrfjprog download
- bluetooth: improve advertisment behavior for nrf52 targets
- bluetooth: resolve compilation warning in ble_drv.c
- readme: update make flash command when defining board
- pwm: remove superfluous NULL in machine_hard_pwm_instances
- bluetooth: add support for SoftDevice s132 version 6.1.1
- board: migrate all nrf52832 targets to new BLE stack
- bluetooth: deprecate use of SoftDevice s132 v6.0.0
- bluetooth: add support for SoftDevice s140 version 6.1.1
- board: migrate nrf52840 target to new BLE stack
- bluetooth: deprecate use of SoftDevice s140 v6.0.0
- readme: add section about LTO
- Makefile: update to match latest oofatfs version
- boards: add support for BLYST Nano module based boards
- change types to size_t for all uses of mp_obj_str_get_data
- machine/i2c: update to support new C-level I2C API
- nrfx_glue: adapt to nrfx v.1.7.1
- uart: change UART driver to be non-blocking and use IRQs
- mpconfigport.h: enable MICROPY_KBD_EXCEPTION by default
- uart: make UART print output something, and add write method
- mphalport: use wfi to save power while waiting at the UART REPL
zephyr port:
- modzephyr: revamp stacks_analyze() call
- modzsensor: rename "TEMP" sensor channel to "DIE_TEMP"
- prj_minimal.conf: switch to CONFIG_STDOUT_CONSOLE
- Makefile: proxy ram_report, rom_report targets from Zephyr
- prj_frdm_k64f.conf: add fxos8700 sensor
- prj_frdm_kw41z.conf: add new board configuration
- i2c: add support for hardware i2c
- CMakeLists.txt: set AR to point to the Zephyr toolchain exe
- machine_i2c: update to support new C-level I2C API
- switch back to enabling I2C in board-specific configs
docs:
- machine: change sleep to lightsleep and add timeout arguments
- convert all cases of machine.sleep to machine.lightsleep
- ure: fix match.group signature to indicate index param is required
- uos: document extra requirements on stream objs passed to dupterm
- pyboard: add link to pyboard v1.1 schematic and layout PDF
- pyboard: make pyboard v1.1 pinout the default shown in quickref
- develop: fix typos in C-module example for example_add_ints
- library/machine.Pin: add PULL_HOLD constant to possible pin pulls
- esp32: add a note to quickref about use of Pin.PULL_HOLD
- esp32: add example for pin isolation in combination with deepsleep
- develop: remove paragraph that was copied in error from other doc
- cmodules: fix example to globally define MODULE_EXAMPLE_ENABLED
- cmodules: note the various ways MODULE_EXAMPLE_ENABLED can be set
- esp8266: add tutorial for APA102 LEDs
- esp32: correct quickref for ESP32 hardware SPI with non-default IO
- machine.I2C: add writevto method to write a vector of byte bufs
- pyboard/quickref: refer to new machine.I2C instead of old pyb.I2C
travis:
- update to use Ubuntu 16.04 Xenial for CI builds
- enable test for running native code via mpy
PreviousNext