SIMD-accelerated computer vision on a $2 microcontroller(shraiwi.com)
217 points by zdw 1 day ago | 61 comments
tl;dr: A developer wrote a SIMD-accelerated FAST feature detector for the ESP32-S3's 128-bit vector instructions, roughly doubling throughput from 5.1MP/s to 11.2MP/s and processing QVGA frames in ~6ms. Key obstacles included the ISA's lack of misaligned reads, signed-only 8-bit comparisons, and saturating arithmetic — worked around with register slice extraction and an XOR-with-0x80 trick to convert unsigned pixels to signed range. The result enables real-time 30fps VGA computer vision on a $2 chip.
HN Discussion:
  • ↑ESP32 boards offer amazing value and capability for the price point
  • ~Alternative RISC-V chips offer more capable SIMD extensions at similar prices
  • ↓The article's performance improvement math is incorrectly stated as a percentage
  • ~Questions the practical usefulness and real-world application of the detector
  • ↑Agrees ESP32-S3 SIMD is difficult to use, validating the article's challenges