Neural Quines

Neural Quines

Code on Github: https://github.com/evanfletcher42/neural-quines Quines are programs that take no input and output their own source code. Can we do something like that with a neural network? Specifically: Can we train a neural network to output its own weights? We are effectively looking for fixpoints, where f(x, W) = W, such that f is a neural network constructed out of […]

Sword Mechanics for VR

Sword Mechanics for VR

A playable demo of this project can be downloaded here.  You’ll need a SteamVR-compatible setup with tracked controllers. The lack of force feedback in VR systems is an interesting limitation when it comes to game design. Many real-world interactions that VR games might like to incorporate only work because your hands don’t always move exactly the way you want them to. Everything from not being able to stick your hand through a table, […]

Fully-Arbitrary Learned Color Filter Mosaics

Fully-Arbitrary Learned Color Filter Mosaics

This article presents a machine-learning method for demosaicing images, in which the mosaic itself and the demosaicing network are jointly optimized without any constraints on the mosaic pattern.  The system is capable of learning any color filter mosaic, up to and including a unique color filter on every pixel.  Code is available on Github: https://github.com/evanfletcher42/DeepMosaic I recently read two papers on […]

IS&T Electronic Imaging 2018 – Multi-Camera Systems for AR/VR and Depth Sensing

IS&T Electronic Imaging 2018 – Multi-Camera Systems for AR/VR and Depth Sensing

This is based on an invited talk I gave this January at IS&T’s Electronic Imaging 2018, in the Photography, Mobile, and Immersive Imaging conference.  The slides are uploaded here (PDF, 12MB), but since I tend to put more content in words than bullet points, I’ve also translated the talk into an “article” format in this post. At Occipital, I lead […]

img2plot – Artistic Line Drawings from Images

img2plot – Artistic Line Drawings from Images

I recently published img2plot, a Python script that generates artistic pen-plotter sketches from arbitrary images. A lot of plotter projects have code for drawing images.  Usually they do something with line density and pixel intensities – a semi-random stippling or wave pattern, for example, with smoothly higher density for darker pixels.  These can very faithfully represent the image, but they […]

Blender – Sword and Rocks

Blender – Sword and Rocks

This was a quick thing mostly to play around with micropolygon displacement & grunge materials in Blender – but I ended up fiddling with it for a while, and learned a bit more about Cycles materials for particle systems. The sword itself was modeled after a few images of German 14th-century longswords.  I’m leaning fairly heavily on the subsurf modifier […]