Stop motion video game Harold Halibut is Wes Anderson meets Monkey Island - here's why its "artists first production values" matter

'We started even longer ago, I fear to admit, and I’ll happily list some of what we’ve learned since, but also feel like prefacing that a lot of our time and learning revolved around running a game company, finding money and all the boring things, as well as actually realising and, in part, inventing a physical-thing-to-interactive-virtual-thing-pipeline. We never felt like doing this ‘traditionally’ in 3D, although we’ve often drawn comparisons out of curiosity.
"The very first reason for doing it the way we did it was that the first three people working on the game had no other way. Building things was their strongest way of telling a story, there wasn’t enough digital 3D knowledge or even 2D drawing at the time.

"It’s the story we always intended but I think it became a lot more fine grained over time. It’s kind of crazy how much extra detail one can forever fit in between going from A to B. It’s an 'artists first' production and never all too 'money sane', so we really enjoyed going all out on fine tuning this world and its inhabitants."

"Stop motion films and films in general. In Germany we had a lot of the Czech classics of animation on TV, growing up. Also weird local / other European stuff and eventually shows like Celebrity Deathmatch on MTV. Also Aardman in theatres, eventually Wes Anderson. I’m sure all that had an influence.
"Even though we also grew up through the proliferation of 3D animation in pop culture I’m pretty sure the whole team shares a closer emotional tie to the practical effects and sets from the things we watched. But yet we all also share a nerdy childhood of picking up on random software at really early ages - film cutting, animation and 3D - we all had our first significant home-movie-making experiences digitally."

"Characters all roughly went from pencil sketches, to polymer clay puppets with sewn clothes, 3D scanned via a camera, two lights and a turntable, retopologized, rigged, animated largely via mo-cap and some more specialised hand animation.
"Sets went from pencil sketch to digital illustration, made of all kinds of different materials, a lot of wood, metal, plaster, painted, 3D scanned in individual parts and reassembled and lit in 3D.
"Software was all pretty normal major-brand-industry stuff. Most of the specialised tasks went through all kinds of iterations. 3D scanning ended up being mostly from Capturing Reality, which does photogrammetry. We had a lot of help scanning the environments (flat surfaces in particular) from a befriended engineering business that were working on an incredible 3D scanner which has since disbanded, sadly.
"So that was all custom hardware in particular which they were building and assembling themselves. We really just used whatever we could to accentuate all the things we wanted to show through from having that analog foundation. Unity is our game engine."

"Yeah, we have developed our own approach for sure. Biggest was figuring out how to go from the things we built to 3D objects that could be handled in a game environment (it has to be really efficient and lightweight, usually.)
"Then we did a ton of tweaking to land on the right spot between expectations for traditional stop motion animation and game animation / feel. Frame rate is a good example. So games usually work at varying frame rates and some people are really used to having that 60 fps interpolated, milky animation look, while stop motion tends to work between 12 and 24 fps and relies a lot on our brains connecting the frames.

"Yes, we used mostly mocap and one rig is our Xsens gloves. We tried a bunch of different suits, gloves, etc and the biggest hurdle for us was not having a big studio space to record in.
"We used mocap because of the big story but relatively small team we had to make it all happen. And because we quickly realised that it works pretty well. The puppet element makes for a good balancing element when it comes to the sometimes awkward quality that stems from mocap animation.
"The only cool gadgets we made were extremely low-fi reference tools, like stacked boxes for different heights to interact with, scribbling portraits on printer paper and taping them to sticks, jumping onto couches, jumping off of chairs, leaving bedrooms covered in tape for all the reference points, stuff like that."

"Hand-building everything I believe makes for a unique feeling while playing the game. It’s hard to describe and I don’t know that most people could point to it, I’m the wrong person to say, but we quickly understood from the beginning that building the game physically first deepened the immersion into the made-up world.
"It’s a little bit the opposite direction of what the photorealism chase of a lot of games does. You know as a player at first sight that this has been created or came from someone's fantasy and its not a real place but then the hand-built part really helps bridging that gap and gives you some subtle conviction that you are deep inside of a reality."

"I hope so, it does to me. Narrative, in that we came to the story via iterations that were based on the building from real materials and looking at them together, writing more, building, etc. Gameplay is hard to say, but to me it has something to do with the relation to puppeteering and people’s experiences as children with puppet theatres and yelling at the box with the puppets inside about what to do or who to look out for.
"I think working by hand in combination with contemporary storytelling methods like gaming and virtual building could also be compared to the history of film and TV production. There’s definitely a public realisation there, too, that ran pretty parallel to our long production timeline, where people are going back to practical, in-camera effects and worlds. Building sets and puppets for actors to walk through and interact with rather than the humungous green halls and tennis-ball-creatures and people in green suits, etc. that were then replaced by completely digital worlds after filming.
"I think there was just a spike of excitement for digital creativity for a while and now its readjusting and landing on a balance between what was learned in the past about telling stories and the expansion of possibilities since."

"Yes, while we didn’t do a lot of hand animating the hand building of the game’s world and characters and the interweaving with 3D building and replication was a fundamental thing for the game’s story, look and feel. Because we didn’t know how else to do it at first, because it was a lot of fun to make this way and because it was an interesting challenge to pick up on an established but somewhat historic way of doing this (namely photographic stop motion animation) and coupling it with contemporary, interactive and experimental ways of storytelling.
"We think there’s a lot that works well when it comes to visualising made-up worlds by building objects. And while virtually building made-up worlds works well in itself we were just really curious about how to use what we liked about physically built worlds together with the contemporary interactive world.
"I think it’s really important for us to emphasise that this wasn’t just a retro-for-the-sake-of-it move. Not forcing the stop-motion into a game context but feeling out what we like and want from both and try to combine them."

"Lots of little tools and plugins, Unity connects to all kinds of third-party software. It’s mostly what we were able to find that fits into that stop-motion-built way of thinking and is still cost-effective when it comes to having a game for all the platforms and their limitations.
"So, for example, we had to unfortunately drop our water surfaces that we used for a while that were looping through different frames of 3D scanned cling-wrap foil. This looked really nice and fit so well into the world but just wasn’t feasible to use in the end.

"We chose Unity because it was very accessible and could easily be extended thanks to the huge community and third party devs. I think the biggest game changer for us was HDRP (High Definition Render Pipeline) being introduced and we’ve since connected with the Unity devs on many occasions to talk about camera and film related things and how to tie them into game dev."

"I don’t actually think I’m qualified to answer that question, since I don’t feel I have a particularly broad understanding of animation's place in the world. I mean in many ways, especially in global economic ways, it surely isn’t, but in terms of experimentation and open mindedness, yeah!
"Two big things that come to mind are of all things Disney buying the Star Wars franchise and embracing all the physical world building and Scavengers Reign, a recent 2D animation show on HBO. Both because it always needs a money management person to have a simple reference for where to put money and I think Disney is a good hallmark to point to and Scavengers Reign is just an incredibly well made and beautiful show which seems like its also successful from a spreadsheet perspective (at least I really hope so).
"While I think it’s completely digital, the 'hand-made' quality is in the animation and people really imagining motion in their minds and putting it to figurative paper. Also the attention to detail, there are so many micro expressions, specific ways of touching objects and other emotional hooks. I loved it!"

"We really made a point to try and somehow translate all the things we built, digitally. A challenge was glass and reflective surfaces in general, because they’re still a challenge to scan. But then we’d find interesting work arounds like the glass thing I mentioned earlier with the light bulb.
"We also really enjoyed eventually playing with how much digital-only stuff we could add like fog or lights or effects that would still fit into the world and add to it from the digital side."

"Yeah, I think so. Both industries are buying into each other (Unity famously bought Weta, for example) and Unreal Engine was used for that crazy 360 LED panel they used on the Mandalorian a bunch [a LED Volume set). If you haven’t heard about it, it’s basically a green screen but it just shows what's in the background instead of being added later. Plus it's tied to the camera, like the physical camera was tied to the virtual background like a 3D camera would be and they played with that. They would still build a huge aircraft from physical materials to put in the middle ground a lot, interestingly.
"So film is picking up on game dev and generally both just have digital work as a common ground. But also games have been inching in on film work, but a bit wonkily so. Looking back, games just weren’t really related and, admirably so, had a completely unique language going on.
"Then I think there was a slightly awkward phase of mimicking film and getting that cinematic quality going but so many times without the actual film experts on the teams. And by now I think it's a nice mixture of many film people working on games and vice versa and yes it's all melting together."

[Laughs] "Please don’t expect it, no. We made this a game on purpose. I think the way we made it its so much about existing in this little world and finding the people inside it on your own, at your pace.
"Surely it could be adapted and developed for TV and movies but there are no concrete plans so far. We did however just spend ages developing this game-making pipeline so we’ll definitely be using that in the future.
"I don’t think I’m allowed to announce any of the other things planned around the Harold story yet. But we’re working with a few different companies on additional things."