← Selected WorkNiccolò Fenili Carravetta04 / 06
Flagship case study2025

Stryker

Medical / AR / Realtime Development

  • ARFoundation
  • C#
  • Shaders
  • iPhone / iOS
Stryker official project cover
01Project overview

Realtime visual guidance for a mobile AR navigation system.

Through UpSurgeOn, I contributed to an augmented-reality application for intraoperative neurosurgical navigation within the Stryker Mobile Navigation ecosystem.

The system provides realtime visual feedback on an instrument’s position relative to a planned target, bringing medical image visualization, spatial calibration and mobile AR guidance into one application context.

Context
UpSurgeOn / Stryker
System
Mobile Navigation
Platform
iPhone / iOS
Brain Target Guidance launch screen with Stryker and UpSurgeOn identities
01

Brain Target Guidance / launch

02Skills + role

AR engineering supported by realtime visual development.

My contribution combined application programming, ARFoundation, custom shader work and graphic optimization for a mobile medical-technology context.

  • 01C#
  • 02ARFoundation
  • 03Shader
  • 04Graphic optimization
03Navigation workflow

The public interface reveals a structured setup sequence.

The numbered public captures show calibration, approach selection, target definition, trajectory setup and guidance. The page presents only what is visible in the supplied material.

Navigation Pen calibration interface using an UpSurgeOn marker
02

Navigation Pen / marker calibration

  1. 01Calibrate Navigation Pen
  2. 02Select approach
  3. 03Define target
  4. 04Plan trajectory
  5. 05Visualize guidance
Mobile navigation approach selection interface
03

Approach selection

Mobile navigation guide index
04

Navigation guide / workflow index

Mobile navigation guide showing the approach selection screen
05

Guide / choose approach

Mobile navigation guide showing target pathology selection
06

Guide / target location

Mobile navigation guide showing pointer calibration
07

Guide / pointer calibration

Mobile navigation guide showing realtime targeting guidance
08

Guide / targeting guidance

04AR calibration + tracking

Real and virtual coordinates meet at the tracked reference.

The AR system included marker tracking, Navigation Pen calibration in 3D space and a coordinate system for precise mapping between the physical and virtual environments.

01MarkerTracked reference
02Navigation Pen3D calibration
03Coordinate mappingReal ↔ virtual space
Application setup sequence for calibration, target, trajectory and offset
09

Calibration workflow / setup

Navigation Pen calibration view with physical simulator
10

Calibration / physical reference

Application training-use disclaimer
11

Public application context / training use

Pointer-tip crosshair calibration interface
12

Pointer-tip calibration

05Technical contribution

A connected stack from image data to spatial guidance.

The project combined medical-image rendering, mobile optimization, trajectory calculation, AR tracking and a responsive interface.

  1. 01

    Custom shaders for realtime CT / MRI rendering

  2. 02

    Texture2DArray slicing across three anatomical planes

  3. 03

    Rendering pipeline optimization

  4. 04

    Entry Point to Target Location trajectory calculation

  5. 05

    Realtime deviation and distance-to-target visualization

  6. 06

    Responsive surgical mobile interface

  7. 07

    AR tracking for sterile environments

  8. 08

    Marker tracking and Navigation Pen calibration

  9. 09

    Real-to-virtual 3D coordinate mapping

06Realtime medical imaging

Tomographic Visualization System

Custom shaders render CT and MRI data in realtime. A Texture2DArray slicing system supports simultaneous visualization across the Axial, Coronal and Sagittal anatomical planes, with the rendering pipeline optimized for consistent mobile performance.

  1. 01AxialTexture2DArray slice
  2. 02CoronalTexture2DArray slice
  3. 03SagittalTexture2DArray slice

CT / MRI dataRealtime shader visualization

AR view with axial, sagittal and coronal image planes plus targeting guidance
13

Tomographic planes + realtime guidance

07Trajectory + deviation

Entry Point and Target Location define the route.

I programmed a 3D trajectory calculation system between the Entry Point and Target Location, supported by realtime deviation and millimetric distance-to-target visualization.

Entry Point to Target Location trajectoryA planned line connects an entry point with a target location while a deviation indicator measures alignment in realtime.
Entry PointTarget LocationRealtime deviationDistance to target
Target location interface on an axial tomographic view
14

Target location / axial plane

Entry point and target location shown on an axial tomographic view
15

Entry point + target location

Planned trajectory between entry point and target location
16

3D trajectory definition

08Platform + delivery

A compact mobile system grounded in a physical setup.

The verified target platform is iPhone on iOS. Project material references the Apple Store listing “Brain Target Guidance”; no download link is inferred or fabricated here.

Brain simulator sculptural presentation
17

Brain simulator / physical context

Physical brain simulator, tracking marker and Navigation Pen tools
18

Simulator + marker + navigation tools

Target
iPhone / iOS
Store
Apple Store · Brain Target Guidance

Verified technical tags

  • ARFoundation
  • C#
  • Shaders
  • Graphic Optimization
  • iPhone / iOS
  • CT / MRI Visualization
  • Realtime Guidance

Next project · 05 / 06

Night City2024 · Technical Art / Environment / Lighting