Augmented Reality: Light Painting Simulator Instructions BETA!!! Litchi Mission Utilities Logo

Instructions

This application can be used to augment reality by combining a simulated light-painting mission with the actual footage of a viewing mission. Two missions are required.

  1. Light-Painting Mission
    Light-Painting Mission
    1. This is a mission that draws a recognizable object in the sky. While any mission can be used, the best results will be obtained when using a true light-painting mission
    2. Use these instructions to create a light-painting mission if you do not already have one.
    3. A "good" light-painting mission will have many waypoints - perhaps 100 or more.
    4. Once a suitable light-painting mission has been created, save it in Litchi's Mission Hub. Export this mission as a CSV file named something like "painting.csv". The exact GPS location of this mission may need to be adjusted and re-exported later.

    Viewing Mission
  2. Viewing Mission
    1. This mission will be used to view the progress of the light-painting mission.
    2. To create this mission, one might place a POI centered at the location of the light-painting mission at a height of roughly one half that of the light-painting mission. In the example provided, "Spiral Mission Creator" was used to create a spiral around the location of the light-painting mission.
    3. A "good" viewing mission will also have many waypoints - perhaps 100 or at least a number of curved turns.
    4. Using Virtual Litchi Mission, export this mission to Google Earth Pro and then right-click on the mission in Google Earth Pro and save it (Save Place As...) as either a KML or KMZ file. Name it something like "view.kmz" or "view.kml".
  3. In page one of "Light-Painting Simulator":
    1. Select the desired line thickness of the light-painted line to be simulated. The default is a good starting value.
    2. Select the desired color of the light-painted line to be simulated. Depending on the background of the actual footage, the default might be a good starting value.
    3. The "End Padding" allows the last frame of the light-painting to be frozen for a while as the viewing mission completes. If this is unclear, leave it set to zero for your first trial.
    4. Select the light-painting mission CSV file.
    5. Select the viewing KML file exported from Google Earth Pro.
    6. Generate the light-painting simulation.
  4. Create a black image (JPG or PNG) using whatever software you have available.
    • ImageMagick or GraphicsMagick
      • gm convert -geometry 1000x1000 xc:black black.png
    • Photoshop
      • File -> New
      • Width: 1000 pixels
      • Height: 1000 pixels
      • Ok
      • Set background to black
      • Ctrl-Delete
      • Save as: black.png
    • Download a 1000x1000 pixel black image here.
    • Other...
  5. In page two of Light-Painting Simulator:
    1. Review the parameters and calculations.
    2. Download the kml file for Google Earth Pro.
  6. In Google Earth Pro:
    1. Delete or disable previously used missions.
    2. Navigate to the light-painting mission area, orient the view to be looking straight down, and zoom out.
      Add Image Overlay
    3. Use the "Add Image Overlay" tool to import the black image created earlier.
      • Open "Add Image Overlay" tool.
      • Browse to find the black.png or black.jpg file created earlier.
      • Make sure the "Altitude" is "Clamped to ground".
      • Grab the corners of the image overlay and drag them way out to cover any nearby terrain.
      • Click "Ok"
      Turn All Layers Off Except for Terrain
    4. Drag the KML file downloaded from the "Light Painting Simulator" into Google Earth Pro.
      • Google Earth Pro should orient the view to show a completely black display.
    5. Turn off all layers except for "Terrain".
    6. In the View menu uncheck "Atmosphere".
      Movie Maker Dialog
    7. From the Tools menu select "Movie Maker".
      • Record from "A saved tour:" select the dropdown list and choose "Run Virtual Light Painting...".
      • Note the location of the "Save to" setting and change if necessary.
      • Set the "Picture size (pixels)" appropriately.
      • Set the "Frames per second" appropriately.
      • Select "Create Movie". It may take a few minutes to generate the light-painting movie.
    8. If you notice the display of any terrain, return to the "Add Image Overlay" step, modify the overlay to cover more terrain.

    Davinci Resolve
  7. In Davinci Resolve: (I use Davinci Resolve. If you use different editing software, it probably has similar functions.)
    1. On the "Media" page, add both the actual viewing footage and the Google Earth Pro movie.
    2. On the "Edit" page, drag both clips into the timeline. Place the Google Earth Pro movie on top of the actual footage.
      1. Select the Google Earth Pro clip.
      2. In the "Inspector" window, change the "Composite Mode" to "Add".
      3. Adjust the starting points of the clips relative to each other as appropriate.
      4. The remaining steps depend upon your workflow.
  8. Restore Settings in Google Earth Pro
    • From the "View" menu, enable "Atmosphere".
    • In the "Layers" window pane, enable "Borders and Labels, Roads, 3D Buildings, as desired.
Augmented Reality: Light Painting with Litchi

This utility can be used to augment reality by combining a simulated light painting mission with the actual footage of a viewing mission creating an interesting combination of real and synthetic drone footage. Two missions are required:

  1. Light-Painting Mission
    • The light-painting mission is one that is used to draw the shape of a recognizable two or three-dimensional object in the sky.
    • This mission does not have to be flown. Instead, it will be simulated. All that is required is the Litchi CSV file of the mission.
  2. Viewing Mission
    • The viewing mission is one that will be used to view the progress of the light-painting mission. This mission will need to be flown with a drone to capture the actual footage.
    • Virtual Litchi Mission data will be combined with light-painting mission data to create a simulation video that can be composited on top of actual drone footage.

Perhaps the best way to understand what can be accomplished with this process is to view the example video displayed to the right. The following tools will be required:

  • A drone
  • Two Litchi Missions (painting and viewing)
  • Virtual Litchi Mission
  • Google Earth Pro
  • Davinci Resolve (or equivalent)
  • This web application and its instructions.

If you would like any help getting this to work, please let me know.

Paint Thickness:
Paint Color:
End Padding:
Painting CSV File:
Viewing KML/KMZ File:
Litchi Utilities dot Com
by Wes Barris