Raymarine MFD apps three ways: from drone control to sat comms to video streaming

MIBS 2018 saw the manufacturers putting the multi in MFD, with Garmin and Raymarine each introducing multiple new multifunction app and app-like display integrations interfacing to all sorts of third party boat systems, plus consumer electronics gadgets and online services — actually every single brand seen below, with lots more likely coming.

The results are exciting, but what the heck are MFD apps? Fortunately, Raymarine is illustrating all three ways they can be created and why it’s useful to know how it’s done…

What’s an MFD app?

At the recent Miami International Boat Show there were three major categories of integrations on display. All three can end up looking pretty much the same when they’re displayed on your MFD but how they got there can be important. MFD manufacturers can use another company’s SDK (Software Development Kit) to control systems on the boat. Or they can publish an API (application programming interface) allowing third party developed integrations to be displayed on the MFD. Lastly, we also saw an MFD show off its ability to run off-the-shelf Android apps.

The first integration, an MFD reaching out to a third party via their SDK, takes the most work for the MFD developers but can result in the most customized and tightest integrations. An early example was MFD developers each coding to Fusion’s FusionLink audio control API; the interfaces are each different and often include difficult integrations like an onscreen sound bar. In Miami, Raymarine introduced the impressive SDK-based UAV (unmanned aerial vehicle, or drone) control detailed below.

The second type of integration, where others code to the MFD’s API, is actually a series of dynamic HTML5 screens being rendered on the MFD. The plotters able to display these integrations are running either Linux or Android, both of which have native HTML5 rendering (Android’s core is a modified version of Linux). These integrations require third party hardware on the boat that serves up the HTML5 via Ethernet or WiFi, like this Lumishore Lumi-Link Bridge.

HTML5 integrations — Garmin calls them OneHelm, while Raymarine groups them as part of their new Lighthouse Apps — allow the MFD manufacturers to easily offer integrations with willing third party marine companies without having to do the development themselves. So, wow, the Mazu all-in-one satellite communications system will suddenly be accessible on a bright Axiom screen — when Lighthouse 3.4 releases, hopefully this spring — and the Seakeeper monitoring app is coming to both Garmin and Raymarine. But there are limitations to HTML5 integration we’ll discuss below.

The last option is native Android apps and is currently unique to Raymarine (though Furuno TZT2 and Si-Tex NavStar MFDs also run Android). While these apps will be Raymarine approved and only available from their Lighthouse app store, a product manager told us that the Netflix and Spotify apps they demonstrated at MIBS were running without modification. That means nearly zero effort on Raymarine’s part while the Axiom user gets access to apps from big time services that would never build apps for special marine hardware. Again there are limitations — like the MFD must be online for music or video streaming — and there’s also the question “Is this taking marine navigation electronics too far?” But please consider the analysis below before making a judgement.

SDK “App”: deep drone control

Raymarine_Axiom_Lighthouse_Apps_cPanbo_LI.jpgFirst let’s deal with some possible confusion. When Lighthouse 3.4 arrives and you tap that new Apps button on the Home screen, you will not see Ray’s new drone interface on the new Installed Apps screen. These are the optionally installed “Lighthouse Apps” discussed below. But then again Raymarine has long said that the “LightHouse 3 home screen offers bold and simple app icons.”

In fact, Raymarine has used, perhaps overused, the “app” term for even completely internal MFD functions like chart plotting since LightHouse 2 days, though in some cases the system icon represents an SDK-based integration with, say, a pan and tilt FLIR thermal camera. Other SDK examples are the Theyr Weather app built into LH2 r17 — especially interesting as it will appear in LH3 as a straight-up Android app (seen below) — and the impressive new drone app.

Raymarine_Axiom_DJI_Spark_drone_control_demo__cPanbo.jpg

The two of us got to see a beta version of an Axiom Pro controlling that tiny DJI Spark drone, and then posed on the bow as the drone streamed HD video to the Axiom over WiFi. That would be pretty cool in itself, but note how the chart window is showing the Spark’s location relative to the boat, as well as its “heading” (camera direction), and that’s just scratching the integration surface.

Raymarine_Axiom_drone_demo_context_menu_aPanbo.jpgThe context menu above suggests the many levels of drone control possible. Free Flight mode, for instance, overlays the streaming video screen with controls similar to the Spark’s optional joystick controller. But because DJI has developed an ActiveTrack mode able to follow a moving object, it’s also possible to have the drone auto fly in tandem with your boat capturing that underway footage you always wanted. In fact, the planned Fish On mode will purportedly combine several Spark features so you can keep fishing as the drone takes off and films the action while circling your tracked boat.

Combining a camera drone with an MFD is also useful for finding fish, as Raymarine was able to demonstrate in their Miami demo video, and future UAV app possibilities include flying to a charted route. Couldn’t that be useful before entering an unfamiliar gunkhole? And if you’ve ever tried to fly a drone using a small, dim display in bright daylight, you know how much easier it will be using a big bright Axiom MFD.

The bigger picture here is that Raymarine is working hard to integrate Spark (and even more feature rich Mavic) drone control to this level, but that’s what it takes sometimes to integrate with a complex product from an industry working at an entirely different scale. DJI alone has 2.7 billion dollars in annual sales — roughly double the entire global recreational marine electronics industry — but the Ray developers could go to the DJI developer site and get to work. Having Android in the Axiom helps, but this SDK-based app development is still in sharp contrast to the easy way HTML5 browser apps can add system integration.

HTML5 apps: Mazu sat comms

Raymarine_Axiom_HTML5_apps_Mazu_satellite_email_aPanbo.jpg

After the 2017 Miami show Panbo highlighted the SkyMate Mazu/mSeries all-in-one Iridium sat comms system, and also discussed an earlier version of SkyMate hardware that interfaced with the Android browser built into the Si-Tex NavStar MFD (good demo video here). The Mazu/mSeries has evolved a lot since, including a browser interface in addition to the dedicated iPad Mazu app, and that’s what you’re seeing on the Axiom LightHouse App screens above and below.

So suddenly an mSeries hardware user will have big, bright, waterproof screen access to satellite email and much more at the helm of a bluewater sailboat or up on the flybridge of a hard charging fishing machine. And it will be fairly easy for the companies to pull off because the mSeries can already serve HTML5 over WiFi while the Axiom MFDs can be WiFi clients (as well as WiFi access points) and display HTML5. While it will take a visit to Raymarine’s yet unseen app store, that also means that Mazu support will not burden the Axioms of boaters who don’t use the hardware and service.

Raymarine_Axiom_HTML5_apps_Mazu_satellite_weather_and_monitoring_aPanbo.jpgBut without a lot of extra development work, HTML5 apps like this will not integrate deeply with an MFD. You won’t, for instance, get a pop-up on your Axiom when a new message arrives (though the mSeries includes neat LED notification).

Another example is Mazu/mSeries weather. While the system can provide a surprising wealth of data given its limited Iridium connection, the NEXRAD radar images and/or GRIB wind/wave predictions will probably not overlay on the Axiom’s chart windows like they can in many MFD implementations of SiriusXM Marine satellite weather. The latter are SDK-based MFD functions while browser apps are much more siloed.

When we take a close look at Garmin’s several OneHelm partnerships we’ll be on the lookout for more HTML5 browser app limitations, but you can see already that the ease of implementation means that Garmin is suddenly supporting four different digital control and monitoring systems (Maretron included though not yet on that web page).

Android apps: Netflix & Theyr

Raymarine_Axiom_Lighthouse_Apps_as_of_2-2018_aPanbo_LI.jpg

Here again is the beta version of the LightHouse 3.4 Apps screen we saw in Miami. What you see are HTML5 delivered apps like Mazu — along with the SeaKeeper and Lumishore apps we’ll detail in the OneHelm entry — and several Android native apps packaged up for the Lighthouse store and ready to run on a plotter.

If you think about browser apps you may already use on your boat — like this old WaveWiFi screen — or cruise the Google Play Store for apps you’d like to have on your Axiom, it seems predictable that the LightHouse app store will eventually offer many choices and some users may fill that screen with installs.

Raymarine_Axiom_Android_apps_Netflix_aPanbo.jpgThe streaming entertainment apps like Netflix and Spotify will probably cause the most harrumphing from those who feel that navigation electronics should only be about navigation. But again, no Axiom owner has to get near these apps if they don’t want to, and they may change their minds when they realize that it’s relatively easy to get an Axiom online through your phone and watch “the big game” or whatever on a much better screen. We saw it working in bright Florida sunshine, and the Axiom could even drive Bluetooth speakers.

Raymarine_Axiom_Android_apps_Theyr_GRIBview_aPanbo.jpgWhile the entertainment apps deliver a nice optional benefit, the real magic might be the ability to run a myriad of boating apps. Note, for instance, how the Theyr Weather screens on the Axiom above are the same as the Theyr GRIBview Android app. It’s true that this weather service, like Mazu, won’t integrate deeply with the MFD, but it’s also true that the LightHouse App store may eventually offer a dozen weather apps while the Ray developers are free to work on core projects plus goodies like drone control.

Overall Raymarine’s new ability to deliver a broad catalog of apps without having to develop anything themselves puts the company in an enviable position. But the step change to Android-based Axiom MFDs caused some pain for owners of previous Ray MFD models, and the LightHouse Apps feature adds a little more. In short, they are not going to work even on older MFDs like the eS and gS series that can run Axiom-like LightHouse 3.3.

It turns out that while the Ray developers built an entirely new MFD operating system on top of Android for the new Axiom machines, LH3 for the older eS and gS series is a different architecture (aside from running on less powerful processing hardware). So Axiom MFDs will continue to get new features that may not be backward compatible even to eS/gS, and LH2 will no longer be developed.

If you own a Raymarine a-, c-, e-Series or older, it’s fair to note that Ray added a lot of features to LH2 over the years, and they are still struggling to put some of those features into LH3 (check the FAQs). Plus, there’s an argument that SDK-based features like LH2 Theyr weather are better than the Android app version. But let’s note that the pace of change in electronics makes for a real challenge in balancing new hardware and software with supporting the legacy equipment. Don’t believe us? Just look at the comments section of the Raymarine Axiom Announcement from last year’s show.

But after massive amounts of Axiom Lighthouse 3 development while enduring some flack from LH2 users, Ray is coming out of the step-change tunnel. You could even say that the Raymarine product folks at MIBS 2018 had noticeable pep in their step; they had some exciting stuff to show off and they knew it. Between the apps, the drone control, and the Quantum 2 doppler radar (we will cover), there’s no doubt about Raymarine’s ability to move forward.