About and Methodology

What is MIT-E?

MachNation IoT Test Environment (MIT-E) is an IoT platform test lab run by MachNation, the world leading analyst firm researching IoT platforms and middleware. MIT-E’s core product is a database to help enterprises compare IoT platform usage statistics. MIT-E analysts perform a set of common hands-on tasks – developer workflows – on IoT platforms. MIT-E analysts score these tasks based on the completeness of tasks, sophistication level, ease-of-completion and time-to-complete each task. MachNation analysts compile all the data and make the MIT-E database and detailed reports available to enterprises to help guide IoT platform purchase decisions. The database and detailed reports provide enterprises an apples-to-apples comparison of IoT platforms across relevant hands-on task metrics.

MIT-E Methodology

MachNation developers test IoT platforms in a controlled manner. MachNation developers receive access to a vendor’s platform services, complete an initial review of platform documentation, complete an initial platform test of 70 workflows, complete the timed test of 70 workflows and then assign scores to the platform. MachNation developers expect vendor personnel to assist with platform challenges during the testing process, but do not receive pre-testing support or training services.

MachNation evaluates platforms on 4 metrics including completeness of tasks, sophistication level, ease-of-completion and time-to-complete each task. All scores are kept in a secure database and aggregated into a series of MIT-E reports.

MachNation continually evaluates its testing methodology to ensure reliability in MIT-E results.

0
microservices tested
0
developer workflows
0
data points per vendor