ApacheCon North America will be held at the Intercontinetal Miami in Miami, Florida. Register now for the event taking place May 16-18, 2017. 
Back To Schedule
Thursday, May 18 • 11:20am - 12:10pm
Data Modeling for IoT - Jayesh Thakrar, Conversant

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Feedback form is now closed.
A common theme in the IoT space is the need for large volume data streaming, ingestion and storage, and post-ingestion processing and analytics all of which depend on an efficient, scalable and well-performing data model.

With intelligent transportation picking up traction as an IoT showcase, this presentation will take the usecase of vehicle-to-infrastructure (V2I) data exchange for intelligent vehicle systems, and walk through a high level data schema and datastore design approach to support billions of vehicles and hundreds of billions of daily data events. It should be noted that at these volumes, effective and efficient schema-level indexing is not practical.

The proposed design borrows a page from the venerable Unix Filesystem inode structure and can be implemented on datastores like Apache Cassandra and Apache HBase.

avatar for Jayesh Thakrar

Jayesh Thakrar

Sr. Software Engineer, Conversant
Jayesh Thakrar is a Sr. Data Engineer at Conversant (http://www.conversantmedia.com/). He is a data geek who gets to build and play with large data systems consisting of Hadoop, Spark, HBase, Cassandra, Flume and Kafka. To rest after a good day's work, he uses OpenTSDB with 500+ million... Read More →

Thursday May 18, 2017 11:20am - 12:10pm EDT