Monday, August 13, 2012
Streaming MapReduce with Scala and GridGain
Come to GridGain's talk - “Streaming MapReduce with GridGain” - and participate in a live coding session, in Scala, of an application based on Hadoop’s example that counts popular words. The GridGain application performs the same analysis in a real time context, and will show users how to build applications to perform distributed parallel in-memory processing on live data.
In this live-coding session, Dmitriy Setrakyan, co-founder of GridGain Systems, will show how GridGain can be used to build real time data processing and analysis applications very quickly. Most of the presentation will provide a live "from scratch" coding example of an application based on Hadoop's example of calculating word frequencies in the large body of text. GridGain will create a similar example that works in a 100% real time context instead. The live coding part of the presentation will be done using Scala programming language that is natively supported by GridGain. The initial 15 minutes of the presentation will be devoted to explaining the big data concepts and high level explanation about GridGain and Hadoop MapReduce approaches to solving it. Overall, the presentation is definitely hands-on, and requires a familiarity with Scala and basic level of understanding for distributed programming concepts such as in-memory data caching/grids and compute grids. GridGain provides in-memory compute and data grid middleware for developers to build faster analytics and processing systems. Their free open source Community Edition is available at www.gridgain.com.
Mr. Ivanov has almost 20 years of experience in software development with last 15 years spent developing grid computing and distributed middleware software. In 2005 Mr. Ivanov founded GridGain project that has become one of the most rapidly growing Java-based real time big data software - with GridGain software used today by hundreds of companies worldwide and starting every few seconds around the world.
Back in 1995, Mr. Ivanov was one of the pioneers in using Java technology for server side middleware development while working at T-Systems GmbH, one of the largest European System Integrator.
Mr. Ivanov has held various positions architecting and leading software product development for start-up companies and working with well-established companies such as Adaptec, Visa, and BEA Systems. Mr. Ivanov is an active member of Java middleware community and is a contributor to Java specifications as a member of JSR-107.
Mr. Ivanov holds a Master's degree in Electro Mechanics from Baltic State Technical University, Saint Petersburg, Russia.