DevInline - Tech Blog

Apache spark,a distributed in-memory computation framework, offer greater flexibility in terms of writing spark application and its deployment over clusters(on-premise and cloud). One benefit of writing applications on Spark is the ability to scale co…

Apache spark is an in-memory computation framework in Hadoop ecosystem. Apache spark allows developer to write application code in Scala,Python,R and Java.The main agenda of this post is to write a spark application in Scala and deploy using SBT(Scala…

Scala is prerequisite for Apache spark Installation.Lets install Scala followed by Apache spark. Scala installation:-    We can set-up Scala either downloading .deb version and extract it OR Download Scala tar ball and extract it. Follow either one…

Apache spark - a very known in memory computing engine to process big data workloads. Scala IDE(an eclipse project) can be used to develop spark application. The main agenda of this post is to setup development environment for spark application in sc…

Apache Spark is a general-purpose cluster computing system to process big data workloads. It is very possible to use spark with Hadoop HDFS, Amazon EC2 and others persistence storage system including local file system. For leaning Apache spark, it is …