Elasticsearch for Apache Hadoop 6.0.0-alpha2 released | Elastic

​I am excited to announce the release of Elasticsearch for Apache Hadoop (aka ES-Hadoop) 6.0.0-alpha2[1] built against Elasticsearch 6.0.0-alpha2.

IMPORTANT: This is an alpha release and is intended for testing purposes only. Crazy things might happen when running this code and indices created with this version will certainly not be compatible with Elasticsearch 6.0.0 GA. For the sake of your own sanity, we do not advise using this version in production.

What’s new?

Alpha Support for Spark Structured Streaming

Spark 2.0 saw the alpha release of Structured Streaming[2], a new streaming framework that combines the query planning facilities from Spark SQL with the potential for exactly once processing of stream messages. Now, with ES-Hadoop 6.0.0-alpha2, we are proud to present our own Elasticsearch structured streaming sink for Apache Spark, complete with all features you’ve come to love from the connector, as well as backed by an internal HDFS-based commit log to help ensure correct message delivery. All of this is detailed further in our documentation[3]. Please remember though: Both Structured Streaming in Spark and this sink in ES-Hadoop are alpha features! There could still be bugs lurking out there. We advise against rolling this out to production without careful consideration.

Squashing Bugs

Parsing errors from index auto-creation, backwards compatibility errors with scroll id’s, missing support for timestamps in params and much more. Take a look at all of the items that have been spruced up[4] in this release!

Feedback

Now you might be wondering, “Why would I want to try an Alpha Release? Aren’t these things normally riddled with bugs?” Well, yeah, sometimes. Thats why we need the help from all of you awesome early adopters!

So, please, DO try this at home! You can download[5] ES-Hadoop 6.0.0-alpha2, try it out, find out how it breaks, and let us know what you did on Twitter[6], GitHub[7], or in the forum[8]. A crisp high five is waiting for all who participate! Not a huge fan of high fives? There’s always the Elasticsearch Pioneer Program[9] instead!

References

  1. ^ 6.0.0-alpha2 (www.elastic.co)
  2. ^ Structured Streaming (spark.apache.org)
  3. ^ documentation (www.elastic.co)
  4. ^ all of the items that have been spruced up (www.elastic.co)
  5. ^ download (www.elastic.co)
  6. ^ Twitter (twitter.com)
  7. ^ GitHub (github.com)
  8. ^ forum (discuss.elastic.co)
  9. ^ Elasticsearch Pioneer Program (www.elastic.co)

Comments

Post a Comment

Popular posts from this blog

New Article Posted: Seven Things You Should Do in Your AMS

Given how advanced and thorough the modern association management software (AMS) system has become, there are many opportunities for your organization to leverage it. Here are seven ways I believe every association should be using their AMS. Click here to read the rest of the article . Of course, if you’re already on my  announcements list , you would have received notice of this new article right in your email box. Not signed up yet?  Click here to sign up . Go to the article
Read more

10 Common Mistakes Biblical Counselors Sometimes Make, Part 8

Image
A Word from Bob: You’re reading Part 8 of a 10-part blog series on 10 Common Mistakes Biblical Counselors Sometimes Make . Mistake #1: We Elevate Data Collection Above Soul Connection . Mistake #2: We Share God’s Eternal Story Before We Listen Well and Wisely to Our Friend’s Earthly Story . Mistake #3: We Talk at Counselees Rather Than Exploring Scriptures with Counselees . Mistake #4: We Practice Half-Biblical Counseling If We Address Sin but Neglect Suffering . Mistake #5: We Fail to Follow the Trinity’s Model of Comforting Care . Mistake #6: We Tend to View People One-Dimensionally . Mistake #7: We Devalue Emotions Rather Than Seeing Emotions as God’s Idea . Mistake #8: We Minimize the Complexity of the Soul-Body Interconnection Because we are soul physicians and soul care-givers, our tendency is to focus on matters of the soul. Most biblical counselors are not trained in the medical field, so we wisely avoid offering medical guidance. Yet, that appropr...
Read more