Cloudera’s PaaS Targets Big Data Workloads Running in the Cloud

Cloudera’s PaaS Targets Big Data Workloads Running in the Cloud
Jessica Lyons Hardcastle

Enterprise cloud[1] company Cloudera[2]’s new Platform-as-a-Service (PaaS) aims to make it easier[3] to run big data workloads in the cloud.

The product, Altus, is initially available on Amazon Web Services[4] (AWS) but will expand to support other public clouds including Microsoft[5] Azure, the company said.

The PaaS allows data engineers to run Hadoop or Spark jobs in the cloud. Hadoop and Spark are open-source[6], distributed database systems designed for interpreting large amounts of data. The company, which went public in April[7], helped pioneer the market for Hadoop.

Data engineers can run Apache Spark, Apache Hive, Hive on Spark, and MapReduce2 through Altus. Cloudera calls these open-source data engines “data pipelines.” Altus executes and manages these pipelines, deploying them on clusters and automating processes like cluster provisioning, configuring, and termination.

“Altus allows data engineers to transform data that lands in S3 really fast, and far more easily than they could ever do before,” said David Tishgart, Cloudera director of product marketing.

Amazon Simple Storage Service, or S3, is designed to make web-scale computing easier for developers. These types of cloud storage services are becoming increasingly popular for their resiliency, scalability, and relatively low cost.

Tishgart says other similar PaaS offerings, such as Amazon Elastic MapReduce (EMR), require users to move data from S3 to another service before they can do anything useful with it.

“Altus does the data processing for you, and then you can take that process data and do a variety of other things with it, without ever having to move that data to another service,” he explained. “On EMR, you have to move it to an analytics base if you want to do analytics. On our platform, you can leave the data where it is, so it’s a much more simplified way to do data analytics.”

The new service also allows users to troubleshoot failed jobs with or without the clusters or compute infrastructure being present. Additionally, its workload management flags significant performance deviations and proposes a root cause analysis.

Altus works with multiple versions of Cloudera Distributed Hadoop (CDH), Cloudera’s open source[8] platform. This also makes it easy for Cloudera customers to migrate their on-premise workloads to the cloud.

“Customers will use the exact same applications and processes that they are using on-prem today in the cloud environment,” Tishgart said. “So there’s no need to use new tools or rethink how you are using security[9]. It’s the same tools running in a different environment.”

References

  1. ^ Cloud Resources (www.sdxcentral.com)
  2. ^ Cloudera (www.sdxcentral.com)
  3. ^ make it easier (vision.cloudera.com)
  4. ^ Amazon Web Services (www.sdxcentral.com)
  5. ^ Microsoft Corporation (www.sdxcentral.com)
  6. ^ Open Source Resources (www.sdxcentral.com)
  7. ^ went public in April (www.sdxcentral.com)
  8. ^ Open Source Resources (www.sdxcentral.com)
  9. ^ Security Resources (www.sdxcentral.com)

Comments

Post a Comment

Popular posts from this blog

New Article Posted: Seven Things You Should Do in Your AMS

Given how advanced and thorough the modern association management software (AMS) system has become, there are many opportunities for your organization to leverage it. Here are seven ways I believe every association should be using their AMS. Click here to read the rest of the article . Of course, if you’re already on my  announcements list , you would have received notice of this new article right in your email box. Not signed up yet?  Click here to sign up . Go to the article
Read more

10 Common Mistakes Biblical Counselors Sometimes Make, Part 8

Image
A Word from Bob: You’re reading Part 8 of a 10-part blog series on 10 Common Mistakes Biblical Counselors Sometimes Make . Mistake #1: We Elevate Data Collection Above Soul Connection . Mistake #2: We Share God’s Eternal Story Before We Listen Well and Wisely to Our Friend’s Earthly Story . Mistake #3: We Talk at Counselees Rather Than Exploring Scriptures with Counselees . Mistake #4: We Practice Half-Biblical Counseling If We Address Sin but Neglect Suffering . Mistake #5: We Fail to Follow the Trinity’s Model of Comforting Care . Mistake #6: We Tend to View People One-Dimensionally . Mistake #7: We Devalue Emotions Rather Than Seeing Emotions as God’s Idea . Mistake #8: We Minimize the Complexity of the Soul-Body Interconnection Because we are soul physicians and soul care-givers, our tendency is to focus on matters of the soul. Most biblical counselors are not trained in the medical field, so we wisely avoid offering medical guidance. Yet, that appropr...
Read more