Independent research firm names Google Cloud the Insight Platform as PaaS Leader

By Regina Hoshimi, Head of Analyst Relations

Forrester Research, a leading analyst firm, just named Google Cloud Platform (GCP) the leader in The Forrester Wave™: Insight Platforms-As-A-Service, Q3 2017, its analysis of cloud providers offering Platform as a Service. According to the report, an insight PaaS makes it easier to:

Manage and access large, complex data sets
Update and evolve applications that deliver insight at the moment of action
Update and upgrade technology
Integrate and coordinate team member activities

For this Wave, Forrester evaluated eight separate vendors. It looked at 36 evaluation criteria spanning three broad buckets — current offering, strategy and market presence.

Of the eight vendors, Google Cloud’s insight PaaS scored highest for both current offering and strategy.

“Google was the only vendor in our evaluation to offer insight execution features like full machine learning automation with hyperparameter tuning, container management and API management. Google will appeal to firms that want flexibility and extreme scalability for highly competent data scientists and cloud application development teams used to building solutions on PaaS.” — The Forrester Wave: Insight Platforms-As-A-Service, Q3 2017
Our presence in the Insight Platform as a Service market goes way back. We started with a vision for serverless computing back in 2008 with Google App Engine and added serverless data processing in 2010 with Google BigQuery. In 2016 we added machine learning (Cloud Machine Learning Engine) to GCP to help bring the power of TensorFlow (Google’s open source machine learning framework) to everyone. We continue to be amazed by what companies like Snap and The Telegraph are doing with these technologies and look forward to building on these insight services to help you build the amazing applications of tomorrow.

Sign up here to get a complimentary copy of the report.
Quelle: Google Cloud Platform

Bring Interactive Analytics to Azure HDInsight: Kyligence Analytics Platform enables sub-second query

In resource-intensive systems, queries will compete for runtime resources and it takes hours to return when the work load is high. SQL on Hadoop is improving continuously, but it is still common to wait minutes or even a couple hours for one single query to return, especially when the dataset is huge. Most of these systems are resource-intensive where queries compete for runtime resources and performance declines when the workload is high.

To solve this problem, Kyligence Analytics Platform (KAP) enables interactive analytics with sub-second query latency on massive dataset. KAP is a leading big data intelligence platform powered by Apache Kylin. It enables interactive analytics with sub-second query latency, even on massive data-set, and is widely adopted by enterprises such as Lenovo, China Mobile, and many more. We are happy to announce that the Kyligence team and Azure HDInsight team have worked closely with each other to bring OLAP capabilities to HDInsight, and KAP is now available on Azure HDInsight as an HDInsight application.

HDInsight Application Platform

Azure HDInsight is the only fully-managed cloud Hadoop offering that provides optimized open source analytical clusters for Spark, Hive, MapReduce, HBase, Storm, Kafka, and R Server backed by a 99.9% SLA. Each of these big data technologies and ISV applications are easily deployable as managed clusters with enterprise-level security and monitoring.

The open source ecosystem of applications has grown with the goal of making it easier for customers to build their big data and analytical solutions. Today, customers find it challenging to discover these productivity applications, and struggle to install and configure the apps. To address this gap, HDInsight Application Platform provides a unique experience to Microsoft where ISV’s can directly offer their applications to customers, and customers can easily discover, install, and use ISV applications built for the big data ecosystem.

As part of this integration, KAP can be easily deployed by one-click on HDInsight.

Interactive Analytics with Trillions of Data on HDInsight

Hadoop is designed for large scale data processing, but is not efficient enough for interactive analytics. KAP provides interactive analytics ability on HDInsight by providing the following integration with HDInsight:

Native SQL support on Hadoop and HDInsight: Many existing big data analytics technologies have their own query language or proprietary storage engine optimized for analytics scenarios. It is difficult for analysts to learn a new query language or move data out of HDFS/BLOB storage to other platforms. With KAP's native SQL support and ODBC drivers, customers can use the standard SQL interface and choose their favorite BI tools on their large amount of data.
Sub-second query response: The query performance is the bottleneck for most big data use cases. The performance will decline if the cluster resource cannot scale out when the original data grows 10x. To make the sub-second query response consistent is the key for interactive analytics and KAP on HDInsight solves this problem by providing pre-calculated Cubes.
Elastic architecture: The dataset normally ranges from gigabytes, terabytes, and more. Hadoop provides the elastic infrastructure for batch processing, and KAP as an interactive analytics technology, also leverages the elastic capability of Hadoop to enable the scale-out solutions.
Native Integration with HDInsight: Cloud is an effortless way to adopt new technology without worrying about deployment or monitoring. With KAP + HDInsight as a full-managed cloud solution, it can help users reduce operation cost as well as achieve high availability. KAP can work with all the supported Azure storage services (Azure BLOB storage and Azure Data Lake Store), and can also work with HDInsight Kafka clusters to ingest data from Kafka.

KAP – Enterprise-ready data warehouse powered by Apache Kylin

KAP, an enterprise OLAP on Hadoop powered by Apache Kylin, enables sub-second SQL query latency on petabyte scale dataset, provides high concurrency at internet scale, and empowers analysts to architect BI on Hadoop with industry-standard data warehouse and business intelligence methodology. KAP is a unified analytics platform simplified Big Data Analytics for business users, analysts, and engineers with self-service, seamless integrated with BI tools and no programming required. KAP is a native on Hadoop OLAP solution which interacts with cluster only via standard APIs and supports main Hadoop distributions from on-prem environment to in the Cloud.

On Azure, most data are stored in Azure BLOB storage or Azure Data Lake Store, and then are loaded into Hive as external tables. KAP builds the cube (index) by using MapReduce/Spark according to the data model designed by the modeler before analysis. During query runtime, all queries can access the pre-aggregated cube data and the result will be returned in sub-second. By leveraging the unique pre-calculation technology, KAP provides consistent query latency regardless of how much data grows, even with limited resources. KAP also provides native integration with various Azure storage services, such as Azure BLOB storage and Azure Data Lake Store. It can also connect with HDInsight Kafka clusters to ingest data from Kafka.

The screenshot below shows the KAP modeling GUI:

 

Compared to Hive query, KAP is 100x faster without modifying the queries into HiveQL dialect. ANSI SQL and JDBC/ODBC drivers are also supported, so users can choose their familiar BI tools to do interactive analytics, for example PowerBI or Tableau. Below is the performance comparison between Apache Kylin and Apache Hive on SSB dataset:

Installing KAP on Azure HDInsight

With the KAP on Azure HDInsight solution, user can install KAP on their exiting HDInsight cluster or standalone optimized cluster designed for KAP with a single click. Currently, KAP works as an application on HDInsight HBase cluster.

After the one-click installation, you will get the following components:

KAP: The enterprise version of Apache Kylin, which provides the core OLAP analysis on HDInsight by building pre-calculated cubes.
KyAnalyzer: The built-in OLAP agile BI tool for quick BI analysis by connecting to KAP.

KAP will be installed on the Edge Node in the HBase cluster. To learn more details on how to use KAP on HDInsight, please check the Kyligence blog post.

Summary

KAP on Azure HDInsight brings quick insight into massive dataset in sub-second latency and empowers interactive analytics on Hadoop for trillion level records. It offers web-scale OLAP solutions for various industries to build their online and offline analytics platforms. With the cloud based technologies, computing resources can extend and shrink when processing burst data, with a more efficient deployment model, thus helping customers reduce cost and improve productivity.

For more resources to get started, please check the "more resources" section below. If you have any feedbacks or questions, feel free to drop us an email at hdiask@microsoft.com. We love to hear from you!

More resources

Getting Started to use KAP on HDInsight (Kyligence Blog or MSDN blog)
Video Tutorial for KAP on HDInsight
KAP Documentation
Learn more about Azure HDInsight
Ask HDInsight questions on stackoverflow
Learn more about Apache Kylin
Learn more about Kyligence Analytics Platform

Quelle: Azure

Peter Thiel Has Been Hedging His Bet On Donald Trump

Peter Thiel Has Been Hedging His Bet On Donald Trump

BuzzFeed News; Getty Images (3)

Donald Trump’s most prominent Silicon Valley supporter has distanced himself from the president in multiple private conversations, describing at different points this year an “incompetent” administration, and one that may well end in “disaster.”

Peter Thiel’s unguarded remarks have surprised associates, some of whom are still reeling from his full-throated endorsement of Trump at the Republican National Convention. And while the investor stands by the president in public — “I support President Trump in his ongoing fight,” he said in a statement to BuzzFeed News — his private doubts underscore the fragility of the president's backing from even his most public allies. Thiel’s comments may sting in particular in the White House as they they come amid a series of hasty and embarrassed departures from the Trump train, as conservative voices from the Wall Street Journal’s editorial page to the floor of the US Senate have begun to distance themselves from the administration.

Thiel’s views remain private — but various disparaging comments were recounted to BuzzFeed News by three separate sources, and others who subsequently confirmed those accounts. These people requested anonymity for fear of damaging personal relationships and possible retribution.

While Thiel told Trump that he is off to a “terrific start” at a White House event in June, his previous statements to friends and associates did not reflect that sentiment. In half a dozen private conversations with friends that were described to BuzzFeed News dating from spring 2016 to as recently as May, Thiel, who served on the Presidential Transition Team Executive Committee, has criticized Trump and his administration and developed increasingly pessimistic feelings about the president.

The sources who talked with BuzzFeed News spent time with Thiel in private group settings before and after the election at his homes in Los Angeles, San Francisco, and Hawaii, engaging in candid discussions on the PayPal cofounder’s politics and his backing of Trump. At one event with friends in January 2017, Thiel said of Trump’s presidency that “there is a 50% chance this whole thing ends in disaster,” according to two people who were in attendance. In other conversations, he questioned the president’s ability to be reelected.

Thiel, through a spokesperson, did not deny any of the quotes attributed to him by his friends and associates when approached by BuzzFeed News.

“The night he won the election, I said President Trump would face an awesomely difficult task,” Thiel said in a statement. “Today it's clear that resistance to change in Washington, D.C. has been even fiercer than I anticipated. We still need change. I support President Trump in his ongoing fight to achieve it.”

Within the White House, Thiel has been one of the few outsiders to crack Trump’s inner circle, which values one characteristic above all else: loyalty. The investor, whose book Zero to One reportedly became essential reading for Trump campaign staffers, gained that trust after a well-received Republican National Convention speech. Following Trump's election to the presidency, Thiel helped select political appointees for the new administration and as of August, was still advising the president on technology policy matters. During a December 2016 meeting of technology executives in New York City, Trump wrung Thiel’s hand and called him “a very special guy.”

“He got just about the biggest applause at the Republican National Convention,” Trump said as cameras snapped away in a room that included Apple CEO Tim Cook and Facebook Chief Operating Officer Sheryl Sandberg. “He’s ahead of the curve, and I want to thank him.”

President Donald Trump shakes the hand of billionaire venture capitalist and transition team member Peter Thiel during a meeting with technology executives at Trump Tower in December.

Drew Angerer / Getty Images

Thiel’s views on Trump began to evolve during spring 2016, according to people close to him. In one private event at his home in San Francisco, he was cautious not to fully endorse Trump, but positioned him as a better option than Bernie Sanders, who he considered far too extreme, and Hillary Clinton, who he thought would be disastrous for trade and tax policy. When someone asked about Trump, however, Thiel, who had previously given $2 million to a Super PAC for then–GOP candidate Carly Fiorina, said that the bombastic Republican populist had a much better shot at winning the presidency than most pundits suggested, according to one person in attendance.

By May of that year, the billionaire investor was ready to tie himself to Trump. He was named a California delegate for the RNC that month, and by July, he was announced as a speaker at the event on the same day as the Republican candidate and his daughter Ivanka Trump. The crowd cheered Thiel’s six-minute speech, in which he declared himself proud to be gay and proud to be a Republican, garnering plenty of applause from Trump’s sons Eric and Donald Jr.

“He saw an opportunity to help somebody, who was not a sure thing, and get in on the ground floor,” said a friend of Thiel’s on his decision to speak at the RNC.

The RNC would be the first time Thiel met with Trump and his family in person. In a private dinner that summer following the event, a person who attended described Thiel as “giddy” and excited about the crowd’s reaction to his speech. This person also told BuzzFeed News that Thiel freely offered his first impressions of the Republican candidate, characterizing him as having “narcissistic tendencies.” He also suggested, in a claim that would be reiterated later, that if Trump were to be elected, there was a half probability that his presidency would end in failure.

The billionaire venture capitalist remained relatively quiet through the summer of 2016, avoiding interviews about Trump and Gawker Media, after Forbes revealed in May that Thiel had been secretly footing former professional wrestler Hulk Hogan's legal bills against the New York news organization. Gawker, which lost a landmark invasion-of-privacy lawsuit in a Florida court and was forced to pay $140 million in damages to Hogan, filed for bankruptcy and sold its assets to Univision Communications in August. Thiel said little publicly about the case.

He spent part of the summer traveling, taking advantage of his American, German, and New Zealand passports, the last of which has garnered its own controversy. Thiel’s Kiwi citizenship, which he’s held since 2011, was not revealed until the New Zealand Herald discovered in January that the government had granted him a passport under an “extraordinary circumstances” exception after he had spent 12 days in the country. “I am happy to say categorically that I have found no other country that aligns more with my view of the future than New Zealand,” Thiel wrote in his 2011 citizenship application, which was later released by the Kiwi government earlier this year after media pressure. Thiel's US$3.5 million property in Queenstown — referred to by locals as “the Plasma Screen” because of its expansive glass facade — was severely damaged in a suspected gas leak fire in August 2016, according to construction documents obtained by BuzzFeed News.

“What Trump represents isn’t crazy and it’s not going away.”

That September, Thiel penned an opinion piece for the Washington Post that highlighted Trump’s antiestablishment nature and “heretical denial of Republican dogma,” while largely ignoring the candidate’s policy initiatives. That was followed up by a $1.25 million donation — less than .05% of his $2.7 billion net worth, as estimated by Forbes — to Trump’s campaign in October. In dinners that fall in San Francisco and Los Angeles, Thiel was described by someone who attended both as “excited” and “positive” about Trump, emphasizing how good he would be for tax issues. Thiel’s boyfriend, Matt Danzeisen, also spoke about his support of Trump during at least one of these dinners, though was described as much more moderate, said that person.

Thiel’s only meaningful speaking appearance outside of the RNC came on Halloween day at Washington’s National Press Club, where he delivered a speech on Trump’s promise as a political outsider. “Trump’s agenda is about making America a normal country,” he said. Thiel also spent time addressing the candidate’s flaws, following the release of an Access Hollywood tape where Trump discussed sexually assaulting a woman. He called the comments “clearly offensive and inappropriate” and later noted in the same speech that “nobody would suggest that Donald Trump is a humble man.”

“No matter what happens in this election, what Trump represents isn’t crazy and it’s not going away,” he said.

At a gathering at his home in Los Angeles the weekend before the election, a source in attendance said Thiel reiterated that point. But in at least one private conversation, Thiel admitted he didn’t have much confidence in either candidate. Whoever wins, he said, will likely be a one-term president, according to a person familiar with the discussion, with Thiel predicting that there would be a major financial catastrophe in the next four years.

Trump’s victory was a marketing coup for Thiel. With a reputation as a renegade investor whose contrarian but prescient bets on companies like Facebook and SpaceX had paid off handsomely, Thiel — one of the few Silicon Valley elite to openly support Trump — now had a victory in the political sphere. The news media lauded his winning bet, with some speculating he might be named to the Supreme Court, a past dream of the Stanford University law degree holder.

While Thiel quickly shot down rumors of a Supreme Court appointment, he was named to Trump’s transition team. There he worked with two acolytes — Blake Masters, his Zero to One coauthor, and Trae Stephens, a former engineer at the Thiel-founded government contractor Palantir Technologies — to source and vet science and technology appointments.

One Trump campaign insider told BuzzFeed News that Thiel had his pick of cabinet positions, but never showed true interest in taking a permanent government job. Instead, he focused on adding his associates to positions of power. Thiel’s former chief of staff Michael Kratsios was named as deputy chief technology officer, while another former colleague, Kevin Harrington, joined the National Security Council as deputy assistant to the president. Justin Mikolay, an evangelist for Palantir — the Thiel-founded data-analysis company — was given a role in the Defense Department.

Thiel and his associates managed to steer clear of much of the infighting that troubled the Trump transition team in its early days. But they didn't escape unscathed. One source in a position to know told BuzzFeed News that when other transition members discovered that Stephens had not voted for Trump, he was summarily isolated from the group, souring some people’s perspectives on progress with the weeks-old administration.

“There is a 50% chance this whole thing ends in disaster.”

A spokesperson at Founders Fund, the Thiel-led venture capital outfit where Stephens is now a partner, declined to comment.

After organizing a meeting with technology leaders at Manhattan’s Trump Tower in December, where he was thanked profusely by the president-elect, Thiel spent the New Year’s holiday in Maui with about a dozen friends. While he worked for some of the time, he engaged with his close friends at meals and events, debating Trump’s merits with some of his more liberal attendees. According to two people in attendance, Thiel described the administration as a work in progress and discounted the suggestion that progress on social issues like gay marriage might be rolled back in the next four years. But these same people said Thiel tempered his enthusiasm with a caveat during one meal, remarking that “there is a 50% chance this whole thing ends in disaster.”

After about a week of relaxing in Maui, his guests, who included Y-Combinator President Sam Altman for part of the time, headed back to their jobs. Thiel readied himself to go back to New York, and later, the inauguration.

Thiel was one of the few chosen for a seat at the inauguration morning service at St. John’s Episcopal Church, and sat near the president during Trump's inauguration speech on January 20, BuzzFeed News has confirmed. In addition, on the night before the inauguration, he made an appearance at a Trump supporter event called the DeploraBall, but quickly left after being approached by reporters (including one from BuzzFeed News) inquiring about his role on Trump's transition team.

Later that month, he was back at his home in the Hollywood Hills, hosting a dinner in celebration for Hulk Hogan. While the two had never come into personal contact during the Gawker lawsuit, they met after the trial and became somewhat close. Thiel had even dressed up like the former WWE superstar during a December celebration at Trump donor Robert Mercer’s home.

The January dinner in Los Angeles was billed as a celebration of the former professional wrestler, and was also attended by Hogan’s attorney Charles Harder and other guests, who went home with goody bags of Hogan memorabilia. One guest in attendance recalled light political discussion, but nothing notable about Trump. Hogan, whose real name is Terry Bollea, would also speak about his life at Founders Fund’s San Francisco office.

“There’s some resonances between Hogan beating Gawker and Trump beating the establishment in this country,” Thiel told the New York Times’ Maureen Dowd in a preinauguration conversation, perhaps the most revealing interview the billionaire has given in the last year.

“I always have very low expectations, so I’m rarely disappointed,” he said of his role in the administration.

Even with his low expectations and his views on possible failure, Thiel hasn’t completely hidden his disappointment. At an event in May in San Francisco, he was described by one guest who was in attendance as “annoyed” with the first months of Trump’s presidency. With little policy being established by the White House, Thiel worried that the the next four years would be defined by stagnation and stressed the notion that he didn’t think Trump would be reelected.

In describing the administration, Thiel used one defining word in front of his guests: “incompetent.”●

With reporting from Nicola Harvey in Sydney.

Quelle: <a href="Peter Thiel Has Been Hedging His Bet On Donald Trump“>BuzzFeed

MIT: KI erkennt Sarkasmus aus Text

Ob traurig, fröhlich oder ironisch: Der Algorithmus Deepmoji soll viele Emotionen erkennen können. Als Grundlage dient dafür eine von Freiwilligen gepflegte Datenbank. Die KI könnte laut den Entwicklern gegen Mobbing und Rassismus helfen. (MIT, Soziales Netz)
Quelle: Golem

Root cause analysis and time exploration updates to Azure Time Series Insights

Azure Time Series Insights is currently in public preview, and we’ve been hard at work the last couple months to help our customers better manage and find value in their time series data.  Time Series Insights is a fully managed analytics, storage, and visualization service that makes it simple to explore and analyze billions of IoT events simultaneously. Additionally, it allows you to visualize and explore time series data streaming into Azure in minutes, all without having to write a single line of code. For more information about the product, pricing, and getting started, please visit the Time Series Insights website on Azure.com.

Faster root cause analysis and investigations

We’ve heard a lot of feedback from our manufacturing, and oil and gas customers that they are using Time Series Insights to help them conduct root cause analysis and investigations, but it’s been difficult for them to quickly pinpoint statistically significant patterns in their data. To make this process more efficient, we’ve added a feature that proactively surfaces the most statistically significant patterns in a selected data region. This relieves users from having to look at thousands of events to understand what patterns most warrant their time and energy. Further, we have made it easy to then jump directly into these statistically significant patterns to continue conducting an analysis.

This new feature is also helpful for post-mortem investigations into historical data. Most of our customers have existing alerting mechanisms in place (for example, Azure Stream Analytics jobs) and use Time Series Insights as a complementary investigative tool to understand the context of an alert. These customers are using Time Series Insights to look back during a postmortem for additional clues to help mitigate and prevent similar issues from occurring in the future.

Below is a GIF showing patterns in the stats tab and adding a pattern as a new term:

Greater control of time for data exploration

Additionally, we have heard from customers across many verticals that they are using Time Series Insights to help them triage and diagnose issues involving sensor data from their key assets, but they have been asking for finer control over their ability to navigate time in our visualizations. To give these customers more control, we have provided several new usability improvements to time navigation to make triage and diagnosing easier.

First, we’ve added a time interval slider for more precise control of movement between large slices of time that show smooth trends down to slices as small as the millisecond, allowing customers to see granular, high-resolution cuts of their data. Further, we’ve set the slider’s default starting point to be the most optimal view of the data from their selection; balancing resolution, query speed, and granularity.

Below is a GIF showing the slider in action:

Secondly, we heard from customers that they would like an easier way to move between time ranges when conducting diagnostics on their sensor data. Previously, a user needed to leave their search and reselect the period they wanted to explore from their environment all over again to complete this task. To make their workflow more seamless, we have added a time brush to make it easier to navigate from one time span to another, putting intuitive UX front and center for easy movement between time ranges.

Below is a GIF showing how simple it is to navigate using the brush:

We are excited about these new updates, but we are even more excited about what’s to come, so be on the lookout for more product news soon! You can also explore Time Series Insights and take these new updates for a test drive using our free demo environment, you’ll just need an Azure.com account to get started. You can also stay up to date on all things Time Series Insights by following us on Twitter.
Quelle: Azure