The Not-So-Wholesome Reality Behind The Making Of Your Meal Kit

August 26, 2015, was, by all accounts, a stressful day at Blue Apron’s facility in Richmond, California.

As the sun rose over what would be an unusually warm Wednesday, a 21-year-old employee made a phone call to a supervisor at the $2 billion food startup&;s Bay Area fulfillment center, where tens of thousands of meal kits are packed into cardboard containers and shipped across the continental United States. The supervisor didn&039;t pick up the phone that morning, so he left a message.

In it, he said he planned to quit his job at Blue Apron later that day. He also said he planned to bring a gun to the warehouse and shoot his manager, as well as other people at the facility. In two messages, he named three people specifically who he wanted to put bullets into when he got there. Around 8:30, en route to work, the supervisor called the police.

Police apprehended the man, who did not have a gun, later that morning. But at Blue Apron, the day was just getting started.

While company security and a Richmond police officer on patrol monitored threats outside the warehouse, inside, Blue Apron management was meeting with representatives from California&039;s Division of Occupational Safety and Health at the conclusion of a two-week inspection by the agency that would result in nine violations and proposed penalties totaling $11,695 for unsafe conditions that put workers at risk for fractured bones, chemical burns, and more. This penalty came on top of $13,050 following a forklift accident earlier in the year, giving Blue Apron the most OSHA violations in the fast-growing, $5 billion meal-kit startup industry, and among the most in perishable prepared-food manufacturing in California. (Like many companies, Blue Apron appealed these findings, and had some of its violation classifications downgraded to “general” or “other.” One of its cases is still open.)

Just after 4 p.m. on the same day, the police were back at Blue Apron for the third time, following a noontime patrol. They were prompted by yet another call from a security guard, concerned that “a weapon might be brought.”

This time the problem was a 26-year-old man who, after being fired earlier in the day for groping a female co-worker, had then threatened the person who let him go. He was later arrested for sexual assault, as well as for violating his parole on an earlier robbery charge.

“I definitely remember that day,” said David Reifschneider, who was general manager of the facility at the time. “It&039;s not what happens on a typical day in a typical warehouse.”

He&039;s right. This wasn’t a typical day, nor was it a typical old-fashioned warehouse, but the thrumming hub of a fast-growing, well-funded, hugely ambitious food startup. Founded in New York City in 2012, Blue Apron now operates fulfillment centers in Richmond, where the vast majority of the workers interviewed for this article worked, as well as Jersey City and Arlington, Texas. Between them and the company’s corporate headquarters in New York City, Blue Apron employs more than 4,000 people and delivers around 8 million meals every month all over the continental United States. It has raised $193.8 million in venture capital, and in 2015 it was valued at $2 billion; if the Silicon Valley rumor mill can be believed, the company could go public in the next year, with an additional billion dollars tacked on to that valuation. The Richmond facility alone grew from fewer than 50 employees in 2014 to over 1,000 today, making Blue Apron one of the largest employers in the city.

But scaling a manufacturing facility in a historically crime-dogged city like Richmond as fast as if it were a downtown San Francisco software firm hasn’t been easy for Blue Apron. The company has set out to upend the entrenched industrial food system and disrupt the dinner table by changing the way Americans buy, receive, and prepare food, reducing food waste and increasing distribution and delivery efficiencies in the process. To do that, it had to rapidly hire a massive unskilled workforce, bringing jobs to a part of the Bay Area that has been largely left behind by Silicon Valley’s boom times. Yet documents and interviews suggest that it was unprepared to properly manage and care for those workers, and as a result has suffered a rash of health and safety violations.

In the 38 months since Blue Apron&039;s facility opened, the Richmond Police Department has received calls from there twice because of weapons, three times for bomb threats, and seven times because of assault. Police captains have met twice with Blue Apron to discuss the frequency of calls to the police. At least four arrests have been made due to violence on the premises, or threats of it. Employees have reported being punched in the face, choked, groped, pushed, pulled, and even bitten by each other on the job, according to police reports. Employees recalled bomb scares, brandished kitchen knives, and talk of guns.

All told, interviews with 14 former employees describe a chaotic, stressful environment where employees work long days for wages starting at $12 an hour bagging cilantro or assembling boxes in a warehouse kept at a temperature below 40 degrees.

“You put honey in a small container. We would put small peppers in little small bags,” said Glenn Lovely, who worked as a temp in the Richmond facility for three months. “And it was cold — cold as hell.”

Scaling a manufacturing facility in a historically crime-dogged city like Richmond as fast as if it were a downtown San Francisco software firm hasn’t been easy for Blue Apron.

To combat the cold temperatures required by food safety laws, Blue Apron provides each employee with a jacket, thermals, a hat, and a neck warmer. Some people said this was sufficient, but others struggled to adjust. “Your fingers would start to get numb and start to hurt from using them,” said former warehouse lead Andrew Driskell.

One person said Blue Apron was the worst job she&039;d ever had. Others said it wasn’t so bad. But every one of them — even those who mostly liked the job — recalled violence or threats of violence, visits from the police, injuries, high turnover, unfair treatment, or a combination of the above.

“I enjoy jobs where things are on fire more than ones where I’m sitting around,” said one former team lead of his experience at Blue Apron. “But there were times when it was just horrible.”

Blue Apron declined to make an executive available for an interview. In a statement to BuzzFeed News, the company stressed its commitment to “creating the best possible workplace experience for all of our employees. We are proud of our corporate culture and the good work that our employees do every day, bringing families across the country together over delicious, home-cooked meals.”

The idea, on its surface, is simple. Once a week, customers receive a box in the mail with recipe cards and all the pre-portioned, farm-fresh ingredients — down to tablespoonfuls of vinegar and sprigs of oregano — needed to make two, three, or four wholesome, healthy, Instagram-ready, home-cooked meals. The cost per plate is just under $10, and each meal takes an average of 35 minutes to prepare (or so the recipe cards claim). As the sales pitch goes, it’s healthier than takeout, easier than cooking from scratch, and cheaper than a private chef or meal delivery service. Blue Apron’s product is, essentially, hired help in the kitchen at a fraction of the cost — a way for busy professionals and rural foodies to whip up meals like skokichi squash ragù and mafalda pasta with mushrooms, garlic chives, and rosemary or crispy catfish with kale-farro salad and warm grape relish in less than an hour, without setting foot in a grocery store or planning a meal. Its popularity has made the company a rising star among a new class of Silicon Valley disruptors whose product is not software, but real-world products, delivered to your door frictionlessly, quickly, efficiently, and sometimes inexpensively, with just a few clicks of a mouse or taps of an app.

Matthew Mead / AP

“I think that there is a great opportunity today to create, through technology, a leaner food system that cuts out the various steps between the consumer and supplier,” company co-founder Matt Wadiak said in an August Q&A with the nonprofit Food Tank. Words like “sustainable” and “responsible” pepper the company’s website, which features high-resolution photos of happy cheesemakers and sun-baked farms.

But between farm and front door is the massive, mostly invisible process by which all those ingredients are measured, cut, prepped, bagged, packed, palletized, and shipped. For all its outward simplicity, Blue Apron’s business model is predicated on a hugely complicated feat of precision logistics, executed at an enormous volume. Each week, the company has to develop 10 original, relatively healthy, widely appealing, geographically and seasonally appropriate recipes that can be prepared easily and quickly, with ingredients that are affordable and available at scale. It has to source correct quantities of produce, meat, cheese, bread, spices, and staples from “artisanal purveyors and hundreds of family-run farms” across the country. And then it has to precisely portion and package each of those ingredients — 10 to 12 per meal in this week’s boxes — and send them out to hundreds of thousands of people, ideally without breakage, spoiling, lost packages, or missing ingredients. While the USDA estimates that 10% of food produced in the US is wasted at the retail level, Blue Apron aims to waste just 3% of the food it purchases. If it’s successful, Blue Apron will have done something no one else has, and save a boatload of money in the process.

Blue Apron’s Richmond facility opened in August 2013. In June 2014, the company posted that it was hiring 400 people there; the next 18 months would see a period of rapid growth. David Reifschneider, who has worked for Walmart, Amazon, and Zulily, was hired in May 2015 to be the general manager of the Richmond warehouse. That same month, Blue Apron announced the opening of its Texas facility. In June, the company raised $135 million to strengthen its supply chain. In the months leading up the chaos of August 26, 2015, it expanded its original 30,000-square-foot Richmond facility into an adjacent warehouse space. In a statement, the company attributed this period of expansion to “exceptionally high, unanticipated demand for our product.”

“When I interviewed with Blue Apron, they were doing 6,500 boxes a week,” said Sara Custer, who became head of West Coast operations in May 2014. “When I started, three weeks later, they were doing 9,000 a week. When I left, they were doing easily 20,000 out of the Richmond facility alone.”

Rita Childs worked for a year and a half on the Blue Apron assembly line in the pack-out division, where boxes are filled with ice packs, recipe cards, and the appropriate ingredients for every meal. Those ingredients are prepped by kitchen associates, who weigh out and perfectly portion bulk ingredients from Blue Apron’s suppliers into small plastic bottles and bags: tablespoons of soy sauce poured into tiny bottles, for example, or carefully counted fingerling potatoes put into boxes. And after the boxes are assembled, the shipping department loads them onto pallets and, ultimately, trucks.

BuzzFeed News; Source: Cal/OSHA

By the time Childs left Blue Apron in August 2015, she said, the number of boxes being shipped per week had shot up to 34,000. “Everything that goes in the box had to be prepped 34,000 times.” When the prepping and packing was done — sometimes with the help of automated sealing and bagging equipment — shipping associates would palletize the boxes and load them onto trucks.

Flexibility and convenience are central to the Blue Apron pitch: Boxes can be canceled or modified up to about a week before the delivery day. That’s a boon for the customer, but it makes sourcing difficult, especially for a company mission-driven to reduce waste. With hundreds of thousands of people expecting dinner to be delivered on time, there’s little margin for error. “There were plenty of times where the kitchen would say we had 2,000 celery, but we actually had zero,” one former team lead told BuzzFeed News. “So we&039;d run around like chickens with our heads cut off looking for celery.”

Purchasers described scrambling to find more of a certain ingredient when supply was unexpectedly low.

“I would get sent to Whole Foods and buy things if we really needed an ingredient and we didn’t have it in the building,” said the former team lead. Blue Apron told BuzzFeed News that while during early days it sourced some of its product from local stores, the company’s shipments have been too large to make grocery store shopping feasible “for years now.”

Still, two years later, former employees recall a hectic pace. “One day in pack-out could be worse than an entire Black Friday at Best Buy, as far as stress goes,” the team lead added. Another said it wasn’t uncommon to see someone quit on their first day.

“It was crazy. You felt like you were running all the time. Your hair&039;s on fire and you can&039;t keep up,” said Custer.

“There were plenty of times where the kitchen would say we had 2,000 celery, but we actually had zero. So we&039;d run around like chickens with our heads cut off looking for celery.”

Quelle: <a href="The Not-So-Wholesome Reality Behind The Making Of Your Meal Kit“>BuzzFeed

Racist Social Media Users Have A New Code To Avoid Censorship

Racist online communities have developed a new code for racial, homophobic and bigoted slurs in an attempt avoid censorship.

The code, using terms like Google, Skittle, and Yahoo as substitutes for offensive words describing blacks, Muslims and Mexicans, appears to be in use by various accounts on Twitter and elsewhere.

Many tweets using the code are doing so in support of Republican Presidential nominee Donald Trump:

The code appears to have originated in response to Google&;s Jigsaw program, a new AI-powered approach to combating harassment and abuse online. The program seems to have inspired members of the online message board 4chan to start “Operation Google,” using Google as a derogatory term for blacks in an attempt to get Google to filter out its own name. The code developed from there.

It appears that a number of 4chan posts in which this effort was discussed were deleted. A search of a 4chan archive, 4plebs, cross referenced with Google search, showed the discussion developing underneath a link to a post about Google Jigsaw:

Some referenced Microsoft&039;s AI-powered chatbot, Tay, as an example of how AI can be manipulated by racists.

And the Skype for Jew substitution emerged too:

This isn&039;t the first time a bigoted social media code has emerged. Placing a name in triple parenthesis is meant to identify Jews and target them for harassment.

BuzzFeed News has reached out to Google and Twitter for comment.

Quelle: <a href="Racist Social Media Users Have A New Code To Avoid Censorship“>BuzzFeed

Evan Rachel Wood And Thandie Newton Defend Sexual Violence In "Westworld"

Evan Rachel Wood And Thandie Newton Defend Sexual Violence In "Westworld"

From left: Evan Rachel Wood, James Marsden, and Thandie Newton.

Frederick M. Brown / Getty Images

Westworld, HBO’s much-anticipated sci-fi series about a futuristic theme park where humans pay $40,000 to interact with lifelike robots, finally airs this Sunday. In the months leading up to the premiere, the show’s creators, producers, and even one top HBO executive have defended its fixation on sexual violence. Last night at a press event, actors Evan Rachel Wood and Thandie Newton, who both play artificially intelligent “hosts” who are repeatedly assaulted, also stepped in to defend the show, arguing that Westworld is both responsible and sensitive in its depiction of rape.

“You have an obligation as a storyteller to raise awareness and to show the horrors of that so that people aren’t desensitized to it. I don’t think there’s anything titillating about what we’re doing — it’s all horrific, as it should be,” said Wood.

“We get to see the consequence and ramifications of this violence, the cost of this violence,” added Newton.

There’s only one rule in Westworld: Hosts can’t harm humans. Humans, on the other hand, can do whatever they want to the hosts, which can mean shooting them, stabbing them, and raping them. At the end of each day, the bots are patched up and their memories are mercifully wiped; the same Western-themed adventure starts anew the next morning.

In the first four episodes, the show does not depict rape onscreen. “We don’t actually show sexual violence towards women,” Wood said. “You never see a scene of like rape or anything, but you know it’s going to happen.” But the inanimate hosts emote and bleed just like humans, so it’s harrowing to watch them get treated like bystanders in a first-person shooter game.

Wood and Newton spoke at a roundtable discussion yesterday evening held at the Four Seasons hotel in Silicon Valley to promote Westworld, along with actor Jeffrey Wright, who plays the theme park’s head programmer, as well as the married couple behind the production, showrunners Jonathan Nolan (the brother of director Christopher Nolan) and Lisa Joy. Nolan’s previous works — he co-wrote the movie Interstellar and created the TV series Person of Interest — have also circled around artificial intelligence. With Westworld, he and Joy wanted to tell the story from the robot’s perspective and see what humans look like through their eyes.

“Morality isn’t a problem with video games because the simulation is poor enough that you don’t conflate the experience,” said Nolan. But, he added, “when the intelligence of the nonplayer characters that you’re interacting with eclipses a certain level, then it’s much more problematic than driving around in Grand Theft Auto and running over a bunch of pedestrians.”

Westworld is adapted from Michael Crichton&;s 1973 movie of the same name. But unlike Crichton&039;s Jurassic Park, the threat here is more existential than physical. In the first episode, a line of code in a software update causes the hosts to remember brief flashes of the horrors that they have lived through, leaving the resort essentially “populated by 2,000 abuse victims and survivors, finally waking up,” Willa Paskin wrote in Slate.

Both executive producer J.J. Abrams and HBO president Casey Bloys have called the criticism about excessive sexual violence accurate and valid, but defended Westworld. “You can’t tell a story about oppression without depicting the oppressed,” Abrams told reporters at the show’s premiere in Los Angeles earlier this week.

At the roundtable, Newton and Wood also acknowledged the horror of those scenes, but emphasized that the intent is to force the audience to contend with sexual violence.

“We’re also looking at it from so many different points of view, the perpetrator, the person who has been affected by it, the people who are complicit by being around it. I mean, when do you ever really get a narrative where you get to see it from those different points of view? I think that’s incredibly valuable, but the only way we can really look at it is by showing it,” said Newton.

Newton also stressed there was nothing gratuitous about the sexual violence on the show. “It’s not like we’ll show you this then we’ll distract you and show you something else so you forgot that you’ve seen something so fucking disgusting, and that you don’t even have time to really sit with it and process it, and challenge it in your own mind,” she said. “I think it’s hugely responsible and sensitive filmmaking to first of all be brave enough to put this stuff out there, frankly. Because it’s the opposite of what we want to promote as a team.”

youtube.com

Quelle: <a href="Evan Rachel Wood And Thandie Newton Defend Sexual Violence In "Westworld"“>BuzzFeed

Volvo Is Opening A Self-Driving Car Research Center In Silicon Valley

Uber&;s Volvo XC90 self-driving car is shown in Pittsburgh, Pennsylvania, on September 13, 2016.

Aaron Josefczyk / Reuters

Volvo is opening a research and engineering center in Mountain View, California, where 70 engineers will work on developing autonomous driving, infotainment, and connectivity technology.

Employees will begin moving in as soon as next week. “We are putting the furniture in now as we speak,” Lex Kerssemakers, Volvo’s US chief executive, told BuzzFeed News in an interview.

The move puts Volvo closer to ride-hailing giant Uber, which is retrofitting Volvo XC90s with its own self-driving technology to put on the road in Pittsburgh. Volvo and Uber also recently announced they were partnering in a non-exclusive, $300 million deal to develop an autonomous car together.

The Swedish luxury carmaker follows a line of automakers who have opened up research and development centers in Silicon Valley recently. Ford set up shop in Palo Alto in 2015 and plans to soon double its staff of 130 people, and General Motors has an office in the area as well. Mercedes-Benz opened a research facility in Sunnyvale, California in 2013.

For automakers, building a base in the Bay Area provides an opportunity to create partnerships with tech companies and startups, and to scout out potential acquisitions to get ahead in the race to develop self-driving vehicles. Ford, for example, says it is working with more than 40 startups on new car technology. The company also purchased Chariot, a San Francisco-based shuttle service, earlier this month.

Besides its plans with Uber, Volvo has several other investments in self-driving vehicle technology, which proponents say could reduce the number of car accidents by removing the chance of human error. The company plans to launch a pilot program in London next year that will give 100 people fully autonomous vehicles. It will launch a similar program in Sweden in early 2018, and it’s negotiating with several cities in China as well. The pilot program is aimed at helping the company understand how real people would use autonomous vehicles on a day-to-day basis, and how they would spend their time while sitting in cars that drive themselves.

“We have this vision that nobody should be killed in a Volvo,” Kerssemakers said. “Autonomous driving plays a very important role for us in reaching our vision.”

Quelle: <a href="Volvo Is Opening A Self-Driving Car Research Center In Silicon Valley“>BuzzFeed

Twitter Says This ISIS Beheading Photo Doesn't Qualify As Abuse

“Kathleen” is an outspoken Hillary Clinton supporter. Last Tuesday she took to Twitter to criticize the Trump campaign&;s Skittles refugee poster, calling it a “disgusting ad.” Shortly after, @leslymill — who goes by the name Adorable Deplorable — replied, “i LOVE THE AD. Describes the complexity of the “PROBLEM perfectly.”

The political disagreement — very common on Twitter — peaked when @leslymill replied to Kathleen&039;s tweet with an unsolicited photo of a child holding a knife and a newly severed head with the caption, “your heading for a deep hole.” The photo, according to the website tangentcode.org, is from a video titled “Information Office of the State of Homs offers families (and ) the liquidation of a Captain in the Army Alnasiri” and shows a child soldier, believed to be associated with ISIS, beheading a man and posing with his head.

After seeing the photo, Kathleen reported the tweet to Twitter using its report forms. Soon after, Twitter replied that its investigation found the alleged violent and threatening tweet did not violate Twitter’s rules, which prohibit tweets involving violent threats, harassment, and hateful conduct. Twitter’s rules explicitly state that one may not “threaten other people on the basis of race, ethnicity, national origin, sexual orientation, gender, gender identity, religious affiliation, age, disability, or disease.”

This is not uncommon. In a recent BuzzFeed News survey, which asked over 2,700 Twitter users about abuse, 90% of respondents alleged that Twitter didn’t do anything when they reported abuse.

For Kathleen — who asked to remain anonymous (and use a pseudonym) so as not to receive more targeted abuse — the harassment is unsurprising, but unnerving. “I&039;ve worked online since 1985, so I&039;ve seen it all,” she told BuzzFeed News. “But that doesn&039;t mean I think it is ok.”

Kathleen&039;s case also raises questions about Twitter&039;s ability to help protect its users from unwanted graphic imagery — the kind frequently used by abusers and trolls to threaten. Reached for comment, Twitter directed BuzzFeed News to a passage from an August blog post on countering violent extremism. The passage notes that “there is no one &039;magic algorithm&039; for identifying terrorist content on the Internet.” It also cites “proprietary spam-fighting tools, to supplement reports from our users and help identify repeat account abuse.” These tools, according to the post, identified “more than one third of the accounts we ultimately suspended for promoting terrorism.”

The post, however, doesn’t address terroristic or graphic imagery that has been co-opted by Twitter accounts that do not explicitly promote terrorism or violence against others. In @leslymill&039;s case, horrific images of death are often used in rebuttal to opposing views, or to express sentiments like “This Is the Real Face of Islam.”

When asked to clarify if the company evaluates graphic images such as beheadings on an individual basis, granting exceptions for newsworthiness, Twitter directed BuzzFeed News to a past statement noting that when evaluating media removal requests, “Twitter considers public interest factors such as the newsworthiness of the content and may not be able to honor every request.” The company declined to provide further details about its handling of Kathleen&039;s abuse report.

But roughly three hours after BuzzFeed News contacted Twitter about Kathleen&039;s report, the tweet she&039;d flagged as abusive disappeared from @leslymills’ timeline. Twitter did not respond to queries about its deletion.

Reached for comment, @leslymill did not directly answer questions about being contacted by Twitter for possible terms of use violations. The account subsequently tweeted that it had been asked by Twitter to remove a picture, though it is not clear whether that picture was the one Kathleen reported. “I was asked to remove it…,” @leslymill explained. “So I guess I shouldn&039;t share those photoes…wonder why they don&039;t tell me.”

Quelle: <a href="Twitter Says This ISIS Beheading Photo Doesn&039;t Qualify As Abuse“>BuzzFeed

New security, performance and ISV solutions build on Azure HDInsight’s leadership to make Hadoop enterprise-ready for the cloud

This week in New York, thousands of people are at Strata Hadoop+World to explore the technology and business of big data and advanced analytics. As part of our participation in the conference, we are pleased to announce new capabilities in Azure HDInsight, Microsoft’s managed Hadoop and Spark cloud services, that build on our leadership to make Hadoop enterprise-ready in the cloud and easy for your users with the most security capabilities of any cloud Hadoop solution, big data query speeds that approach data warehousing performance, and new notebook experiences for data scientists all on the latest Hortonworks Data Platform 2.5 and Spark 2.0 platform.

The highest levels of security in a managed Cloud Hadoop solution

To support the adoption of Hadoop in the cloud, Microsoft understands that enterprises need peace of mind that the solution will help protect sensitive corporate data and intellectual property. With the new security features of Azure HDInsight, we provide you with the highest levels of security for authentication, authorization, auditing and encryption available in the cloud for Hadoop.

Authentication and identity management in a few clicks

Azure HDInsight is the first big data service to seamlessly integrate Azure Active Directory and Azure Active Directory Domain Services for enterprise-grade authentication and identity management. This is accomplished with a few clicks, making it easy to secure your Hadoop clusters. This also makes it easy to leverage your existing on-premises Active Directory deployment, which currently supports 1.3 billion daily authentications across 600 million user accounts. You can build sophisticated access control policies around users or security groups supported by features such as multifactor authentication.

Authorization with central security policy administration and auditing

Azure HDInsight is the first managed cloud Hadoop service to include Apache Ranger, which provides a central policy and management portal where administrators can author and maintain fine-grained access control policies over Hadoop data access, components and services. In addition, you can now analyze detailed audit records in the familiar Apache Ranger user interface.

Encryption for data protection

Data processed by Azure HDInsight is stored in Azure Data Lake Store or Azure Storage that both provide server-side encryption as an option to secure data at rest. The encryption works transparently with HDInsight with no extra configuration needed. For Azure Data Lake Store, enterprises can rely on service-managed encryption keys or manage their own keys in Azure Key Vault. Azure Key Vault protects your keys using hardware security models and gives you the ability to revoke access to the keys at any time.

These advanced security capabilities will be available as a public preview in October.

HDInsight now at data warehousing speeds with the latest Hive using LLAP

Microsoft has been involved from the beginning in making Hive run faster with our contributions to Project Stinger and Tez that sped up Hive query performance 100x. We are now pleased to be the first Cloud Hadoop solution to onboard LLAP (Long Lived and Process) from the Stinger.Next initiatives, which promises sub-second querying on big data, which is 25x faster than existing Hive.

LLAP keeps data compressed running in-memory, while retaining the ability to scale elastically within a Hadoop cluster. It also brings many enhancements to the Hive execution engine like Smarter Map Joins, Better MapJoin vectorization, a fully vectorized pipeline, and a smarter cost-based optimizer. In addition to these LLAP enhancements, the latest version of Hive also has faster type conversions, dynamic partitioning optimizations and vectorization support for text files. Collectively, these enhancements have brought a speed improvement of up to 25x when comparing LLAP to Hive on Tez, opening up new scenarios to do interactive BI and reporting on top of big data.

In addition, Microsoft has partnered with Simba to deliver an ODBC driver for Azure HDInsight that can be used with world-class BI tools like Power BI, Tableau and QlikView. Together, this allows business analysts to gain insights over big data using their tool of choice. 

Figure 1: Hortonworks TPC-DS benchmark on 15 queries using the hive-testbench repository: here

Microsoft continues commitment to Spark with a fully managed, SLA-backed Spark 2.0 offering

Spark 2.0 is a major release that overhauls the core query engine with “Project Tungsten,” which upgrades Spark with capabilities of a modern compiler to perform cache-efficient vectorized computations. This has enabled up to 10x faster performance with Spark 2.0 on an already-fast platform. In addition to faster performance, Spark 2.0 also has broader support of the SQL syntax, an improved streaming engine that makes it easier to build real-time solutions, improvements to the Machine Learning pipelines, and more algorithms supported in SparkR. Finally, in response to customer demand, Microsoft and Hortonworks included 100+ fixes for Spark 2.0, improving its stability for production deployments.

With the latest release of Apache HBase for HDInsight, we are also introducing a Spark-HBase connector, letting you use the performance and power of Spark SQL to query HBase. This lets you perform advanced analytics on top of all the data available in your NoSQL database.

Both the latest Hortonworks Data Platform 2.5 and Spark 2.0 are available in Azure HDInsight later today. Hive with LLAP is a new cluster type available as a public preview.

New data science experiences with Zeppelin notebook support

Our goal with big data is to make it accessible for everybody. With Spark for HDInsight, we have designed productivity experiences for the different audiences that use Spark, including the data engineer working on ETL jobs with IntelliJ support, the data scientists performing experimentation with R Server and Jupyter notebook support, and the business analysts creating dashboards with Power BI, Tableau, SAP Lumira and Qlik support.

As part of HDInsight’s support for Hortonworks Data Platform 2.5, we now provide out-of-the-box support for Zeppelin notebooks available later today to give data scientists even more options to create narratives that combine code, statistical equations and visualizations that tell a story about the data.

The easiest way to spin up third-party ISV applications with HDInsight

In the broader ecosystem for Hadoop, there is a thriving market of independent software vendors (ISVs) that provides value-added solutions which help organizations do data preparation, and provide visualizations, advanced security or streaming solutions. In the past these applications would sit outside the cluster, which required spinning up separate virtual machine; also, the connectivity to the Hadoop cluster was limited. Azure HDInsight introduced a way for ISVs such as Datameer to run their applications directly on the HDInsight clusters, letting customers spin up Hadoop and Spark clusters pre-integrated and pre-tuned with the ISV application out-of-the-box. 

"Azure HDInsight Application Platform is the most robust and stable framework we&;ve seen to quickly configure and test Datameer deployments in the cloud,” says Stefan Groschupf, Datameer CEO. “We had all the flexibility to iteratively test different deployment options for our solution as well as marketing collateral within the same portal. It is by far the easiest and fastest way to take your cloud-based solution to market. As a partner, HDInsight application platform has allowed us to connect with customers easily and reduce the time for customers to try Datameer on HDInsight."

Today, we are excited to announce that new partners Cask and StreamSets join the Azure HDInsight ISV program. Cask provides a self-service, extendable open source framework to visually develop, run, automate and operate data pipelines. StreamSets Dataflow Performance Manager provides a single pane of glass for management of big data flows, so enterprises can map and measure all their data in motion.

This week the big data world is focused on Strata + Hadoop World, a great event for the industry and community. It’s exciting to consider the new ideas and innovations happening around the world every day with data. Here at Microsoft, we’re thrilled to be part of it and to fuel that innovation with data solutions that give customers simple but powerful capabilities, using their choice of tools and platforms in the cloud.
Quelle: Azure

Trump Claims Google Suppressed Bad News About Hillary Clinton

Jonathan Ernst / Reuters

Republican presidential nominee Donald Trump on Wednesday claimed Google&;s search engine was biased in burying bad news about his rival Hillary Clinton.

Trump made the comment at a rally in Council Bluffs, Iowa, after mentioning a Google poll, which he said he was leading “despite the fact that Google&039;s search engine was suppressing the bad news about Hillary Clinton. How about that.”

Trump did not elaborate on what “bad news” he believed was being suppressed, though he typically appends “crooked” to Clinton&039;s first name and has made her private email server a central talking point of his campaign.

Google did not immediately respond to a BuzzFeed News request for comment on the Republican nominee&039;s latest allegation.

Though his claim that Google stacked the deck against him appears to be new, Trump has also repeatedly complained that the electoral system is, or could be, “rigged” against him. This summer he repeatedly warned of voter fraud, and put out a call for “observers” to watch polling places and safeguard against cheating.

After Monday&039;s debate, Trump also claimed that his microphone was faulty and speculated that the alleged problem could have been intentional.

LINK: Trump Seeks Volunteer “Observers” To Stop Clinton From “Rigging” The Election

LINK: Trump Defends His “Rigged” Election Claim: “I Just Hear Things, And I Just Feel It”

Quelle: <a href="Trump Claims Google Suppressed Bad News About Hillary Clinton“>BuzzFeed

Amid Fears Of Russian Hacks, Officials Say The US Election Is Secure

Afp / AFP / Getty Images

Less than a week after high-ranking lawmakers accused Russian intelligence agencies of trying to interfere with the presidential election, US officials have tried to offer a reassuring response: a cyberattack, they say, couldn’t change the outcome of the presidential election.

“I’m here to communicate one message — that message is that our elections are secure,” said Thomas Hicks, the chairman of the Election Assistance Commission (EAC), during a Congressional hearing Wednesday on election cybersecurity. Hicks said that our locally run election process, with each state managing its own systems, and comprising over 9,000 jurisdictions, presents an overwhelming obstacle to any would-be hacker.

Although hackers breached online election databases in Arizona and Illinois recently, Hicks stressed the difference between websites and voting systems. No voting machines in use are connected to the internet, he said. Hicks added that the attack on state systems served as a wake up call. “Instead of causing a national crisis, the breaches notified election officials across the country that they should be on high alert,” he said.

The EAC and the Department of Homeland Security (DHS) have been tasked with providing cybersecurity resources and guidance to state governments after the hacks in Arizona and Illinois, and the Democratic National Committee’s email hack in July.

“We have confidence in the overall integrity of our electoral system because our voting infrastructure is fundamentally resilient.”

Andy Ozment, a top DHS cybersecurity official, agreed that our decentralized election system protects against outside interference. “We have confidence in the overall integrity of our electoral system because our voting infrastructure is fundamentally resilient,” he said during the same hearing.

Ozment acknowledged that parts of the US electoral system, just like any digital technology, are vulnerable to tampering. But “we have no indication that adversaries are planning cyber operations against US election infrastructure that would change the outcome of the election in November,” he said.

Several lawmakers referenced how Sen. Dianne Feinstein and Rep. Adam Schiff had publicly accused Russia of engaging in sustained efforts to influence the US election, but Ozment declined to comment. No member of the executive branch has confirmed that Russian agents perpetrated the hacks, nor have they pinned the attacks on any other entity.

“Attacks against voting machines are unlikely to have widespread impact… However, attacks or malfunctions that could undermine public confidence are much easier.”

Despite Ozment and Hicks’ reassurances, experts during the hearing pointed to the glaring security flaws tied to dangerously outdated voting equipment that’s still used across the country, as well as paperless voting machines.

Andrew Appel, a computer science professor at Princeton University, urged election officials to abandon touchscreen machines that produce no paper record. This protects not only against deliberate and malicious interference, but also miscalibration and software bugs, he said during the hearing. Appel has demonstrated how it&;s possible to install a vote-stealing program onto a voting machine in 7 minutes using just a screwdriver.

“As the equipment gets older, we are more likely to see failures,” said Lawrence Norden, the deputy director of the democracy program for the Brennan Center for Justice and co-author of a recent study that catalogued the alarming state of US voting machines.

Norden doubts that a Kremlin-hatched election scheme could determine who ends up in the White House. But he expressed a different concern, echoing lawmakers like Feinstein and Schiff: Rather than manipulating vote tallies, tampering with voting machines could sow distrust in the electoral process.

“Attempted attacks against voting machines are highly unlikely to have widespread impact on vote totals this November,” he said. “However, attacks or malfunctions that could undermine public confidence are much easier.”

Quelle: <a href="Amid Fears Of Russian Hacks, Officials Say The US Election Is Secure“>BuzzFeed

New Hampshire "Ballot Selfie" Ban Is Unconstitutional, Appeals Court Rules

Mike Blake / Reuters

WASHINGTON — A New Hampshire law that forbids people from taking so-called “ballot selfies” is unconstitutional, a federal appeals court ruled on Wednesday.

“New Hampshire may not impose such a broad restriction on speech by banning ballot selfies in order to combat an unsubstantiated and hypothetical danger” of vote buying or voter intimidation, Judge Sandra Lynch wrote for the 1st Circuit Court of Appeals.

“We repeat the old adage: &;a picture is worth a thousand words.&039;”

The ACLU had brought a lawsuit challenging the law on behalf of three people investigated for alleged violations of the law during the 2014 election. At the appeals court, they were backed by the Reporters Committee for Freedom of the Press and Snapchat, among others.

In the key part of the ruling, Lynch wrote:

Read the opinion:

Quelle: <a href="New Hampshire "Ballot Selfie" Ban Is Unconstitutional, Appeals Court Rules“>BuzzFeed