Kategorie: Microsoft Azure

General Availability: Larger Block Blobs in Azure Storage

Azure Blob Storage is a massively scalable object storage solution capable of storing and serving tens to hundreds of petabytes of data per customer across a diverse set of data types including media, documents, log files, scientific data and much more. Many of our customers use Blobs to store very large data sets, and have requested support for larger files. The introduction of larger Block Blobs increases the maximum file size from 195 GB to 4.77 TB. The increased blob size better supports a diverse range of scenarios, from media companies storing and processing 4K and 8K videos to cancer researchers sequencing DNA.  

Azure Block Blobs have always been mutable, allowing a customer to insert, upload or delete blocks of data without needing to upload the entire blob. With the new larger block blob size, mutability offers even more significant performance and cost savings, especially for workloads where portions of a large object are frequently modified. For a deeper dive into the Block Blobs service including object mutability, please view this video from our last Build Conference. The REST API documentation for Put Block and Put Block List also covers object mutability. 

We have increased the maximum allowable block size from 4 MB to 100 MB, while maintaining support for up to 50,000 blocks committed to a single Blob. Range GETs continue to be supported on larger Block Blobs allowing high speed parallel downloads of the entire Blob, or just portions of the Blob. You can immediately begin taking advantage of this improvement in any existing Blob Storage or General Purpose Storage Account across all Azure regions. 

Larger Block Blobs are supported by the most recent release of the .NET Client Library (version 8.0.0), with support for Java, Node.js and AzCopy rolling out over the next few weeks. You can also directly use the REST API as always. Larger Block Blobs are supported by REST API version 2016-05-31 and later. There is nothing new to learn about the APIs, so you can start uploading larger Block Blobs right away.  

This size increase only applies to Block Blobs, and the maximum size of Append Blobs (195 GB) and Page Blobs (1 TB) remains unchanged. There are no billing changes. To get started using Azure Storage Blobs, please see our getting started documentation, or reference one of our code samples.
Quelle: Azure

Flashback 2016 – Highlights from Azure SQL Data Warehouse

Earlier this year we announced the general availability of Azure SQL Data Warehouse, offering a SQL-based fully managed, petabyte-scale cloud solution for data warehousing. SQL Data Warehouse is highly elastic, enabling you to provision in minutes and scale capacity in seconds. You can scale compute and storage independently, allowing you to burst compute for complex analytical workloads or scale down your warehouse for archival scenarios, and pay based off what you’re using instead of being locked into predefined cluster configurations. Unlike other cloud data warehouse services, SQL Data Warehouse offers the unique option to pause compute, giving you even more freedom to better manage your cloud costs. We are excited to see the customer momentum across industries and we have continued to bring new features to even further enhance the customer experience. Leading digital advertising company MediaBrix uses Azure SQL Data Warehouse to run analysis across billions of rows of data – drilling deep down into 30 TB of data. SQL Data Warehouse not only helps MediaBrix gain fast insights, but it also hooks up to technologies like Azure Machine Learning to create predictive models, change data in real time, and deliver the right ads to the right people. Learn more about how MediaBrix gets answers from data with Microsoft Azure platform. As 2016 ends, here are some of the highlights from a memorable year. General availability now across 23 regions world wide Since announcing general availability in 14 regions in July, we have now extended to 9 additional regions bringing the total to 23 – more than any other major cloud provider. Now customers across following regions can use Azure SQL Data Warehouse: North Europe, North Central US, Central US, East US, East US 2, South Central US, West Central US, West US, West US 2, Canada Central, Canada East, West Europe, Germany Central, Germany Northeast, East Asia, Southeast Asia, Australia Southeast, Central India, South India, China East, China North, Japan East, and Brazil South. Industry Leading Performance for Analytic Queries Azure SQL Data Warehouse is powered by SQL Server underneath and with GA we went live with SQL Server 2016. The industry leading SQL Server 2016 columnstore implementation is at the core of serving analytic queries in SQL Data Warehouse. We significantly improved the data compression and segment elimination to reduce the IO when processing large number of rows. Batch mode execution on top of columnstore speeds up queries by orders of magnitude. With SQL Server 2016, we added batch mode support for common analytic operators, such as order by and windowing aggregates. In addition, we now support aggregate pushdown and string predicate pushdown to the scan node. “We can tell customers who’s actually consuming their advertising. For example, we might say that to target women aged 24 to 35 who have children, they’ll need to do so between 6 and 8 AM on the East Coast, preferably in Pennsylvania or New Jersey. It’s mind-blowing to tell them that, because they’re not getting that level of intelligence from anybody else.” – Christopher Beach, Senior Vice President of Engineering, MediaBrix Learn more about how an advertising company gets answers from data with Microsoft Azure platform. Fast Loading with ADF and PolyBase We recently shared how you can use Azure Data Factory Copy Wizard to load 1TB data in under 15 mins into Azure SQL Data Warehouse, at over 1.2 GB per second throughput. Azure Data Factory is a data movement service in the cloud enabling ingestion of data from multiple on-premises and cloud sources – SQL Data Warehouse has deployed a single-click integration with Data Factory to make data movement even easier. Using the staging blob feature, you can achieve high load speeds from all types of data stores besides Azure Blob storage, which the Polybase supports by default. “Using Azure SQL Data Warehouse, we’re able to do near-real-time compute so they can see data from the last hour. In some cases, we can even bypass our default system and go into a true live system that shows how many people are in the room at that time.” – Tom Sheppard, Chief Executive Officer, Presence Orb Learn more about real-time benefits with Azure SQL Data Warehouse. Enhanced migration, monitoring, and SQL tooling experience Azure SQL Data Warehouse has introduced updates to the Azure portal and SQL Server Management Studio (SSMS) to provide a seamless experience when loading, monitoring, and developing your SQL Data Warehouse. The updates include integrated support for loading from 20+ data stores on premise and in the cloud, a simple process to troubleshoot common issues. The updates also bring highly requested functionality within SSMS further enhancing the experience for SQL users, like enabling the execution of Generate Scripts wizard for database users and user defined functions. SQL Data Warehouse introduced a new top level resource blade that allows you to quickly manage all your databases. You can use the SQL Data Warehouse resource blade to quickly scan through your data warehouse for details like the name, status, server, pricing tier, location, and subscription. Accelerated look up queries SQL Data Warehouse now supports the creation of secondary B-Tree indexes on column store tables. Most analytic queries aggregate large amounts of data and are served well by scanning the column store segments directly. However, there is often a need to look for a “needle in a haystack”, which translates to a query that does a lookup of a single row or a small range of rows. Such look up queries can get orders of magnitude (even 1000x) improvement in response time and potentially run in sub-second if there is a B-Tree index on the filter column. Easy integration with Azure Active Directory authentication and other services within Azure Azure AD provides an alternative to SQL Authentication enabling centralized identity and group management. It enables a single sign-on experience using SQL Data Warehouse for federated domains. Azure AD can be used to authenticate against a growing number of Azure and other Microsoft services and helps customers prevent the proliferation of users and passwords. “Switching from Amazon Redshift was not just about a direct comparison to Azure SQL Data Warehouse. The overall Azure offering provided a lot of motivation.” – Bill Sabo, Managing Director of Information Technology, Integral Analytics Learn more about Integral Analytics switch to Azure from AWS. HIIPA Certification To enable greater adoption within the health industry, Azure SQL Data Warehouse is HIIPA certified. The Health Insurance Portability and Accountability Act (HIPAA) is a US healthcare law that establishes requirements for the use, disclosure, and safeguarding of individually identifiable health information. New products from Partners for easy experience We have had great partners join us to help customers on their journey to experience and adopt the service – including building custom product to enhance data migration and management experience. For example, Redgate, a long-time partner that delivers SQL Server tools, has created Data Platform Studio (DPS) which provides a simple and reliable way to migrate on-premises SQL Server databases to Azure SQL Data Warehouse. Exclusive free trial At the annual PASS Summit in October, we announced a SQL Data Warehouse exclusive free trial – enabling customers to experience this cloud-based service for free for a month. It’s been a great year and thanks to everyone who has joined us in the journey. We are excited for the next year and look forward to helping you solve your most important data warehousing challenges and bringing you even more compelling features and service enhancements. Till then, wish you the best start to 2017. Learn more Check out the many resources for learning more about SQL Data Warehouse, including: What is Azure SQL Data Warehouse? SQL Data Warehouse best practices Video library MSDN forum Stack Overflow forum
Quelle: Azure

Project Bletchley – Corda Distributed Ledger available on Azure

We are very excited to announce the availability of R3’s Corda on Microsoft Azure, only a few weeks after its release to the open source community.  With the addition of Corda to Project Bletchley, we continue to expand our distributed ledger platform support on Azure to enable the next generation of distributed business applications.

Today, R3 published a virtual machine image in the Azure Marketplace to easily and quickly deploy a multi-member Corda demo network on a single VM.  This offering demonstrates the capabilities of Corda through real world scenarios, including an interest rate swap deal and Standard Initial Margin Model (SIMM) valuation. This is the first click-stop of many towards R3’s financial-grade distributed ledger platform offering on Azure.

As Richard G Brown, Chief Technology Officer at R3, describes “Corda is a distributed ledger platform designed from the ground up to record, manage and synchronize financial agreements between regulated financial institutions. It is heavily inspired by and captures the benefits of blockchain systems, without the design choices that make blockchains inappropriate for many banking scenarios.  By making simple Corda demos available on the Azure Marketplace, R3 and Microsoft are making it easy for newcomers to experience Corda for themselves before joining the community.”

Some of Corda’s key design choices include:

Designed for Business: Recording and management of financial transactions, within existing legal and regulatory frameworks
Privacy First: Data sharing restricted to entitled participants of a transaction
Modular Consensus: Support for multiple consensus algorithms

For additional information, you can download the technical white paper.

Try out the Corda distributed ledger demo on Azure to gain insight for your business process development and let us know what you think!  Do not hesitate to leave a comment with questions, feedback, or additional requests as you begin.
Quelle: Azure

Azure Analysis Services is now available in North Europe and West US

Azure Analysis Services is a new preview service in Microsoft Azure where you can host semantic data models. Users in your organization can then connect to your data models using tools like Excel, Power BI and many others to create reports and perform ad-hoc data analysis.

We are excited to announce that Azure Analysis Services is now available in North Europe and West US.

Azure Analysis Services is now available in the following regions: North Europe, West Europe, West US, South Central US and West Central US.

Learn more about Azure Analysis Services or try creating your first data model.
Quelle: Azure