AWS Migration Hub unterstützt jetzt den Import von Server- und Anwendungsdaten vor Ort. So können Sie den Migrationsfortschritt verfolgen.

AWS Migration Hub, ab sofort mit Importfunktion, bietet einen zentralen Ort, an dem der Fortschritt der Migration von Anwendungen mit verschiedenen AWS- und Partnerlösungen erfasst und verfolgt werden kann. Diese neue Funktion ermöglicht es Ihnen, Informationen über Ihre lokalen Server in AWS Migration Hub zu importieren. Dazu gehören Serverspezifikationen, Nutzungsdaten und die Anwendungen, an denen die Server beteiligt sind. Dies gibt Ihnen die Möglichkeit, den Status der Anwendungsmigrationen bei der Migration zu AWS zu verfolgen.
Quelle: aws.amazon.com

AWS Config erhöht die Standard-Limit-Werte für AWS Config Rules

AWS Config freut sich, allen Kunden in allen Regionen höhere Standard-Limit-Werte für AWS Config Rules anzukündigen. Die Kunden können jetzt standardmäßig 150 AWS Config Rules pro Konto pro Region erstellen. Damit hat sich der Wert von 50 AWS Config Rules pro Konto pro Region erhöht. Die vollständige Liste der AWS Service Limits finden Sie auf der AWS Service Limits-Seite.
Quelle: aws.amazon.com

Amazon Comprehend jetzt in AWS CloudTrail integriert

Amazon Comprehend ist ein NLP-Service (Natural Language Processing), der Machine Learning nutzt, um Einsichten und Zusammenhänge im Text zu finden. Ab heute werden asynchrone Amazon Comprehend API-Aufrufe mit AWS CloudTrail aufgezeichnet. Mit AWS CloudTrail können Sie die Sicherheitsanalyse, die Verfolgung von Ressourcenänderungen und die Fehlerbehebung Ihrer Amazon Comprehend-Anfragen vereinfachen. So können Sie beispielsweise den Auftragsstatus Ihrer Comprehend Batch-Analysen überwachen.
Quelle: aws.amazon.com

HDInsight Tools for Visual Studio Code now generally available

We are pleased to announce the general availability for Azure HDInsight Tools for Visual Studio Code (VSCode). HDInsight Tools for VSCode give developers a cross-platform lightweight code editor for developing HDInsight PySpark and Hive batch jobs and interactive query. 

For PySpark developers who value the productivity Python enables, HDInsight Tools for VSCode offer a quick Python editor with simple getting started experiences, and allow you to submit PySpark statements to HDInsight clusters with interactive responses. This interactivity brings the best properties of Python and Spark to developers and empowers you to gain faster insights.

For Hive developers, HDInsight tools for VSCode offer great data warehouse query experiences for big data and helpful features in querying log files and gaining insights. 

Key customer benefits   

Integration with Azure worldwide environments for Azure sign-in and HDInsight cluster management 
HDInsight Hive and Spark job submission with integration with Spark UI and Yarn UI
Interactive responses with the flexibility to execute one or multiple selected Hive and Python scripts
Preview and export your interactive query results to CSV, JSON, and Excel format
Built-in Hive language services such as IntelliSense auto-suggest, autocomplete, and error marker, among others
Supports HDInsight ESP Cluster and Ambari connection
Simplified cluster and Spark job configuration management

Latest improvements

Since public preview, we have worked closely with customers to address feedback, implement new functionality, and constantly improve user experiences. Some key improvements include:

HDInsight Tools for VSCode can be connected to all the Azure environments which host HDInsight services. Read more in the blog post, “HDInsight Tools for VSCode supports Azure environments worldwide.”
Support for HDInsight Enterprise Security Package. Read more in the blog post, “HDInsight Tools for VSCode integrates with Ambari and HDInsight Enterprise Secure Package.”
Leverage VSCode built-in user settings and workspace settings for clusters and job configuration management. Read more in the blog post, “HDInsight tools for Visual Studio Code: simplifying cluster and Spark job configuration management.”
Integrate with VSCode Azure Account and HDInsight explorer to improve Azure sign-in experience, as well as cluster and Hive metadata browse. Read more in the blog post, “HDInsight Tools for VSCode: Integrations with Azure Account and HDInsight Explorer.”

How to get started

First, install Visual Studio Code and download Mono 4.2.x (for Linux and Mac). Then, get the latest HDInsight Tools by going to the VSCode Extension repository or the VSCode Marketplace and searching HDInsight Tools for VSCode.

For more information about HDInsight Tools for VSCode, please see the following resources:

User Manual: HDInsight Tools for VSCode
User Manual: Set Up PySpark Interactive Environment
Demo Video: “HDInsight Tools for VSCode to support Hive Interactive, Hive Batch and PySpark”

If you have questions, feedback, comments, or bug reports, please send a note to hdivstool@microsoft.com.
Quelle: Azure

Azure Service Bus and Azure Event Hubs expand availability

The Azure Messaging team is continually working to enhance the resiliency and availability of our service offerings – Azure Service Bus, Azure Event Hubs, and Azure Event Grid. As part of this effort, in June 2018, we previewed Azure Service Bus Premium tier for Availability Zones and Azure Event Hubs Standard tier in 3 regions – Central US, East US 2, and France Central.

Today, we’re happy to announce that we’ve added Availability Zones support for Azure Service Bus Premium and Azure Event Hubs Standard in the following regions:

East US 2
West US 2
West Europe
North Europe
France Central
Southeast Asia

Availability Zones is a high availability offering by Azure that protects applications and data from datacenter failures. Availability Zones are unique physical locations within an Azure region. Each zone is made up of one or more datacenters equipped with independent power, cooling, and networking. To ensure resiliency, there’s a minimum of three separate zones in all enabled regions. The physical separation of Availability Zones within a region protects applications and data from datacenter failures. Zone-redundant services replicate your applications and data across Availability Zones to protect from single-points-of-failure.

With this, Azure Service Bus Premium and Azure Event Hubs Standard are generally available for Availability Zones, and Azure Event Hubs Standard in every Azure region that has zone redundant datacenters.

How do you enable Availability Zones on your Azure Service Bus Premium namespace or Azure Event Hubs Standard?

You can enable Availability Zones on new namespaces only. Migration of existing namespaces is not supported.

If using an ARM template to create a Service Bus Premium namespace, it is as simple as specifying an AZ supported region and setting the zoneRedundant property to true in the template.

For Azure Service Bus Premium namespace:

"resources": [{
"apiVersion": "2018-01-01-preview",
"name": "[parameters('serviceBusNamespaceName')]",
"type": "Microsoft.ServiceBus/namespaces",
"location": "[parameters('location')]",
"sku": {
"name": "Premium"
},
"properties": {
"zoneRedundant": true
}
}],

For Azure Event Hubs Standard namespace:

"resources": [{
"apiVersion": "2018-01-01-preview",
"name": "[parameters('eventHubNamespaceName')]",
"type": "Microsoft.EventHub/namespaces",
"location": "[parameters('location')]",
"sku": {
"name": "Standard"
},
"properties": {
"zoneRedundant": true
}
}],

You can also enable zone-redundancy by creating a new namespace in the Azure portal as shown below. It is important to note that you cannot disable zone redundancy after enabling it on your namespace.

Azure Service Bus Premium:

Azure Event Hubs Standard:

General availability of Service Bus and Event Hubs Availability Zones

In addition to the announcements regarding Availability Zones, we’re happy to announce that we’ve added support for Azure Service Bus Premium tier in the following regions:

China North 2
China East 2
Australia Central
Australia Central 2
France Central
France South

Built on the successful and reliable foundation of Azure Service Bus messaging, we introduced Azure Service Bus Premium in 2015. The Premium tier allows our customers to provision dedicated resources for the Azure Service Bus namespace so that they can ensure greater predictability and performance for the most demanding workloads paired with an equally predictable pricing model. With Service Bus Premium Messaging, our customers benefit from the economics and operational flexibility of a multi-tenant public cloud system, while getting single-tenant reliability and predictability.

Azure Service Bus Premium also provides access to advanced enterprise features such as Availability Zones, Geo-Disaster recovery, and Virtual Network Service Endpoints along with Firewall rules. These additional features make the Premium tier tremendously valuable for customers looking for a highly reliable, resilient, and secure enterprise messaging solution.

For more information on Availability Zones:

Azure Availability Zones
What are Availability Zones in Azure?

For more information on Service Bus Premium:

Azure Service Bus Premium Messaging
Azure Service Bus Premium Messaging launch blog

Quelle: Azure

Introducing IoT Hub device streams in public preview

In today's security-first digital age, ensuring secure connectivity to IoT devices is of paramount importance. A wide range of operational and maintenance scenarios in the IoT space rely on end-to-end device connectivity in order to enable users and services to interact with, login, troubleshoot, send, or receive data from devices. Security and compliance with the organization's policies are therefore an essential ingredient across all these scenarios.

Azure IoT Hub device streams is a new PaaS service that addresses these needs by providing a foundation for secure end-to-end connectivity to IoT devices. Customers, partners, application developers, and third-party platform providers can leverage device streams to communicate securely with IoT devices that reside behind firewalls or are deployed inside of private networks. Furthermore, built-in compatibility with the TCP/IP stack makes device streams applicable to a wide range of applications involving both custom proprietary protocols as well standards-based protocols such as remote shell, web, file transfer and video streaming, among others.

At its core, an IoT Hub device stream is a data transfer tunnel that provides connectivity between two TCP/IP-enabled endpoints: one side of the tunnel is an IoT device and the other side is a customer endpoint that intends to communicate with the device (the latter is referred here as service endpoint). We have seen many setups where direct connectivity to a device is prohibited based on the organization's security policies and connectivity restrictions placed on its networks. These restrictions, while justified, frequently impact various legitimate scenarios that require connectivity to an IoT device.

Examples of these scenarios include:

An operator wishes to login to a device for inspection or maintenance. This scenario commonly involves logging to the device using Secure Shell (SSH) for Linux and Remote Desktop Protocol (RDP) for Windows. The device or network firewall configurations often block the operator's workstation from reaching the device.
An operator needs to remotely access device's diagnostics portal for troubleshooting. Diagnostic portals are typically in the form of a web server hosted on the device. A device's private IP or its firewall configuration may similarly block the user from interacting with the device's web server.
An application developer needs to remotely retrieve logs and other runtime diagnostic information from a device's file system. Protocols commonly used for this purpose may include File Transfer Protocol (FTP) or Secure Copy (SCP), among others. Again, the firewall configurations typically restrict these types of traffic.

IoT Hub device streams address the end-to-end connectivity needs of the above scenarios by leveraging an IoT Hub cloud endpoint that acts as a proxy for application traffic exchanged between the device and service. This setup is depicted in the figure below and works as follows.

Device and service endpoints each create separate outbound connections to an IoT Hub endpoint that acts as a proxy for the traffic being transmitted between them.
IoT Hub endpoint will relay traffic packets sent from device to service and vice-versa. This establishes an end-to-end bidirectional tunnel through which device and service applications can communicate.
The established tunnel through IoT Hub provides reliable and ordered packet delivery guarantees. Furthermore, the transfer of traffic through IoT Hub as an intermediary is masked from the applications, giving them the seamless experience of direct bidirection communication that is on par with TCP.

Benefits

IoT Hub device streams provide the following benefits:

Firewall-friendly secure connectivity: IoT devices can be reached from service endpoints without opening of inbound firewall port at the device or network perimeters. All that is needed is the ability to create outbound connections to IoT Hub cloud endpoints over port 443 (devices that use IoT Hub SDK already maintain such a connection).
Authentication enforcement: To establish a stream, both device and service endpoints need to authenticate with IoT Hub using their corresponding credentials. This enhances security of the device communication layer, by ensuring that the identity of each side of the tunnel is verified prior to any communication taking place between them.
Encryption: By default, IoT Hub device streams use TLS-enabled connections. This ensures that the application traffic is encrypted regardless of whether the application uses encryption or not.
Simplicity of connectivity: The use of device streams eliminates the need for complex setup of Virtual Private Networks (VPN) to enable connectivity to IoT devices. Furthermore, unlike VPN, which give broad access to the entire network, device streams are point-to-point involving a single device and a single service at each side of the tunnel.
Compatibility with the TCP/IP stack: IoT Hub device streams can accommodate TCP/IP application traffic. This means that a wide range of proprietary as well as standards-based protocols can leverage this feature. This includes well established protocols such as Remote Desktop Protocol (RDP), Secure Shell (SSH), File Transfer Protocol (FTP), and HTTP/REST, among many others.
Ease of use in private network setups: Devices that are deployed inside of private networks can be reached without the need to assign publicly routable IP addresses to each device. Another similar case involves devices with dynamic IP assignment which might not be known by the service at all times. In both cases, device streams enable connectivity to a target device using its device ID (rather than IP address) as identifier.

As outlined above, IoT Hub device streams are particularly helpful when devices are placed behind a firewall or inside a private network (with no publicly reachable IP address). Next, we review one such setup as a case study where direct connectivity to the device is restricted.

A case study: Remote device access in a manufacturing setup

To further illustrate the applicability of device streams in real-world IoT scenarios, consider a setup involving equipment and machinery (i.e., IoT devices) on a factory floor that are connected to the factory's local area network. The LAN typically is connected to the Internet through a network gateway or an HTTP proxy and is protected by a firewall at the network boundary. In this setup, the firewall is configured based on the organizations security policies which may prohibit opening of certain firewall ports. For example, port 3389 used by Remote Desktop Protocol is often blocked. Therefore, users from outside of the network cannot access devices over this port.

While such a network setup is in widespread use, it introduces challenges to many common IoT scenarios. For example, if operators need to access equipment from outside of the LAN, the firewall may need to allow inbound connectivity on arbitrary ports used by the application. In the case of a Windows machine that uses the RDP protocol, this comes at odds with the security policies that block port 3389.

Using device streams, the RDP traffic to target devices is tunneled through IoT Hub. Specifically, this tunnel is established over port 443 using outbound connections originating from the device and service. As a result, there is no need to relax firewall policies in the factory network. In our quickstart guides available in C, C#, and NodeJS languages, we have included instructions on how to leverage IoT Hub device streams to enable the RDP scenario. Other protocols can use a similar approach by simply configuring their corresponding communication port.

Next steps

We are excited about the possibilities that can be enabled to communicate with IoT devices securely via IoT Hub device streams. Use the following links to learn more about this feature:

Device streams documentation page
IoT Show recording on Channel 9

Quelle: Azure

AWS Cloud9 unterstützt AWS CloudTrail-Protokollierung

AWS Cloud9 ist eine cloudbasierte, integrierte Entwicklungsumgebung (IDE), mit der Sie für die Erstellung, Ausführung und Fehlerbehebung Ihres Codes nur einen Browser benötigen. Sie lässt sich jetzt in AWS CloudTrail integrieren und ermöglicht Ihnen so eine einfachere Nachverfolgung von Änderungen an Cloud9. CloudTrail erfasst diese Änderungen und stellt diese Protokolldateien für ein von Ihnen festgelegtes Amazon S3 Bucket bereit. Dadurch haben Sie Einblick in die Erstellung und Löschung innerhalb der Cloud9-Umgebung.
Quelle: aws.amazon.com