New Features

Data Ingestion

  • Data source management PowerShell CmdLet. The tool providing users the command line to manage, configure and manipulate all data sources ingested into the solution accelerator.
  • Push channels – Web(HTTP/HTTPS) channel that dispatches data to the HBase. Software packages that can wait and proactively adopt sent data from external data sources, and forward the received data to the Hbase in real-time for processing.
  • Push channels - Web(HTTP/HTTPS) channel that dispatches data to the Service Bus. Software packages that can wait and proactively adopt sent data from external data sources, and forward the received data to the Service Bus in real-time for processing.
  • Pull Channels – DB(SQL DataBase) channel. Software packages that ingest external data from the DB (SQL DataBase) and saves them to buffer for further processing.
  • Pull Channels - IBM MQ channel. Software packages that ingest external data from IBM MQ and saves them to buffer for further processing.
  • Formatter - JSON format. Processes the ingested data and converts it into JSON format.
  • Formatter - HTML format. Processes the ingested data and converts it into HTML format.

City Artifacts Management

  • MDM Power Shell CmdLet. Power Shell command line management interface for Master Data Manager.
  • Master Data Management Service – Source Data Enrichment. This feature is used to enrich the key value pairs of the ingested data using rules.
  • Master Data Management Service – Entity Definition. This feature is used to define the entities discovered by City Artifacts Management.
  • Master Data Management Service – Entity Binding. This feature is used to map the defined entities to the ingested data.
  • Data Warehouse – Hive.
  • ODS to DW ETL - Hbase2Hive ETL. This feature is used to extract entities from Hbase to be displayed using tables in Hive.
  • HBase Secondary Index. This feature is used to rebuild the batch entity index stored in the SQL Server, and to incrementally update the entity index stored in the SQL Server.
  • Dynamic OData Adapter - OData Query Standard Compliancy. This feature is to ensure that the OData Adapter is in compliance with OData Standard.
  • Hive over HBase. This feature uncovers data stored in the HBase through Hive.
  • Support plugins for computed columns. This feature is used to customize computing functions to extend the functionality of the computed column.
  • Security for OData. This feature is to implement the security control mechanism on the Entity level for OData.
  • Support EDMX import/export. This feature allows the importing and exporting of CAM schema through EDMX files.
  • Support entity association relationship. This feature is used to define the entity association relationship.

City Analytics

  • Insight Catalog PowerShell CmdLet. This feature provides users the command line tools to manage, configure and manipulate the Insight Catalog.
  • Insight Catalog Service - Analytics Client Library. This feature is used for client integration with analytics management.
  • Data Publication Service - Publishing data from SQL and Hive. This feature is used to publish result sets generated by analytics and makes them available to other analytics or services running under City Services Management.
  • Batch Analytics Runtime Manager for Hadoop. This feature is used to provide standard Hadoop installation running on Windows. Includes separate environments for production use and lab use.
  • Analytics Job Management. This feature is used to execute, schedule and monitor Windows-based batch/CEP analytics published in the Insight Catalog. Includes an SDK for access to solution accelerator resources and configuration.
  • OLAP Cubes. This feature is used to provide multi-dimensional analytics for city KPIs. Cubes can be built from data extracted from the data warehouse.
  • SDK for Windows Analytics jobs. This feature allows developers to easily write data processing jobs to connect to the solution accelerator’s resources.
  • Analysis developer on-boarding. This feature allocates solution accelerator resources for developers to use when running analytics jobs.
  • API for resource locations. This feature provides the analytics Service API for resource location.

City Services Management

  • Service Management PowerShell CmdLet. The tool providing users the command line to manage, configure and manipulate information dissemination channels provided by the Microsoft CityNext Big Data Solution Accelerator.
  • Service Management Service - Service category management. Categories are a set of semantics defined to classify the services and the service interfaces. There are 3 types of categories: functional categories which describe services from the government’s business and operation perspective; algorithm categories which are derived from the implementation, design and field of study perspectives; and programming categories which describe specific programming techniques. Service category management allows the administrator to create new semantics and/or modify the predefined ones.
  • Service Management Service - Service Interface management. This feature is to define the contract of the service. The Microsoft CityNext Big Data Solution Accelerator predefines a set of service interfaces that are useful from a city perspective using the data within the solution accelerator. Service interface management enables the administrator to create new interfaces and/or modify the predefined ones.
  • Discovery Service - Search the service interface defined using category. This feature provides the search capability for the service and service interface catalog. It retrieves the matched services or service interfaces for the caller.
  • Integrated service - UAir service reveals the air quality index. It is an integrated service, meaning it is hosted on the Microsoft CityNext Big Data Solution Accelerator and consumes data from CAM and analytics. With the geo-coordinates given to the UAir service, it calculates the air quality index for the given area based on the data from coarse inference from the analytics, as well as the real-time weather and air monitoring station.
  • Telemetry. This feature is for the collection and analysis of telemetry in order to assess solution accelerator performance and data activities.
  • Data Query Service (DQS). This feature allows users to register parameterized data queries (OData, Hive & MDX), execute the registered queries, and share the registered queries with others.

Information Dissemination

  • Channel Management PowerShell CmdLet. The tool providing users the command line to manage, configure and manipulate information dissemination channels provided by the Microsoft CityNext Big Data Solution Accelerator.
  • Push Channels - Windows Phone 8 toast. Notification can be pushed to the Windows Phone 8 app toast through this feature.
  • Channel Management Services - Data source and adapter mapping management. This feature is used to build up the mapping relationship between the data source and adapter provided by the solution accelerator, and to validate and control information dissemination.
  • Channel Management Services - Ad-hoc user group management. This feature is used to create an ad-hoc user group based on the input of contract information.
  • Channel Management Services - Data source management. Registering a data source which would want to disseminate data through the solution accelerator.
  • Channel Management Services - Adapter management. Registering a new adapter which can be used to disseminate data through the solution accelerator.
  • Channel Management Services – Data Source and user mapping management. This feature is used to validate and control whether data can be sent to special users.

Last edited Jul 15, 2014 at 8:15 AM by gheadd, version 18