Teradata 15, What to Expect !!
Teradata Database 15 new features :
- Teradata QueryGrid, provides virtual compute capability within and beyond the Teradata Unified Data Architecture, enabling companies to access and process analytic queries across multiple systemsTeradata Database , with QueryGrid, offers bi-directional data movement and push-down processing to open source Hadoop, and that the announcements develop its unified data approach to bridging the relational and non-relational technologies in the database market.
- It minimizes data movement which takes time, and processes data where it resides.It also reduces data duplication.
- Teradata 15 will really open up the potential uses in data warehouse, including storing and analyzing sensor data along with other data stored on the Teradata platform.
- A JSON data type, its stores the data in JSON document or JSON records in relational format.
- JSON data can be used for all methods, functions, and procedures for processing, shredding, and publishing.
- The size of JSON documents up to 16MB
- JSONPath support provides simple traversal and regular expressions with wildcards to filter and navigate complex JSON documents.
- One of the advantages of processing JSON is the capability to perform query-on-reads, or late data binding, as opposed to the traditional early binding, or the query-on-write method used with traditional data types. With JSON, the database can actually discover what data is there when you run your query.
Hadoop is an open-source framework that allows to store and process big data in a distributed environment across clusters of computers using simple programming models.
Teradata database now able to connect Hadoop with this QueryGrid so it’s called as Teradata Database-to-Hadoop also referred as Teradata-to-Hadoop connector.
- Query Grid for Multiple System Analytics.
- It provides a SQL interface for transferring data between Teradata Database and remote Hadoop hosts.
- Import Hadoop data into a temporary or permanent Teradata table.
- Export data from temporary or permanent Teradata tables into existing Hadoop tables.
- Create or drop tables in Hadoop from Teradata Database.
- Reference tables on the remote hosts in SELECT and INSERT statements.
- Select Hadoop data for use with a business tool.
- Select and join Hadoop data with data from independent data warehouses for analytical use.
- QueryGrid is a "direct replacement" for two of Teradata's existing standalone connectors: SQL-H (technology that it inherited from Aster) and its Unity Source Link connector for Oracle.
- QueryGrid takes them to the next step with more functionality, more intelligence, and then a path to develop several more
- QueryGrid support bi-directional connectivity between Hadoop and Teradata Warehouse and also between Oracle platforms and the Teradata Database
- QueryGrid Use cases shared by Teradata : Click here
XML Data Type:
Teradata also provides a new data type which stores and process the XML data.
It supports methods, functions, stored procedures for all operations like parsing, validation, transformations and Query.
- The XML type stores values up to 2GB in size.
DBQL SHOW PARAMETERS
A parameterized query used to place parameters, and the parameter values are provided in a separate statement at time of execution. The main purpose is to distinguishes between code and data. Also avoids attackers from changing the query by inserting SQL commands
Two new Data Dictionary tables are
- DBC.DBQLParamTbl logs
Below points are shows the overall enhancements in Teradata 15 release.
- The Light-Weight Redistribution(LWR) also referred to as the Single Sender Redistribution (SSR). With this feature, the Teradata Database optimizer can switch from an all-AMP row redistribution to a few AMP row redistribution.
- While executing the query, Teradata optimizer determines a query step is eligible for SSR, then the retrieved rows are redistributed by hash code to receiver AMP. In this case the number of AMPs is few. Without SSR all rows are normally redistributed across all AMPs.
- Software Efficiency Improvements
- New PI On Access Rights Table
- DBQL – Show Parameters
- Onsite System and Dump Analysis
In addition to changing the internal data organization for the table, Teradata Columnar includes automatic dynamic compression and new compression mechanisms. Because all the data in a column storage container is for the same column, it is more consistent and lends itself to more compression algorithms than row-oriented data. To take advantage of the consistency within the data, Teradata Columnar includes various compression mechanisms, such as:
- Run length encoding
- Trim leading or trailing bytes or characters
- Delta from mean
- UNICODE to UTF8
Teradata Columnar can apply multiple compression mechanisms to a column partition. Applying this broad set of mechanisms to homogeneous data in columnar storage achieves dramatic compression rates.
GIVE THE HIGHEST PRIORITY TO IMPORTANT TACTICAL WORK ,
- Everybody wants to run queries on your database at the same TIME – FROM the boardroom TO the LOADING dock, from marketing to front-line customer service – AND they ALL want answers AS CLOSE TO REAL-TIME AS possible.
- TERADATA WORKLOAD Management prioritizes the WORK AS per your specifications AND assigns resources to make sure everything gets done on time to meet business demands.
- HASH JOIN ENHANCEMENTS These enhancements extend the application of hash joins to include:* Classical and dynamic hash outer joins* Inclusion hash semi joins and exclusion hash semi joins* Dynamic, inclusion, and exclusion hash semi joins with dynamic partition elimination* Hash joins with cross terms Benefits * More efficient hash joins.
- Enhanced performance of outer joins, inclusion and exclusion semi joins, joins with partition elimination, and joins with cross terms.
Considerations : Hash join enhancements with dynamic partition elimination only apply to dynamic hash joins, inclusion hash joins, and exclusion hash joins. They do not apply to classical or direct hash joins.
Indexes on UDT Columns : You can now create primary and secondary indexes on most types of user-defined type (UDT)columns
Benefits: You can declare a primary or secondary index on a UDT column when you create:
* Indexed tables
* Join indexes
* Hash indexes
* Secondary indexes
You cannot create primary or secondary indexes on:
* LOB UDTs
* ARRAY/VARRAY (Teradata internal UDT)
* The VARIANT_TYPE data type
- Teradata Database defaulted to a single set of encryption standards with no options for increasing encryption strength:
- Teradata client applications provided the option to encrypt network traffic to and from the database, but all encryption used the default AES 128-bit algorithm.
THE QUERY WINDOW
SQL Assistant 15.0 uses a new code editor control to provide the Query window and SQL parsing functionality. This has required changes to the way in which some functions are performed, but has also added additional functionality.
The following changes will be observed:
- The scroll bars now conform to your chosen appearance settings
- Outline indicators now appear at the left of the SQL text
- The background colour of the current line may now be different from other lines
- A narrow yellow bar now appears at the left of any line that you have changed
- The bookmark symbols have changed
- Quick-Info tool tips may be displayed when you hover over a built-in function name
- Suggestion lists are now displayed for additional commands
- The Find and Replace dialogs have changed
- The process to Record, Play back, or manage, Keyboard macros has changed
- Changes during query execution
- When you execute a query only the portion that you are executing will become read only. This will allow you to continue working on other parts of the query without having to copy it to another Query tab.
- You can now highlight and submit part of a Query for execution as an Import statement.
The approximate location of syntax errors is now indicated by red wavy lines below the text. These lines will remain until you next submit the query.
Note that syntax error locations are still only available when connected using Teradata.Net.
- Teradata's Active EDW 6750 MPP appliances ship with many capacity increases. Teradata benefits from Intel Corp.'s own innovation — each Active EDW 6750 system now ships with dual 12-core variants of Intel's 64-bit Xeons, for a total of 24 cores per node — as well as from improving economies of scale in both the solid state drive (SSD) and memory markets.
- The new EDW 6750 packs in 2.5 times more SSD capacity — 40 SSDs per node, as distinct from 16 — and eight times as much memory capacity. In fact, each Active EDW 6750 node can be stuffed with 512 GB of memory. (A single cabinet can house up to three active Active EDW 6750 nodes and one standby node. That's 1.5 TB of memory per active node, with 512 GB available as standby.)
- Teradata's "Intelligent Memory" strategy, which — instead of loading all database data and indexes into physical RAM — tries to make intelligent decisions about which data to load into memory, how (or at what levels) it caches data, and how it performs certain kinds of operations.