call us toll-free +1 855 855 3600
 
DB Best Chronicles
 
Talks on Managing Data and Applications Anywhere

Database Compare Suite 4.12 update brings some important improvements

Posted by | On February 21st, 2018 | In Data Warehouse, Database Compare Suite, Database Migration, Database Upgrades | Tags: , , , , , , , , , , , , ,
 

We’re happy to announce the latest release of Database Compare Suite 4.12. This new version brings several important improvements and bug fixes, including:

Database Compare Suite 4.12

Continue reading to learn more about the ultimate DBA tool and discover all of the major improvements implemented in this latest application release. Read the rest of this entry »

Using AWS Snowball Edge to transfer multiple terabytes of data into the Amazon cloud

Posted by | On January 10th, 2018 | In Amazon Redshift, AWS, AWS SCT, Data Warehouse, Move to Cloud | Tags: , , , , ,
 

One of the main concerns during large-scale database migrations to the cloud is how long will the data transfer last. When you need to move multiple terabytes of data, the migration process may last for weeks or even months. In addition, the bandwidth of your network connection becomes a limiting factor, and some security concerns may appear. So, the whole migration project becomes unsustainable, and many customers with heavy-weight databases had to abandon their cloud migration initiatives. Amazon came up with a physical solution called AWS Snowball Edge, which allows for fast and secure data transfer of up to 80 TB of data in a matter of days.

We at DB Best had a great opportunity to test the latest AWS Snowball Edge device in our data-center. Being half the size of the original AWS Snowball, the latest version of the appliance can store up to 83 TB of data. This allows for speeding up large-scale data transfers, even taking into account the shipping time of the device.

Managing data and applications anywhere, we often face the issues related to the migration of huge amounts of data for our customers. So, as the Amazon partner, we received the brand new AWS Snowball Edge for testing purposes and tried to migrate our Oracle Database to Amazon Aurora PostgreSQL. Watch the following video to learn more about our experience with AWS Snowball Edge.

Read the rest of this entry »

Loading Amazon Redshift Data Utilizing AWS Glue ETL service

Posted by | On December 27th, 2017 | In AWS, AWS SCT, Database Migration, Move to Cloud | Tags: , , , , , , , , ,
 

Your CIO made a strategic decision to move to AWS and you are wondering how to move your Enterprise Data Warehouse (EDW) on Teradata: should you opt for using Teradata Software Tears on AWS Marketplace with EC2 instances, or consider migrating to Amazon Redshift? The latter option looks interesting, but there’s one big issue: Redshift doesn’t support stored procedures.  You’ve got a plenty of procedural code as part of your Extract-Transform-Load (ETL) processes, but it is not clear how to move it to Redshift. In this article, we’ll look into how regular data loading jobs can be moved to Redshift using AWS Glue ETL service on a regular basis.  Our specific focus is on migrating stored procedure code of Teradata ETL to AWS Glue scripts.

AWS Glue

For the sake of this exercise we chose a following typical scenario from our Teradata ETL:

  • Source data: the file is dropped onto FTP server;
  • Transformations: filter, join, calculation, aggregation data from datasets;
  • Target: load resulting dataset inserted into Redshift table.

We’ll try to build the same scenario on AWS Glue ETL service to see whether it can be a workable solution or not.

Continue reading to see how we approached the loading Amazon Redshift data utilizing AWS Glue and converted the source ETL scripts to the new format.
Read the rest of this entry »

Webinar 2.9 Followup (Episode 12 – Columnstore Indexes)

Posted by | On December 19th, 2017 | In Kalen's Continuum, Training | Tags: , ,
 

Thanks to everyone who attended! You can get the slides and demo files here:
Webinar 2.9 – Columnstore Indexes

 

Columnstore index storage

 

If you missed the session, or would like to watch the recorded session, the recording will be available soon.

 

Don’t miss the next webinar on January 9th: Viewing Query Plans!   The registration link will be posted here when available,

 

In addition, I am publishing a list of the upcoming topics. Please be aware they are subject to change or re-ordering. It’s not complete at this point, but it does show the planned topics for the next several months.  I will be updating it periodically

Using Amazon Redshift performance tuning tips to reduce query times by 800%

Posted by | On December 14th, 2017 | In AWS, AWS SCT, Data Warehouse | Tags: , , , ,
 

Often database administrators experience decreases in query performance with Amazon Redshift as the size of data increases. The problem becomes even more significant when we start talking about regularly executed queries. Design time decisions that were made with the given the statistics at the start of the project may not make sense with the new data and query patterns. So, this means that the Amazon Redshift cluster requires some optimization. See how these Amazon Redshift performance tuning tips can improve query execution times when users start noticing performance issues.

Amazon Redshift performance tuning tips

Amazon introduced a feature called Redshift Optimization for the AWS Schema Conversion Tool (SCT)  with the November 17, 2016 release. You can now use the Schema Conversion Tool the optimization of existing Amazon Redshift deployments! This dramatically reduces the manual effort of addressing performance issues with your Redshift deployments.

Here’s why you should consider taking advantage of the Redshift Optimization option in the AWS Schema Conversion Tool.

Read the rest of this entry »

Webinar 2.8 Followup (Episode 11 – Compression)

Posted by | On December 12th, 2017 | In Kalen's Continuum, Training | Tags: , ,
 

Thanks to everyone who attended! You can get the slides and demo files here:
Webinar 2.8 – Data Compression

 

CI Record

 

If you missed the session, or would like to watch the recorded session, the recording is available here.

 

Don’t miss the next webinar on December 19th: Columnstore Index Storage!   You can register here,

 

In addition, I am publishing a list of the upcoming topics. Please be aware they are subject to change or re-ordering. It’s not complete at this point, but it does show the planned topics for the next several months.  I will be updating it periodically

Webinar 2.7 Followup (Episode 10 – Partitioning)

Posted by | On December 5th, 2017 | In Kalen's Continuum, Training | Tags: , ,
 

Thanks to everyone who attended! You can get the slides and demo files here:
Webinar 2.7 – Partitioning

 

Partition Switch

 

If you missed the session, or would like to watch the recorded session, the recording is available here.

 

Don’t miss the next webinar on December 12th: Data Compression!   You can register here.

 

In addition, I am publishing a list of the upcoming topics. Please be aware they are subject to change or re-ordering. It’s not complete at this point, but it does show the planned topics for the next several months.  I will be updating it periodically

 

Webinar 2.6 Followup (Episode 9 – Fragmentation)

Posted by | On November 28th, 2017 | In Kalen's Continuum, Training | Tags: , ,
 

Thanks to everyone who attended! You can get the slides and demo files here:
Webinar 2.6 – Fragmentation

Fragmentation

If you missed the session, or would like to watch the recorded session, the recording is available here.

 

Don’t miss the next webinar on December 5th: Partitioning!  Registration is available here.

 

 

In addition, I am publishing a list of the upcoming topics. Please be aware they are subject to change or re-ordering. It’s not complete at this point, but it does show the planned topics for the next several months.  I will be updating it periodically

Webinar 2.5 Followup (Episode 8 – Nonclustered Indexes)

Posted by | On November 21st, 2017 | In Kalen's Continuum, SQL Server | Tags: , ,
 

Thanks to everyone who attended! You can get the slides and demo files here:
Webinar 2.5 — Nonclustered Indexes

nonclustered index leaf

Because this week is a holiday week in the US, there is NO HOMEWORK!

If you missed the session, or would like to watch the recorded session, the recording is available through this link.

Don’t miss the next webinar on November 28th: Fragmentation! You can register here: https://www.eventbrite.com/e/webinar-kalen-delaneys-sql-server-internals-webinars-episode-9-tickets-39714618493

In addition, I am publishing a list of the upcoming topics. Please be aware they are subject to change or re-ordering. It’s not complete at this point, but it does show the planned topics for the next several months. I will be updating it periodically.

Webinar 2.4 Followup (Episode 7 – Clustered Indexes)

Posted by | On November 14th, 2017 | In Kalen's Continuum, SQL Server | Tags: , ,
 

Thanks to everyone who attended! You can get the slides and demo files here:
Webinar 2.4 — Clustered Indexes

Clustered index btree

If you missed the session, or would like to watch the recorded version,  here is the link to the video.

Don’t miss the next webinar on November 21st: Nonclustered Indexes!  You can register here. https://www.eventbrite.com/e/webinar-kalen-delaneys-sql-server-internals-webinars-episode-8-tickets-39713832141

In addition, I am publishing a list of the upcoming topics. Please be aware they are subject to change or re-ordering. It’s not complete at this point, but it does show the planned topics for the next several months.  I will be updating it periodically.

Homework solution/discussion:

Read the rest of this entry »