call us toll-free +1 855 855 3600
 
Home > Blog

Improve PostgreSQL Performance 12X by Migrating to Amazon Aurora with Minimal Downtime

Posted by | On May 17th, 2018 | In Amazon Web Services, AWS Database Migration Service, AWS RDS Platform, Database Migration, Database Upgrade
 

An online marketplace company managed a 6-terabyte database using an old version of Amazon RDS PostgreSQL version 9.3. With the gaining popularity of their platform, they needed a way to scale the performance and size of their database near term to 15-terabytes. They also had several performance issues including a daily batch script that was taking almost 2 hours to complete that was starting to exceed the maintenance window, and simple tasks like adding a new column to their largest table would time out. The main challenge for the migration project was that downtime could not exceed 6 hours and test efforts by their DBA team could never meet the requirement.

In this blog post, we will walk through two things:

  1. The various options for upgrading their PostgreSQL 9.3 server to 9.6
  2. The process of migrating them to Amazon Aurora from RDS

Please read on to see how we were able to complete the entire migration process in under 3 hours and take advantage of the performance of Amazon Aurora for PostgreSQL.

Improve PostgreSQL Performance 12X by Migrating to Amazon Aurora with Minimal Downtime

Read the rest of this entry »

Take advantage of a customized video chat module to improve your mobile applications

Posted by | On May 10th, 2018 | In Application Development, Mobile, Technologies
 

So, you want to upgrade your existing mobile application by adding some cool new features to it? Or do you want to build a new app from scratch, leveraging the most advanced features available on the market? Let us introduce an easily customizable video chat module, which we regularly use in various mobile applications. Watch the following video to learn how we can embed video chat directly into your mobile app quickly and easily.

Read the rest of this entry »

Accelerate Database Migration to AWS with DB Best – Webinar Wrap Up

Posted by | On May 2nd, 2018 | In Amazon Web Services, Data Warehouse Migration, Database Migration
 

Big thank you to everyone who attended our webinar on May 1, 2018 – Accelerate Database Migration to AWS with DB Best! Dmitry Balin and myself talked about how DB Best and Amazon Web Services (AWS) can help you improve performance and reduce costs by migrating your on-premises databases to managed Amazon Relational Database Service (Amazon RDS), to virtual machines using Amazon Elastic Compute Cloud (EC2), or database warehousing solutions such as Amazon Redshift. I also did a couple of demos to show how the AWS Schema Conversion Tool (AWS SCT) helps accelerate the database adoption process by converting the schema of your source databases to your choice of databases.

We had a great Q&A session at the end of the webinar, however as soon as the webinar ended, we all got cut off :(. For the attendees and anyone else interested in migrating your databases to AWS, we will be using Twitter to answer your questions. Just log into Twitter with your favorite Twitter handle and post a question using #AWSDBBestWebinar with our @dbbest_tech handle as a mention. For example:

#AWSDBBestWebinar @dbbest_tech What’s the best way to import 30 TB of data from my Oracle data warehouse to #Amazon #Redshift?

For those that missed the webinar, it should be live within the next few days on the AWS Partner Webinar Series on Migration site.

Be sure to check out some of the great resources that we have on our new website and blog as shown below.

Look forward to continuing the conversation on Twitter!

Thanks,
Bill

Database Compare Suite 4.12 update brings some important improvements

Posted by | On February 20th, 2018 | In Data Warehouse, Data Warehouse Migration, Database Compare Suite, Database Migration, Modernization, Products & Featured Tools
 

We’re happy to announce the latest release of Database Compare Suite 4.12. This new version brings several important improvements and bug fixes, including:

Database Compare Suite 4.12

Continue reading to learn more about the ultimate DBA tool and discover all of the major improvements implemented in this latest application release. Read the rest of this entry »

Top customers’ stories on AWS

Posted by | On February 8th, 2018 | In Amazon Web Services, AWS Database Migration Service, Cloud Migration | Tags: ,
 

The goal of DB Best blog is to deliver technical content on various completed projects and researches. Publishing over 100 blog posts per year, we pay great attention to the projects, related to the cloud data platforms in general, and Amazon Web Services (AWS) in particular. Some of the AWS customers’ stories attract more attention than others, so, that’s why we decided to collect them in one place. We consider these articles must-read and super useful.

AWS customers' stories

Please take a look through our list of the most read customers’ stories on AWS.

Top 3 AWS customers’ stories

We’ve had an amazing experience, migrating on-premises Oracle database to the AWS cloud for a major data processing company. We delivered a cost and time-effective turnkey solution, adding automated monitoring and reporting capabilities to their existing solution.

oracle-aws-migration

1

Fast and error-free migration to the AWS cloud

Another brilliant example of reducing customer’s operational costs by moving their Oracle on-premises database into the AWS cloud. We created highly available and easily scalable database system, providing the customer with a set of best practices on operating the new cloud environment.

high-available-aws

2

Architecting highly available and scalable system when migrating to SQL Server on AWS

Our customer wanted to support additional database platform to their original Oracle database system. They wanted to expand their on-premises system with a new PostgreSQL database running at AWS RDS. We came up with a magnificent solution to unify the application’s SQL code. After unification, the application was running correctly against both databases. You can check the details of this sophisticated project in the following blog post.

oracle-postgre-unification

3Using PostgreSQL in cloud alongside with Oracle to enhance the database system performance

Bonus track: application development with AWS

Check how we implemented a variety of Amazon Web Services to build a set of video streaming applications for one of our regular customers. Highlighting the unlimited power of web services, we will show you how to keep costs under control even under the extremely increasing workloads.

aws-application

4Building a video streaming application based on Amazon Web Services

Be sure to check the related AWS DMS post. It uncovers the technical best practices on AWS cloud migrations and cloud database management.

Top AWS DMS and SCT blog posts

Posted by | On February 8th, 2018 | In Amazon Data Warehouse Solutions, Amazon Web Services, AWS Data Integration, AWS Database Migration Service, AWS RDS Platform, Cloud Migration, Data Warehouse Migration, Database Migration, Modernization | Tags: ,
 

Sharing our technical experience with the readers, we’ve reached a pretty impressive audience on our blog. So, it was pretty easy to distinguish the most popular AWS Database Migration Service (AWS DMS) Support stories. Let’s jump right in and review the most valuable and really important DB Best blog posts on AWS DMS and AWS Schema Conversion Tool (AWS SCT).

We’ve got an impressive series of blog posts, where we talk about the features of AWS Schema Conversion Tool, which is the must-use utility for moving workloads into the Amazon cloud. In addition to that, we talk about popular conversion issues, helping you overcome the action items, which occur during the migration process.

top-aws-dms-and-sct-blog-posts-cut

 

Let’s start with the Amazon Redshift Performance tuning tips. We’ve worked on this blog post for several months to tell you the real story of Redshift optimization project and describe the best practices we’ve learned.

Amazon-Redshift-Optimization

1Using Amazon Redshift performance tuning tips to reduce query times by 800%

Another massive experience was related to the AWS Snowball Edge appliance. We had a unique chance to use this cool device, which combines 80 TB of built-in storage and compute power to migrate our on-premises Oracle database to AWS Redshift.

aws-snowball-edge

2Using AWS Snowball Edge to transfer multiple terabytes of data into the Amazon cloud

Summing up the top 3 technology AWS blog posts, comes our research on taking advantage of AWS Glue ETL service to load the data into Amazon Redshift after migrating the Teradata data warehouse into the Amazon cloud.

AWS-Glue

3Loading Amazon Redshift Data Utilizing AWS Glue ETL service

 

The following blog posts show our immersive experience with AWS Schema Conversion Tool (SCT).

aws-sct

Operational Data Management Helps Multimedia Content Provider Build a New System on AWS

Posted by | On January 25th, 2018 | In Amazon Web Services, Cloud Migration, Customer Stories, Data Management Optimized (DMO), Database Migration, Future-State Architecture Design, Microsoft SQL Server, MySQL, Operational Data Management, Oracle Database
 

One of the world’s largest multimedia content providers was looking for a way to increase the level of user satisfaction by improving the performance of their enormously huge database system. They wanted to leverage operational best practices to increase resiliency/uptime, performance, and scalability at the lowest possible cost. DB Best provided the customer with the day-to-day operational data management services both on-premises and in the cloud, as well as configured the new architecture for their cloud-based system.

Discover the benefits of the outsource Operational Data Management (ODM) solution from the following video.

Read the rest of this entry »

Using AWS Snowball Edge to transfer multiple terabytes of data into the Amazon cloud

Posted by | On January 10th, 2018 | In Amazon Data Warehouse Solutions, Amazon Web Services, Cloud Migration, Data Warehouse | Tags: ,
 

One of the main concerns during large-scale database migrations to the cloud is how long will the data transfer last. When you need to move multiple terabytes of data, the migration process may last for weeks or even months. In addition, the bandwidth of your network connection becomes a limiting factor, and some security concerns may appear. So, the whole migration project becomes unsustainable, and many customers with heavy-weight databases had to abandon their cloud migration initiatives. Amazon came up with a physical solution called AWS Snowball Edge, which allows for fast and secure data transfer of up to 80 TB of data in a matter of days.

We at DB Best had a great opportunity to test the latest AWS Snowball Edge device in our data-center. Being half the size of the original AWS Snowball, the latest version of the appliance can store up to 83 TB of data. This allows for speeding up large-scale data transfers, even taking into account the shipping time of the device.

Managing data and applications anywhere, we often face the issues related to the migration of huge amounts of data for our customers. So, as the Amazon partner, we received the brand new AWS Snowball Edge for testing purposes and tried to migrate our Oracle Database to Amazon Aurora PostgreSQL. Watch the following video to learn more about our experience with AWS Snowball Edge.

Read the rest of this entry »

Loading Amazon Redshift Data Utilizing AWS Glue ETL service

Posted by | On December 27th, 2017 | In Amazon Web Services, Cloud Migration, Database Migration | Tags: , ,
 

Your CIO made a strategic decision to move to AWS and you are wondering how to move your Enterprise Data Warehouse (EDW) on Teradata: should you opt for using Teradata Software Tiers on AWS Marketplace with EC2 instances, or consider migrating to Amazon Redshift? The latter option looks interesting, but there’s one big issue: Redshift doesn’t support stored procedures.  You’ve got a plenty of procedural code as part of your Extract-Transform-Load (ETL) processes, but it is not clear how to move it to Redshift. In this article, we’ll look into how regular data loading jobs can be moved to Redshift using AWS Glue ETL service on a regular basis.  Our specific focus is on migrating stored procedure code of Teradata ETL to AWS Glue scripts.

AWS Glue

For the sake of this exercise we chose a following typical scenario from our Teradata ETL:

  • Source data: the file is dropped onto FTP server;
  • Transformations: filter, join, calculation, aggregation data from datasets;
  • Target: load resulting dataset inserted into Redshift table.

We’ll try to build the same scenario on AWS Glue ETL service to see whether it can be a workable solution or not.

Continue reading to see how we approached the loading Amazon Redshift data utilizing AWS Glue and converted the source ETL scripts to the new format.
Read the rest of this entry »

Webinar 2.9 Followup (Episode 12 – Columnstore Indexes)

Posted by | On December 19th, 2017 | In Kalen's Continuum, Microsoft SQL Server, Training | Tags: ,
 

Thanks to everyone who attended! You can get the slides and demo files here:
Webinar 2.9 – Columnstore Indexes

 

Columnstore index storage

 

If you missed the session, or would like to watch the recorded session, the recording will be available soon.

 

Don’t miss the next webinar on January 9th: Viewing Query Plans!   The registration link will be posted here when available,

 

In addition, I am publishing a list of the upcoming topics. Please be aware they are subject to change or re-ordering. It’s not complete at this point, but it does show the planned topics for the next several months.  I will be updating it periodically