Senior Big Data Engineer

12 Feb 2019

DB Best is a global full-service company, operating at the cutting edge of the latest cloud technologies. DB Best is involved in hundreds of projects with top-tier customers worldwide. Currently, we have several ongoing engagements with a leading global retailer in the beauty industry. We’ve been working with this customer for over 5 years and have established a strong relationship with them.

We have already significantly improved their entire enterprise reporting platform, including ETL processes, enterprise data warehouse, data marts and data visualization components for this customer.  Now, our customer is looking for faster and better decision making and advanced analytics. So, they consider leveraging Big Data technologies and they turned to DB Best to help them develop and maintain this new system.

So, we’re looking for an experienced Senior Big Data Engineer in San Francisco, CA to join our star team.

Actually, we invite you to join one of the most skillful teams at DB Best. Currently, our distributed team includes over 60% of senior developers. So, working with this team of industry experts is really a great pleasure.

This huge opportunity is unlike any project that you’ve worked before. Come join the team and let’s discover together how big, big data can be…

Seeking Big Data Superhero

As a Big Data Senior Developer, you will be working with clients to implement leading edge data analytics and cloud solutions across a range of industries. We are looking for software engineers with a strong understanding of the full data development lifecycle, including requirements gathering, solution design, development, and production deployment. The ideal candidate will have solid Spark & Scala development experience with the desire and passion to continue to learn big data technologies.


The exciting things you will get to do once employed as a Senior Big Data Engineer:

  • Participate in technical planning & requirements gathering phases including design, coding, testing, troubleshooting, and documenting big data-oriented software applications
  • Be Responsible for the ingestion, maintenance, improvement, cleaning, and manipulation of data in the business’s operational and analytics databases. The ability to troubleshoot any existent issues will be a big plus
  • Design, build and launch extremely efficient & reliable data pipelines to move data (both large and small amounts) to our data warehouses
  • Design, build and launch new data extraction, transformation and loading processes in production
  • Create new systems and tools to enable the customer to consume and understand data faster
  • Build, implement and support the data infrastructure; ingest and transform data (ETL/ELT process)
  • Implements, troubleshoots, and optimizes distributed solutions based on modern big data technologies like Spark, Scala, Storm, and Kafka in both an on premise and cloud deployment model to solve large scale processing problems
  • Define and build large-scale near real-time streaming data processing pipelines that will enable faster, better, data-informed decision making within the business
  • Work inside the team of industry experts on the cutting edge Big Data technologies to develop solutions for deployment at massive scale
  • Study data, identify patterns, make sense out of it and convert it to algorithms
  • Designs and plans BI, and other Visualization Tools capturing and analyzing data from multiple sources to make data-driven decisions, as well as debugs, monitors, and troubleshoots solutions
  • Keep up with industry trends and best practices, advising senior management on new and improved data engineering strategies that will drive departmental performance leading to improvement in overall improvement in data governance across the business, promoting informed decision-making, and ultimately improving overall business performance

Required Qualifications

The experience and qualifications we hope you bring to the Senior Big Data Engineer position:

  • Bachelor’s Degree with a minimum of 7+ year’s relevant experience or equivalent
  • 4+ years of hands-on experience in Java and Spring frame work
  • Minimum of 4 years Java/J2EE software development experience in a complex enterprise system environment, building software from conception to production deployment
  • 4+ years of hands-on experience in building data pipeline with Java and Spark
  • 4+ years of hands-on experience with various messaging systems, such as Kafka, Spark data manipulation, pipeline creation
  • 2+ years’ experience with traditional relational databases such as Oracle, SQL Server, PostgreSQL, MySQL
  • Experience working in an Agile/Scrum environment
  • Need someone who is a self-starter and team player, capable of working with a team of Architects, Developers, Business/Data Analysts, QA, and client stakeholders
  • Proficient understanding of distributed computing principles
  • Strong written and verbal communications

Preferred Qualifications

  • Hands-on experience working with Business Intelligence and Reporting
  • Hands-on experience working within AWS, Azure, Google, or other Cloud Platform based on IaaS and PaaS Solutions.
  • Experience with integration of data from multiple data sources
  • Hands-on experience with DevOps solutions like: Puppet, AWS CloudFormation, Docker and Microservices
  • Intelligence & Visualization Space (Tableau, Power BI, Qlik, Cognos, SAP BOBJ, etc.)
  • Passion for working with open-source technologies as well as commercial platforms


As the Microsoft, Amazon, Google, and IBM partner, DB Best provides you with:

  • Working with the industry-leading partners and customers — you will not be limited with just the one project we covered here
  • Flexible work hours, up to 32 days off annually
  • Friendly teams, experienced colleagues, and perfect work equipment
  • Opportunities for career growth and raising professional skills
  • Travel opportunities

Certainly, DB Best is a great place to work. Join our top-tier team of engineers, developers, and experts who are continually pushing the boundaries of what is and what can be. DB Best is the perfect environment for you to grow your skills, understand new technologies, and work with some of the world’s most important companies in creating the future of the cloud. We’re always seeking inquiring minds, so send in your resume today.


Multiple Locations Across US, USA Send Resume


DB Best is internationally known for comprehensive data-management services, database development and migration, and the creation of highly successful web and mobile systems. Hundreds of customers from all over the world rely on our developers and architects for cost-effective strategies in migrating and modernizing their on-premises and cloud assets every day.

Our expertise covers all major databases, including SQL Server, Oracle, Sybase, IBM DB2, PostgreSQL, MySQL, and Access. Unlike smaller, narrow-focused competitors, our developers can choose among many development platforms, including iOS, Android, Windows Mobile, PHP, ASP.NET, and Java.

As a Microsoft Gold Partner for five years running with competencies in Application Development, Data Analytics, Data Platform, and Cloud Platform and an Amazon Web Services Consulting Partner, we have the experience to make our customers successful.

DB Best has rapidly become one of America’s fastest growing companies, as recognized by our presence on the prestigious Inc. 500 list in 2012. Originally started in Silicon Valley as a two-person team by Dmitry and Irena Balin, DB Best now has hundreds of employees in five countries, including our headquarters in Redmond, Washington, and locations in San Francisco, the UK, Israel, Poland, and Ukraine.


We’re always looking for amazing people to join our team. Want to work with us, but couldn't find an appropriate opening?
Let us know about your passion, tell us why you stand out from the crowd and how you can make the difference working at DB Best.
We always keep the doors open for outstanding talents. Just hit the button below to send us your resume.