Microservice Architectures - Introduction to Spring Cloud


In this article, we focus on Spring Cloud. We talk about the various components under its umbrella.

You will learn

  • What is Spring Cloud?
  • What are the typical challenges in microservices architectures?
  • What are the challenges that Spring Cloud solves?
  • What are the important projects under Spring Cloud umbrella?
  • How does Spring Cloud help you build your microservices architecture?

Introduction to Cloud, Microservice - Challenges and Advantages

This is the second article in a series of five articles on cloud and microservices:

Introducing Spring Cloud

If you go to the homepage of Spring Cloud:

image info

Spring Cloud provides tools for developers to quickly build some of the common patterns in distributed systems (e.g. configuration management, service discovery, circuit breakers, intelligent routing, micro-proxy, control bus, one-time tokens, global locks, leadership election, distributed sessions, cluster state)

Spring Cloud is not a single project, rather a cluster of them.

Shown below is just a small sample of the projects present under this umbrella.

image info

Let’s get a quick introduction to some of the important projects under Spring Cloud umbrella

Spring Cloud Netflix

Netflix was one of the first organizations to play around with microservices architecture. Under this project, a large number of projects have been open sourced for public use. Eureka, Hystrix and Zuul are popular ones among them.

Spring Cloud Config

This project provides a framework for centralized configuration management, making use of a Git or a SVN repository.

Spring Cloud Bus

This enables the microservices and infrastructure components to communicate with each other, in a distributed setup.

Challenges in Microservices Architectures

Let’s now have a look at the challenges we face while developing microservices applications, and the solutions offered by Spring Cloud for them.

Configuration Management

In a system with a microservices architecture, there are a large number of small-sized microservices that communicate with each other:

image info

Each of these microservices needs to execute across multiple environments. In a given environment, there could be multiple instances of that microservice running. This means the operations team needs to manage a lot of configuration information for each microservice.

The Spring Cloud Config Server provides a solution to such configuration management

image info

It provides an approach, where all the configurations across environments for all the microservices, is stored in a Git repository. The Spring Cloud Config Server then exposes this information to all the microservices.

Storing the configurations in such a centralized location makes it easier for the operations team to manage it.

Dynamic Scale Up And Down

Consider the following example:

The CurrencyCalculationService microservice talks to another microservice, the CurrencyExchangeService. Currently, three instances of CurrencyExchangeService are running. it is possible that at any point in time, more instances can be added in, or existing instances can be removed.

image info

We need the CurrencyCalculationService to be able to distribute the load across the instances available at that point in time.

The need is to dynamically find out the number of instances of the CurrencyExchangeService at that time, and distribute the load across them.

Solution involves multiple components.

Service Registration

All microservices register with a naming server. One of the options Spring Boot provides is Eureka.

Service Discovery

When any microservice wants to talk to another microservice, it asks the naming server In the example above, the CurrencyCalculationService can ask the Eureka naming server, about the instances of the CurrencyExchangeService that are running. The naming service would, in turn, provide the URLs of those instances back to the CurrencyConversionService.

This helps establish a dynamic relationship between instances of the communicating microservices.

Load Balancing

When there are multiple instances of same microservice, you want to distribute load between them. One of the options Spring Cloud provides is a client side load balancing framework, Ribbon.

The CurrencyCalculationService uses Ribbon and distributes requests across instances of the CurrencyExchangeService.

The Feign framework helps us to write simpler RESTful clients.

Visibility And Monitoring

In Microservices Architectures, You would need to have complete visibility into what’s happening in your microservices.

In order to trace a request, you need to assign it a unique identifier. Spring Cloud Sleuth helps in assigning an identifier to every request. You can use a distributed tracing solution like Zipkin to trace the request across multiple components.

API Gateway

All micorservices have a few common features - security, logging, analytics, and so on. What is best place to implement these common features?

An API Gateway provides a great solution to this kind of a challenge.

The Netflix Zuul API gateway is a great solution to implement an API Gateway.

Fault Tolerance

What if a microservice is down? How do other microservices respond to it?

Hystrix helps in improving fault tolerance of your microservices.

Do check out our video on this:

image info

Summary

In this article, we had a look at the Spring Cloud project, and saw that it is an umbrella for a wide variety of projects. Each of these solves a particular problem associated with microservices. Important problems include service registration, service discovery, load distribution, event tracing, service monitoring and fault tolerance.

Related Posts

Spring Boot Tutorials for Beginners

At in28Minutes, we are creating a number of tutorials with videos, articles & courses on Spring Boot for Beginners and Experienced Developers. This resources will help you learn and gain expertise at Spring Boot.

Introduction To Aspect Oriented Programming and Cross Cutting Concerns

Software applications are built in layers. There is common functionality that is sometimes needed across layers - logging, performance tracing etc. How do you implement these common features?

Programming Basics - Introduction To Object Oriented Programming

Object oriented programming (OOP) is all about thinking in terms of objects. Let's dig deeper.

Programming Basics - Five Things To Think About While Programming

You would obviously want to write code that meets your core requirements and provide good performance - choosing right data structures and algorithms to use is the fundamental part of programming. What are the other things that you need to worry about? Here are five things that we think are essential.

Asynchronous communication with queues and microservices - A perfect combination?

In this article, we throw some light on what asynchronous messaging is all about and discuss why you should consider it for your microservices architectures.

Microservice Best Practice - Build an Archetype

In this article, we focus on learning why creating proper archetypes is important for successful microservices architecture.

Microservice Architecture Best Practices - Messaging Queues

In this article, we discuss why Messaging queues are needed, and how they form the cornerstone of communication in microservices architectures.

Microservice Best Practice - Why do you build a Vertical Slice?

In this article, we look at what is a vertical slice, and why we build it. We also discuss the best practices involved in building vertical slices.

Microservices Architectures - Event Driven Approach

In this article, we talk about event driven approach, in the context of microservices architectures. We also discuss what are the advantages of using an event driven approach.

The 12 Factor App - Best Practices In Cloud Native Applications and Microservices

In order that an application be deployed in the cloud and enjoy features such as auto scaling, it first needs to be cloud native. In this article, we have a close look at the best practices for cloud native applications, popularly known as The 12 Factor App.