Goal:

Creation of the reliable infrastructure for data collection and processing. The infrastructure was to allow running numerous Java and Python components. Two databases Mongo and Zookeeper should be set up in such a way that their work could be uninterrupted and independent of the operability of the physical infrastructure components. The components – services were provided by the customer and their work was controlled by Java Virtual Machine.

Scope of work:

The outcome is a resilient (to the assumed level) infrastructure, which allowed an uninterrupted operation of the system through the use of cloud technology.

Tasks:

• writing of system configuration scripts in Ansible allowing the infrastructure to be expanded efficiently as required
• the use of WireGuard allowing secure VPN communication and application development in a secure environment – unaffected by traffic analysis
• implementation and configuration of MongoDB for maximum data security
• configuring Zookeper and creating a shared file system for the operation of some containers by using GlusterFS. With this configuration, the services were able to share config files independently of the machine hosting them.

Technologies:

Ansible, Wireguard, Docker, Docker Swarm, MongoDB, Zookeeper, Portainer, GlusterFS, earlier also: Jetty, Hibernate