Valitive is a B2B consumer data handling application, designed on a microservice architecture, that processes, cleanses, filters and transfers data covering the entire population of Sweden. Fidenz engineered its delivery pipeline and the automated process that keeps that data clean.
Size of the Platform
- 70M+ business data points
- 20+ microservices
- 10K unit tests
- 10+ Kubernetes clusters
- 15+ server instances across two AWS regions
Technologies and Tools
| Layer | What runs it |
|---|---|
| Version controlling | Self-managed GitLab |
| Continuous deployment | TeamCity, Azure DevOps Pipeline |
| Containerization | Docker, Amazon Elastic Container Registry (ECR) |
| Container management | Amazon Elastic Container Service (ECS), Amazon Elastic Kubernetes Service (EKS) |
| Domain management and routing | Route53 |
| Load balancers | Amazon Elastic Load Balancer (ELB), NGINX Ingress Controller |
| HTTP cache | Nginx |
| Log management | Elasticsearch, Logstash, Kibana |
| Data processing | Kafka, Elasticsearch |
CI/CD for the Microservices
Every application repository is managed on GitLab under a clean Git Flow pattern, with TeamCity and AWS CodePipeline driving the automation. The pipeline builds each Spring Boot service, checks it and runs its automated tests; a successful build is packaged as a Docker image and registered in ECR as a new version. New containers then roll into ECS with no downtime on the live system.
Automated Data Cleansing
The cleansing process pulls updated data from several sources and makes it available in a structured, B2B-exchangeable format, which means merging and verifying records rather than simply copying them across.
