Mia‑Platform Fast Data is built mixing the Data Mesh and Data Fabric paradigms, two new approaches to enterprise data architecture. Our solution is based on three principles:
- Data sources are the “source of true” of data;
- Data is ingested, land on the Data Mesh Platform and is validated as raw;
- Raw data is curated for different usage and is exposed to consumers.
Data is collected by the SoR using several ingestion methods – which depend on the type of data and the speed at which you want to process it – and then uploaded to an Apache Kafka queue. From there, data is extracted and uploaded to MongoDB Projections. Projections are replicas of the individual entities (for example, a table in a relational database) where the original data is located. This means that for each entity within a System of Records there is only one Projection created within MongoDB, which is a replica (projection) of the original entity.
The data in the projections will, in turn, be aggregated to create Single Views, a set of data that is grouped and organized to meet the needs of the channels that require it. Finally, data is exposed and made available externally via APIs. The whole process of reading data on the corresponding SoR, aggregating it, and exposing it to the different channels takes place in a very short time, thus offering near real time data.
Since Mia‑Platform Fast Data provides always available and up‑to‑date data, companies that decide to adopt it will be able to become data‑driven and access new business opportunities. Mia‑Platform Fast Data is continuously improving thanks to the introduction of low Code components, speeding up the configuration phase. Low code/no‑code approach speeds up many tasks and reduces the risk of mistakes being made in the process: for this reason, Gartner has listed low code/no code capabilities as one of the 4 cloud-native trends of 2022.
Fast Data Low Code
In order to simplify the work of developers and improve the Developer Experience, starting from Mia‑Platform v9.0, we have progressively and drastically reduced the time and effort required for configuration. In fact, it will no longer be necessary to manually write the code to search for the Single View that needs to be updated and to define how the data should be aggregated. It will only be required to write JSON configurations that specify in a declarative way how you want to implement Fast Data. In case you need more elaborate or customized configurations, there will always be the opportunity to write custom code.
In addition to this major improvement, some sections have been made completely No code, such as the creation of Systems of Record and the creation of Projections within them. In particular, now you can directly import a DDL Schema file, thus avoiding the manual creation of every single Projection. The process is very simple: first, you’ll have to download the DLL file from the database, a feature common to many DBMS. Once the file is exported, you can upload it in just a few clicks. During the upload, it is possible to check the imported data and make any necessary changes; the creation process will then be automatically carried out.
Mia‑Platform Fast Data is the tool that enables the construction of your Digital Integration Hub, offering the best possible Developer Experience to your development team. In fact, we believe that developers should focus primarily on developing functionality related to the company’s core business, and should reduce the time spent dealing with configuration and maintenance tasks. Thanks to the low code/no code features, not only the configuration operations will be faster, but also the probability of mistakes being made during the operations will be limited.
At Mia‑Platform, we are constantly working to bring the development team back to the center. Our continuous developments help improve the Developer Experience, so that your developers create services that are more and more competitive, scalable and adaptable to market needs.
Don’t waste time setting up your platform, just push the code!