ביג דאטה ו-NoSQL
היסטוריית הביג דאטה – מה זה ביג דאטה? פלטפורמות BigData הגיעו לעולם כאשר כמויות הנתונים הקיימות החלו לגדול
Data Warehouse and BI
For Data Warehouse and BI we use three types of solutions depending on the DWH size and the data platform the customer uses:
The first three listed above are more compatible as they support parallel query execution and analytic functions, MySQL only supports Version 8 and above.
These databases can be hosted on an on-premise machine or database cloud service (RDS, Cloud SQL). These databases can be suited to up to 1TB.
Every type of solution will require an ETL process which extracts the data from the source system, transforms and loads it to DWH.
It is important to define the correct DWH data model so queries will not make many joins and return the results quickly. In order to achieve this you need a good Data Architect.
Our Data Engineers use Python (small/medium DWH) and Spark (Huge Data Warehouse) to extract the data from source systems or messages queue systems like Kafka and RabbitMQ transform and load it into the DWH platform.
We use a data lake so all customer dimensions, fields and statistics are stored in one or more tables for easy and fast query analysis.
For vitalization we use Tableau, Qlik Sense and Power BI. Our experts build the optimized data layer above the DWH platform in order to best access the data to the data analysts and business stakeholders.
Contact Us today to hear more about our solutions. We will help build the best DWH to suit your business needs at the lowest cost and the best performance.
היסטוריית הביג דאטה – מה זה ביג דאטה? פלטפורמות BigData הגיעו לעולם כאשר כמויות הנתונים הקיימות החלו לגדול
