Working with Bold Data Hub in our Bold BI / Bold Reports

Overview

The primary objective of the Bold Data Hub application is to facilitate the extraction, transformation, and loading of data from diverse sources such as file types and web, SQL, and NoSQL data sources. please refer to Working With Data Hub Connectors. we can conveniently schedule recurring jobs to retrieve data from these sources and utilize SQL scripts for data transformation purposes.

Integrated Bold Data Hub Architecture

Source

Python Requirement for ETL Server

For Windows OS, Python 3.11 is required to run ETL scripts in Bold BI or Bold Reports Data Hub. You may use either:

  • A system-wide Python 3.11 installation, or

  • A Python 3.11 Virtual Environment (venv) created specifically for ETL

If Python 3.11 is already installed (either globally or inside a venv), you must specify the correct Python path in: {Drive}:\BoldServices\etl\etlservice\appsettings.json

  1. Using System-Wide Python 3.11

If you installed Python normally on Windows:

"PythonPath": "<Drive>:\\BoldServices\\Python311"
  1. Using Python 3.11 with Virtual Environment (venv)

If you prefer to use a dedicated venv environment:

"isVirtualEnvironmentAdded": true
"PythonPath": "C:\\BoldServices\\Python311Env\\Scripts"

Manually Creating a Python Virtual Environment on Windows

  1. Ensure Python is Installed Python 3.11 (64-bit) and ensure Add Python to PATH is selected.
  2. Create a directory: 
    C:\BoldServices\Python311Env
  3. Create the virtual environment: 
    python -m venv C:\BoldServices\Python311Env
  4. Verify: 
    C:\BoldServices\Python311Env\Scripts\python.exe
  5. Update appsettings.json: 
    "isVirtualEnvironmentAdded": true,
"PythonPath": "C:\\BoldServices\\Python311Env\\Scripts"

Using Python 3.11 with Virtual Environment (venv) on Linux

  1. Create the virtual environment: 
    sudo apt update
sudo apt install -y python3 python3-venv python3-pip
python3 -m venv /var/www/bold-services/python311env
  2. Verify: 
    /var/www/bold-services/python311env/bin/python --version
  3. Update appsettings.json: 
    "isVirtualEnvironmentAdded": true,
"PythonPath": "/var/www/bold-services/python311env/bin"

Using the Bold Data Hub Application In Bold BI / Bold Reports

To access the Data Hub site, please click on the “Data Hub” icon displayed on the page.

This action will open the site in a new tab. In the Bold BI Server page, the icon can be found under the working-with-etl section as shown in the image.

Source

Similarly, in the Bold Reports Server page, the icon is located under the same section as depicted in the image.

Source

Upon clicking the icon, you will be redirected to the Bold Data Hub site homepage, as illustrated in the image

Source

IMPORTANT: The Bold BI, Bold Reports, and Bold Data Hub applications are seamlessly integrated with our Identity Provider (IdP), allowing users to access them using a single set of login credentials.

This section explains how to work with projects, schedule jobs, and create Bold BI data sources.

For more details on working with Bold Data Hub, click here.

Relationship Between Bold Data Hub and Bold BI Data Sources

Data Store

FAQ

Working with Pipelines

Transformation and Preview

Scheduling ETL Jobs