Apache Doris BE 开发环境搭建

前期准备工作

本教程是在Ubuntu 20.04下进行的

下载doris源代码下载地址为：apache/incubator-doris: Apache Doris (Incubating) (github.com)
安装GCC 8.3.1+，Oracle JDK 1.8+，Python 2.7+，确认 gcc, java, python 命令指向正确版本, 设置 JAVA_HOME 环境变量

安装其他依赖包

sudo apt install build-essential openjdk-8-jdk maven cmake byacc flex automake libtool-bin bison binutils-dev libiberty-dev zip unzip libncurses5-dev curl git ninja-build python brotli
sudo add-apt-repository ppa:ubuntu-toolchain-r/ppa
sudo apt update
sudo apt install gcc-10 g++-10 
sudo apt-get install autoconf automake libtool autopoint

安装openssl-devel:

sudo apt install -y openssl-devel

编译

以下操作步骤在/home/zhangfeng目录下进行

下载源码

git clone https://github.com/apache/incubator-doris.git

编译第三方依赖包

cd /home/zhangfeng/incubator-doris/thirdparty
./build-thirdparty.sh

编译doris产品代码

cd /home/zhangfeng/incubator-doris
./build.sh

注意：这个编译有以下几条指令：

./build.sh  ##同时编译be 和fe
./build.sh  --be ##只编译be
./build.sh  --fe ##只编译fe
./build.sh  --fe --be##同时编译be fe
./build.sh  --fe --be --clean##删除并同时编译be fe
./build.sh  --fe  --clean##删除并编译fe
./build.sh  --be  --clean##删除并编译be
./build.sh  --be --fe  --clean##删除并同时编译be fe

如果不出意外，应该会编译成功，最终的部署文件将产出到 /home/zhangfeng/incubator-doris/output/ 目录下。如果还遇到其他问题，可以参照doris的安装文档http://doris.apache.org。

部署调试

给be编译结果文件授权

chmod  /home/zhangfeng/incubator-doris/output/be/lib/palo_be

注意： /home/zhangfeng/incubator-doris/output/be/lib/palo_be为be的执行文件。

通过查看/home/zhangfeng/incubator-doris/output/be/conf/be.conf

## INFO, WARNING, ERROR, FATAL
sys_log_level = INFO
be_port = 9060
be_rpc_port = 9070
webserver_port = 8040
heartbeat_service_port = 9050
brpc_port = 8060

## Note that there should at most one ip match this list.

## If no ip match this rule, will choose one randomly.

## use CIDR format, e.g. 10.10.10.0/

## Default value is empty.
priority_networks = 192.168.59.0/24 ## data root path, seperate by ';'
storage_root_path = /soft/be/storage 

## sys_log_dir = $/log

## sys_log_roll_mode = SIZE-MB-

## sys_log_roll_num =

## sys_log_verbose_modules =

## log_buffer_level = -

## palo_cgroups

需要创建这两个文件夹，这是be数据存放的地方

mkdir -p /soft/be/storage

打开vscode，并打开be源码所在目录，在本案例中打开目录为/home/workspace/incubator-doris/
安装vscode ms c++调试插件

创建launch.json文件，文件内容如下：

{
"version": "0.2.0",
"configurations": [
    {
        "name": "(gdb) Launch",
        "type": "cppdbg",
        "request": "launch",
        "program": "/home/workspace/incubator-doris/output/be/lib/palo_be",
        "args": [],
        "stopAtEntry": false,
        "cwd": "/home/workspace/incubator-doris/",
        "environment": [{"name":"PALO_HOME","value":"/home/zhangfeng/incubator-doris/output/be/"},
                        {"name":"UDF_RUNTIME_DIR","value":"/home/zhangfeng/incubator-doris/output/be/lib/udf-runtime"},
                        {"name":"LOG_DIR","value":"/home/zhangfeng/incubator-doris/output/be/log"},
                        {"name":"PID_DIR","value":"/home/zhangfeng/incubator-doris/output/be/bin"}
                       ],
        "externalConsole": true,
        "MIMode": "gdb",
        "setupCommands": [
            {
                "description": "Enable pretty-printing for gdb",
                "text": "-enable-pretty-printing",
                "ignoreFailures": true
            }
        ]
    }
]
}

其中，environment定义了几个环境变量DORIS_HOME UDF_RUNTIME_DIR LOG_DIR PID_DIR，这是palo_be运行时需要的环境变量，如果没有设置，启动会失败。 注意：如果希望是attach(附加进程）调试，配置代码如下：

{
    "version": "0.2.0",
    "configurations": [
        {
          "name": "(gdb) Launch",
          "type": "cppdbg",
          "request": "attach",
          "program": "/home/zhangfeng/incubator-doris/output/lib/palo_be",
          "processId":,
          "MIMode": "gdb",
          "internalConsoleOptions":"openOnSessionStart",
          "setupCommands": [
                {
                    "description": "Enable pretty-printing for gdb",
                    "text": "-enable-pretty-printing",
                    "ignoreFailures": true
                }
            ]
        }
    ]
}

配置中 “request”: “attach”, “processId”:17016，这两个配置节是重点：分别设置gdb的调试模式为attach，附加进程的processId，否则会失败。如何查找进程id，可以在命令行中输入以下命令：

ps -ef | grep palo*

如图：

其中的15200即为当前运行的be的进程id.

一个完整的lainch.json的例子如下：

 {
    "version": "0.2.0",
    "configurations": [
        {
            "name": "(gdb) Attach",
            "type": "cppdbg",
            "request": "attach",
            "program": "/home/zhangfeng/incubator-doris/output/be/lib/palo_be",
            "processId": 17016,
            "MIMode": "gdb",
            "setupCommands": [
                {
                    "description": "Enable pretty-printing for gdb",
                    "text": "-enable-pretty-printing",
                    "ignoreFailures": true
                }
            ]
        },
        {
            "name": "(gdb) Launch",
            "type": "cppdbg",
            "request": "launch",
            "program": "/home/zhangfeng/incubator-doris/output/be/lib/palo_be",
            "args": [],
            "stopAtEntry": false,
            "cwd": "/home/zhangfeng/incubator-doris/output/be",
            "environment": [
                {
                    "name": "DORIS_HOME",
                    "value": "/home/zhangfeng/incubator-doris/output/be"
                },
                {
                    "name": "UDF_RUNTIME_DIR",
                    "value": "/home/zhangfeng/incubator-doris/output/be/lib/udf-runtime"
                },
                {
                    "name": "LOG_DIR",
                    "value": "/home/zhangfeng/incubator-doris/output/be/log"
                },
                {
                    "name": "PID_DIR",
                    "value": "/home/zhangfeng/incubator-doris/output/be/bin"
                }
            ],
            "externalConsole": false,
            "MIMode": "gdb",
            "setupCommands": [
                {
                    "description": "Enable pretty-printing for gdb",
                    "text": "-enable-pretty-printing",
                    "ignoreFailures": true
                }
            ]
        }
    ]
}

6.点击调试即可

Apache Doris BE 开发环境搭建

前期准备工作

编译

部署调试

文章列表

更多推荐

更多

张家锋

近期文章

更多

基于Apache Doris怎么构建数据中台(七)-数据指标管理

link 使用 SQL 读取 Kafka 利用Doris Flink Connector写入到Doris表中

Apache Doris Binlog load使用方法

Doris Grafana监控指标介绍

Apache Doris 实战指南

Apache Doris数据备份及恢复

热门标签

更多

推荐作者

更多