flink介绍:https://blog.csdn.net/weixin_43563705/article/details/107604693
一、安装启动
-
安装flink及其依赖
yum install java-1.8.0-openjdk curl tar
mkdir -p /usr/local/flink
wget https://mirrors.aliyun.com/apache/flink/flink-1.16.1/flink-1.16.1-bin-scala_2.12.tgz -
启动flink
cd /usr/local/flink
tar -xvf flink-1.16.1-bin-scala_2.12.tgz
cd flink-1.16.1
./bin/start-cluster.sh
出现如下字样:
Starting cluster.
Starting standalonesession daemon on host bogon.
Starting taskexecutor daemon on host bogon.
二、测试
1、查看摘要信息
curl localhost:8081
如果部署成功,我们可以看到类似如下字样的返回结果
<!--
~ Licensed to the Apache Software Foundation (ASF) under one
~ or more contributor license agreements. See the NOTICE file
~ distributed with this work for additional information
~ regarding copyright ownership. The ASF licenses this file
~ to you under the Apache License, Version 2.0 (the
~ "License"); you may not use this file except in compliance
~ with the License. You may obtain a copy of the License at
~
~ http://www.apache.org/licenses/LICENSE-2.0
~
~ Unless required by applicable law or agreed to in writing, software
~ distributed under the License is distributed on an "AS IS" BASIS,
~ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
~ See the License for the specific language governing permissions and
~ limitations under the License.
--><!DOCTYPE html><html lang="en"><head>
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
<title>Apache Flink Web Dashboard</title>
<link rel="apple-touch-icon" sizes="180x180" href="assets/favicon/apple-touch-icon.png">
<link rel="icon" type="image/png" href="assets/favicon/favicon-32x32.png" sizes="32x32">
<link rel="icon" type="image/png" href="assets/favicon/favicon-16x16.png" sizes="16x16">
<link rel="manifest" href="assets/favicon/manifest.json">
<link rel="mask-icon" href="assets/favicon/safari-pinned-tab.svg" color="#aa1919">
<link rel="shortcut icon" href="assets/favicon/favicon.ico">
<meta name="msapplication-config" content="assets/favicon/browserconfig.xml">
<meta name="theme-color" content="#ffffff">
<base href="./">
2、通过web浏览器请求对应服务器8081端口
3、提交任务 WordCount
./bin/flink run examples/streaming/WordCount.jar
可以看到类似如下的输出:
Executing example with default input data.
Use --input to specify file input.
Printing result to stdout. Use --output to specify output path.
Job has been submitted with JobID d4fa249528a524aac35743bc9bc20ae8
Program execution finished
Job with JobID d4fa249528a524aac35743bc9bc20ae8 has finished.
Job Runtime: 1471 ms
之后,可以在网页上看到运行结果
也可以查看执行日志 tail flink-root-taskexecutor-0-bogon.out
(nymph,1)
(in,3)
(thy,1)
(orisons,1)
(be,4)
(all,2)
(my,1)
(sins,1)
(remember,1)
(d,4)
三、清理环境
./bin/stop-cluster.sh
rm -rf /usr/local/flink