Skip to content
Projects
Groups
Snippets
Help
This project
Loading...
Sign in / Register
Toggle navigation
G
gic-spark-tag-4.0
Overview
Overview
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
wangxiaokang
gic-spark-tag-4.0
Commits
0c5f50db
Commit
0c5f50db
authored
Aug 21, 2020
by
guos
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
会员标签4.0
parent
9c9a0bb0
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
1 deletions
+3
-1
TagProcessManager.java
src/main/java/com/gic/spark/tag/TagProcessManager.java
+3
-1
No files found.
src/main/java/com/gic/spark/tag/TagProcessManager.java
View file @
0c5f50db
...
...
@@ -265,7 +265,9 @@ public class TagProcessManager {
SparkSession
sparkSession
=
SparkEnvManager
.
getInstance
().
getSparkSession
();
Dataset
<
Row
>
tagGroupInfoDataset
=
sparkSession
.
createDataFrame
(
tagGroupInfoRDD
,
TagGroupInfo
.
class
);
tagGroupInfoDataset
.
createOrReplaceTempView
(
"tag_group_info_tmp"
);
sparkSession
.
sql
(
String
.
format
(
"INSERT overwrite table %s.tag_group_info PARTITION(enterprise_id = '%s') SELECT id,tag_group_info from tag_group_info_tmp"
,
isProduction
?
"tag4_prod"
:
"tag4_test"
,
enterpriseId
));
tagGroupInfoDataset
.
show
();
// sparkSession.sql(String.format("INSERT overwrite table %s.tag_group_info PARTITION(enterprise_id = '%s') SELECT id,tag_group_info from tag_group_info_tmp",isProduction?"tag4_prod":"tag4_test", enterpriseId));
}
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment