Skip to content
Projects
Groups
Snippets
Help
This project
Loading...
Sign in / Register
Toggle navigation
G
gic-spark-tag-4.0
Overview
Overview
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
wangxiaokang
gic-spark-tag-4.0
Commits
c679cffa
Commit
c679cffa
authored
May 11, 2020
by
guos
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
会员标签4.0
parent
d208ce70
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
19 additions
and
1 deletions
+19
-1
TagProcess.java
src/main/java/com/gic/spark/tag/TagProcess.java
+19
-1
No files found.
src/main/java/com/gic/spark/tag/TagProcess.java
View file @
c679cffa
...
...
@@ -40,6 +40,9 @@ import scala.collection.JavaConversions;
import
java.util.*
;
import
org.apache.spark.api.java.Optional
;
import
javax.sound.midi.MidiSystem
;
import
javax.swing.text.TabSet
;
import
static
com
.
gic
.
spark
.
datasource
.
mysql
.
MysqlDatasource
.
JDBC_OPTIONS
;
/**
...
...
@@ -83,7 +86,7 @@ public class TagProcess {
}
mysqlRddManager
=
member4Datasource
.
buildRddManager
();
Dataset
<
TabSceneCrowd
>
sceneCrowdDataset
=
mysqlRddManager
.
getPojo
(
""
,
TabSceneCrowd
.
class
,
null
)
Dataset
<
TabSceneCrowd
>
sceneCrowdDataset
=
mysqlRddManager
.
getPojo
(
"
tab_scene_crowd
"
,
TabSceneCrowd
.
class
,
null
)
.
filter
(
new
Column
(
"valid_flag"
).
equalTo
(
1
));
List
<
TabSceneCrowd
>
sceneCrowdList
=
sceneCrowdDataset
.
collectAsList
();
for
(
TabSceneCrowd
sceneCrowd:
sceneCrowdList
){
...
...
@@ -93,6 +96,21 @@ public class TagProcess {
}
public
void
setEnterpriseId
(
List
<
Integer
>
enterpriseIdList
){
for
(
SceneCrowdDTO
dto:
sceneCrowdDTOList
){
if
(!
enterpriseIdList
.
contains
(
dto
.
getEnterprise_Id
())){
sceneCrowdDTOList
.
remove
(
dto
);
}
}
}
public
void
setTagGroupId
(
List
<
Integer
>
tagGroupIdList
){
for
(
SceneCrowdDTO
dto:
sceneCrowdDTOList
){
if
(!
tagGroupIdList
.
contains
(
dto
.
getId
())){
sceneCrowdDTOList
.
remove
(
dto
);
}
}
}
public
void
process
(
boolean
extractData
){
Map
<
Integer
,
List
<
TagProcessEntity
>>
tagGroupByEnterpriseMap
=
new
HashMap
<>();
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment