Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] worker wrangler #52

Merged
38 commits merged into from
Jan 6, 2022
Merged
Show file tree
Hide file tree
Changes from 14 commits
Commits
Show all changes
38 commits
Select commit Hold shift + click to select a range
52955dd
feat: [WIP] worker wranggler
Dec 20, 2021
f958135
add: PORT envar
Dec 21, 2021
baec170
add: Dockfile
Dec 21, 2021
4fbce88
add: healthcheck endpoint
Dec 21, 2021
f84d088
feat: [WIP] pan-pek worker
Dec 21, 2021
b428051
Merge branch 'worker' of github.com:teknologi-umum/spectator into worker
Dec 23, 2021
27c807e
feat(wip): tidying up stuffs
Dec 23, 2021
4537b39
feat: wip pan pek
Dec 23, 2021
f606224
add: envar to Dokerfile
Dec 23, 2021
b82f5e3
Merge remote-tracking branch 'origin/aldy505/worker' into aldy505/worker
Dec 24, 2021
2f36f72
chore: merge with remote worker
Dec 24, 2021
57b8e1d
feat: modifying the logic and csv marshaler
Dec 24, 2021
f733fc5
chore: added git ignore config
Dec 24, 2021
8894166
Merge pull request #61 from teknologi-umum/aldy505/worker
Dec 24, 2021
0153610
danger: experimental query
Dec 25, 2021
c156ced
add: wip submission
Dec 27, 2021
83b833d
pusing: the result is not array
Dec 27, 2021
642cb61
wip
Dec 29, 2021
c59980c
add: errorgroup to avoid leak
Dec 30, 2021
a002619
add: member id validation
Dec 30, 2021
7246c20
refactor: flux
Dec 30, 2021
0864f1a
docs: readme
Dec 30, 2021
5147663
add: uuid parser
Dec 30, 2021
eaad7eb
Merge remote-tracking branch 'origin/worker' into worker
Jan 1, 2022
fb9501d
feat: moving to grpc
Jan 1, 2022
46da6b8
fix: tidy up context placement and rows logic
Jan 1, 2022
f9664b1
Merge pull request #119 from teknologi-umum/wranggler/helpers
Jan 2, 2022
b0c6d27
Merge branch 'master' into worker
Jan 3, 2022
55a0db4
Merge branch 'worker' of https://github.com/teknologi-umum/spectator …
Jan 3, 2022
cb55325
wip
Jan 3, 2022
acc3fbd
Merge branch 'dummy/script' into worker
Jan 3, 2022
7cb24ad
test: struct test
Jan 4, 2022
222b962
wondering...
Jan 4, 2022
0b07146
Merge branch 'master' into worker
Jan 4, 2022
c3a03a7
wip: file
Jan 4, 2022
579d6b2
feat: upload to minio
Jan 6, 2022
317c420
feat: store minio upload to influx
Jan 6, 2022
89006ec
refactor: fix
Jan 6, 2022
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
104 changes: 104 additions & 0 deletions wranggler/.dockerignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,104 @@
# Created by https://www.toptal.com/developers/gitignore/api/go,goland
# Edit at https://www.toptal.com/developers/gitignore?templates=go,goland

### Go ###
# Binaries for programs and plugins
*.exe
*.exe~
*.dll
*.so
*.dylib

# Test binary, built with `go test -c`
*.test

# Output of the go coverage tool, specifically when used with LiteIDE
*.out

# Dependency directories (remove the comment below to include it)
# vendor/

### Go Patch ###
/vendor/
/Godeps/

### Goland ###
# Covers JetBrains IDEs: IntelliJ, RubyMine, PhpStorm, AppCode, PyCharm, CLion, Android Studio, WebStorm, Rider and Goland
# Reference: https://intellij-support.jetbrains.com/hc/en-us/articles/206544839

# User-specific stuff
.idea/**/workspace.xml
.idea/**/tasks.xml
.idea/**/usage.statistics.xml
.idea/**/dictionaries
.idea/**/shelf

# AWS User-specific
.idea/**/aws.xml

# Generated files
.idea/**/contentModel.xml

# Sensitive or high-churn files
.idea/**/dataSources/
.idea/**/dataSources.ids
.idea/**/dataSources.local.xml
.idea/**/sqlDataSources.xml
.idea/**/dynamic.xml
.idea/**/uiDesigner.xml
.idea/**/dbnavigator.xml

# Gradle
.idea/**/gradle.xml
.idea/**/libraries

# Gradle and Maven with auto-import
# When using Gradle or Maven with auto-import, you should exclude module files,
# since they will be recreated, and may cause churn. Uncomment if using
# auto-import.
# .idea/artifacts
# .idea/compiler.xml
# .idea/jarRepositories.xml
# .idea/modules.xml
# .idea/*.iml
# .idea/modules
# *.iml
# *.ipr

# CMake
cmake-build-*/

# Mongo Explorer plugin
.idea/**/mongoSettings.xml

# File-based project format
*.iws

# IntelliJ
out/

# mpeltonen/sbt-idea plugin
.idea_modules/

# JIRA plugin
atlassian-ide-plugin.xml

# Cursive Clojure plugin
.idea/replstate.xml

# Crashlytics plugin (for Android Studio and IntelliJ)
com_crashlytics_export_strings.xml
crashlytics.properties
crashlytics-build.properties
fabric.properties

# Editor-based Rest Client
.idea/httpRequests

# Ignores the whole .idea folder and all .iml files
.idea/

# Android studio 3.1+ serialized cache file
.idea/caches/build_file_checksums.ser

# End of https://www.toptal.com/developers/gitignore/api/go,goland
13 changes: 13 additions & 0 deletions wranggler/.editorconfig
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
root = false

[*]
end_of_line = lf
charset = utf-8
trim_trailing_whitespace = true
insert_final_newline = true
max_line_length = 80

[*.go]
indent_size = 4
indent_style = tabs
tab_width = 4
104 changes: 104 additions & 0 deletions wranggler/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,104 @@
# Created by https://www.toptal.com/developers/gitignore/api/go,goland
# Edit at https://www.toptal.com/developers/gitignore?templates=go,goland

### Go ###
# Binaries for programs and plugins
*.exe
*.exe~
*.dll
*.so
*.dylib

# Test binary, built with `go test -c`
*.test

# Output of the go coverage tool, specifically when used with LiteIDE
*.out

# Dependency directories (remove the comment below to include it)
# vendor/

### Go Patch ###
/vendor/
/Godeps/

### Goland ###
# Covers JetBrains IDEs: IntelliJ, RubyMine, PhpStorm, AppCode, PyCharm, CLion, Android Studio, WebStorm, Rider and Goland
# Reference: https://intellij-support.jetbrains.com/hc/en-us/articles/206544839

# User-specific stuff
.idea/**/workspace.xml
.idea/**/tasks.xml
.idea/**/usage.statistics.xml
.idea/**/dictionaries
.idea/**/shelf

# AWS User-specific
.idea/**/aws.xml

# Generated files
.idea/**/contentModel.xml

# Sensitive or high-churn files
.idea/**/dataSources/
.idea/**/dataSources.ids
.idea/**/dataSources.local.xml
.idea/**/sqlDataSources.xml
.idea/**/dynamic.xml
.idea/**/uiDesigner.xml
.idea/**/dbnavigator.xml

# Gradle
.idea/**/gradle.xml
.idea/**/libraries

# Gradle and Maven with auto-import
# When using Gradle or Maven with auto-import, you should exclude module files,
# since they will be recreated, and may cause churn. Uncomment if using
# auto-import.
# .idea/artifacts
# .idea/compiler.xml
# .idea/jarRepositories.xml
# .idea/modules.xml
# .idea/*.iml
# .idea/modules
# *.iml
# *.ipr

# CMake
cmake-build-*/

# Mongo Explorer plugin
.idea/**/mongoSettings.xml

# File-based project format
*.iws

# IntelliJ
out/

# mpeltonen/sbt-idea plugin
.idea_modules/

# JIRA plugin
atlassian-ide-plugin.xml

# Cursive Clojure plugin
.idea/replstate.xml

# Crashlytics plugin (for Android Studio and IntelliJ)
com_crashlytics_export_strings.xml
crashlytics.properties
crashlytics-build.properties
fabric.properties

# Editor-based Rest Client
.idea/httpRequests

# Ignores the whole .idea folder and all .iml files
.idea/

# Android studio 3.1+ serialized cache file
.idea/caches/build_file_checksums.ser

# End of https://www.toptal.com/developers/gitignore/api/go,goland
21 changes: 21 additions & 0 deletions wranggler/Dockerfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,21 @@
FROM golang:1.17-alpine AS builder
RUN mkdir /app
WORKDIR /app
COPY . /app
RUN go mod tidy
RUN go build -o /app/uwoh main.go

FROM alpine
RUN mkdir /app
WORKDIR /app
COPY --from=builder /app/uwoh /app/uwoh
EXPOSE 4444
This conversation was marked as resolved.
Show resolved Hide resolved

ENV INFLUX_TOKEN=""
ENV INFLUX_HOST=""
ENV INFLUX_ORG=""
ENV MINIO_HOST=""
ENV MINIO_SECRET_KEY=""
This conversation was marked as resolved.
Show resolved Hide resolved

HEALTHCHECK CMD curl --fail http://localhost:4444/ping || exit 1
CMD ["/app/uwoh"]
Loading