* `silo` refactoring changes (#2304) * add sdk and services for workspace connection and import jobs * rename service * move worker folder to root + remove controller folder * remove controller folder * add external api service in silo * fix params in service * fix params in service * fix services + remove projectid in job endpoints * chore: added generic config types for job store (#2158) * chore: made import job as generic * chore: added generic parameter inside the job service * chore: added generic parameter inside the job service * feat: remove projectId from jobs endpoint * chore: modified job store for new services * chore: revert go.mod.sum * chore: spaces * gitlab auth callback * github controllers update with plane api * create api client fix * base integration importer store * remove junk store * silo external api token middleware + plane api to generate user tokens * add ahmac permission method in apiserver + ahmac sign flow on silo * remove junk * getapi client remove unwanted options * modify api route for silo access + github gitlab and slack controller clean up * types modify + jira importer cleanup * fix: nodemon setup * make getAPIClient as a singleton * chore: added new definitions in base-import-worker * chore: modified jira migrator to adhere to the modified types * feat: modified base migrator to adhere new types * chore: modified jira-server-migrator to adhere new changes * chore: modified asana importer to adhere to new types * fix: migrated importer controllers for new schema * fix: build * chore: asana and linear controller * feat: updated job controller for new schema changes * chore: added permissions * integrations api migrations changes (#2193) * chore: added workspace_slug inside job data * replaced ahmac with hmac implementation * add new service base api view for microservices * fix: apiserver changes and base view * feat: added changes to services * feat: modified engine controller for using api services * feat: modified UI stores for modified jira importer * remove-log * resolve hmac issue + silo endpoint url fixes * add silo target access token rotation in get * integration ui migration changes * revert changes in il8n * fix crud for api * fix crud for api * fix: batch lock config * fix silo bundler issue (#2233) * chore: combined common dashboard components for silo (#2166) * chore: added new types to job store * feat: updated job store dependencies for new params * feat: created common components for importers dashboard * feat: modified jira importer to comply with new common components * feat: modified jira server dashboard to comply with the new component changes * feat: modified asana to comply with the common dashboard changes * fix: linear to comply with the new changes * reset job store * feat: migrated importers to new schema * fix: removed unused code * fix: base job importer model and serializer * fix-lint-errors --------- Co-authored-by: Saurabh Kumar <[email protected]> * fix api serialisers * fix: stabilized all integrations and jira importer * fix: linear, asana and jira-server importers * fix: reinstantiated hmac permission * chore: removed the db folder for silo * feat: added types for integration config * feat: added check for supported integration in silo and web * feat: added self hosted and cloud message differences * add en translations for importers and jira importer (#2264) * feat: Added language support for integrations (#2277) * feat: added translations for github, slack and gitlab integrations * fix: slack integration project modal * fix: gitlab organization disconnect * fix: silo build fixes * feat: added more language to integration language support * fix: review * feat: modified caddy and compose for silo selfhosted changes (#2276) * silo - fixes for keys and integrations form reset (#2283) * fix hardcoded values for integration importer keys * reset state after integration form submit * fix missing key integration * fix gitlab connection update * fix: added slack images being updated while creating issues (#2288) Co-authored-by: Saurabh Kumar <[email protected]> * silo - fix integration lang support (#2291) * fix hardcoded values for integration importer keys * reset state after integration form submit * fix missing translation key integration * fix gitlab connection update * fix integration lang support * fix integration lang support --------- Co-authored-by: Saurabhkmr98 <[email protected]> Co-authored-by: Saurabh Kumar <[email protected]> * [SILO-71] flatfile importer v1 (#2156) * feat: initialized CSV importer * feat: added flatfile components * feat: setup workbook and listener for csv importer * feat: added store structure for flatfile importer * chore: translated csv importer to flatfile importer * feat: setup listener * fix: event listener for creating agent * feat: added flatfile importer skeleton * feat: added flatfile etl logic for pulling and transforming data * feat: added flatfile controller and migrator * feat: curated flatfile root store and importer UI * feat: initialized flatfile migrator * fix: flatfile * feat: added transformers for cycles and issues * feat: added mapping and transformation for flatfile * feat: added assignee field for fixing migrator bugs * fix:build * feat: added metrics inside the data import task' * fix:workbook * feat: added validation of email and date for flatfile * add sdk and services for workspace connection and import jobs * rename service * move worker folder to root + remove controller folder * remove controller folder * feat: added modules and issue types inside flatfile * fix: build * fix:response-handler * fix:errors * fix:deleted-file * fix: readded jobs route * add external api service in silo * fix params in service * fix params in service * fix services + remove projectid in job endpoints * chore: added generic config types for job store (#2158) * chore: made import job as generic * chore: added generic parameter inside the job service * chore: added generic parameter inside the job service * feat: remove projectId from jobs endpoint * chore: modified job store for new services * chore: revert go.mod.sum * chore: spaces * gitlab auth callback * github controllers update with plane api * create api client fix * base integration importer store * remove junk store * silo external api token middleware + plane api to generate user tokens * add ahmac permission method in apiserver + ahmac sign flow on silo * remove junk * getapi client remove unwanted options * modify api route for silo access + github gitlab and slack controller clean up * types modify + jira importer cleanup * fix: nodemon setup * make getAPIClient as a singleton * chore: added new definitions in base-import-worker * chore: modified jira migrator to adhere to the modified types * feat: modified base migrator to adhere new types * chore: modified jira-server-migrator to adhere new changes * chore: modified asana importer to adhere to new types * fix: migrated importer controllers for new schema * fix: build * chore: asana and linear controller * feat: updated job controller for new schema changes * chore: added permissions * integrations api migrations changes (#2193) * chore: added workspace_slug inside job data * replaced ahmac with hmac implementation * add new service base api view for microservices * fix: apiserver changes and base view * feat: added changes to services * feat: modified engine controller for using api services * feat: modified UI stores for modified jira importer * remove-log * resolve hmac issue + silo endpoint url fixes * add silo target access token rotation in get * integration ui migration changes * revert changes in il8n * fix crud for api * fix crud for api * fix: batch lock config * fix silo bundler issue (#2233) * chore: combined common dashboard components for silo (#2166) * chore: added new types to job store * feat: updated job store dependencies for new params * feat: created common components for importers dashboard * feat: modified jira importer to comply with new common components * feat: modified jira server dashboard to comply with the new component changes * feat: modified asana to comply with the common dashboard changes * fix: linear to comply with the new changes * reset job store * feat: migrated importers to new schema * fix: removed unused code * fix: base job importer model and serializer * fix-lint-errors --------- Co-authored-by: Saurabh Kumar <[email protected]> * fix api serialisers * fix: stabilized all integrations and jira importer * fix: linear, asana and jira-server importers * fix: reinstantiated hmac permission * chore: removed the db folder for silo * feat: added types for integration config * feat: added check for supported integration in silo and web * feat: added self hosted and cloud message differences * add en translations for importers and jira importer (#2264) * feat: Added language support for integrations (#2277) * feat: added translations for github, slack and gitlab integrations * fix: slack integration project modal * fix: gitlab organization disconnect * fix: silo build fixes * feat: added more language to integration language support * fix: review * feat: modified caddy and compose for silo selfhosted changes (#2276) * silo - fixes for keys and integrations form reset (#2283) * fix hardcoded values for integration importer keys * reset state after integration form submit * fix missing key integration * fix gitlab connection update * fix: added slack images being updated while creating issues (#2288) Co-authored-by: Saurabh Kumar <[email protected]> * silo - fix integration lang support (#2291) * fix hardcoded values for integration importer keys * reset state after integration form submit * fix missing translation key integration * fix gitlab connection update * fix integration lang support * fix integration lang support * feat: added controllers as default exports * feat: modified flatfile worker and controller to adhere new changes * feat: modified flatfile importer to ahere silo api migration * fix: source project and workspace hide props --------- Co-authored-by: Saurabhkmr98 <[email protected]> Co-authored-by: Saurabh Kumar <[email protected]> * add fuzzy find in state and priority mapping (#2310) Co-authored-by: Saurabhkmr98 <[email protected]> Co-authored-by: sriram veeraghanta <[email protected]> * fix: build * chore: moved flatfile agent to external * chore:build-fixes * fix: credential breaking for slack * fix: credential route for api * SILO - chore: Importers translation (#2352) * add en translations for importers and jira importer * add en translations for all the importers * add importers language translation changes * chore silo importer translation * chore silo importer translation * fix: env removing trailing slashes * fix: trailing slashed env * fix duplicate entity connection issue (#2362) --------- Co-authored-by: Henit Chobisa <[email protected]> Co-authored-by: sriram veeraghanta <[email protected]>
286 lines
8.8 KiB
YAML
286 lines
8.8 KiB
YAML
x-monitor-env: &monitor-env
|
|
environment:
|
|
- SERVICE_HTTP_WEB=web:3000
|
|
- SERVICE_HTTP_API=api:8000
|
|
- SERVICE_HTTP_LIVE=live:3000
|
|
- SERVICE_HTTP_PROXY=proxy:80
|
|
- SERVICE_HTTP_MINIO=plane-minio:9090
|
|
- SERVICE_TCP_REDIS=plane-redis:6379
|
|
- SERVICE_TCP_POSTGRES=plane-db:5432
|
|
- TRUSTED_PROXIES=${TRUSTED_PROXIES:-0.0.0.0/0}
|
|
|
|
x-proxy-env: &proxy-env
|
|
environment:
|
|
- SITE_ADDRESS=${SITE_ADDRESS:-localhost:80}
|
|
- CERT_EMAIL=${CERT_EMAIL:[email protected]}
|
|
- CERT_ACME_CA=${CERT_ACME_CA:-}
|
|
- CERT_ACME_DNS=${CERT_ACME_DNS:-}
|
|
- BUCKET_NAME=${BUCKET_NAME:-uploads}
|
|
- FILE_SIZE_LIMIT=${FILE_SIZE_LIMIT:-5242880}
|
|
- LISTEN_HTTP_PORT=${LISTEN_HTTP_PORT:-80}
|
|
- LISTEN_HTTPS_PORT=${LISTEN_HTTPS_PORT:-443}
|
|
|
|
x-silo-env: &silo-env
|
|
environment:
|
|
# App Envs
|
|
- BATCH_SIZE=${BATCH_SIZE:-60}
|
|
- PORT=${PORT:-3000}
|
|
- DEDUP_INTERVAL=${DEDUP_INTERVAL:-3}
|
|
- DB_URL=${DB_URL:-postgresql://plane:plane@plane-db/plane}
|
|
- AMQP_URL=${AMQP_URL:-amqp://plane:plane@plane-mq:5672/plane}
|
|
- REDIS_URL=${REDIS_URL:-redis://plane-redis:6379/}
|
|
- SENTRY_DSN=${SENTRY_DSN:-""}
|
|
- PG_SCHEMA=${PG_SCHEMA:-silo}
|
|
- APP_BASE_URL=${APP_BASE_URL:-}
|
|
- SILO_API_BASE_URL=${SILO_API_BASE_URL:-}
|
|
- API_BASE_URL=${API_BASE_URL:-http://api:8000}
|
|
- SILO_BASE_PATH=${SILO_BASE_PATH:-/silo}
|
|
- WEBHOOK_SECRET=${WEBHOOK_SECRET:-plane-silo}
|
|
- MQ_PREFETCH_COUNT=${MQ_PREFETCH_COUNT:-10}
|
|
|
|
# Authentication
|
|
- SILO_HMAC_SECRET_KEY=${SILO_HMAC_SECRET_KEY:-}
|
|
|
|
# Feature Flag Envs
|
|
- FEATURE_FLAG_SERVER_BASE_URL=${FEATURE_FLAG_SERVER_BASE_URL:-}
|
|
- FEATURE_FLAG_SERVER_AUTH_TOKEN=${FEATURE_FLAG_SERVER_AUTH_TOKEN:-}
|
|
|
|
# Github Envs
|
|
- GITHUB_APP_NAME=${GITHUB_APP_NAME:-}
|
|
- GITHUB_APP_ID=${GITHUB_APP_ID:-}
|
|
- GITHUB_CLIENT_ID=${GITHUB_CLIENT_ID:-}
|
|
- GITHUB_CLIENT_SECRET=${GITHUB_CLIENT_SECRET:-}
|
|
- GITHUB_PRIVATE_KEY=${GITHUB_PRIVATE_KEY:-}
|
|
|
|
# Gitlab Envs
|
|
- GITLAB_CLIENT_ID=${GITLAB_CLIENT_ID:-}
|
|
- GITLAB_CLIENT_SECRET=${GITLAB_CLIENT_SECRET:-}
|
|
|
|
# Slack Envs
|
|
- SLACK_CLIENT_ID=${SLACK_CLIENT_ID:-}
|
|
- SLACK_CLIENT_SECRET=${SLACK_CLIENT_SECRET:-}
|
|
|
|
x-app-env: &app-env
|
|
environment:
|
|
- WEB_URL=${WEB_URL:-http://localhost}
|
|
- DEBUG=${DEBUG:-0}
|
|
- SENTRY_DSN=${SENTRY_DSN:-""}
|
|
- SENTRY_ENVIRONMENT=${SENTRY_ENVIRONMENT:-"production"}
|
|
- CORS_ALLOWED_ORIGINS=${CORS_ALLOWED_ORIGINS:-}
|
|
- API_BASE_URL=${API_BASE_URL:-http://api:8000}
|
|
# Gunicorn Workers
|
|
- GUNICORN_WORKERS=${GUNICORN_WORKERS:-2}
|
|
#DB SETTINGS
|
|
- PGHOST=${PGHOST:-plane-db}
|
|
- PGDATABASE=${PGDATABASE:-plane}
|
|
- POSTGRES_USER=${POSTGRES_USER:-plane}
|
|
- POSTGRES_PASSWORD=${POSTGRES_PASSWORD:-plane}
|
|
- POSTGRES_DB=${POSTGRES_DB:-plane}
|
|
- PGDATA=${PGDATA:-/var/lib/postgresql/data}
|
|
- DATABASE_URL=${DATABASE_URL:-postgresql://plane:plane@plane-db/plane}
|
|
# REDIS SETTINGS
|
|
- REDIS_HOST=${REDIS_HOST:-plane-redis}
|
|
- REDIS_PORT=${REDIS_PORT:-6379}
|
|
- REDIS_URL=${REDIS_URL:-redis://plane-redis:6379/}
|
|
# RabbitMQ Settings
|
|
- RABBITMQ_HOST=${RABBITMQ_HOST:-plane-mq}
|
|
- RABBITMQ_PORT=${RABBITMQ_PORT:-5672}
|
|
- RABBITMQ_DEFAULT_USER=${RABBITMQ_USER:-plane}
|
|
- RABBITMQ_DEFAULT_PASS=${RABBITMQ_PASSWORD:-plane}
|
|
- RABBITMQ_DEFAULT_VHOST=${RABBITMQ_VHOST:-plane}
|
|
- RABBITMQ_VHOST=${RABBITMQ_VHOST:-plane}
|
|
- AMQP_URL=${AMQP_URL:-amqp://plane:plane@plane-mq:5672/plane}
|
|
# Application secret
|
|
- SECRET_KEY=${SECRET_KEY:-60gp0byfz2dvffa45cxl20p1scy9xbpf6d8c5y0geejgkyp1b5}
|
|
# DATA STORE SETTINGS
|
|
- USE_MINIO=${USE_MINIO:-1}
|
|
- AWS_REGION=${AWS_REGION:-}
|
|
- AWS_ACCESS_KEY_ID=${AWS_ACCESS_KEY_ID:-"access-key"}
|
|
- AWS_SECRET_ACCESS_KEY=${AWS_SECRET_ACCESS_KEY:-"secret-key"}
|
|
- AWS_S3_ENDPOINT_URL=${AWS_S3_ENDPOINT_URL:-http://plane-minio:9000}
|
|
- AWS_S3_BUCKET_NAME=${AWS_S3_BUCKET_NAME:-uploads}
|
|
- MINIO_ROOT_USER=${MINIO_ROOT_USER:-"access-key"}
|
|
- MINIO_ROOT_PASSWORD=${MINIO_ROOT_PASSWORD:-"secret-key"}
|
|
- BUCKET_NAME=${BUCKET_NAME:-uploads}
|
|
- FILE_SIZE_LIMIT=${FILE_SIZE_LIMIT:-5242880}
|
|
- SSL_VERIFY=${SSL_VERIFY:-1}
|
|
- FEATURE_FLAG_SERVER_BASE_URL=${FEATURE_FLAG_SERVER_BASE_URL:-http://monitor:8080}
|
|
- PAYMENT_SERVER_BASE_URL=${PAYMENT_SERVER_BASE_URL:-http://monitor:8080}
|
|
# Enternal Services Config
|
|
- SILO_HMAC_SECRET_KEY=${SILO_HMAC_SECRET_KEY:-}
|
|
|
|
x-live-env: &live-env
|
|
environment:
|
|
- API_BASE_URL=${API_BASE_URL:-http://api:8000}
|
|
- REDIS_HOST=${REDIS_HOST:-plane-redis}
|
|
- REDIS_PORT=${REDIS_PORT:-6379}
|
|
- REDIS_URL=${REDIS_URL:-redis://plane-redis:6379/}
|
|
|
|
services:
|
|
admin:
|
|
<<: *app-env
|
|
image: registry.plane.tools/plane/admin-enterprise:${APP_RELEASE_VERSION}
|
|
restart: unless-stopped
|
|
command: node admin/server.js admin
|
|
deploy:
|
|
replicas: ${ADMIN_REPLICAS:-1}
|
|
depends_on:
|
|
- api
|
|
- web
|
|
|
|
web:
|
|
<<: *app-env
|
|
image: registry.plane.tools/plane/web-enterprise:${APP_RELEASE_VERSION}
|
|
restart: unless-stopped
|
|
command: node web/server.js web
|
|
deploy:
|
|
replicas: ${WEB_REPLICAS:-1}
|
|
depends_on:
|
|
- api
|
|
- worker
|
|
|
|
space:
|
|
<<: *app-env
|
|
image: registry.plane.tools/plane/space-enterprise:${APP_RELEASE_VERSION}
|
|
restart: unless-stopped
|
|
command: node space/server.js space
|
|
deploy:
|
|
replicas: ${SPACE_REPLICAS:-1}
|
|
depends_on:
|
|
- api
|
|
- web
|
|
|
|
live:
|
|
<<: *live-env
|
|
image: registry.plane.tools/plane/live-enterprise:${APP_RELEASE_VERSION}
|
|
restart: unless-stopped
|
|
command: node live/dist/server.js live
|
|
deploy:
|
|
replicas: ${LIVE_REPLICAS:-1}
|
|
depends_on:
|
|
- api
|
|
- web
|
|
|
|
monitor:
|
|
<<: *monitor-env
|
|
image: registry.plane.tools/plane/monitor-enterprise:${APP_RELEASE_VERSION}
|
|
restart: on-failure:5
|
|
volumes:
|
|
- ${INSTALL_DIR}/data/monitor:/app
|
|
|
|
api:
|
|
<<: *app-env
|
|
image: registry.plane.tools/plane/backend-enterprise:${APP_RELEASE_VERSION}
|
|
restart: unless-stopped
|
|
command: ./bin/docker-entrypoint-api-ee.sh
|
|
deploy:
|
|
replicas: ${API_REPLICAS:-1}
|
|
volumes:
|
|
- ${INSTALL_DIR}/logs/api:/code/plane/logs
|
|
depends_on:
|
|
- plane-db
|
|
- plane-redis
|
|
|
|
worker:
|
|
<<: *app-env
|
|
image: registry.plane.tools/plane/backend-enterprise:${APP_RELEASE_VERSION}
|
|
restart: unless-stopped
|
|
command: ./bin/docker-entrypoint-worker.sh
|
|
volumes:
|
|
- ${INSTALL_DIR}/logs/worker:/code/plane/logs
|
|
depends_on:
|
|
- api
|
|
- plane-db
|
|
- plane-redis
|
|
|
|
beat-worker:
|
|
<<: *app-env
|
|
image: registry.plane.tools/plane/backend-enterprise:${APP_RELEASE_VERSION}
|
|
restart: unless-stopped
|
|
command: ./bin/docker-entrypoint-beat.sh
|
|
volumes:
|
|
- ${INSTALL_DIR}/logs/beat-worker:/code/plane/logs
|
|
depends_on:
|
|
- api
|
|
- plane-db
|
|
- plane-redis
|
|
|
|
migrator:
|
|
<<: *app-env
|
|
image: registry.plane.tools/plane/backend-enterprise:${APP_RELEASE_VERSION}
|
|
restart: "no"
|
|
command: ./bin/docker-entrypoint-migrator.sh
|
|
volumes:
|
|
- ${INSTALL_DIR}/logs/migrator:/code/plane/logs
|
|
depends_on:
|
|
- plane-db
|
|
- plane-redis
|
|
|
|
plane-db:
|
|
<<: *app-env
|
|
image: registry.plane.tools/plane/postgres:15.5-alpine
|
|
restart: unless-stopped
|
|
command: postgres -c 'max_connections=1000'
|
|
volumes:
|
|
- ${INSTALL_DIR}/data/db:/var/lib/postgresql/data
|
|
|
|
plane-redis:
|
|
<<: *app-env
|
|
image: registry.plane.tools/plane/valkey:7.2.5-alpine
|
|
restart: unless-stopped
|
|
volumes:
|
|
- ${INSTALL_DIR}/data/redis:/data
|
|
|
|
plane-mq:
|
|
<<: *app-env
|
|
image: registry.plane.tools/plane/rabbitmq:3.13.6-management-alpine
|
|
restart: unless-stopped
|
|
healthcheck:
|
|
test: rabbitmq-diagnostics -q ping
|
|
interval: 10s
|
|
timeout: 10s
|
|
retries: 5
|
|
volumes:
|
|
- ${INSTALL_DIR}/data/mq:/var/lib/rabbitmq
|
|
|
|
plane-minio:
|
|
<<: *app-env
|
|
image: registry.plane.tools/plane/minio:latest
|
|
restart: unless-stopped
|
|
command: server /export --console-address ":9090"
|
|
volumes:
|
|
- ${INSTALL_DIR}/data/minio/uploads:/export
|
|
- ${INSTALL_DIR}/data/minio/data:/data
|
|
|
|
# Comment this if you already have a reverse proxy running
|
|
proxy:
|
|
<<: *proxy-env
|
|
image: registry.plane.tools/plane/caddy:latest
|
|
restart: unless-stopped
|
|
ports:
|
|
- ${LISTEN_HTTP_PORT:-80}:${LISTEN_HTTP_PORT:-80}
|
|
- ${LISTEN_HTTPS_PORT:-443}:${LISTEN_HTTPS_PORT:-443}
|
|
volumes:
|
|
- ${INSTALL_DIR}/Caddyfile:/etc/caddy/Caddyfile
|
|
- ${INSTALL_DIR}/caddy/config:/config
|
|
- ${INSTALL_DIR}/caddy/data:/data
|
|
depends_on:
|
|
- web
|
|
- api
|
|
- space
|
|
- admin
|
|
- live
|
|
|
|
silo:
|
|
<<: *silo-env
|
|
image: registry.plane.tools/plane/silo-enterprise:${APP_RELEASE_VERSION}
|
|
restart: unless-stopped
|
|
command: node silo/start.cjs
|
|
deploy:
|
|
replicas: ${SILO_REPLICAS:-1}
|
|
depends_on:
|
|
plane-redis:
|
|
condition: service_started
|
|
plane-mq:
|
|
condition: service_healthy
|