Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Binary file removed .Dockerfile.swp
Binary file not shown.
9 changes: 9 additions & 0 deletions .gitmodules
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
[submodule "api"]
path = api
url = https://github.com/deepmarket/api.git
[submodule "core"]
path = core
url = https://github.com/deepmarket/core.git
[submodule "docker-spark"]
path = docker-spark
url = https://github.com/deepmarket/docker-spark.git
29 changes: 29 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,2 +1,31 @@
# DeepShare
An OpenSource resource sharing platform accompanied by the capability to execute Distributed Tensorflow Programs at a very low cost.

To clone: `git clone --recurse-submodules https://github.com/shared-systems/DeepShare.git`

To build `docker-compose up --build --detach`

To stop `docker-compose down`

To update commit hash `git submodule update --recursive --remote`

To pull new changes from each repo `git submodule foreach git pull origin develop`
Note: This requires a develop branch to exist in each submodule

To clean `docker container prune -f && docker image prune -f && docker network prune -f && docker volume prune -f`

### Potential Problems:
Some of our servers have ran into a problem with apparmor disallowing us to bring down some of the containers we're using. While we look into this issue, there's a [workaround](https://forums.docker.com/t/can-not-stop-docker-container-permission-denied-error/41142/6) that looks like this:
```sh
# Check the status of AppArmor (there should be some comments about the docker user being in `enforce-mode`)
sudo aa-status

# Disable the service
sudo systemctl disable apparmor.service --now

# Make sure it doesn't come back up when the machine restarts (once a permanent solution is found we'll re-roll the system anyways)
sudo service apparmor teardown

# The status should now say that no programs are in `enforce-mode`
sudo aa-status
```
1 change: 1 addition & 0 deletions api
Submodule api added at 8bffa3
1 change: 1 addition & 0 deletions core
Submodule core added at 6122fe
90 changes: 90 additions & 0 deletions docker-compose.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,90 @@
version: "3"
services:

# nginx:
# image: nginx:1.15-alpine
# ports:
# - "80:80"
# - "443:443"
# volumes:
# - ./conf/nginx:/etc/nginx/conf.d

# General server acting as reverse proxy to the api
nginx:
image: owasp/modsecurity
ports:
- "80:80"
- "443:443"
volumes:
- ./nginx:/etc/nginx/conf.d

# Client for generating CA certs
#certbot:
# image: certbot/certbot

# Api infrastructure as backend for clients (i.e. pluto)
api:
container_name: deepmarket_api

build: ./api
image: "api:latest"

restart: always

environment:
- MONGO_DATABASE_URL=mongodb://deepmarket_db:27017

ports:
- "8080:8080"

networks:
- services_bridge
- db_bridge

depends_on:
- mongo

command: npm start

# Price generation microservice
generate_prices:
container_name: deepmarket_gen_prices

build: ./core/generate_prices
image: "generate_prices:latest"

# restart: always
environment:
- API_PRICING_ENDPOINT=http://deepmarket_api:8080/api/v1/pricing

networks:
- services_bridge

depends_on:
- api

# Mongo db instance as backend for api
mongo:
container_name: deepmarket_db
image: mongo

networks:
- db_bridge

volumes:
- /data/db:/data/db

ports:
- "27017:27017"

networks:

services_bridge:
driver: bridge

web_bridge:
driver: bridge

db_bridge:
driver: bridge

1 change: 1 addition & 0 deletions docker-spark
Submodule docker-spark added at d38509
57 changes: 0 additions & 57 deletions sbin/executor-setup.sh

This file was deleted.

57 changes: 0 additions & 57 deletions sbin/services-setup.sh

This file was deleted.

57 changes: 0 additions & 57 deletions sbin/start-services.sh

This file was deleted.

Loading