Skip to content

Commit 2a249f4

Browse files
junbo75junbo75
committed
2024.01 release
Signed-off-by: Junbo Liang <68558268+junbo75@users.noreply.github.com>
1 parent 1ce86ac commit 2a249f4

File tree

361 files changed

+15150
-5060
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

361 files changed

+15150
-5060
lines changed

‎.github/ISSUE_TEMPLATE/bug_report.md‎

Lines changed: 15 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -7,16 +7,14 @@ assignees: ''
77

88
---
99
If you have an active AWS support contract, please open a case with AWS Premium Support team using the below documentation to report the issue:
10-
1110
https://docs.aws.amazon.com/awssupport/latest/user/case-management.html
1211

13-
Before submitting a new issue, please search through open GitHub Issues (https://github.com/aws/res/issues) and check out the troubleshooting documentation.
14-
1512
Please make sure to add the following data in order to facilitate the root cause detection.
13+
1614
**Describe the bug**
17-
A clear and concise description of what the bug is.
15+
A clear and concise description of what the bug is. Before submitting a new issue, please search through open [GitHub Issues](https://github.com/aws/res/issues) and check out the [troubleshooting documentation](https://github.com/aws/res/wiki/Troubleshooting).
1816

19-
**To Reproduce**
17+
**Steps to reproduce**
2018
Steps to reproduce the behavior:
2119
1. Go to '...'
2220
2. Click on '....'
@@ -26,13 +24,18 @@ Steps to reproduce the behavior:
2624
**Expected behavior**
2725
A clear and concise description of what you expected to happen.
2826

29-
**Screenshots**
30-
If applicable, add screenshots to help explain your problem.
27+
**Actual behavior**
28+
A clear and concise description of what actually happened.
3129

32-
**Desktop (please complete the following information):**
33-
- OS: [e.g. iOS]
34-
- Browser [e.g. chrome, safari]
35-
- Version [e.g. 22]
30+
**Screenshots/Video**
31+
If applicable, add screenshots and/or a video to help explain your problem.
32+
33+
**Environment (please complete the following information):**
34+
- RES Version: [e.g. 2023.11]
35+
- Software Stack AMI ID: [e.g. ami-0fceec18b58bfda68]
36+
- Software Stack OS: [e.g. Windows, Amazon Linux 2, CentOS 7, RedHat Enterprise Linux 7]
3637

3738
**Additional context**
38-
Add any other context about the problem here.
39+
Add any other context about the problem here.
40+
41+

‎.viperlightignore‎

Lines changed: 35 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,35 @@
1+
# Ignore
2+
^source/dist/
3+
^.idea/
4+
^deployment/idea/
5+
Config
6+
^.tox/
7+
^venv/
8+
9+
CODE_OF_CONDUCT.md:4
10+
CONTRIBUTING.md:50
11+
README.md:44
12+
region_elb_account_id.yml
13+
source/idea/idea-cluster-manager/resources/api/api_doc.yml:122
14+
source/idea/idea-cluster-manager/webapp/src/docs/_footer.md:3
15+
source/idea/idea-cluster-manager/webapp/src/docs/_footer.md:3
16+
source/idea/idea-administrator/src/ideaadministrator/app/support_helper.py:195
17+
source/idea/idea-administrator/src/ideaadministrator/integration_tests/cluster_manager_tests.py:63
18+
source/idea/idea-administrator/resources/lambda_functions/custom_resource_self_signed_certificate.py
19+
source/idea/idea-cluster-manager/webapp/src/components/password-strength-check/password-strength-check.tsx
20+
source/idea/idea-cluster-manager/webapp/src/pages/auth/auth-confirm-forgot-password.tsx
21+
source/idea/idea-cluster-manager/webapp/src/pages/auth/auth-forgot-password.tsx
22+
23+
# False Positive
24+
tests/generate_ami_list.py:90
25+
tests/generate_ami_list.py:91
26+
tests/generate_ami_list.py:92
27+
tests/generate_ami_list.py:93
28+
tests/generate_ami_list.py:94
29+
tests/generate_ami_list.py:95
30+
tests/generate_ami_list.py:98
31+
tests/generate_ami_list.py:99
32+
tests/generate_ami_list.py:100
33+
34+
[python-pipoutdated]
35+
pip_audit=2.4.12

‎CHANGELOG.md‎

Lines changed: 28 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,30 @@
11
# Change Log
2-
All notable changes to this project will be documented in this file.
2+
This file is used to list changes made in each release of Research and Engineering Studio (RES).
33

4-
The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
5-
and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
4+
2024.01
5+
------
6+
7+
**ENHANCEMENTS**
8+
9+
- Add support for snapshots that enable migration between versions of RES.
10+
- The migration process involves taking a snapshot, deploying the new version (e.g. 2024.01) and applying the snapshot from the previous version (e.g. 2023.11) on the new version. Allows for admins to confirm the new version works before transferring users.
11+
- Add support for private subnets.
12+
- Enable deployments of RES infrastructure hosts in private subnets with internet access.
13+
- RES infrastructure hosts refer to the Cluster Manager, Bastion Host, VDC Gateway, VDC Controller, and VDC Broker.
14+
- Deprecation of the analytics stack.
15+
- Removed required OpenSearch dependency.
16+
- Reduces RES environment deployment and deletion time by approximately 30 minutes.
17+
- Add support for use of custom Amazon Linux 2 EC2 AMI for RES infrastructure hosts.
18+
- Enable specifying an AL2 EC2 AMI use for RES infrastructure hosts for users that require specific software or updates installed on their hosts.
19+
- RES infrastructure hosts refer to the Cluster Manager, Bastion Host, VDC Gateway, VDC Controller, and VDC Broker.
20+
- Add support for ldap_id_mapping “True” in SSSD.
21+
- Previously the AD sync code required the groups and users to have POSIX attributes uidNumber and gidNumber in order to sync with RES. This conflicted with the IDs generated by SSSD, potentially causing RES users to not be able to access filesystems if they were using SSSD with other systems (e.g. ParallelCluster) .
22+
- Add support for four new regions Asia Pacific (Tokyo), Asia Pacific (Seoul), Canada (Central), Europe (Milan).
23+
- Add ability to add users to projects. Previously only groups could be added to project permissions.
24+
25+
**BUG FIXES**
26+
27+
- Added validation for FSx ONTAP filesystem creation
28+
- Narrowed installation IAM permissions
29+
- Skipped deletion of batteries included related resources
30+
- VDI no longer tries to mount filesystems after removing filesystem from project

‎Config‎

Lines changed: 26 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,26 @@
1+
package.DigitalEngineeringPlatform = {
2+
interfaces = (1.0);
3+
4+
# Use NoOpBuild. See https://w.amazon.com/index.php/BrazilBuildSystem/NoOpBuild
5+
build-system = no-op;
6+
build-tools = {
7+
1.0 = {
8+
NoOpBuild = 1.0;
9+
};
10+
};
11+
12+
# Use runtime-dependencies for when you want to bring in additional
13+
# packages when deploying.
14+
# Use dependencies instead if you intend for these dependencies to
15+
# be exported to other packages that build against you.
16+
dependencies = {
17+
1.0 = {
18+
};
19+
};
20+
21+
runtime-dependencies = {
22+
1.0 = {
23+
};
24+
};
25+
26+
};

‎README.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -31,7 +31,7 @@ If you have a [support plan](https://aws.amazon.com/premiumsupport/) with AWS Su
3131

3232
You can also [open an issue](https://github.com/aws/res/issues/new/choose) and choose from one of our templates for guidance, bug reports, or feature requests. Please check for open [similar issues](https://github.com/aws/res/issues) before opening another one.
3333

34-
##More Resources
34+
## More Resources
3535

3636
* [Changelog](https://github.com/aws/res/blob/mainline/CHANGELOG.md)
3737
* [Amazon Web Services Discussion Forums](https://repost.aws/)

‎RES_VERSION.txt‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
2023.11
1+
2024.01

‎codeCoverage.yml‎

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,6 @@ source/idea/idea-data-model/src/ideadatamodel/aws: 0.8
55
source/idea/idea-data-model/src/ideadatamodel/cluster_resources: 0.8
66
source/idea/idea-data-model/src/ideadatamodel/common: 0.8
77
source/idea/idea-data-model/src/ideadatamodel: 0.8
8-
source/idea/idea-sdk/src/ideasdk/analytics: 0.8
98
source/idea/idea-sdk/src/ideasdk/auth: 0.8
109
source/idea/idea-sdk/src/ideasdk/aws: 0.8
1110
source/idea/idea-sdk/src/ideasdk/utils: 0.8

‎deployment/idea/codebuild/code_scan/buildspec-idea-code-scan-bandit.yml‎

Lines changed: 33 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,33 @@
1+
version: 0.2
2+
env:
3+
variables:
4+
PYTHON_VERSION: "3.9.16" # Python version to setup local dev environment
5+
6+
phases:
7+
pre_build:
8+
commands:
9+
# Update Pyenv
10+
- echo "Updating Pyenv"
11+
- echo "Pyenv version"
12+
- pyenv --version
13+
- echo "Pyenv version list"
14+
- pyenv install --list
15+
- cd /root/.pyenv/plugins/python-build/../.. && git reset --hard && git pull && cd -
16+
- echo "Post-PyEnv update"
17+
- pyenv --version
18+
- pyenv install --list
19+
# Installing Python
20+
- pyenv install --skip-existing $PYTHON_VERSION
21+
- PYENV_VERSION=$PYTHON_VERSION python3 -m venv ~/.venv
22+
23+
build:
24+
commands:
25+
- cd $CODEBUILD_SRC_DIR
26+
- . ~/.venv/bin/activate
27+
- pip install bandit
28+
- |
29+
if [[ -z "$SCAN_LEVEL" ]]; then
30+
echo "SCAN_LEVEl environment variable not set, default to -ll"
31+
SCAN_LEVEL="-ll"
32+
fi
33+
- bandit -r source/idea/ $SCAN_LEVEL

‎deployment/idea/codebuild/code_scan/buildspec-idea-code-scan-npm.yml‎

Lines changed: 28 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,28 @@
1+
2+
version: 0.2
3+
env:
4+
variables:
5+
NODEJS_VERSION: "18.18.0" # NodeJS version to setup local dev environment
6+
7+
phases:
8+
install:
9+
commands:
10+
- n $NODEJS_VERSION
11+
12+
pre_build:
13+
commands:
14+
- echo "npm version"
15+
- node --version
16+
- echo "node version"
17+
- npm --version
18+
19+
build:
20+
commands:
21+
- cd $CODEBUILD_SRC_DIR
22+
- npm i --package-lock-only
23+
- |
24+
if [[ -z "$AUDIT_LEVEL" ]]; then
25+
echo "AUDIT_LEVEL environment variable not set, default to moderate"
26+
AUDIT_LEVEL="moderate"
27+
fi
28+
- npm audit --json --audit-level=$AUDIT_LEVEL

‎deployment/idea/codebuild/code_scan/buildspec-idea-code-scan-safety.yml‎

Lines changed: 44 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,44 @@
1+
2+
version: 0.2
3+
env:
4+
variables:
5+
PYTHON_VERSION: "3.9.16" # Python version to setup local dev environment
6+
7+
phases:
8+
pre_build:
9+
commands:
10+
# Update Pyenv
11+
- echo "Updating Pyenv"
12+
- echo "Pyenv version"
13+
- pyenv --version
14+
- echo "Pyenv version list"
15+
- pyenv install --list
16+
- cd /root/.pyenv/plugins/python-build/../.. && git reset --hard && git pull && cd -
17+
- echo "Post-PyEnv update"
18+
- pyenv --version
19+
- pyenv install --list
20+
# Installing Python
21+
- pyenv install --skip-existing $PYTHON_VERSION
22+
- PYENV_VERSION=$PYTHON_VERSION python3 -m venv ~/.venv
23+
24+
build:
25+
commands:
26+
- BUILD_SUCCEED="true"
27+
- cd $CODEBUILD_SRC_DIR
28+
- . ~/.venv/bin/activate
29+
- pip install safety
30+
- |
31+
for req in `ls $CODEBUILD_SRC_DIR/requirements/*.txt`
32+
do
33+
echo "==========================================="
34+
echo "Checking $req ..."
35+
echo "==========================================="
36+
safety check -r "$req" --output json
37+
if [[ $? -ne 0 ]]; then
38+
BUILD_SUCCEED="false"
39+
fi
40+
done
41+
- |
42+
if [[ $BUILD_SUCCEED == "false" ]]; then
43+
exit 1
44+
fi

0 commit comments

Comments
 (0)