Skip to content
This repository was archived by the owner on May 21, 2025. It is now read-only.
Open
Changes from all commits
Commits
Show all changes
139 commits
Select commit Hold shift + click to select a range
8254760
add eks-msk-opensearch example
Sep 21, 2022
05e2e2e
update Readme.md
Sep 21, 2022
8634cb9
update Readme.md
Sep 21, 2022
529dd0c
update Readme.md
Sep 21, 2022
ddea5a7
Add Ref arch Diagram
Sep 22, 2022
d30c861
Update Readme
Sep 22, 2022
06b82e8
Update Readme
Sep 22, 2022
ce9ff00
Remove Zone-id variable, Connector is not able to resovle private hos…
Sep 22, 2022
6c691d3
Update README.md
priyavartk Oct 8, 2022
9b4265c
Update README.md
priyavartk Oct 8, 2022
591f369
Update README.md
priyavartk Oct 8, 2022
d3a86e0
Update README.md
priyavartk Oct 8, 2022
f6c8704
Update README.md
priyavartk Oct 8, 2022
b41923a
Update README.md
priyavartk Oct 8, 2022
3ac83d4
Update README.md
priyavartk Oct 8, 2022
c7e6e10
Update README.md
priyavartk Oct 8, 2022
2df1762
Update fluent-bit.yaml
priyavartk Oct 8, 2022
8e978c1
Update fluent-bit.yaml
priyavartk Oct 8, 2022
1d77fab
Update README.md
priyavartk Oct 8, 2022
d5ce39e
Update README.md
priyavartk Oct 8, 2022
c2f5f80
Update fluent-bit.yaml
priyavartk Oct 8, 2022
feb313b
Update fluent-bit.yaml
priyavartk Oct 8, 2022
c3a1009
Update README.md
priyavartk Oct 13, 2022
28ec217
Update README.md
priyavartk Oct 13, 2022
a10cc9f
Update README.md
priyavartk Oct 13, 2022
8758b82
Update fluent-bit.yaml
priyavartk Oct 13, 2022
776822f
Update README.md
priyavartk Oct 13, 2022
19fef26
Update README.md
priyavartk Oct 13, 2022
e2bdbd9
Update README.md
priyavartk Oct 13, 2022
2b8904d
Update README.md
priyavartk Oct 13, 2022
9e11823
Update README.md
priyavartk Oct 13, 2022
2b8e160
Update README.md
priyavartk Oct 13, 2022
cf61713
Update README.md
priyavartk Oct 13, 2022
31b7aef
Update README.md
priyavartk Oct 13, 2022
fc5ece1
Update README.md
priyavartk Oct 24, 2022
7c29d07
Update README.md
priyavartk Oct 24, 2022
251d31d
Update README.md
priyavartk Oct 24, 2022
dbb5d5a
Update README.md
priyavartk Oct 24, 2022
15fd5be
Update README.md
priyavartk Oct 24, 2022
6048bfb
Update README.md
priyavartk Oct 24, 2022
c98adde
Update README.md
priyavartk Oct 24, 2022
17c9726
Update README.md
priyavartk Oct 24, 2022
f3a7001
Update README.md
priyavartk Oct 24, 2022
f741414
Update README.md
priyavartk Oct 24, 2022
0e24770
Update README.md
priyavartk Oct 24, 2022
07a1d61
Update README.md
priyavartk Nov 1, 2022
1801ed0
Update README.md
priyavartk Nov 1, 2022
3e0c389
Update README.md
priyavartk Nov 1, 2022
4c2fa0e
Update README.md
priyavartk Nov 1, 2022
b42683c
Update README.md
priyavartk Nov 1, 2022
147f0ef
Update README.md
priyavartk Nov 1, 2022
5a29f22
Update README.md
priyavartk Nov 1, 2022
60aadc4
Update README.md
priyavartk Nov 1, 2022
423b556
Update README.md
priyavartk Nov 1, 2022
4c0e705
Update README.md
priyavartk Nov 1, 2022
d1aedf9
Update README.md
priyavartk Nov 1, 2022
81ebdba
Update README.md
priyavartk Nov 1, 2022
60c49fd
Update README.md
priyavartk Nov 1, 2022
a07d68b
Update README.md
priyavartk Nov 7, 2022
cd5a05b
Update README.md
priyavartk Nov 7, 2022
c561485
Update README.md
priyavartk Nov 7, 2022
261087e
Update README.md
priyavartk Nov 7, 2022
91e00be
Update README.md
priyavartk Nov 7, 2022
b605a83
Update README.md
priyavartk Nov 7, 2022
6062397
Update README.md
priyavartk Nov 7, 2022
b9df8f0
Update README.md
priyavartk Dec 7, 2022
5e3c8f7
Update README.md
priyavartk Dec 7, 2022
405556f
Update README.md
priyavartk Dec 7, 2022
9ea992d
Update README.md
priyavartk Dec 7, 2022
6a6c996
Update README.md
priyavartk Dec 7, 2022
684239f
Update README.md
priyavartk Dec 7, 2022
33f6c6e
Update README.md
priyavartk Dec 7, 2022
09953cc
Update README.md
priyavartk Dec 7, 2022
4ac993f
Update README.md
priyavartk Dec 7, 2022
53e0451
Update README.md
priyavartk Dec 7, 2022
fb486d5
Update README.md
priyavartk Dec 7, 2022
cc070a3
Update README.md
priyavartk Dec 7, 2022
6f712ac
Delete README.md
priyavartk Dec 19, 2022
c320dfd
Rename 0-provider.tf to provider.tf
priyavartk Dec 19, 2022
01b5d51
Rename 1-locals.tf to locals.tf
priyavartk Dec 19, 2022
7d58143
Rename 3-variables.tf to variables.tf
priyavartk Dec 19, 2022
59f3aa0
Rename 2-data.tf to data.tf
priyavartk Dec 19, 2022
675a589
Rename 4-vpc.tf to vpc.tf
priyavartk Dec 19, 2022
1a657e3
Rename 5-eks.tf to eks.tf
priyavartk Dec 19, 2022
7275a61
Rename 6-irsa.tf to irsa.tf
priyavartk Dec 19, 2022
48e7a26
Rename 8-sa.tf to sa.tf
priyavartk Dec 19, 2022
6e035d0
Rename 9-namespaces.tf to namespaces.tf
priyavartk Dec 19, 2022
5ca9cb5
Rename 7-lbc.tf to lbc.tf
priyavartk Dec 19, 2022
f540a41
Rename 14-output.tf to output.tf
priyavartk Dec 19, 2022
4e9dd08
Rename 10-msk.tf to msk.tf
priyavartk Dec 19, 2022
dbbe5d4
Rename 12-es.tf to es.tf
priyavartk Dec 19, 2022
5ce1453
Rename 13-fluentbit.tf to fluentbit.tf
priyavartk Dec 19, 2022
0f8c9c8
Rename 11-iam.tf to iam.tf
priyavartk Dec 19, 2022
c603000
Update fluent-bit.yaml
priyavartk Dec 19, 2022
b746da9
Delete Ref-Architecture.png
priyavartk Dec 19, 2022
b3cb367
Add logging for multi-tenant applications on EKS
Dec 21, 2022
b0ddb7f
update readme
Dec 21, 2022
e6856db
Fix opensearch password validation
Dec 21, 2022
2b9ea7f
Fix use kubelet issue
Dec 22, 2022
4260e3f
Merge branch 'mainline' into mainline
priyavartk Dec 22, 2022
8d5e0e2
Merge pull request #1 from shahim/mainline
priyavartk Dec 22, 2022
86d403e
update fluent-bit config and remove lb controller code
Dec 22, 2022
773a744
remove bucket name
Dec 22, 2022
83ecbde
fix fluent-bit config
Dec 23, 2022
0a7c7bc
Update msk.tf
priyavartk Jan 5, 2023
368b041
Update msk.tf
priyavartk Jan 5, 2023
1700e84
Update variables.tf
priyavartk Jan 5, 2023
12971ce
Update README.md
priyavartk Jan 5, 2023
4e4bf82
Update variables.tf
priyavartk Jan 6, 2023
2b289fc
Update msk.tf
priyavartk Jan 6, 2023
7e0fb7a
Merge branch 'mainline' into mainline
priyavartk Jan 8, 2023
725a61d
Merge pull request #2 from shahim/mainline
priyavartk Jan 8, 2023
63fb973
Update README.md
priyavartk Jan 8, 2023
7bf29e6
Update README.md
priyavartk Jan 8, 2023
08f8c60
Update msk.tf
priyavartk Jan 20, 2023
b3027d1
Update fluent-bit.yaml
priyavartk Mar 23, 2023
0e2000a
Update fluent-bit.yaml
priyavartk Mar 23, 2023
dac4b8a
Update logging.json
priyavartk Mar 23, 2023
78939c4
Update iam.tf
priyavartk Mar 23, 2023
3a8bbbe
Update logging.json
priyavartk Mar 23, 2023
73400fe
Update fluent-bit.yaml
priyavartk Mar 23, 2023
e47e1a8
Update README.md
priyavartk Mar 23, 2023
4f3ef28
Update fluent-bit.yaml
priyavartk Mar 23, 2023
cd2378e
Update README.md
priyavartk Mar 23, 2023
f9ab232
Update README.md
priyavartk Mar 23, 2023
c85ac52
Update README.md
priyavartk Mar 23, 2023
daa6bd1
Update README.md
priyavartk Mar 23, 2023
38e9211
Update fluent-bit.yaml
priyavartk Mar 24, 2023
d45688e
Update README.md
priyavartk Apr 13, 2023
6e42f69
Update README.md
priyavartk Apr 13, 2023
6fb73c3
Create Cost.md
priyavartk Apr 13, 2023
86e02fd
Update README.md
priyavartk Apr 13, 2023
821ad39
Update README.md
priyavartk Apr 13, 2023
e050a2d
Update README.md
priyavartk Apr 13, 2023
8a50fe8
Merge branch 'mainline' into mainline
priyavartk Apr 13, 2023
c05d160
Delete Cost.md
priyavartk Apr 13, 2023
e7133f3
Update README.md
priyavartk Apr 13, 2023
8d17159
Update README.md
priyavartk Apr 13, 2023
24c7581
Merge pull request #3 from priyavartk/priyavartk-patch-1
priyavartk Apr 13, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 2 additions & 1 deletion examples/eks-msk-opensearch/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,8 @@ In the following diagram Product, Order, and Payment are example of tenants whic

### Fluent Bit configuration

We used the Lua filter plugin to add a key `namespace` with value of Kubernetes namespace name prefixed by `logs_`. This key is subsequently used in the Kafka output plugin to define Kafka topic name dynamically. Therefore, all logs belong to a Kubernetes namespace will be grouped by a Kafka topic.

We used the 'nest' filter plugin to move namespace_name key to the top from inputs logs enriched by kubernetes filter. Nest filter also prefixes `logs_` to the namespace key. This new key is subsequently used in the Kafka output plugin to define Kafka topic name dynamically. Therefore, all logs belong to a Kubernetes namespace will be grouped by a Kafka topic.

If you need a custom parser for your application logs, Fluent Bit allows you to suggest a pre-defined parser by annotating your application Pod definition using `fluentbit.io/parser: <parser-name>`. You can also completely opt out of logging for any of your Pods using `fluentbit.io/exclude: "true"` annotation. For more information, see [Fluent Bit - Kubernetes Annotations](https://docs.fluentbit.io/manual/pipeline/filters/kubernetes#kubernetes-annotations).

Expand Down