db47400576
Allow namespace configuration for different CRD resources in Fission ( #2539 )
...
* Allow multiple namespaces for builder manager
* Enable multiple namespaces for executor informers
* Added missing context
* helm chart support for multiple namespaces
* Directly consume map type from GetInformerForNamespaces fn
* Optimize function resolver by choosing namespace-specific informer
* helm chart support for multiple namespaces
* consider default namespace and move duplicate code to helm template
* Improve documentation for fission namespace values
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
Co-authored-by: shubham bansal <shubhambansaliimtgn@gmail.com >
2022-10-19 15:48:47 +05:30
Sanket Sudake and GitHub
5b8d569e1d
Remove unwanted permissions from Fission components ( #2568 )
...
* Remove unwanted permissions from Fission components
* Remove unwanted permission from buildermgr
* Remove rbac permissions from controller
* Remove unwanted namespace permission
* Remove unwanted fission resource permissions
* Add deployment list permission for buildermgr
* add deployment create permission for buildermgr
* Update action version
* Add rolebinding permission for buildermanager
* Reduce permissions for fetcher and builder components
* Aded deployment delete permission to buildermgr
* Add logger to wait crds function
* Revert "Grant CustomResourcedefintion read permission to specific components (#2567 )"
This reverts commit 1f23c1b57dsanketsudake@gmail.com >
2022-10-13 15:04:49 +05:30
Sanket Sudake and GitHub
ea80865efe
Ensuring passing context across fission ( #2555 )
...
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
2022-09-26 16:05:45 +05:30
Sanket Sudake and GitHub
b1eed7a5d5
Capture context from cobra CLI and pass forward ( #2551 )
...
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
2022-09-22 13:54:05 +05:30
Shubham Bansal and GitHub
84eeda933a
Add metric fission_mqt_message_lag for kafka mqt connector ( #2544 )
...
These changes have specifically been made for Kafka connector. This will expose a new metric named `fission_mqt_message_lag`, which will show a number of messages lag per topic and partition.
We can use this metric in the auto-scaling of the pod for the new deploy type executor function. While creating a new deploy function we need to add hpa metrics of external type inside the function definition.
2022-09-15 14:45:51 +05:30
neha_gupta and GitHub
3a2e56c74f
add values for nats jetstream keda connector ( #2515 )
...
* add values for jetstream connector
* formatte fission cli
* Update jetstream connector version
2022-08-29 10:45:18 +05:30
Sanket Sudake and GitHub
809c9bec45
Reestablish kakfa consumer group session on disconnection ( #2504 )
...
* Reestablish kakfa consumer group session on disconnection
* Add wait for the consumer
* Ignore empty message
* Update github.com/Shopify/sarama to v1.35.0
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
2022-08-09 11:06:19 +05:30
Sanket Sudake and GitHub
d4569eb7e6
Use Clientset interface instead of type for Fission/kubernetes clients ( #2416 )
...
Using interface makes it easy to create a fake client and unit test
a specific portion of the code. We should be able to more write unit
test and increase coverage of code with this change.
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
2022-04-21 16:49:52 +05:30
Sanket Sudake and GitHub
3e8f31b156
Use common httpserver across fission ( #2409 )
...
* Defining httpserver package to capture httpserver shutdown and
introduces uniform running of http server across codebase.
* Add unit tests for httpserver
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
2022-04-14 11:35:58 +05:30
Sanket Sudake and GitHub
0b2419c724
Remove deprecated Fission Azure Storage Queue connector ( #2404 )
...
We are removing Fission deprecated Azure Storage Queue connector and
planning to adopt Keda going forward to have better
delegated functionality and more rich support.
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
2022-04-06 15:13:56 +05:30
Sanket Sudake and GitHub
3495ea14a0
Remove deprecated Fission Nats connector ( #2403 )
...
We are removing Fission deprecated Nats connector and
planning to adopt Keda going forward to have better
delegated functionality and more rich support.
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
2022-04-06 13:41:38 +05:30
d4f58bde5a
Added metrics for fission mqtrigger and optimizations in trigger subscriptions ( #2399 )
...
- Use mqtrigger watch instead of polling mqtrigger every 5 seconds
- Added metrics to monitor no of subscriptions, and no of messages per subscription
- Add standard go metrics exported by prometheus
- Enable prometheus discovery for mqtrigger pod
- Optimized mqtrigger manager cache
- Add unit tests for mqtrigger cache
Co-authored-by: Sanket Sudake <sanketsudake@gmail.com >
2022-04-05 21:51:05 +05:30
Ankit Chawla and GitHub
d846191960
Added validation to keda types and updated help ( #2346 )
...
* Added validation to keda types and updated help
* Changed formatting of help
* Changed variable name
2022-02-09 19:55:14 +05:30
Ankit Chawla and GitHub
eaa55ab661
Minor bug fixes ( #2298 )
2022-01-11 17:06:21 +05:30
Sanket Sudake and GitHub
30b764a220
MQT Kafka: Use Sarama Group Consumer instead of bsm/sarama-cluster library ( #2286 )
...
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
2021-12-22 18:00:25 +05:30
Sanket Sudake and GitHub
c5ae216a4e
Capture os signals to gracefully shutdown fission components ( #2261 )
...
- Currently, fission components don't handle shutdown signals.
So we don't get any to do the required cleanup before the fission process
exits. Adding signal capture process with cancelling context so
that all dependent processes stop working when the process gets term
signal.
- Set log level to error in otel shutdown function
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
2021-11-11 17:02:11 +05:30
Eng Zer Jun and GitHub
7d904a9401
refactor: move from io/ioutil to io and os package ( #2236 )
...
The io/ioutil package has been deprecated as of Go 1.16, see
https://golang.org/doc/go1.16#ioutil . This commit replaces the existing
io/ioutil functions with their new definitions in io and os packages.
Signed-off-by: Eng Zer Jun <engzerjun@gmail.com >
2021-10-23 17:14:12 +05:30
Sanket Sudake and GitHub
e480f81937
Change default informer resync period to 30 minutes ( #2167 )
...
Currently most of informers used in Fission are using resync
period of 30sec which is quite low and causes lot of disturbances
in overall system. Since informers already have watchers which would
be delivering events to the handlers. If any handlers require lower
sync period they should register handler with `AddEventHandlersWithResyncPeriod`
instead of we generaling informer.
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
2021-08-20 09:03:09 +05:30
Sanket Sudake and GitHub
7cd877698b
Enable race detector for unit tests ( #2085 )
...
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
2021-07-23 13:24:10 +05:30
Sanket Sudake and GitHub
e8adb3c2f1
Replace controller with generated SharedIndexerInformers ( #2103 )
...
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
2021-07-06 13:56:10 +05:30
Sanket Sudake and GitHub
59c950eeda
Retrieve pod metrics only if metrics server is running and Go lint fixes ( #2094 )
...
* Retrieve pod metrics only if metrics server is running
Currently we query pod metrics every 30 sec which floods executor logs,
added check which confirms if metrics server is running then only we start
querying pod metrics for identifying CPU utilization.
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
* Fixed couple of typos and misspells with Go CI
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
* Remove unnecessary conversions with Go CI
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
2021-06-28 10:06:32 +05:30
Harsh Thakur and GitHub
3f0f2e8fe2
Fix golang lint errors ( #2068 )
...
* Fix golang lint errors
Signed-off-by: Harsh Thakur <harshthakur9030@gmail.com >
* Typo for fields
Signed-off-by: Harsh Thakur <harshthakur9030@gmail.com >
* Multi error fix
Signed-off-by: Harsh Thakur <harshthakur9030@gmail.com >
* Multi error fix
Signed-off-by: Harsh Thakur <harshthakur9030@gmail.com >
* Add nolint to logtostderr errcheck
Signed-off-by: Harsh Thakur <harshthakur9030@gmail.com >
2021-06-15 15:03:42 +05:30
8283073c62
Added body in the error topic header ( #1830 )
...
Signed-off-by: therahulbhati <rjbhati009@gmail.com >
Co-authored-by: Vishal <vishal-biyani@users.noreply.github.com >
Co-authored-by: Sanket Sudake <sanketsudake@gmail.com >
2021-06-07 22:28:11 +05:30
ec86464280
Keda podspec ( #2021 )
...
* Add podspec to MQT
Signed-off-by: Harsh Thakur <harshthakur9030@gmail.com >
* Add preupgrade check
Signed-off-by: Harsh Thakur <harshthakur9030@gmail.com >
* Use zap logger
Signed-off-by: Harsh Thakur <harshthakur9030@gmail.com >
Co-authored-by: Sanket Sudake <sanketsudake@gmail.com >
2021-05-27 14:21:34 +05:30
a111dbd5a0
Crds update ( #2033 )
...
* Add code generated using latest code-generator
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
* Update client-go and respective dependencies to v0.19.2
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
* Upgrading CRD version
Signed-off-by: Harsh Thakur <harshthakur9030@gmail.com >
* Minor changes
Signed-off-by: Harsh Thakur <harshthakur9030@gmail.com >
* Resolved client-go calls as per new generated code
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
* Function validations fix
Signed-off-by: Harsh Thakur <harshthakur9030@gmail.com >
* Fix environment and package validations
Signed-off-by: Harsh Thakur <harshthakur9030@gmail.com >
* Add basic validation to all CRDs
Signed-off-by: Harsh Thakur <harshthakur9030@gmail.com >
* Remove CRD installation related code
Signed-off-by: Harsh Thakur <harshthakur9030@gmail.com >
* Modify GHA for CRD installation
Signed-off-by: Harsh Thakur <harshthakur9030@gmail.com >
* Fix Package and HTTPTrigger validations
Signed-off-by: Harsh Thakur <harshthakur9030@gmail.com >
* Change Go version in CI to 1.15
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
* Style: kubebuilder marker change
Signed-off-by: Harsh Thakur <harshthakur9030@gmail.com >
* Fix test with deprecated fields
Signed-off-by: Harsh Thakur <harshthakur9030@gmail.com >
* Update kind node image to v1.16.15 in CI
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
* Update kind node image to v1.19.11 in CI
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
* Replace context Background with TODO for future implementation
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
* Optimize initial CRD check code
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
* Use Get call only to check CRDs
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
* Add kustomize for CRD apply
Signed-off-by: Sanket Sudake <sanketsudake@gmail.com >
Co-authored-by: Sanket Sudake <sanketsudake@gmail.com >
2021-05-26 15:07:03 +05:30
2fb79e1355
do not use deprecated functions/methods ( #2027 )
...
Signed-off-by: Gaurav Gahlot <gauravgahlot0107@gmail.com >
Co-authored-by: Sanket Sudake <sanketsudake@gmail.com >
2021-05-21 13:53:28 +05:30
7d78004b4b
feat: Add image pull policy when create KEDA connector deployments ( #1944 )
...
Co-authored-by: Vishal <vishal-biyani@users.noreply.github.com >
2021-05-20 01:22:25 +05:30
Rahul Bhati and GitHub
eb737d0f3e
Feature request per pod ( #1946 )
...
This feature enables routing more than one request to a pod at the same time. This is the first draft of the work and might involve more optimizations later.
2021-03-31 12:35:30 +05:30
452b1e332d
Migrating to keda2.0 ( #1868 )
...
Co-authored-by: Rahul Bhati <rjbhati009@gmail.com >
Co-authored-by: Vishal <vishal-biyani@users.noreply.github.com >
2021-02-05 10:28:54 +05:30
f1ce32e9d3
Put message to error topic when exceed max retries in kafka mqt ( #1885 )
...
Co-authored-by: Vishal <vishal-biyani@users.noreply.github.com >
Co-authored-by: Rahul Bhati <rjbhati009@gmail.com >
2021-02-02 23:20:40 +05:30
Gaurav Gahlot and GitHub
6758a04dbd
Fixed golangci-lint issues: /fission/pkg ( #1902 )
2021-01-19 23:29:20 +05:30
Tosone and GitHub
5155dc72ad
Remove unnecessary import package. ( #1897 )
2020-12-28 18:48:02 +05:30
Rahul Bhati and GitHub
9acf5b143f
Added flag for insecureSkipVerfiy ( #1829 )
2020-10-13 21:03:19 +05:30
0c6f86b6cc
Add headers to Kafka MQT error topics ( #1701 )
...
Co-authored-by: Vishal <vishal-biyani@users.noreply.github.com >
2020-09-07 19:13:36 +05:30
Rahul Bhati and GitHub
c6b7145080
Removed code related to mqtrigger ( #1680 )
2020-08-06 20:59:08 +05:30
Rahul Bhati and GitHub
a01cf1e3d5
Fission MQT integration with keda ( #1657 )
...
Fission MQT integration based on Keda with Kafka connector
2020-07-14 21:35:48 +05:30
063739948f
Fixing verify-staticcheck.sh ( #1622 )
...
Co-authored-by: Vishal <vishal-biyani@users.noreply.github.com >
2020-06-04 15:16:09 +05:30
9a4efa3f1e
External nats streaming ( #1576 )
...
Support for external NATS streaming instead of the one deployed with Fission
Co-authored-by: Shaun Cutts <shaunc@factfiber.com >
2020-04-19 21:53:27 +05:30
Ta-Ching Chen and GitHub
baaeb321ff
Add message queue service factory ( #1537 )
2020-02-20 23:30:39 +08:00
Ta-Ching Chen and GitHub
26a2889476
Update NATS-Streaming dependencies version ( #1533 )
2020-02-12 20:35:20 +08:00
Ta-Ching Chen and GitHub
81eb541442
Fix Git issue on case-insensitive OS ( #1532 )
2020-02-12 16:08:05 +08:00
Ta-Ching Chen and GitHub
72a7d490c6
Reorganize message queue trigger directory structure ( #1531 )
2020-02-12 15:40:00 +08:00
Ta-Ching Chen and GitHub
6379559c78
Follow kubernetes APIs directory structure ( #1497 )
2020-01-20 17:06:46 +08:00
Ta-Ching Chen and GitHub
301fe0b249
Codebase cleanup & optimization ( #1493 )
...
Remove old v1 types that are no longer used and move fetcher structs to fetcher directory.
2020-01-16 16:47:32 +08:00
Ta-Ching Chen and GitHub
308ba054a9
Use code-generator to generate clientset/informer/lister ( #1492 )
...
To reduce maintenance effort and avoid writing duplicate informer code,
use code-generator to generate clientset/informer/lister code.
2020-01-16 15:18:38 +08:00
Ta-Ching Chen and GitHub
3a1ad91658
Update staticcheck version and fix all warnings ( #1381 )
2019-11-05 18:09:12 +08:00
Vivek Singh and Ta-Ching Chen
795c1f1e6d
Calling the function that handles kafka messages, asynchronously ( #1355 )
2019-10-19 14:41:46 +08:00
Suraj Banakar and Ta-Ching Chen
48df99eacf
Implement TLS authentication for kafka mqt ( #1300 )
...
* use secrets to store keys and certificates
2019-10-10 00:18:57 +08:00
Suraj Banakar and Ta-Ching Chen
7cec1c2b55
Fix kafka producer and consumer logs show empty objects ( #1281 )
2019-09-29 23:47:05 +08:00
Suraj Banakar and Ta-Ching Chen
161e084c8e
Fix typo "consumer" => "producer" ( #1278 )
2019-08-20 19:45:56 +08:00
