Commit Graph

20 Commits

Author SHA1 Message Date
Nicolas JUHEL
3d9eee878f Package AWS:
- fix bug whos aws config checksum not loaded from config struct, using callback on config process
- bump to latest sdk release

Other:
- bump dependencies
2025-03-13 16:47:17 +01:00
Nicolas JUHEL
82d32d81b0 Package AWS:
- bump dependencies aws sdk go v2 with checksum calulation when supported by default
- add function in config interface to allow changing checksum calculation
- set checksum calculation as 'when required' with custom config
- set checksum calcultation as 'when supported' with aws config

Other:
- bump dependencies
2025-01-28 16:42:02 +01:00
Nicolas JUHEL
77c7ebfe83 Package AWS:
- Allow to use config anonymous with no access key / secret key
- Replace *http.client to interface of Do function
2023-12-14 13:40:36 +01:00
nabbar
82be8c0c89 Pakcage AWS:
- add subpackage to sign http.request with AWS V4 signature and parse response based on http.response and given model

Other:
- bump dependencies
2023-11-24 13:22:57 +01:00
Nicolas JUHEL
b0fd08792c Package AWS
Add feature to change http timeout directly in httpcli store in aws client
  Add copy/MPUCopy function
  Update mpu to allow copy with MPU

Package Cobra
  Fix println by fmt.Fprint to os.stdout

Package Crypt
  Refactor package to use instance of crypt instead of a global crypt unique instance
  Allow to gen key/nonce
  Add io stream reader/writer instead of only buffer slice encoder decoder

Package file/bandwidth
  Add new subpackage bandwith to limit a amount of byte read/write for a duraction
  Use file/progress function increment/reset
  Allow to add custom function increment / reset

Package IOUtils
  Remove useless file error.go, tempFile.go (replaced by package file)
  Move fileDescriptor to a subpackage fileDescriptor: allow to change nb of FD for linux/windows os
  Move Buffer ReadCloser to a new subpackage: allow to add close function to buffer, and expose read / write io interface
  Add sub package multiplexer to allow send/receive multiple io stream into on io stream

Package Socket
  Rework to expose io stream instead of buffer
  Fix minor bugs

Other:
  Bump dependencies
  Update code following bump dependencies
2023-10-03 12:03:36 +02:00
Nicolas JUHEL
984ba51587 Rework Error interface
Package Errors:
- add function to check & cast error interface into golib Error interface
- update CodeError type to simplify management & error creation
- add function to simplify call of Error function from a generic error interface
- remove some useless function from Error interface

All Other Packages:
- apply change of package Errors into all other packages
2023-08-28 11:22:08 +02:00
nabbar
e3239db998 Rework Monitoring, Prometheus, Status system
Package Monitoring :
- use packag dedicated to monitor component
- each monitor work as standalone server to monitor health
- collect metrics to export them to prometheus exporter

Package Prometheus :
- review to simplify use for API and not API metrics
- optimize code

Package Status :
- Rework to use Monitor package
- Rework to use native json / text Marshaller interface

Context :
- rework context config (context var) to use sync map and sync RWMutex (WORM)
- move gin context to dedicated sub package (dependancies of logger make circular dependencies)
- optimize code

Config :
- rework to optimize sync / collect of component
- rework status to monitor
- remove monitor managment from config to each component
- add a func to set default logger to implement inherit default logger options
- optimize code

IOUtils :
- isolate logger / closer interface as a usable & public interface & instance
- this interface / instance allow to collect io.closer over a context to close all if context is done

Logger :
- rework to use context.config map
- rework to use ioutils closer
- rework to allow options to inherit a default options, or the last version of options
- optimize code

Size :
- Add package Size to calculate and manipulate size Byte or bit
- Add encoding : Text/JSON/Yaml/Toml...
- Add option to défine default unit : Byte or bit

Other :
- adjust following code
- optimize code
- limit use of atomic value
- rework to use RWMutex instead of sync.Mutex to maximize capabilities of read instead of write
- remove 32bit build for CI/CD
- add darwin/arm64 build for CI/CD

Bump Dependencies
2023-02-21 16:30:40 +01:00
nabbar
980012d921 Package AWS :
- Bucket ADD CreateWithLock : create bucket with Object Lock enable
  - Bucket ADD GetLock : retrieve object lock bucket configuration
  - Bucket ADD SetLock : set object lock bucket configuration
  - Object ADD GetLegalHold : retrieve object lock status for object/version
  - Object ADD SetLegalHold : set object lock flag for object/version
  - Interface ADD SetClientS3 : replace current client S3 with a new one given as parameters
  - Interface ADD SetClientIam : replace current client IAM with a new one given as parameters
  - Interface ADD HTTPCli : return the current setting of func to return a http.client
  - Interface ADD mutex : lock any accessing struct properties to prevent race

Other :
  - bump dependencies
2022-12-02 09:35:29 +01:00
Nicolas JUHEL
573af6ce3a Package AWS :
- Config Model : add a config model with a golib RouerStatus Config Model to use a AWS connection for API with a request status health check
  - Config Interface : add function GetAccessKey to retrieve the accesskey value currently used into the current connection
  - function Walk (Object, version, ...) : fix bug with pointer of string not initialized

Package Config :
  - interface Component : add status router pointer into the Init function to allow used a global router status for all component status registration as router status component

Package Status :
  - move Status Config as an sub package of Package Status

Package Errors :
  - add CamelCase const

Package Logger :
  - fix following bump dependencies

Global :
  - bump dependencies
  - change init of errors files : change function never call vy panic to prevent an error code collision
2022-09-13 12:31:04 +02:00
Nicolas JUHEL
55aa0c3637 Package AWS:
- Bucket : add function Walk based on list but run a given function for each found bucket
- Object : add function Walk & WalkPrefix based on ListPrefix to run a given function for each returned object
- Object : add function WalkVersion & WalkVersionPrefix based on ListVersion to run a given function for each returned object version
Package logger:
- Fix bug with compat : a nil error not clean when sent to logger
Package Context:
- Fix bug with context/config : the load key return an atomic value instead of the interface stored
2022-08-10 11:11:34 +02:00
Nicolas JUHEL
f0a5a894f2 Pakcage AWS :
+ Add Tag function for object
  + Add Lock function for object
  + Add Attributes function for object
  + Add lifecycle function for bucket
  + Add function to get client in AWS interface
Package Certificates :
  + Add clean certifs function in config
Bump dependencies
2022-08-03 12:13:15 +02:00
Nicolas JUHEL
48b47ec97e Package AWS :
- fix missing commit : version function
- fix missing commut : deleteall function
- add function to load bucket replication configuration
- add AWS feature to create new client for a config based on current client
- add Config feature to change the credentials of current config
2022-04-22 14:37:59 +02:00
Nicolas JUHEL
f073bca2d3 Package AWS :
- Fix issue #136 :
  - add function ForceSignerOptions to pass options funct to signer
  - if not option exist, use default signer v4, else specify the options function list to the new signer
- fix error with multiple ptr identifier on model
- add function to list and cancel multipart uploads
- add function to list, get and delete version object
- add function to delete all objects following the S3 API DeleteObjects function (to send array of object key / version) in one request

Package Config :
- modify component interface :
    - add cpt as custom function parameters to prevent new component still not stored when running custom function
    - re-order mutex on start / reload process

Change :
- Bump dependancies
2022-04-20 12:21:26 +02:00
Nicolas JUHEL
312ce42dc3 Fix issue #132 2022-03-29 08:36:19 +02:00
Nicolas JUHEL
1249f319bc Bump dependancies
- AWS SDK to release v1.0.0
  - other dependancies
Fix Packages :
  - AWS : fix validator function, rules, config model
  - Certificates : fix func NewFrom
  - HTTPServer: fix IsRunning
Fix other :
  - Fix CI/CD job to prevent alert on files modified
  - Fix missing licence comment header
2021-01-25 08:33:18 +01:00
Nicolas JUHEL
cbc0a35ea7 Fix Issue #73 and other bugs:
- Boolean value for EndpointOption
- Optimize CustomConfig IsHTTPS function
- Bucket Creation return
- Bucket Create contraint Region Location
- CustomConfig missing Signing Region
- some AWS errors

Fix Github/Action :
- Add some linter/test as blocked task
2020-11-25 11:51:20 +01:00
Nicolas JUHEL
0290b217c5 Bump aws to release v0.29.0 2020-11-02 10:30:45 +01:00
Nicolas JUHEL
3671701836 Fix linter + working dir for test 2020-10-02 12:51:23 +02:00
Nicolas JUHEL
94f90d7e22 Bump to sdk aws go v2 at release v0.26.0...
Bump dependancies
Refactor / Fix aws to work with sdk-aws-go-v2 at release v0.26.0...
2020-10-02 12:43:08 +02:00
Nicolas JUHEL
8def6ec437 PKG Aws : add aws package to simplify uses of aws sdk + aimplify custom config for custom endpoint or region like use of minio server 2020-09-11 13:56:17 +02:00