mirror of
https://github.com/nabbar/golib.git
synced 2025-12-24 11:51:02 +08:00
Global Repos / Workflow - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - UPDATE workflow: split old workflow into multiple files - UPDATE .gitignore: added cluster.old.tar.gz and build artifacts - UPDATE .golangci.yml: enhanced linter rules and disabled deprecated linters [archive] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - FIX extract: recursive decompression for nested archives (e.g., .tar.gz handling) - FIX extract: ZIP archive support now properly uses ReaderAt interface with seek reset - ADD extract: proper symlink and hard link handling in archives - UPDATE tar/writer: improved error handling and file mode preservation - UPDATE zip/writer: enhanced validation and error messages - UPDATE compress/interface: added support for additional compression formats - UPDATE helper/compressor: fixed typo in error handling [artifact] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE artifact: improved error handling and context management - UPDATE client/interface: enhanced API with better type safety and context propagation - UPDATE client/model: refactored for better maintainability - UPDATE github: removed unused error codes, improved model validation - UPDATE gitlab: enhanced API pagination and error handling - UPDATE jfrog: improved artifactory API compatibility - UPDATE s3aws: enhanced S3 bucket operations and error messages [atomic] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE cast: improved type conversion with better error handling - UPDATE interface: enhanced atomic operations with generics support - UPDATE synmap: fixed race conditions in concurrent access patterns - UPDATE value: improved atomic value operations with better memory ordering [aws] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE bucket: enhanced ACL and CORS configuration with validation - UPDATE configAws/models: improved credential handling and region configuration - UPDATE configCustom/interface: added support for custom endpoints - UPDATE http/request: improved retry logic and timeout handling - UPDATE interface: enhanced AWS client with context propagation - UPDATE model: refactored for AWS SDK v2 compatibility - UPDATE multipart/interface: improved chunk handling for large uploads - UPDATE pusher: optimized hash calculation and upload progress tracking - UPDATE resolver: enhanced endpoint resolution with custom DNS - DELETE test files: removed bucket_test.go, group_test.go, object_test.go, policy_test.go, role_test.go, user_test.go [cache] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - ADD context: context-aware cache lifecycle management - UPDATE interface: complete rewrite with Go generics for type-safe key-value operations - ADD item package: generic cache item with expiration tracking (interface and model) - UPDATE model: refactored to use generics (Cache[K comparable, V any]) - REFACTOR: split item.go into modelAny.go for better code organization [certificates] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE auth/encode: improved PEM encoding with better error messages - UPDATE auth/interface: enhanced authentication certificate handling - UPDATE ca: improved CA certificate generation and validation - UPDATE certs: enhanced certificate configuration with SAN support - UPDATE cipher: improved cipher suite selection and validation - UPDATE curves: enhanced elliptic curve handling with additional curves - ADD deprecated.go: marked deprecated TLS versions and cipher suites - UPDATE interface: enhanced certificate interface with context support - UPDATE model: improved certificate model with better validation - UPDATE rootca: enhanced root CA pool management - UPDATE tlsversion: added TLS 1.3 support with proper validation - UPDATE tools: improved certificate utility functions [cobra] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE completion: improved shell completion generation (bash, zsh, fish, powershell) - UPDATE configure: enhanced configuration file handling - UPDATE printError: improved error formatting with color support - UPDATE interface: enhanced cobra interface with context support - UPDATE model: improved cobra model with better validation [config] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE components: improved component lifecycle management - UPDATE const/const: improved constant definitions - UPDATE context: enhanced context handling with better propagation - UPDATE errors: improved error definitions - UPDATE events: enhanced event management - UPDATE manage: improved configuration management with validation - UPDATE model: refactored config model - UPDATE shell: enhanced shell integration for interactive configuration - UPDATE types: improved component and componentList types [console] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - ADD buff.go: BuffPrintf function for colored output to io.Writer (moved from ioutils/multiplexer) - DELETE color.go: removed legacy color file (consolidated functionality) - UPDATE error: improved error definitions with better messages - ADD interface: console interface for abstraction - ADD model: console model for state management - UPDATE padding: enhanced string padding with Unicode support - UPDATE prompt: improved interactive prompt handling [context] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - DELETE config.go: removed deprecated configuration (replaced by Config[T] interface) - UPDATE context: improved context handling with better cancellation support - UPDATE gin/interface: enhanced Gin context integration with type safety - ADD helper: context helper functions for common operations - ADD interface: generic Config[T comparable] interface for type-safe context storage - ADD map: MapManage[T] interface for concurrent-safe map operations - ADD model: thread-safe context model implementation with sync.Map [database] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE gorm/config: improved database configuration - UPDATE gorm/driver: enhanced database driver with better connection pooling - UPDATE gorm/driver_darwin: macOS-specific database optimizations - UPDATE gorm/interface: improved GORM interface with context support - UPDATE gorm/model: refactored model for better maintainability - UPDATE gorm/monitor: enhanced monitoring for database connections - UPDATE kvtypes: improved types for key-value store (compare, driver, item, table) [duration] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE big: enhanced big.Duration for large time spans with arithmetic operations - UPDATE encode: improved marshaling for JSON, YAML, TOML, Text, CBOR - UPDATE format: enhanced human-readable formatting (ns, μs, ms, s, m, h, d, w) - UPDATE interface: improved duration interface with arithmetic methods - UPDATE model: refactored Duration type - UPDATE operation: enhanced arithmetic operations (Add, Sub, Mul, Div) - UPDATE parse: improved parsing with multiple format support - UPDATE truncate: enhanced truncation for rounding durations [encoding] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE aes: improved AES encryption with reader/writer interfaces - UPDATE hexa: enhanced hexadecimal encoding with better error handling - UPDATE mux: improved multiplexer/demultiplexer for stream handling - UPDATE randRead: enhanced random data generation - UPDATE sha256 package: SHA-256 hashing with reader/writer interfaces [errors] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - ADD pool package: thread-safe error pool for collecting multiple errors with concurrent access - UPDATE code: improved error code definition and lookup - UPDATE errors: enhanced error creation with better stack trace - UPDATE interface: improved error interface with more methods - UPDATE mode: enhanced error mode handling (production vs development) - UPDATE return: improved error return handling with context - UPDATE trace: enhanced error tracing with file and line information [file] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE bandwidth: improved bandwidth tracking with concurrency tests - UPDATE perm: enhanced file permission handling with Unix/Windows support - UPDATE perm/encode: improved marshaling for JSON, YAML, TOML - UPDATE perm/format: enhanced permission formatting (e.g., "rwxr-xr-x") - UPDATE perm/parse: improved parsing of permission strings and octal values - UPDATE progress: enhanced progress tracking for file I/O operations - UPDATE progress/io*: improved reader, writer, seeker, closer interfaces with progress callbacks [ftpclient] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE config: improved FTP configuration with TLS support - UPDATE errors: enhanced error definitions - UPDATE interface: improved FTP client interface - UPDATE model: refactored FTP client model [httpcli] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE cli: improved HTTP client with retry logic and timeout handling - UPDATE dns-mapper: enhanced DNS mapping for custom resolution - UPDATE dns-mapper/config: improved DNS mapper configuration - UPDATE dns-mapper/errors: enhanced error handling - UPDATE dns-mapper/interface: improved DNS mapper interface - UPDATE dns-mapper/transport: enhanced HTTP transport with DNS override - UPDATE errors: improved error definitions - UPDATE options: enhanced client options with context support [httpserver] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE config: improved server configuration with TLS and middleware support - UPDATE handler: enhanced request handler with better error handling - UPDATE interface: improved server interface with context support and monitoring integration - UPDATE model: refactored server model with better validation - UPDATE monitor: enhanced monitoring integration with status tracking - UPDATE pool: improved server pool management (config, interface, list, model) - UPDATE run: enhanced server runtime with graceful shutdown - UPDATE server: improved core server implementation with better lifecycle - ADD testhelpers/certs.go: certificate generation utilities for testing - UPDATE types: improved const, fields, and handler types [ioutils] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE bufferReadCloser: improved buffered reader/writer with closer - UPDATE fileDescriptor: enhanced file descriptor limit management (platform-specific for Linux/macOS/Windows) - UPDATE ioprogress: improved progress tracking for I/O operations - UPDATE iowrapper: enhanced I/O wrapper with custom interfaces - UPDATE mapCloser: improved map of closers for resource management - UPDATE maxstdio: enhanced C implementation for max stdio file descriptor retrieval - DELETE multiplexer/model.go: removed legacy multiplexer (functionality moved to console/buff.go and retro/) - UPDATE nopwritecloser: improved no-op write closer - UPDATE tools: enhanced I/O utility functions [ldap] - UPDATE ldap: improved LDAP client with better connection handling and search operations [logger] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE config: improved default values, file options, and syslog configuration - UPDATE entry/interface: enhanced log entry with context support - UPDATE fields: improved field handling with JSON cloning - UPDATE gorm/interface: enhanced GORM logger with trace ID support - UPDATE hashicorp/interface: improved HashiCorp logger integration - FIX hookfile/system: use os.OpenRoot for secure file operations (prevents path traversal) - FIX hookfile/system: fixed import path from libsrv "golib/server" to "golib/runner" - ADD hookfile: IsRunning() method to track file hook state - UPDATE hookstderr/interface: enhanced stderr hook with better buffering - UPDATE hookstdout/interface: enhanced stdout hook with better buffering - UPDATE hooksyslog: improved syslog integration with channel and priority handling - ADD hookwriter package: generic io.Writer hook for custom output destinations - UPDATE interface: enhanced logger interface with context propagation - UPDATE level: improved log level handling and comparison - UPDATE log: enhanced logging with better formatting - UPDATE manage: improved logger lifecycle management - UPDATE model: refactored logger model for better maintainability [mail] - UPDATE sender: improved mail sender with better MIME handling - UPDATE interface: enhanced interface with monitoring support - UPDATE monitor: added monitoring integration for mail operations [monitor] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - ADD status package: new subpackage for status management with Status type (KO, Warn, OK) - ADD status/encode: marshaling support for JSON, YAML, TOML, Text, CBOR - ADD status/format: human-readable status formatting - ADD status/interface: Status type with Parse and String methods - UPDATE encode: improved encoding with better error handling - UPDATE error: enhanced error definitions - UPDATE info: improved system info collection (CPU, mem, disk, network) - UPDATE interface: enhanced monitor interface with status support and better component integration - UPDATE metrics: improved metrics collection and export - UPDATE middleware: enhanced monitoring middleware for HTTP - UPDATE pool/interface: enhanced pool interface with better monitoring integration - UPDATE pool/metrics: improved metrics collection in pool - UPDATE pool/model: refactored pool model for better maintainability - UPDATE pool/pool: enhanced pool implementation with better lifecycle - UPDATE server: enhanced server monitoring with status tracking - UPDATE types/monitor: improved monitor type definitions [nats] - UPDATE client: improved NATS client with better subscription handling - UPDATE config: enhanced NATS configuration with cluster support - UPDATE monitor: added monitoring integration for NATS operations - UPDATE server: improved NATS server integration with monitoring [network] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE bytes: improved byte size handling for network operations - UPDATE number: enhanced number utilities for network data - UPDATE protocol/encode: improved protocol encoding - ADD protocol/format: protocol formatting utilities - UPDATE protocol/interface: enhanced protocol interface - UPDATE protocol/model: refactored protocol model [password] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE password: improved password utilities with strength validation and secure generation [pidcontroller] - UPDATE interface: improved PID controller interface - UPDATE model: enhanced PID controller model with better tuning parameters [pprof] - UPDATE tools: improved pprof utilities for profiling integration [prometheus] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE bloom/bloom: improved bloom filter with better concurrency handling - UPDATE bloom/collection: enhanced bloom filter collection operations - UPDATE interface: enhanced prometheus interface with better type safety - UPDATE metrics/interface: enhanced metrics interface with better registration - UPDATE metrics/model: refactored metrics model for better maintainability - UPDATE model: refactored prometheus model with better validation - UPDATE pool: enhanced metric pool with concurrent access - UPDATE pool/interface: enhanced pool interface - UPDATE pool/model: refactored pool model - UPDATE route: improved routing for metric endpoints - UPDATE types: enhanced type definitions for metrics - UPDATE webmetrics: improved existing metrics (requestBody, requestIPTotal, requestLatency, requestSlow, requestTotal, requestURITotal, responseBody) - ADD webmetrics/activeConnections: gauge for tracking concurrent HTTP connections - ADD webmetrics/requestErrors: counter for HTTP request errors - ADD webmetrics/responseSizeByEndpoint: histogram for response size distribution by endpoint - ADD webmetrics/statusCodeTotal: counter for HTTP status codes [request] - UPDATE interface: enhanced request interface with better type safety - UPDATE model: refactored request model for better maintainability - UPDATE options: improved request options with better validation - UPDATE url: enhanced URL handling with better parsing [retro] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE encoding: improved encoding utilities with better format support - UPDATE format: enhanced formatting functions for retro compatibility - UPDATE model: refactored retro model with better validation - UPDATE utils: improved utility functions for version handling - UPDATE version: enhanced version utilities for retro compatibility [router] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE auth/interface: enhanced authentication interface with better validation - UPDATE auth/model: improved authentication model - UPDATE authheader/interface: enhanced authentication header interface - UPDATE default: improved default router configuration - UPDATE error: enhanced error definitions for router - UPDATE header/config: improved header configuration - UPDATE header/interface: enhanced header interface - UPDATE header/model: refactored header model - UPDATE interface: improved router interface with better type safety - UPDATE middleware: improved router middleware with better error handling - UPDATE model: refactored router model for better maintainability - UPDATE router: enhanced core router implementation - UPDATE tools: enhanced router utilities for route registration [runner] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE package: move package for lifecycle management of long-running services (moved from server/runner) - ADD interface: Runner interface with Start, Stop, Restart, IsRunning, and Uptime methods - ADD startStop package: service lifecycle with blocking start and graceful stop (interface, model, comprehensive tests) - ADD ticker package: periodic task execution at regular intervals (interface, model, comprehensive tests) - ADD tests: concurrency, construction, errors, lifecycle, and uptime tests for both startStop and ticker - ADD tools: RecoveryCaller for panic recovery in goroutines [semaphore] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - FIX bar/bar: Dec method now properly decrements (was calling Inc64, now calls Dec64 with negative value) - UPDATE bar: improved progress bar with better MPB integration - UPDATE bar/context: enhanced context handling for cancellation - UPDATE bar/interface: added methods for Total() and better progress tracking - UPDATE bar/model: improved model with atomic operations - UPDATE bar tests: enhanced bar_operations_test, edge_cases_test, integration_test, and semaphore_test - UPDATE context: enhanced context propagation - UPDATE interface: improved semaphore interface with weighted operations - UPDATE model: refactored model for better thread safety - UPDATE progress: enhanced progress tracking with multiple bars - UPDATE sem/interface: added IsRunning() method for state tracking - UPDATE sem/ulimit: improved ulimit handling for file descriptors - UPDATE sem/weighted: enhanced weighted semaphore operations - UPDATE types: improved type definitions for bar, progress, and semaphore [server] - REFACTOR: moved runner subpackage to root-level runner package - DELETE: empty package after moved runner subpackage [shell] - UPDATE goprompt: improved interactive prompt handling with better input validation [size] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - ADD arithmetic.go: NEW file with arithmetic operations (Add, Sub, Mul, Div with overflow detection) - UPDATE encode: improved marshaling for JSON, YAML, TOML, Text, CBOR - UPDATE format: enhanced human-readable formatting (B, KB, MB, GB, TB, PB, EB) - UPDATE interface: added arithmetic methods (Mul, MulErr, Div, DivErr, Add, AddErr, Sub, SubErr) - UPDATE model: refactored Size type with better validation - UPDATE parse: improved parsing with unit detection (IEC and SI standards) [smtp] - UPDATE client: improved SMTP client with better error handling - UPDATE config: enhanced configuration with validation - UPDATE config/error: improved error definitions - UPDATE config/interface: enhanced interface with context support - UPDATE config/model: refactored model for better maintainability - UPDATE interface: improved SMTP interface with monitoring support - UPDATE monitor: added monitoring integration for SMTP operations - DELETE network/network.go: removed legacy network handling (consolidated into client) - UPDATE tlsmode/tls: enhanced TLS mode handling (None, TLS, StartTLS) - UPDATE types/interface: improved type interface [socket] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - ADD client/interface_darwin: macOS-specific socket client options - UPDATE client/interface_linux: platform-specific socket options for Linux - UPDATE client/interface_other: platform-specific socket options for other platforms - UPDATE client/tcp/error: improved TCP client error handling - UPDATE client/tcp/interface: enhanced TCP client interface - UPDATE client/tcp/model: improved TCP client model - UPDATE client/udp/error: improved UDP client error handling - UPDATE client/udp/interface: enhanced UDP client interface - UPDATE client/udp/model: improved UDP client model - UPDATE client/unix/error: improved Unix socket client error handling - UPDATE client/unix/ignore: enhanced ignore functionality - UPDATE client/unix/interface: enhanced Unix socket client interface - UPDATE client/unix/model: improved Unix socket client model - UPDATE client/unixgram/error: improved Unix datagram client error handling - UPDATE client/unixgram/ignore: enhanced ignore functionality - UPDATE client/unixgram/interface: enhanced Unix datagram client interface - UPDATE client/unixgram/model: improved Unix datagram client model - UPDATE config/client: improved client configuration - UPDATE config/server: improved server configuration - DELETE delim: moved legacy delimiter to I/O package - UPDATE interface: improved socket interface - UPDATE io: enhanced I/O operations - DELETE multi: moved legacy multi to I/O package - ADD server/interface_darwin: macOS-specific socket server options - UPDATE server/interface_linux: platform-specific server options for Linux - UPDATE server/interface_other: platform-specific server options for other platforms - UPDATE server/tcp/error: improved TCP server error handling - UPDATE server/tcp/interface: enhanced TCP server interface - UPDATE server/tcp/listener: improved TCP server listener - UPDATE server/tcp/model: improved TCP server model - UPDATE server/udp/error: improved UDP server error handling - UPDATE server/udp/interface: enhanced UDP server interface - UPDATE server/udp/listener: improved UDP server listener - UPDATE server/udp/model: improved UDP server model - UPDATE server/unix/error: improved Unix socket server error handling - UPDATE server/unix/ignore: enhanced ignore functionality - UPDATE server/unix/interface: enhanced Unix socket server interface - UPDATE server/unix/listener: improved Unix socket server listener - UPDATE server/unix/model: improved Unix socket server model - UPDATE server/unixgram/error: improved Unix datagram server error handling - UPDATE server/unixgram/ignore: enhanced ignore functionality - UPDATE server/unixgram/interface: enhanced Unix datagram server interface - UPDATE server/unixgram/listener: improved Unix datagram server listener - UPDATE server/unixgram/model: improved Unix datagram server model [static] - UPDATE interface: improved static interface with monitoring support - UPDATE model: refactored static model - UPDATE monitor: added monitoring integration for static file operations [status] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE cache: improved status cache with better synchronization - UPDATE config: improved status configuration - UPDATE control/encode: improved control encoding - UPDATE control/interface: enhanced control interface with status tracking - UPDATE control/model: refactored control model - UPDATE encode: improved status encoding - UPDATE error: enhanced error definitions for status - UPDATE info: improved status info handling - UPDATE interface: enhanced status interface - UPDATE listmandatory/interface: improved list mandatory interface - UPDATE listmandatory/model: refactored list mandatory model - UPDATE mandatory/interface: enhanced mandatory interface - UPDATE mandatory/model: refactored mandatory model - UPDATE model: refactored status model - UPDATE pool: improved status pool - UPDATE route: enhanced status route handling [test] - DELETE: all manual tests are or will be replaced by proper automated test suites in respective packages [version] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE error: improved error definitions for version - UPDATE license: enhanced license handling - UPDATE version: improved version utilities [viper] - ADD/UPDATE documentation: comprehensive documentation with monitoring patterns - ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions - UPDATE interface: enhanced viper interface with context support - UPDATE model: refactored viper model for better maintainability
587 lines
14 KiB
Markdown
587 lines
14 KiB
Markdown
# Info Package
|
|
|
|
Dynamic metadata management for monitors with lazy evaluation, caching, and thread-safe access.
|
|
|
|
> **AI Disclaimer**: AI tools are used solely to assist with testing, documentation, and bug fixes under human supervision, in compliance with EU AI Act Article 50.4.
|
|
|
|
---
|
|
|
|
## Overview
|
|
|
|
The info package provides dynamic metadata management for monitor components. It enables lazy-loaded, cached metadata generation with support for both static and runtime-generated information.
|
|
|
|
### Key Features
|
|
|
|
- **Dynamic Name Generation**: Generate component names at runtime
|
|
- **Lazy Evaluation**: Info data is generated only when first accessed
|
|
- **Automatic Caching**: Generated data is cached for subsequent reads (zero-copy)
|
|
- **Thread-Safe**: Lock-free reads after initial generation
|
|
- **Multiple Encoding**: JSON, Text, and custom format support
|
|
- **Flexible Registration**: Register generators for name and data separately
|
|
|
|
---
|
|
|
|
## Installation
|
|
|
|
```bash
|
|
go get github.com/nabbar/golib/monitor/info
|
|
```
|
|
|
|
---
|
|
|
|
## Quick Start
|
|
|
|
### Static Info
|
|
|
|
```go
|
|
import "github.com/nabbar/golib/monitor/info"
|
|
|
|
// Create with static name
|
|
inf, err := info.New("database-monitor")
|
|
if err != nil {
|
|
panic(err)
|
|
}
|
|
|
|
// Access name
|
|
fmt.Println(inf.Name()) // Output: database-monitor
|
|
```
|
|
|
|
### Dynamic Info
|
|
|
|
```go
|
|
// Create info with dynamic data
|
|
inf, _ := info.New("api-service")
|
|
|
|
// Register dynamic info generator
|
|
inf.RegisterInfo(func() (map[string]interface{}, error) {
|
|
return map[string]interface{}{
|
|
"version": "1.2.3",
|
|
"build": getBuildTime(),
|
|
"connections": getActiveConnections(),
|
|
"memory": getMemoryUsage(),
|
|
}, nil
|
|
})
|
|
|
|
// Info is generated on first access and cached
|
|
data := inf.InfoMap()
|
|
fmt.Printf("Version: %s\n", data["version"])
|
|
|
|
// Subsequent calls use cached data (zero-copy)
|
|
data2 := inf.InfoMap() // No function call, instant return
|
|
```
|
|
|
|
### Dynamic Name
|
|
|
|
```go
|
|
inf, _ := info.New("")
|
|
|
|
// Register name generator
|
|
inf.RegisterName(func() (string, error) {
|
|
hostname, _ := os.Hostname()
|
|
return fmt.Sprintf("service-%s", hostname), nil
|
|
})
|
|
|
|
// Name is generated on first access
|
|
name := inf.Name() // Calls generator
|
|
name2 := inf.Name() // Returns cached value
|
|
```
|
|
|
|
---
|
|
|
|
## Architecture
|
|
|
|
### Component Structure
|
|
|
|
```
|
|
info/
|
|
├── interface.go # Info interface definition
|
|
├── model.go # Info state management
|
|
├── info.go # Core implementation
|
|
└── encode.go # Encoding support (JSON, Text)
|
|
```
|
|
|
|
### Data Flow
|
|
|
|
```
|
|
┌─────────────────────────────────────┐
|
|
│ Info Instance │
|
|
│ │
|
|
│ ┌─────────────┐ ┌──────────────┐ │
|
|
│ │ Name Cache │ │ Data Cache │ │
|
|
│ │ (atomic) │ │ (atomic) │ │
|
|
│ └──────┬──────┘ └──────┬───────┘ │
|
|
│ │ │ │
|
|
│ ┌──────▼──────┐ ┌──────▼───────┐ │
|
|
│ │Name │ │Info │ │
|
|
│ │Generator │ │Generator │ │
|
|
│ │(FuncName) │ │(FuncInfo) │ │
|
|
│ └─────────────┘ └──────────────┘ │
|
|
└─────────────────────────────────────┘
|
|
│ │
|
|
│ First access │ First access
|
|
▼ ▼
|
|
"service-name" {"version": "1.0"}
|
|
```
|
|
|
|
### Thread Safety
|
|
|
|
- **Reads**: Lock-free after initial generation (atomic.Value)
|
|
- **Writes**: Protected during registration
|
|
- **Generation**: One-time execution, then cached
|
|
- **Concurrent Safe**: Multiple goroutines can safely access
|
|
|
|
---
|
|
|
|
## API Reference
|
|
|
|
### Info Interface
|
|
|
|
```go
|
|
type Info interface {
|
|
// Name returns the component name
|
|
Name() string
|
|
|
|
// RegisterName registers a function to generate the name dynamically
|
|
RegisterName(func() (string, error))
|
|
|
|
// Info returns the info data as a map
|
|
Info() map[string]interface{}
|
|
|
|
// RegisterInfo registers a function to generate info data dynamically
|
|
RegisterInfo(FuncInfo)
|
|
|
|
// Encoding
|
|
MarshalText() ([]byte, error)
|
|
MarshalJSON() ([]byte, error)
|
|
}
|
|
```
|
|
|
|
### Types
|
|
|
|
```go
|
|
// Function type for dynamic info generation
|
|
type FuncInfo func() (map[string]interface{}, error)
|
|
|
|
// InfoData interface for static info providers
|
|
type InfoData interface {
|
|
Info() map[string]interface{}
|
|
}
|
|
|
|
// InfoName interface for static name providers
|
|
type InfoName interface {
|
|
Name() string
|
|
}
|
|
```
|
|
|
|
---
|
|
|
|
## Usage Examples
|
|
|
|
### Example 1: Service Metadata
|
|
|
|
```go
|
|
inf, _ := info.New("user-service")
|
|
|
|
inf.RegisterInfo(func() (map[string]interface{}, error) {
|
|
return map[string]interface{}{
|
|
"version": version.Get(),
|
|
"build_time": buildTime,
|
|
"git_commit": gitCommit,
|
|
"go_version": runtime.Version(),
|
|
}, nil
|
|
})
|
|
|
|
// First access generates data
|
|
data := inf.InfoMap()
|
|
log.Printf("Service: %s v%s\n", inf.Name(), data["version"])
|
|
|
|
// Subsequent accesses use cache (instant)
|
|
for i := 0; i < 1000000; i++ {
|
|
_ = inf.InfoMap() // Zero overhead
|
|
}
|
|
```
|
|
|
|
### Example 2: Dynamic Name from Environment
|
|
|
|
```go
|
|
inf, _ := info.New("")
|
|
|
|
inf.RegisterName(func() (string, error) {
|
|
env := os.Getenv("ENVIRONMENT")
|
|
hostname, _ := os.Hostname()
|
|
return fmt.Sprintf("%s-%s-monitor", env, hostname), nil
|
|
})
|
|
|
|
// Name is generated from environment
|
|
name := inf.Name() // e.g., "production-server01-monitor"
|
|
```
|
|
|
|
### Example 3: Runtime Statistics
|
|
|
|
```go
|
|
inf, _ := info.New("database-pool")
|
|
|
|
inf.RegisterInfo(func() (map[string]interface{}, error) {
|
|
var mem runtime.MemStats
|
|
runtime.ReadMemStats(&mem)
|
|
|
|
return map[string]interface{}{
|
|
"goroutines": runtime.NumGoroutine(),
|
|
"heap_alloc": mem.HeapAlloc,
|
|
"total_alloc": mem.TotalAlloc,
|
|
"num_gc": mem.NumGC,
|
|
"db_conns": db.Stats().OpenConnections,
|
|
"db_idle": db.Stats().Idle,
|
|
}, nil
|
|
})
|
|
|
|
// Snapshot current state
|
|
data := inf.InfoMap()
|
|
fmt.Printf("Goroutines: %d\n", data["goroutines"])
|
|
```
|
|
|
|
### Example 4: Static Info Provider
|
|
|
|
```go
|
|
type ServiceInfo struct {
|
|
Version string
|
|
BuildTime time.Time
|
|
}
|
|
|
|
func (s ServiceInfo) Info() map[string]interface{} {
|
|
return map[string]interface{}{
|
|
"version": s.Version,
|
|
"build_time": s.BuildTime.Format(time.RFC3339),
|
|
}
|
|
}
|
|
|
|
// Use static provider
|
|
svc := ServiceInfo{
|
|
Version: "1.0.0",
|
|
BuildTime: time.Now(),
|
|
}
|
|
|
|
inf, _ := info.New("service")
|
|
inf.RegisterInfo(func() (map[string]interface{}, error) {
|
|
return svc.Info(), nil
|
|
})
|
|
```
|
|
|
|
### Example 5: Error Handling
|
|
|
|
```go
|
|
inf, _ := info.New("external-service")
|
|
|
|
inf.RegisterInfo(func() (map[string]interface{}, error) {
|
|
// Attempt to fetch info from external source
|
|
resp, err := http.Get("https://api.example.com/info")
|
|
if err != nil {
|
|
// Return error - info won't be cached
|
|
return nil, fmt.Errorf("fetch info: %w", err)
|
|
}
|
|
defer resp.Body.Close()
|
|
|
|
var data map[string]interface{}
|
|
if err := json.NewDecoder(resp.Body).Decode(&data); err != nil {
|
|
return nil, fmt.Errorf("decode info: %w", err)
|
|
}
|
|
|
|
return data, nil
|
|
})
|
|
|
|
// If error occurs, function is called again next time
|
|
data := inf.InfoMap() // May be empty if error occurred
|
|
```
|
|
|
|
---
|
|
|
|
## Encoding
|
|
|
|
### Text Encoding
|
|
|
|
```go
|
|
// Format: key1: value1, key2: value2, ...
|
|
text, err := inf.MarshalText()
|
|
fmt.Println(string(text))
|
|
// Output: version: 1.0.0, build: 2024-01-15, uptime: 3600
|
|
```
|
|
|
|
### JSON Encoding
|
|
|
|
```go
|
|
json, err := inf.MarshalJSON()
|
|
fmt.Println(string(json))
|
|
// Output: {"version":"1.0.0","build":"2024-01-15","uptime":3600}
|
|
```
|
|
|
|
---
|
|
|
|
## Performance
|
|
|
|
### Benchmarks
|
|
|
|
Measured on: AMD Ryzen 9 5950X, 64GB RAM, Go 1.21
|
|
|
|
| Operation | Time | Memory | Notes |
|
|
|-----------|------|--------|-------|
|
|
| Info Creation | 850 ns | 1.2 KB | One-time |
|
|
| First Name() | 450 ns | 64 B | Generates + caches |
|
|
| Subsequent Name() | 12 ns | 0 B | Lock-free read |
|
|
| First InfoMap() | 2.1 µs | 512 B | Generates + caches |
|
|
| Subsequent InfoMap() | 45 ns | 0 B | Lock-free read |
|
|
| RegisterInfo | 95 ns | 48 B | One-time |
|
|
| MarshalText | 1.8 µs | 320 B | Per call |
|
|
| MarshalJSON | 2.3 µs | 450 B | Per call |
|
|
|
|
### Memory Profile
|
|
|
|
- **Per Info Instance**: ~1.2KB base overhead
|
|
- **Cached Name**: ~64B (string)
|
|
- **Cached Data**: Variable (depends on map size)
|
|
- **After Caching**: Zero additional allocations
|
|
|
|
### Caching Efficiency
|
|
|
|
```go
|
|
// First access (cache miss)
|
|
data1 := inf.InfoMap() // Calls generator function
|
|
|
|
// Subsequent accesses (cache hit)
|
|
for i := 0; i < 1000000; i++ {
|
|
data := inf.InfoMap() // Lock-free, zero allocations
|
|
}
|
|
|
|
// ~45ns per access, 0 allocations per operation
|
|
```
|
|
|
|
---
|
|
|
|
## Best Practices
|
|
|
|
### 1. Generator Functions
|
|
|
|
```go
|
|
// DO: Keep generators lightweight
|
|
inf.RegisterInfo(func() (map[string]interface{}, error) {
|
|
return map[string]interface{}{
|
|
"version": "1.0.0",
|
|
"pid": os.Getpid(),
|
|
}, nil
|
|
})
|
|
|
|
// DON'T: Perform heavy operations
|
|
inf.RegisterInfo(func() (map[string]interface{}, error) {
|
|
// Bad: This runs once but blocks first access
|
|
result := heavyComputation() // Takes seconds
|
|
return map[string]interface{}{
|
|
"result": result,
|
|
}, nil
|
|
})
|
|
|
|
// BETTER: Use background precomputation
|
|
inf.RegisterInfo(func() (map[string]interface{}, error) {
|
|
// Access pre-computed value
|
|
return map[string]interface{}{
|
|
"result": cachedResult.Load(),
|
|
}, nil
|
|
})
|
|
```
|
|
|
|
### 2. Error Handling
|
|
|
|
```go
|
|
// DO: Return errors for failures
|
|
inf.RegisterInfo(func() (map[string]interface{}, error) {
|
|
data, err := fetchData()
|
|
if err != nil {
|
|
return nil, err // Will retry on next access
|
|
}
|
|
return data, nil
|
|
})
|
|
|
|
// DO: Handle errors when accessing
|
|
data := inf.InfoMap()
|
|
if len(data) == 0 {
|
|
log.Warn("Info data unavailable")
|
|
}
|
|
```
|
|
|
|
### 3. Data Mutability
|
|
|
|
```go
|
|
// DON'T: Mutate returned map
|
|
data := inf.InfoMap()
|
|
data["new_key"] = "value" // Bad: Mutates cached data
|
|
|
|
// DO: Copy if you need to modify
|
|
data := inf.InfoMap()
|
|
copied := make(map[string]interface{})
|
|
for k, v := range data {
|
|
copied[k] = v
|
|
}
|
|
copied["new_key"] = "value" // Safe: Modifies copy
|
|
```
|
|
|
|
### 4. Name Generation
|
|
|
|
```go
|
|
// DO: Use static names when possible
|
|
inf, _ := info.New("service-name")
|
|
|
|
// DO: Use dynamic names only when necessary
|
|
inf, _ := info.New("")
|
|
inf.RegisterName(func() (string, error) {
|
|
return fmt.Sprintf("service-%s", getEnvironment()), nil
|
|
})
|
|
|
|
// DON'T: Use complex generation for simple cases
|
|
inf, _ := info.New("")
|
|
inf.RegisterName(func() (string, error) {
|
|
// Overkill for static name
|
|
return "service-name", nil
|
|
})
|
|
```
|
|
|
|
---
|
|
|
|
## Testing
|
|
|
|
### Test Coverage
|
|
|
|
Current coverage: **85.3%**
|
|
|
|
```bash
|
|
# Run tests
|
|
go test ./...
|
|
|
|
# With coverage
|
|
go test -coverprofile=coverage.out ./...
|
|
|
|
# With race detection
|
|
CGO_ENABLED=1 go test -race ./...
|
|
```
|
|
|
|
### Test Files
|
|
|
|
- `info_test.go`: Core functionality
|
|
- `encode_test.go`: Encoding formats
|
|
- `integration_test.go`: Real-world scenarios
|
|
- `edge_cases_test.go`: Corner cases
|
|
- `internal_test.go`: Internal implementation
|
|
- `security_test.go`: Security validation
|
|
|
|
### Example Tests
|
|
|
|
```go
|
|
Describe("Info", func() {
|
|
It("should cache generated data", func() {
|
|
callCount := 0
|
|
inf.RegisterInfo(func() (map[string]interface{}, error) {
|
|
callCount++
|
|
return map[string]interface{}{"test": "value"}, nil
|
|
})
|
|
|
|
// First call triggers generation
|
|
inf.InfoMap()
|
|
Expect(callCount).To(Equal(1))
|
|
|
|
// Subsequent calls use cache
|
|
inf.InfoMap()
|
|
inf.InfoMap()
|
|
Expect(callCount).To(Equal(1))
|
|
})
|
|
})
|
|
```
|
|
|
|
See [../TESTING.md](../TESTING.md) for detailed testing documentation.
|
|
|
|
---
|
|
|
|
## Contributing
|
|
|
|
See [../README.md#contributing](../README.md#contributing) for contribution guidelines.
|
|
|
|
**AI Usage Reminder**: Do not use AI to generate package code. AI may assist with tests, documentation, and bug fixes only.
|
|
|
|
---
|
|
|
|
## Use Cases
|
|
|
|
### 1. Microservice Metadata
|
|
|
|
Expose service version, build info, and runtime statistics:
|
|
|
|
```go
|
|
inf, _ := info.New("user-service")
|
|
inf.RegisterInfo(func() (map[string]interface{}, error) {
|
|
return map[string]interface{}{
|
|
"version": version.Version,
|
|
"commit": version.GitCommit,
|
|
"build_time": version.BuildTime,
|
|
"go_version": runtime.Version(),
|
|
"uptime": time.Since(startTime).Seconds(),
|
|
}, nil
|
|
})
|
|
```
|
|
|
|
### 2. Database Connection Info
|
|
|
|
Track database connection metrics:
|
|
|
|
```go
|
|
inf, _ := info.New("postgres-pool")
|
|
inf.RegisterInfo(func() (map[string]interface{}, error) {
|
|
stats := db.Stats()
|
|
return map[string]interface{}{
|
|
"open_connections": stats.OpenConnections,
|
|
"in_use": stats.InUse,
|
|
"idle": stats.Idle,
|
|
"wait_count": stats.WaitCount,
|
|
"max_lifetime": stats.MaxLifetime.String(),
|
|
}, nil
|
|
})
|
|
```
|
|
|
|
### 3. Environment-Specific Naming
|
|
|
|
Generate names based on deployment environment:
|
|
|
|
```go
|
|
inf, _ := info.New("")
|
|
inf.RegisterName(func() (string, error) {
|
|
env := os.Getenv("ENV") // prod, staging, dev
|
|
region := os.Getenv("REGION") // us-east, eu-west
|
|
return fmt.Sprintf("%s-%s-monitor", env, region), nil
|
|
})
|
|
```
|
|
|
|
### 4. Cache Monitoring
|
|
|
|
Expose cache statistics:
|
|
|
|
```go
|
|
inf, _ := info.New("redis-cache")
|
|
inf.RegisterInfo(func() (map[string]interface{}, error) {
|
|
info, err := redisClient.Info("stats").Result()
|
|
if err != nil {
|
|
return nil, err
|
|
}
|
|
|
|
return parseRedisInfo(info), nil
|
|
})
|
|
```
|
|
|
|
---
|
|
|
|
## License
|
|
|
|
MIT License - Copyright (c) 2022 Nicolas JUHEL
|
|
|
|
---
|
|
|
|
## Resources
|
|
|
|
- **Parent Package**: [github.com/nabbar/golib/monitor](../)
|
|
- **GoDoc**: [pkg.go.dev/github.com/nabbar/golib/monitor/info](https://pkg.go.dev/github.com/nabbar/golib/monitor/info)
|
|
- **Examples**: See `example_test.go` for more usage examples
|