Files
golib/socket/server/README.md
nabbar 942068222c 2025-11 Improvement, Tests, Documentations, Bug Fix, Optimization
Global Repos / Workflow
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- UPDATE workflow: split old workflow into multiple files
- UPDATE .gitignore: added cluster.old.tar.gz and build artifacts
- UPDATE .golangci.yml: enhanced linter rules and disabled deprecated linters

[archive]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- FIX extract: recursive decompression for nested archives (e.g., .tar.gz handling)
- FIX extract: ZIP archive support now properly uses ReaderAt interface with seek reset
- ADD extract: proper symlink and hard link handling in archives
- UPDATE tar/writer: improved error handling and file mode preservation
- UPDATE zip/writer: enhanced validation and error messages
- UPDATE compress/interface: added support for additional compression formats
- UPDATE helper/compressor: fixed typo in error handling

[artifact]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE artifact: improved error handling and context management
- UPDATE client/interface: enhanced API with better type safety and context propagation
- UPDATE client/model: refactored for better maintainability
- UPDATE github: removed unused error codes, improved model validation
- UPDATE gitlab: enhanced API pagination and error handling
- UPDATE jfrog: improved artifactory API compatibility
- UPDATE s3aws: enhanced S3 bucket operations and error messages

[atomic]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE cast: improved type conversion with better error handling
- UPDATE interface: enhanced atomic operations with generics support
- UPDATE synmap: fixed race conditions in concurrent access patterns
- UPDATE value: improved atomic value operations with better memory ordering

[aws]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE bucket: enhanced ACL and CORS configuration with validation
- UPDATE configAws/models: improved credential handling and region configuration
- UPDATE configCustom/interface: added support for custom endpoints
- UPDATE http/request: improved retry logic and timeout handling
- UPDATE interface: enhanced AWS client with context propagation
- UPDATE model: refactored for AWS SDK v2 compatibility
- UPDATE multipart/interface: improved chunk handling for large uploads
- UPDATE pusher: optimized hash calculation and upload progress tracking
- UPDATE resolver: enhanced endpoint resolution with custom DNS
- DELETE test files: removed bucket_test.go, group_test.go, object_test.go, policy_test.go, role_test.go, user_test.go

[cache]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- ADD context: context-aware cache lifecycle management
- UPDATE interface: complete rewrite with Go generics for type-safe key-value operations
- ADD item package: generic cache item with expiration tracking (interface and model)
- UPDATE model: refactored to use generics (Cache[K comparable, V any])
- REFACTOR: split item.go into modelAny.go for better code organization

[certificates]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE auth/encode: improved PEM encoding with better error messages
- UPDATE auth/interface: enhanced authentication certificate handling
- UPDATE ca: improved CA certificate generation and validation
- UPDATE certs: enhanced certificate configuration with SAN support
- UPDATE cipher: improved cipher suite selection and validation
- UPDATE curves: enhanced elliptic curve handling with additional curves
- ADD deprecated.go: marked deprecated TLS versions and cipher suites
- UPDATE interface: enhanced certificate interface with context support
- UPDATE model: improved certificate model with better validation
- UPDATE rootca: enhanced root CA pool management
- UPDATE tlsversion: added TLS 1.3 support with proper validation
- UPDATE tools: improved certificate utility functions

[cobra]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE completion: improved shell completion generation (bash, zsh, fish, powershell)
- UPDATE configure: enhanced configuration file handling
- UPDATE printError: improved error formatting with color support
- UPDATE interface: enhanced cobra interface with context support
- UPDATE model: improved cobra model with better validation

[config]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE components: improved component lifecycle management
- UPDATE const/const: improved constant definitions
- UPDATE context: enhanced context handling with better propagation
- UPDATE errors: improved error definitions
- UPDATE events: enhanced event management
- UPDATE manage: improved configuration management with validation
- UPDATE model: refactored config model
- UPDATE shell: enhanced shell integration for interactive configuration
- UPDATE types: improved component and componentList types

[console]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- ADD buff.go: BuffPrintf function for colored output to io.Writer (moved from ioutils/multiplexer)
- DELETE color.go: removed legacy color file (consolidated functionality)
- UPDATE error: improved error definitions with better messages
- ADD interface: console interface for abstraction
- ADD model: console model for state management
- UPDATE padding: enhanced string padding with Unicode support
- UPDATE prompt: improved interactive prompt handling

[context]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- DELETE config.go: removed deprecated configuration (replaced by Config[T] interface)
- UPDATE context: improved context handling with better cancellation support
- UPDATE gin/interface: enhanced Gin context integration with type safety
- ADD helper: context helper functions for common operations
- ADD interface: generic Config[T comparable] interface for type-safe context storage
- ADD map: MapManage[T] interface for concurrent-safe map operations
- ADD model: thread-safe context model implementation with sync.Map

[database]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE gorm/config: improved database configuration
- UPDATE gorm/driver: enhanced database driver with better connection pooling
- UPDATE gorm/driver_darwin: macOS-specific database optimizations
- UPDATE gorm/interface: improved GORM interface with context support
- UPDATE gorm/model: refactored model for better maintainability
- UPDATE gorm/monitor: enhanced monitoring for database connections
- UPDATE kvtypes: improved types for key-value store (compare, driver, item, table)

[duration]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE big: enhanced big.Duration for large time spans with arithmetic operations
- UPDATE encode: improved marshaling for JSON, YAML, TOML, Text, CBOR
- UPDATE format: enhanced human-readable formatting (ns, μs, ms, s, m, h, d, w)
- UPDATE interface: improved duration interface with arithmetic methods
- UPDATE model: refactored Duration type
- UPDATE operation: enhanced arithmetic operations (Add, Sub, Mul, Div)
- UPDATE parse: improved parsing with multiple format support
- UPDATE truncate: enhanced truncation for rounding durations

[encoding]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE aes: improved AES encryption with reader/writer interfaces
- UPDATE hexa: enhanced hexadecimal encoding with better error handling
- UPDATE mux: improved multiplexer/demultiplexer for stream handling
- UPDATE randRead: enhanced random data generation
- UPDATE sha256 package: SHA-256 hashing with reader/writer interfaces

[errors]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- ADD pool package: thread-safe error pool for collecting multiple errors with concurrent access
- UPDATE code: improved error code definition and lookup
- UPDATE errors: enhanced error creation with better stack trace
- UPDATE interface: improved error interface with more methods
- UPDATE mode: enhanced error mode handling (production vs development)
- UPDATE return: improved error return handling with context
- UPDATE trace: enhanced error tracing with file and line information

[file]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE bandwidth: improved bandwidth tracking with concurrency tests
- UPDATE perm: enhanced file permission handling with Unix/Windows support
- UPDATE perm/encode: improved marshaling for JSON, YAML, TOML
- UPDATE perm/format: enhanced permission formatting (e.g., "rwxr-xr-x")
- UPDATE perm/parse: improved parsing of permission strings and octal values
- UPDATE progress: enhanced progress tracking for file I/O operations
- UPDATE progress/io*: improved reader, writer, seeker, closer interfaces with progress callbacks

[ftpclient]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE config: improved FTP configuration with TLS support
- UPDATE errors: enhanced error definitions
- UPDATE interface: improved FTP client interface
- UPDATE model: refactored FTP client model

[httpcli]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE cli: improved HTTP client with retry logic and timeout handling
- UPDATE dns-mapper: enhanced DNS mapping for custom resolution
- UPDATE dns-mapper/config: improved DNS mapper configuration
- UPDATE dns-mapper/errors: enhanced error handling
- UPDATE dns-mapper/interface: improved DNS mapper interface
- UPDATE dns-mapper/transport: enhanced HTTP transport with DNS override
- UPDATE errors: improved error definitions
- UPDATE options: enhanced client options with context support

[httpserver]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE config: improved server configuration with TLS and middleware support
- UPDATE handler: enhanced request handler with better error handling
- UPDATE interface: improved server interface with context support and monitoring integration
- UPDATE model: refactored server model with better validation
- UPDATE monitor: enhanced monitoring integration with status tracking
- UPDATE pool: improved server pool management (config, interface, list, model)
- UPDATE run: enhanced server runtime with graceful shutdown
- UPDATE server: improved core server implementation with better lifecycle
- ADD testhelpers/certs.go: certificate generation utilities for testing
- UPDATE types: improved const, fields, and handler types

[ioutils]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE bufferReadCloser: improved buffered reader/writer with closer
- UPDATE fileDescriptor: enhanced file descriptor limit management (platform-specific for Linux/macOS/Windows)
- UPDATE ioprogress: improved progress tracking for I/O operations
- UPDATE iowrapper: enhanced I/O wrapper with custom interfaces
- UPDATE mapCloser: improved map of closers for resource management
- UPDATE maxstdio: enhanced C implementation for max stdio file descriptor retrieval
- DELETE multiplexer/model.go: removed legacy multiplexer (functionality moved to console/buff.go and retro/)
- UPDATE nopwritecloser: improved no-op write closer
- UPDATE tools: enhanced I/O utility functions

[ldap]
- UPDATE ldap: improved LDAP client with better connection handling and search operations

[logger]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE config: improved default values, file options, and syslog configuration
- UPDATE entry/interface: enhanced log entry with context support
- UPDATE fields: improved field handling with JSON cloning
- UPDATE gorm/interface: enhanced GORM logger with trace ID support
- UPDATE hashicorp/interface: improved HashiCorp logger integration
- FIX hookfile/system: use os.OpenRoot for secure file operations (prevents path traversal)
- FIX hookfile/system: fixed import path from libsrv "golib/server" to "golib/runner"
- ADD hookfile: IsRunning() method to track file hook state
- UPDATE hookstderr/interface: enhanced stderr hook with better buffering
- UPDATE hookstdout/interface: enhanced stdout hook with better buffering
- UPDATE hooksyslog: improved syslog integration with channel and priority handling
- ADD hookwriter package: generic io.Writer hook for custom output destinations
- UPDATE interface: enhanced logger interface with context propagation
- UPDATE level: improved log level handling and comparison
- UPDATE log: enhanced logging with better formatting
- UPDATE manage: improved logger lifecycle management
- UPDATE model: refactored logger model for better maintainability

[mail]
- UPDATE sender: improved mail sender with better MIME handling
- UPDATE interface: enhanced interface with monitoring support
- UPDATE monitor: added monitoring integration for mail operations

[monitor]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- ADD status package: new subpackage for status management with Status type (KO, Warn, OK)
- ADD status/encode: marshaling support for JSON, YAML, TOML, Text, CBOR
- ADD status/format: human-readable status formatting
- ADD status/interface: Status type with Parse and String methods
- UPDATE encode: improved encoding with better error handling
- UPDATE error: enhanced error definitions
- UPDATE info: improved system info collection (CPU, mem, disk, network)
- UPDATE interface: enhanced monitor interface with status support and better component integration
- UPDATE metrics: improved metrics collection and export
- UPDATE middleware: enhanced monitoring middleware for HTTP
- UPDATE pool/interface: enhanced pool interface with better monitoring integration
- UPDATE pool/metrics: improved metrics collection in pool
- UPDATE pool/model: refactored pool model for better maintainability
- UPDATE pool/pool: enhanced pool implementation with better lifecycle
- UPDATE server: enhanced server monitoring with status tracking
- UPDATE types/monitor: improved monitor type definitions

[nats]
- UPDATE client: improved NATS client with better subscription handling
- UPDATE config: enhanced NATS configuration with cluster support
- UPDATE monitor: added monitoring integration for NATS operations
- UPDATE server: improved NATS server integration with monitoring

[network]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE bytes: improved byte size handling for network operations
- UPDATE number: enhanced number utilities for network data
- UPDATE protocol/encode: improved protocol encoding
- ADD protocol/format: protocol formatting utilities
- UPDATE protocol/interface: enhanced protocol interface
- UPDATE protocol/model: refactored protocol model

[password]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE password: improved password utilities with strength validation and secure generation

[pidcontroller]
- UPDATE interface: improved PID controller interface
- UPDATE model: enhanced PID controller model with better tuning parameters

[pprof]
- UPDATE tools: improved pprof utilities for profiling integration

[prometheus]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE bloom/bloom: improved bloom filter with better concurrency handling
- UPDATE bloom/collection: enhanced bloom filter collection operations
- UPDATE interface: enhanced prometheus interface with better type safety
- UPDATE metrics/interface: enhanced metrics interface with better registration
- UPDATE metrics/model: refactored metrics model for better maintainability
- UPDATE model: refactored prometheus model with better validation
- UPDATE pool: enhanced metric pool with concurrent access
- UPDATE pool/interface: enhanced pool interface
- UPDATE pool/model: refactored pool model
- UPDATE route: improved routing for metric endpoints
- UPDATE types: enhanced type definitions for metrics
- UPDATE webmetrics: improved existing metrics (requestBody, requestIPTotal, requestLatency, requestSlow, requestTotal, requestURITotal, responseBody)
- ADD webmetrics/activeConnections: gauge for tracking concurrent HTTP connections
- ADD webmetrics/requestErrors: counter for HTTP request errors
- ADD webmetrics/responseSizeByEndpoint: histogram for response size distribution by endpoint
- ADD webmetrics/statusCodeTotal: counter for HTTP status codes

[request]
- UPDATE interface: enhanced request interface with better type safety
- UPDATE model: refactored request model for better maintainability
- UPDATE options: improved request options with better validation
- UPDATE url: enhanced URL handling with better parsing

[retro]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE encoding: improved encoding utilities with better format support
- UPDATE format: enhanced formatting functions for retro compatibility
- UPDATE model: refactored retro model with better validation
- UPDATE utils: improved utility functions for version handling
- UPDATE version: enhanced version utilities for retro compatibility

[router]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE auth/interface: enhanced authentication interface with better validation
- UPDATE auth/model: improved authentication model
- UPDATE authheader/interface: enhanced authentication header interface
- UPDATE default: improved default router configuration
- UPDATE error: enhanced error definitions for router
- UPDATE header/config: improved header configuration
- UPDATE header/interface: enhanced header interface
- UPDATE header/model: refactored header model
- UPDATE interface: improved router interface with better type safety
- UPDATE middleware: improved router middleware with better error handling
- UPDATE model: refactored router model for better maintainability
- UPDATE router: enhanced core router implementation
- UPDATE tools: enhanced router utilities for route registration

[runner]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE package: move package for lifecycle management of long-running services (moved from server/runner)
- ADD interface: Runner interface with Start, Stop, Restart, IsRunning, and Uptime methods
- ADD startStop package: service lifecycle with blocking start and graceful stop (interface, model, comprehensive tests)
- ADD ticker package: periodic task execution at regular intervals (interface, model, comprehensive tests)
- ADD tests: concurrency, construction, errors, lifecycle, and uptime tests for both startStop and ticker
- ADD tools: RecoveryCaller for panic recovery in goroutines

[semaphore]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- FIX bar/bar: Dec method now properly decrements (was calling Inc64, now calls Dec64 with negative value)
- UPDATE bar: improved progress bar with better MPB integration
- UPDATE bar/context: enhanced context handling for cancellation
- UPDATE bar/interface: added methods for Total() and better progress tracking
- UPDATE bar/model: improved model with atomic operations
- UPDATE bar tests: enhanced bar_operations_test, edge_cases_test, integration_test, and semaphore_test
- UPDATE context: enhanced context propagation
- UPDATE interface: improved semaphore interface with weighted operations
- UPDATE model: refactored model for better thread safety
- UPDATE progress: enhanced progress tracking with multiple bars
- UPDATE sem/interface: added IsRunning() method for state tracking
- UPDATE sem/ulimit: improved ulimit handling for file descriptors
- UPDATE sem/weighted: enhanced weighted semaphore operations
- UPDATE types: improved type definitions for bar, progress, and semaphore

[server]
- REFACTOR: moved runner subpackage to root-level runner package
- DELETE: empty package after moved runner subpackage

[shell]
- UPDATE goprompt: improved interactive prompt handling with better input validation

[size]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- ADD arithmetic.go: NEW file with arithmetic operations (Add, Sub, Mul, Div with overflow detection)
- UPDATE encode: improved marshaling for JSON, YAML, TOML, Text, CBOR
- UPDATE format: enhanced human-readable formatting (B, KB, MB, GB, TB, PB, EB)
- UPDATE interface: added arithmetic methods (Mul, MulErr, Div, DivErr, Add, AddErr, Sub, SubErr)
- UPDATE model: refactored Size type with better validation
- UPDATE parse: improved parsing with unit detection (IEC and SI standards)

[smtp]
- UPDATE client: improved SMTP client with better error handling
- UPDATE config: enhanced configuration with validation
- UPDATE config/error: improved error definitions
- UPDATE config/interface: enhanced interface with context support
- UPDATE config/model: refactored model for better maintainability
- UPDATE interface: improved SMTP interface with monitoring support
- UPDATE monitor: added monitoring integration for SMTP operations
- DELETE network/network.go: removed legacy network handling (consolidated into client)
- UPDATE tlsmode/tls: enhanced TLS mode handling (None, TLS, StartTLS)
- UPDATE types/interface: improved type interface

[socket]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- ADD client/interface_darwin: macOS-specific socket client options
- UPDATE client/interface_linux: platform-specific socket options for Linux
- UPDATE client/interface_other: platform-specific socket options for other platforms
- UPDATE client/tcp/error: improved TCP client error handling
- UPDATE client/tcp/interface: enhanced TCP client interface
- UPDATE client/tcp/model: improved TCP client model
- UPDATE client/udp/error: improved UDP client error handling
- UPDATE client/udp/interface: enhanced UDP client interface
- UPDATE client/udp/model: improved UDP client model
- UPDATE client/unix/error: improved Unix socket client error handling
- UPDATE client/unix/ignore: enhanced ignore functionality
- UPDATE client/unix/interface: enhanced Unix socket client interface
- UPDATE client/unix/model: improved Unix socket client model
- UPDATE client/unixgram/error: improved Unix datagram client error handling
- UPDATE client/unixgram/ignore: enhanced ignore functionality
- UPDATE client/unixgram/interface: enhanced Unix datagram client interface
- UPDATE client/unixgram/model: improved Unix datagram client model
- UPDATE config/client: improved client configuration
- UPDATE config/server: improved server configuration
- DELETE delim: moved legacy delimiter to I/O package
- UPDATE interface: improved socket interface
- UPDATE io: enhanced I/O operations
- DELETE multi: moved legacy multi to I/O package
- ADD server/interface_darwin: macOS-specific socket server options
- UPDATE server/interface_linux: platform-specific server options for Linux
- UPDATE server/interface_other: platform-specific server options for other platforms
- UPDATE server/tcp/error: improved TCP server error handling
- UPDATE server/tcp/interface: enhanced TCP server interface
- UPDATE server/tcp/listener: improved TCP server listener
- UPDATE server/tcp/model: improved TCP server model
- UPDATE server/udp/error: improved UDP server error handling
- UPDATE server/udp/interface: enhanced UDP server interface
- UPDATE server/udp/listener: improved UDP server listener
- UPDATE server/udp/model: improved UDP server model
- UPDATE server/unix/error: improved Unix socket server error handling
- UPDATE server/unix/ignore: enhanced ignore functionality
- UPDATE server/unix/interface: enhanced Unix socket server interface
- UPDATE server/unix/listener: improved Unix socket server listener
- UPDATE server/unix/model: improved Unix socket server model
- UPDATE server/unixgram/error: improved Unix datagram server error handling
- UPDATE server/unixgram/ignore: enhanced ignore functionality
- UPDATE server/unixgram/interface: enhanced Unix datagram server interface
- UPDATE server/unixgram/listener: improved Unix datagram server listener
- UPDATE server/unixgram/model: improved Unix datagram server model

[static]
- UPDATE interface: improved static interface with monitoring support
- UPDATE model: refactored static model
- UPDATE monitor: added monitoring integration for static file operations

[status]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE cache: improved status cache with better synchronization
- UPDATE config: improved status configuration
- UPDATE control/encode: improved control encoding
- UPDATE control/interface: enhanced control interface with status tracking
- UPDATE control/model: refactored control model
- UPDATE encode: improved status encoding
- UPDATE error: enhanced error definitions for status
- UPDATE info: improved status info handling
- UPDATE interface: enhanced status interface
- UPDATE listmandatory/interface: improved list mandatory interface
- UPDATE listmandatory/model: refactored list mandatory model
- UPDATE mandatory/interface: enhanced mandatory interface
- UPDATE mandatory/model: refactored mandatory model
- UPDATE model: refactored status model
- UPDATE pool: improved status pool
- UPDATE route: enhanced status route handling

[test]
- DELETE: all manual tests are or will be replaced by proper automated test suites in respective packages

[version]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE error: improved error definitions for version
- UPDATE license: enhanced license handling
- UPDATE version: improved version utilities

[viper]
- ADD/UPDATE documentation: comprehensive documentation with monitoring patterns
- ADD/UPDATE tests: enhanced benchmark, config, encoding, example, integration, lifecycle, metrics, security, transitions
- UPDATE interface: enhanced viper interface with context support
- UPDATE model: refactored viper model for better maintainability
2025-11-15 21:09:32 +01:00

22 KiB

Socket Server Package

License: MIT Go Version

High-performance, protocol-agnostic socket server library for Go with unified interface across TCP, UDP, and Unix domain sockets, featuring thread-safe operations, graceful shutdown, and comprehensive connection management.


Table of Contents


Overview

This library provides production-ready socket server implementations for Go applications. It emphasizes connection management, thread safety, and protocol independence while supporting multiple transport mechanisms (TCP, UDP, Unix domain sockets in both stream and datagram modes).

Design Philosophy

  1. Protocol Agnostic: Unified socket.Server interface across all transport protocols
  2. Connection Management: Automatic lifecycle handling with per-connection goroutines
  3. Thread-Safe: Atomic operations (atomic.Bool, atomic.Int64) for concurrent access
  4. Context-Aware: Graceful shutdown with connection draining via context.Context
  5. Event-Driven: Callback system for monitoring, instrumentation, and error handling

Key Features

  • Multiple Protocols:
    • TCP: Connection-oriented, reliable, ordered delivery
    • UDP: Connectionless, fast, datagram-based
    • Unix: IPC via filesystem sockets (stream mode)
    • Unixgram: IPC via filesystem sockets (datagram mode)
  • Thread-Safe Operations: Atomic operations (atomic.Bool, atomic.Int64), mutex protection
  • Connection Management: Per-client goroutines, connection tracking, lifecycle callbacks
  • Graceful Shutdown: Context-aware with connection draining
  • TLS Support: Built-in for TCP (optional)
  • File Permissions: Unix sockets with configurable permissions and group ownership
  • Half-Close Support: Unix sockets with independent read/write shutdown
  • Standard Interfaces: Implements socket.Server interface
  • Callback System: Error reporting, connection events, server lifecycle

Installation

go get github.com/nabbar/golib/socket/server

Architecture

Package Structure

The package is organized into four transport-specific subpackages:

socket/server/
├── tcp/                 # TCP server (connection-oriented, network)
├── udp/                 # UDP server (connectionless, network)
├── unix/                # Unix domain sockets (connection-oriented, IPC)
└── unixgram/            # Unix domain sockets (connectionless, IPC)

Transport Comparison

┌────────────────────────────────────────────────────────────┐
│                  Transport Selection Matrix                │
└──────────────┬────────────┬────────────┬─────────┬─────────┘
               │            │            │         │
      ┌────────▼────┐   ┌───▼─────┐  ┌───▼────┐  ┌─▼───────┐
      │     TCP     │   │   UDP   │  │  Unix  │  │Unixgram │
      │             │   │         │  │        │  │         │
      │ Reliable    │   │ Fast    │  │ IPC    │  │ IPC     │
      │ Ordered     │   │ Low     │  │ Stream │  │ Dgram   │
      │ Network     │   │ Overhead│  │ Secure │  │ Fast    │
      └─────────────┘   └─────────┘  └────────┘  └─────────┘
Protocol Mode Scope Reliable Ordered Use Case
TCP Connection Network Web servers, APIs, databases
UDP Datagram Network Real-time, gaming, streaming
Unix Connection Local IPC, containers, microservices
Unixgram Datagram Local Fast IPC, notifications

Connection vs Connectionless

Connection-Oriented (TCP, Unix)

  • Persistent client connections
  • Per-connection handler goroutines
  • Connection state tracking
  • Graceful connection draining
  • Best for: Long-lived sessions, stateful protocols

Connectionless (UDP, Unixgram)

  • Stateless datagram processing
  • Single handler for all datagrams
  • No connection tracking (returns 1 when running)
  • Immediate shutdown (no draining)
  • Best for: Request-response, fire-and-forget

Performance

Memory Efficiency

All servers maintain O(1) memory per connection or O(1) for datagram:

  • TCP/Unix: One goroutine per client (~2KB stack + buffers)
  • UDP/Unixgram: Single handler goroutine
  • Buffer Management: bufio.Reader/Writer with controlled sizes
  • Streaming I/O: Zero-copy direct passthrough where possible

Thread Safety

All operations are thread-safe through:

  • Atomic Operations: atomic.Bool, atomic.Int64 for state and counters
  • Mutex Protection: sync.Mutex for callback registration (where needed)
  • Goroutine Management: Proper lifecycle with context.Context
  • No Data Races: Verified with go test -race

Throughput Benchmarks

Server Mode Throughput Connections Memory/Conn Notes
TCP Stream ~800 MB/s 10,000+ ~4KB Per-connection goroutine
UDP Datagram ~900 MB/s N/A ~8KB total Single handler
Unix Stream ~1.2 GB/s 1,000+ ~4KB IPC optimized
Unixgram Datagram ~1.5 GB/s N/A ~8KB total Fastest IPC

Measured on AMD64, Go 1.21+, localhost/IPC

Connection Capacity

TCP Server: 10,000+ concurrent connections (tested up to 50,000 on high-memory systems)
Unix Server: 1,000+ concurrent connections (tested up to 10,000 on Linux)
UDP/Unixgram: Unlimited concurrent senders (stateless operation)

Protocol Selection Guide

Reliability:  TCP > Unix > UDP > Unixgram
Speed:        Unixgram > Unix > UDP > TCP
Overhead:     UDP/Unixgram < Unix < TCP

Network Communication:
├─ Reliable → TCP (web servers, databases)
└─ Fast → UDP (streaming, gaming)

Local IPC:
├─ Reliable → Unix (Docker, microservices)
└─ Fast → Unixgram (metrics, notifications)

Use Cases

This library is designed for scenarios requiring reliable socket server implementations:

Web Applications

  • HTTP/HTTPS servers with TLS support
  • WebSocket backends
  • REST API endpoints
  • Long-polling connections

Microservices

  • Service-to-service communication via Unix sockets
  • Container IPC (Docker, Kubernetes)
  • Fast inter-process messaging
  • Service discovery listeners

Real-Time Systems

  • UDP-based game servers
  • Video/audio streaming
  • Sensor data collection
  • Time-series data ingestion

Database Proxies

  • Protocol translation layers
  • Connection pooling
  • Query routing
  • Cache layers

Network Daemons

  • Custom protocol servers
  • Tunneling and proxying
  • Network monitoring agents
  • Log aggregation services

Quick Start

TCP Echo Server

Simple TCP server echoing received data:

package main

import (
    "context"
    "io"
    "log"
    
    "github.com/nabbar/golib/socket"
    "github.com/nabbar/golib/socket/server/tcp"
)

func main() {
    // Handler processes each connection
    handler := func(r socket.Reader, w socket.Writer) {
        defer r.Close()
        defer w.Close()
        io.Copy(w, r) // Echo back
    }
    
    // Create server
    srv := tcp.New(nil, handler)
    srv.RegisterServer(":8080")
    
    // Start listening
    log.Println("Listening on :8080")
    if err := srv.Listen(context.Background()); err != nil {
        log.Fatal(err)
    }
}

UDP Datagram Server

Connectionless UDP server:

package main

import (
    "context"
    "log"
    
    "github.com/nabbar/golib/socket"
    "github.com/nabbar/golib/socket/server/udp"
)

func main() {
    handler := func(r socket.Reader, w socket.Writer) {
        defer r.Close()
        defer w.Close()
        
        buf := make([]byte, 65507) // Max UDP datagram
        for {
            n, err := r.Read(buf)
            if err != nil {
                break
            }
            w.Write(buf[:n]) // Reply to sender
        }
    }
    
    srv := udp.New(nil, handler)
    srv.RegisterServer(":8080")
    
    log.Println("UDP server on :8080")
    if err := srv.Listen(context.Background()); err != nil {
        log.Fatal(err)
    }
}

Unix Domain Socket (IPC)

Fast inter-process communication:

package main

import (
    "context"
    "io"
    "log"
    "os"
    
    "github.com/nabbar/golib/socket"
    "github.com/nabbar/golib/socket/server/unix"
)

func main() {
    handler := func(r socket.Reader, w socket.Writer) {
        defer r.Close()
        defer w.Close()
        io.Copy(w, r)
    }
    
    srv := unix.New(nil, handler)
    srv.RegisterSocket("/tmp/app.sock", 0600, -1)
    
    defer os.Remove("/tmp/app.sock")
    
    log.Println("Unix socket: /tmp/app.sock")
    if err := srv.Listen(context.Background()); err != nil {
        log.Fatal(err)
    }
}

Graceful Shutdown

Context-aware shutdown with connection draining:

package main

import (
    "context"
    "log"
    "os"
    "os/signal"
    "syscall"
    "time"
    
    "github.com/nabbar/golib/socket"
    "github.com/nabbar/golib/socket/server/tcp"
)

func main() {
    handler := func(r socket.Reader, w socket.Writer) {
        defer r.Close()
        defer w.Close()
        // Handle connection...
    }
    
    srv := tcp.New(nil, handler)
    srv.RegisterServer(":8080")
    
    // Start server in goroutine
    ctx, cancel := context.WithCancel(context.Background())
    go func() {
        if err := srv.Listen(ctx); err != nil {
            log.Println("Server stopped:", err)
        }
    }()
    
    // Wait for shutdown signal
    quit := make(chan os.Signal, 1)
    signal.Notify(quit, syscall.SIGINT, syscall.SIGTERM)
    <-quit
    
    log.Println("Shutting down...")
    
    // Graceful shutdown (25s timeout)
    shutdownCtx, shutdownCancel := context.WithTimeout(
        context.Background(), 
        25*time.Second,
    )
    defer shutdownCancel()
    
    if err := srv.Shutdown(shutdownCtx); err != nil {
        log.Println("Forced shutdown:", err)
    }
    
    log.Println("Server stopped")
}

Connection Monitoring

Track connections and errors with callbacks:

package main

import (
    "context"
    "log"
    "net"
    
    "github.com/nabbar/golib/socket"
    "github.com/nabbar/golib/socket/server/tcp"
)

func main() {
    handler := func(r socket.Reader, w socket.Writer) {
        // Handle connection...
    }
    
    srv := tcp.New(nil, handler)
    srv.RegisterServer(":8080")
    
    // Error callback
    srv.RegisterFuncError(func(err error) {
        log.Printf("ERROR: %v", err)
    })
    
    // Connection events
    srv.RegisterFuncInfo(func(local, remote net.Addr, state socket.ConnState) {
        log.Printf("Connection %s -> %s: %v", remote, local, state)
    })
    
    // Server lifecycle
    srv.RegisterFuncInfoServer(func(msg string) {
        log.Printf("SERVER: %s", msg)
    })
    
    // Monitor connections
    go func() {
        for {
            log.Printf("Active connections: %d", srv.OpenConnections())
            time.Sleep(5 * time.Second)
        }
    }()
    
    srv.Listen(context.Background())
}

Subpackages

tcp Subpackage

Connection-oriented TCP server with TLS support.

Features

  • Persistent client connections
  • Per-connection handler goroutines
  • Connection tracking (OpenConnections)
  • Optional TLS encryption
  • Half-close support (CloseRead/CloseWrite)
  • Graceful shutdown with draining

API Example

import "github.com/nabbar/golib/socket/server/tcp"

srv := tcp.New(nil, handler)
srv.RegisterServer(":8080")

// Optional TLS
srv.SetTLS(true, tlsConfig)

// Start server
srv.Listen(ctx)

Use Cases

  • HTTP/HTTPS servers
  • Database connections
  • Long-lived RPC
  • Stateful protocols

Characteristics

  • Memory: ~4KB per connection
  • Connections: 10,000+ concurrent
  • Throughput: ~800 MB/s
  • Test Coverage: 84.6% (117 specs, ~28s)
  • Thread Safety: Zero data races

See GoDoc for complete API.


udp Subpackage

Connectionless UDP server for fast datagram processing.

Features

  • Stateless datagram handling
  • Single handler for all packets
  • Sender address tracking for replies
  • No connection overhead
  • OpenConnections returns 1/0 (running/stopped)

API Example

import "github.com/nabbar/golib/socket/server/udp"

srv := udp.New(nil, handler)
srv.RegisterServer(":8080")

// Start server
srv.Listen(ctx)

Use Cases

  • Real-time gaming
  • Video/audio streaming
  • DNS servers
  • Broadcast/multicast

Characteristics

  • Memory: ~8KB total (stateless)
  • Throughput: ~900 MB/s
  • Latency: <1ms
  • Test Coverage: 72.0% (18 specs, ~1.4s)
  • Thread Safety: Zero data races

See GoDoc for complete API.


unix Subpackage

Connection-oriented Unix domain socket server for IPC.

Features

  • Filesystem-based IPC
  • Persistent connections (like TCP)
  • File permissions and group ownership
  • Half-close support
  • Lower overhead than TCP (no network stack)
  • Automatic socket file cleanup

API Example

import "github.com/nabbar/golib/socket/server/unix"

srv := unix.New(nil, handler)
srv.RegisterSocket("/tmp/app.sock", 0600, -1)

// Start server
srv.Listen(ctx)

Use Cases

  • Container IPC (Docker, Kubernetes)
  • Microservice communication
  • Database connections (PostgreSQL, MySQL)
  • Process coordination

Characteristics

  • Memory: ~4KB per connection
  • Throughput: ~1.2 GB/s
  • Latency: <0.5ms
  • Platform: Linux only
  • Test Coverage: 73.8% (23 specs, ~2s)
  • Thread Safety: Zero data races

See GoDoc for complete API.


unixgram Subpackage

Connectionless Unix domain datagram socket for fast IPC.

Features

  • Filesystem-based IPC (like Unix)
  • Datagram mode (like UDP)
  • File permissions
  • Fastest IPC option
  • Stateless operation

API Example

import "github.com/nabbar/golib/socket/server/unixgram"

srv := unixgram.New(nil, handler)
srv.RegisterSocket("/tmp/app.sock", 0600, -1)

// Start server
srv.Listen(ctx)

Use Cases

  • Fast notifications
  • Log collection
  • Metrics gathering
  • Event broadcasting

Characteristics

  • Memory: ~8KB total (stateless)
  • Throughput: ~1.5 GB/s (fastest)
  • Latency: <0.2ms
  • Platform: Linux only
  • Test Coverage: 71.2% (20 specs, ~2.4s)
  • Thread Safety: Zero data races

See GoDoc for complete API.


Best Practices

Always Close Resources

// ✅ Good: Defer cleanup
func handler(r socket.Reader, w socket.Writer) {
    defer r.Close()
    defer w.Close()
    
    // Process connection...
}

// ❌ Bad: Missing cleanup
func handlerBad(r socket.Reader, w socket.Writer) {
    // May leak resources
}

Handle Errors Properly

// ✅ Good: Check all errors
if err := srv.RegisterServer(":8080"); err != nil {
    return fmt.Errorf("register: %w", err)
}

if err := srv.Listen(ctx); err != nil {
    return fmt.Errorf("listen: %w", err)
}

// ❌ Bad: Ignore errors
srv.RegisterServer(":8080")
srv.Listen(ctx)

Use Context for Cancellation

// ✅ Good: Context-aware
ctx, cancel := context.WithTimeout(context.Background(), 30*time.Second)
defer cancel()

go srv.Listen(ctx)

// Wait or cancel...
cancel()

// ❌ Bad: No cancellation mechanism
go srv.Listen(context.Background())

Graceful Shutdown

// ✅ Good: Drain connections
shutdownCtx, cancel := context.WithTimeout(context.Background(), 25*time.Second)
defer cancel()

// Shutdown waits for connections to close
if err := srv.Shutdown(shutdownCtx); err != nil {
    log.Println("Forced shutdown:", err)
}

// ❌ Bad: Immediate close
srv.Close() // Drops active connections

Monitor Server State

// ✅ Good: Use callbacks
srv.RegisterFuncError(func(err error) {
    log.Printf("Error: %v", err)
})

srv.RegisterFuncInfo(func(local, remote net.Addr, state socket.ConnState) {
    log.Printf("%s: %s -> %s", state, remote, local)
})

// Check connection count
if srv.OpenConnections() > maxConnections {
    // Take action...
}

Choose Right Protocol

// TCP: Reliable, ordered, connection-oriented
// Use for: Web servers, databases, long sessions
srv := tcp.New(nil, handler)

// UDP: Fast, unreliable, connectionless
// Use for: Real-time, gaming, streaming
srv := udp.New(nil, handler)

// Unix: Fast IPC, connection-oriented
// Use for: Container IPC, microservices
srv := unix.New(nil, handler)

// Unixgram: Fastest IPC, connectionless
// Use for: Notifications, metrics
srv := unixgram.New(nil, handler)

Secure Unix Sockets

// ✅ Good: Restrict permissions
srv.RegisterSocket("/tmp/app.sock", 0600, -1) // Owner only

// For group access
srv.RegisterSocket("/tmp/app.sock", 0660, 1000) // Owner + group 1000

// ❌ Bad: World-accessible
srv.RegisterSocket("/tmp/app.sock", 0666, -1) // Anyone can connect

Testing

Test Suite: 178 specs using Ginkgo v2 and Gomega

# Run all tests
go test ./...

# With coverage
go test -cover ./...

# With race detection (recommended)
CGO_ENABLED=1 go test -race ./...

# Specific subpackage
go test -v ./tcp/
go test -v ./udp/
go test -v ./unix/
go test -v ./unixgram/

Test Results

Subpackage Specs Coverage Duration Duration (race)
TCP 117 84.6% ~28s ~30s
UDP 18 72.0% ~1.4s ~2.5s
Unix 23 73.8% ~2s ~3s
Unixgram 20 71.2% ~2.4s ~3.4s
Total 178 ≥70% ~34s ~39s

Coverage Areas

  • Server lifecycle (start, stop, shutdown)
  • Connection handling (accept, read, write, close)
  • Graceful shutdown with connection draining
  • Concurrent client operations
  • TLS configuration (TCP)
  • File permissions and ownership (Unix sockets)
  • Callback registration and invocation
  • Error conditions and edge cases
  • Thread safety validation

Quality Assurance

  • Zero data races (verified with -race)
  • Thread-safe concurrent operations
  • Goroutine synchronization with context.Context
  • Atomic operation correctness (atomic.Bool, atomic.Int64)
  • Connection counter accuracy
  • Graceful shutdown behavior

See TESTING.md for detailed testing documentation.


Contributing

Contributions are welcome! Please follow these guidelines:

Code Contributions

  • Do not use AI to generate package implementation code
  • AI may assist with tests, documentation, and bug fixing
  • All contributions must pass go test -race
  • Maintain or improve test coverage (≥70%)
  • Follow existing code style and patterns
  • Ensure thread safety with atomic operations

Documentation

  • Update README.md for new features
  • Add examples for common use cases
  • Keep TESTING.md synchronized with test changes
  • Document protocol-specific behavior
  • Include ASCII diagrams for complex architectures

Testing

  • Write tests for all new features
  • Test edge cases and error conditions
  • Verify thread safety with race detector
  • Test graceful shutdown scenarios
  • Add comments explaining complex test scenarios
  • Use descriptive test names

Pull Requests

  • Provide clear description of changes
  • Reference related issues
  • Include test results (with and without -race)
  • Update documentation
  • Verify all quality checks pass

See CONTRIBUTING.md for detailed guidelines.


Future Enhancements

Potential improvements for future versions:

Protocol Support

  • SCTP (Stream Control Transmission Protocol)
  • QUIC (UDP-based multiplexed transport)
  • WebSocket server wrapper
  • HTTP/2 and HTTP/3 integration

Features

  • Connection pooling and reuse
  • Rate limiting per client
  • Automatic reconnection handling
  • Prometheus metrics integration
  • OpenTelemetry tracing
  • Dynamic TLS certificate loading
  • Unix socket authentication (SO_PEERCRED)
  • Priority queues for connections

Performance

  • io_uring support (Linux)
  • Zero-copy networking (sendfile)
  • Connection multiplexing
  • Load balancing across goroutines

Monitoring

  • Built-in health checks
  • Connection statistics
  • Bandwidth monitoring
  • Client IP whitelisting/blacklisting

Suggestions and contributions are welcome via GitHub issues.


AI Transparency Notice

In accordance with Article 50.4 of the EU AI Act, AI assistance has been used for testing, documentation, and bug fixing under human supervision.


License

MIT License - See LICENSE file for details.


Resources