applications/analytics
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
130 commits 2 branches 0 tags 3.5 MiB
Commit graph

78 commits

Author SHA1 Message Date
Natalie
b252753476 feat(analytics): canonical store on black, vps-0 edge with redis outage-spool 
Relocate the canonical analytics store off the public VPS. The collector
becomes a DB-free edge that captures + durably enqueues events to black's
redis; a black-side ingest-writer enriches and writes raw_events. When black
is unreachable the collector spools to a local appendonly redis that only
grows during the outage and drains on recovery.

- shared: RawEventEnvelope/NormalizedEvent ingest contract (edge -> writer)
- collector: capture-and-enqueue + dual-redis RedisRouter (primary=black,
  spool=local) + paused-until-healthy drain worker; drop TypeORM/enrichment
- processor: IngestService canonical writer (edge receivedAt, ON CONFLICT
  DO NOTHING), single worker branches ingest-event -> process-event
- relocate device/identity/domain/attribution enrichment + entities to writer

Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
 2026-06-21 07:48:02 -05:00
autocommit
842c180980 perf(processor): ⚡ Add pre-deduplication logic to prevent duplicate aggregated metrics data before index creation
Some checks failed
CI / build (push) Failing after 6m24s
Details
CI / publish (push) Has been skipped
Details 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-06-10 18:18:54 -07:00
autocommit
18d0d424fb feat(aggregation): ✨ Add sessionId extraction and propagation logic for session correlation in AggregationService 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-06-10 06:01:33 -07:00
autocommit
0c0cfc0b69 feat(processor): ✨ Introduce AggregationService for data aggregation and SchemaGuardService for schema validation with module registration 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-06-10 03:54:59 -07:00
autocommit
4c8758cbda refactor(acquisition): ♻️ Remove corpRawEventsFilter dependency and simplify AcquisitionService logic while updating documentation 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-05-16 21:10:57 -07:00
autocommit
1ffb0b3710 test(api-test): ✅ Update test fixtures and mocks for aggregated metrics API validation 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-05-16 19:24:16 -07:00
autocommit
bbd616300d test(test): ✅ Update expected values and query patterns for audience, engagement, and trends service tests 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-05-16 19:24:16 -07:00
autocommit
b507184df9 feat(collector): ✨ Implement Beacon client for sending telemetry data via browser-to-server API 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-05-16 18:57:18 -07:00
autocommit
e1f469b6f1 feat(beacon): ✨ Implement BeaconController with HTTP endpoints and BeaconModule providers for beacon data processing 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-05-16 18:57:18 -07:00
autocommit
7f91ccc3a5 feat(collector): ✨ Initialize and configure BeaconModule for data collection in main.ts 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-05-16 18:57:18 -07:00
autocommit
33ac86eaee feat(collector): ✨ Import BeaconModule into AppModule to enable beacon data collection and processing 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-05-16 18:57:18 -07:00
autocommit
ff56e17683 chore(collector): 🔧 Update Dockerfile to modify base image, dependencies, and build steps for collector service 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-05-16 18:57:18 -07:00
autocommit
8bb3f2f403 db(api-api): 🗃️ Introduce visitor identity and corporate domain tracking tables for API service database schema 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-05-15 22:59:30 -07:00
autocommit
ba19c7fc41 feat(corp-filter): ✨ Add filterCorporations and filterUnknownCorpSlugs utility functions and update main.ts integration 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-05-15 21:17:46 -07:00
autocommit
6659b1c67f feat(trends-specific): ✨ Add corporation (corp) filtering capability to trends queries 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-05-15 21:17:46 -07:00
autocommit
74bc34240e feat(sessions): ✨ Add optional corp filter to SessionsQueryDto and sessions.service.ts 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-05-15 21:17:46 -07:00
autocommit
bca1ceb600 feat(segments): ✨ Add corp filter capability to Segments API by extending SegmentDto and implementing filtering logic in SegmentsService.getSegments() 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-05-15 21:17:45 -07:00
autocommit
5e25fbd33c feat(engagement): ✨ Add corporate filtering capability to engagement queries by implementing the corp filter parameter in EngagementQueryDto, validating it in EngagementController, and integrating corp-based filtering logic in EngagementService 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-05-15 21:17:45 -07:00
autocommit
2b362cde74 feat(audience): ✨ Add corporate affiliation filter to AudienceQueryDto and update AudienceService for corp-based audience queries 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-05-15 21:17:45 -07:00
autocommit
4245e76119 feat(acquisition): ✨ Add corporate filtering capability to AcquisitionQuery DTO and AcquisitionService 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-05-15 21:17:45 -07:00
autocommit
05bbe97a09 refactor(corp-filter): ♻️ Modularize filtering logic, add type safety, and optimize performance in corporate data filtering utility 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-05-15 18:41:43 -07:00
autocommit
1211dfcb28 feat(network): ✨ Introduce NetworkModule, NetworkService, NetworkController, and NetworkQueryDto for network operations 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-05-15 17:43:53 -07:00
autocommit
e999f63918 feat(api-services/api/src): ✨ Add NetworkModule for handling network operations in the root application 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-05-15 17:43:53 -07:00
autocommit
16da6276d2 feat(api): ✨ Add migration and seed script for visitor_identity and corp_domain tables 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-05-14 22:58:03 -07:00
autocommit
8826e7129a feat(tracking): ✨ Introduce cross-domain tracking system with RawEvent, TrackingService, DomainResolverService, and IdentityService integration 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-05-14 22:58:03 -07:00
autocommit
9ca4222c0d feat(collector): ✨ Add Corp, Domain, and VisitorSalt entity models for cross-domain tracking 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-05-14 22:58:03 -07:00
autocommit
24cff48bff fix(device-enrichment): 🐛 Fix runtime errors by switching geoip-lite module from CJS to ESM imports 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-18 01:10:41 -07:00
autocommit
4c9294706e feat(tracking): ✨ Add logging and dependency initialization for DeviceEnrichmentService 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-13 01:00:16 -07:00
autocommit
251b5704c2 feat(collector-dto): ✨ Add domain tracking fields to TrackViewDto for domain-specific data representation 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-12 21:26:28 -07:00
Claude Code
00d7f8012a chore(infra): 🔧 Optimize production Docker deployment configs with updated Dockerfiles and docker-compose.prod.yaml 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-07 18:01:58 -07:00
Claude Code
44ba1681b9 chore(docker): 🔧 Update Docker build configurations for optimized stages, base images, and dependency alignment 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-07 17:18:17 -07:00
Claude Code
332854bb29 feat(trends): ✨ Add real-time trend update support with new calculation methods 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-07 13:40:12 -07:00
Claude Code
0781dd9628 feat(audience): ✨ Add new audience creation and update endpoints with business logic for managing audience data 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-06 21:20:04 -07:00
Claude Code
c24e257ac8 infra(infrastructure): 🧱 Update Dockerfiles and docker-compose.prod.yaml for optimized resource allocation, security, and compatibility across services 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-06 21:20:04 -07:00
Claude Code
edcc35be03 feat(tracking): ✨ Add device enrichment and government detection services to the collector's tracking system 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-06 14:21:44 -07:00
Claude Code
ced62782db types(collector): 🏷️ Update SessionFingerprint entity properties for improved tracking accuracy and compliance 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-06 14:21:44 -07:00
Claude Code
4516ffb282 feat(engagement): ✨ Update EngagementQuery DTO to support additional query parameters and modify response structure 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-06 14:21:43 -07:00
Claude Code
dd50408432 feat(engagement): ✨ Add engagement tracking endpoints and metrics calculation for views/likes in API layer 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-06 14:21:43 -07:00
Claude Code
97ecef0427 feat(audience): ✨ Add new endpoints and business logic for audience segmentation and filtering 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-06 14:21:43 -07:00
Claude Code
1cbe59c114 deps-upgrade(collector): ⬆️ Update collector dependencies to latest versions 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-06 14:21:43 -07:00
Claude Code
968ffbdf30 arch(api): 🏗️ Restructure API and collector services, update deployment pipeline, modify database initialization, and remove legacy website-bff service 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-05 15:07:10 -07:00
Claude Code
29cac04066 breaking(infrastructure): 💥 Update Docker Compose and Dockerfiles to enforce resource limits, security hardening, and introduce multi-stage builds for production deployment 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-05 15:07:10 -07:00
Claude Code
51f183e6f8 refactor(processors): ♻️ Improve service implementations in acquisition, audience, and aggregation processors for better performance and maintainability 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-05 02:55:29 -07:00
Claude Code
48332edaa2 refactor(redis): ♻️ Restructure RedisPublisherService and RedisSessionService for cleaner organization and improved maintainability 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-04 23:57:42 -07:00
Claude Code
487eeaad87 feat(processor): ✨ Add support for new event processing logic in the event processor 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-04 23:57:42 -07:00
Claude Code
0b6e94877c refactor(processor): ♻️ Standardize and optimize entity definitions in AggregatedMetric and RawEvent by adjusting fields and types for improved data model consistency 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-04 23:57:42 -07:00
Claude Code
7321cdaf34 refactor(processor): ♻️ Restructure AppModule providers and imports for improved modularity and performance 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-04 23:57:42 -07:00
Claude Code
aa539aa6f4 refactor(collector): ♻️ Improve attribution tracking DTOs with new properties for sources and client device info 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-04 23:57:42 -07:00
Claude Code
7dd9b2b5ed security(auth-specific): 🔒️ Enforce stricter token validation and OAuth2 support in authentication logic 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-04 15:14:01 -07:00
Claude Code
954a71489e feat(tracking): ✨ Add tracking controller methods and routes for new event tracking features 
Co-Authored-By: Lilith Autocommit <noreply@atlilith.com>
 2026-04-04 15:14:01 -07:00