bulk-processor

Commit Graph

Author	SHA1	Message	Date
Rene Krenn	8a09b9ab48	TT#37115 normalize line endings Change-Id: Icac176ba667d5fc613654b13a458babb39181f64	8 years ago
Rene Krenn	25f2619de1	TT#28473 force JSON::PP everywhere Change-Id: I414c6f14cd3c4040b646229d38c5e8522208b5fb	8 years ago
Rene Krenn	13c1a35d6f	TT#18878 implement Teletek/generic importer #1 - CSV importer: escaped field enclosing, mutliline values, comment char, constant memory - SQLite table to hold flat file content - multithread import for large files - concept of single flatfile abandonend as teletek also wants to import AllowedIPs, MaxConcurrentCalls, NCOS levels, CallForwards - load teletek's main subscriber flatfile - single insert/upsert txn import to identify duplicate cc+ac+sn - alias range unfolding - alias range unfolding fix, analysis of duplicate cc+ac+sn in export_kundinfo_leica2.csv - fixed one-off bug in parser - aliases sorting - aliases dupe check - check for sip account used by different contacts - reseller cache/check for missing reseller - domain cache/check for missing domain - billing profile cache/check for missing billing profile - rest api cert-authentification, multi-user, thread safe, tested - contact create, no update - contract create, no update - billing mapping creaet, no update - contract balance create, no update - billing subscriber, prov subscriber, primary voip_number and voip_dbalias - prefs: account_id, cc, ac - prefs: allowed_cli, cli - load allowed clis file, identify dupes - todo: remove partly adjusted old code parts, depending on this will be extended or not. - add aliases, tested, panel can display 1000+ aliases. - disable multithreading Change-Id: I4f5ae61610bab744e3d0644f7a56afa8874a2c3c	8 years ago
Rene Krenn	0c667af245	MT#18663 MT#20893 row bulk processing framework WIP #12 +subscriber provisioning via db: +delta handling +create billing subscriber +create provisioning subscriber +create/update billing voip_number +create cli preference +update billing subscriber +create voip_dbalias +create allowed clis preference +release other subscriber's voip numbers +delete obsolete dbalieses +delete obsolete allowed_clis +create kamailio voicemail user +create account_id preference +create cc preference +check config parameters (billing profile of same reseller..) +subscriber and contract termination via api +reprovisioning use-case (upon changed password): -terminate subscriber -terminate contract -create contact, contract, subscriber as normal +log successful provisions +limit to imported batch with --batch +bulk write subscriber preferences directly to db +barring profile to adm_ncos_ID preference +peer_aut_* preferences: init, switchover, clear modes +bulk write via rest-api: +call forwards from features_define.cfg +bulk create lnp_numbers +checks, delta detection for lnp carriers +changed from txn per record (42min) to txn per block (3min) +tuning sqlite params to prevent db lock error with multithreading +workaround for https://rt.cpan.org/Public/Bug/Display.html?id=102791 +include .pl and .cfg file types to be installed by the package +fixup to skip '0' usernames with --skip-errors +check for minimum password length +block rollback issue +import txns only, stmt was not "finished" +fix db_do "E0E" return value +disable multithreading when perldebug +warning counter (--skip-errors only) +fixed locking issue +make the --run=<db-prefix> option work to use different import slite db's Change-Id: I82d27b593b1d5194331c1559b022cf677e232550	10 years ago
Rene Krenn	15762ef304	MT#18663 row bulk processing framework WIP #11 +provisioning db connectivity +kamailio db connectivity +default db connectivity for distributed txn's (XA) +provisioning db dao's +kamailio db dao's +subscriber provisioning via db: +create contact +create contract +create billing_mapping +create contract_balance Change-Id: I11de85fa5473e59bd6a8c05e1541a9fbc96c1a9d	10 years ago
Rene Krenn	84575f90e6	MT#18663 row bulk processing framework WIP #10 +reject invalid subscriber numbers by pattern +detect changed passwords in subscriber+username.xslx +separate --skip-errors option from --dry option +rest request classes for ngcp resources: +SystemContacts +Contracts +BillingProfiles +Resellers +BillingZones +BillingFees +Domains +CustomerContacts +Customers +Subscribers +making post, get, put, patch, delete work for NGCP rest-api Change-Id: Ic55caed7d5425716adfbba9e2bc6b9153334481c	10 years ago
Rene Krenn	52d66ca0de	MT#18663 MT#20893 row bulk processing framework WIP #5 +setting to drop duplicate setoptionitems in Feature_Define.cfg +adjust Feature_Define.cfg threads vs block size settings to arrange with a low sqlite busy_timeout +Subscriber_Define.cfg importer +resolve garbage collector problems with log4perl +refactoring to conform with perl module lib/folder structure for installation -runs again Change-Id: I1821cc0085086684c3c1415be4c262453509045a	10 years ago

7 Commits (mr7.2)