bulk-processor

Commit Graph

Author	SHA1	Message	Date
Guillem Jover	bee151585a	TT#53701 Remove executable bit from perl module files Change-Id: I8598dc0ce9382b7b31c946e8f2864fa54c9a92d2	7 years ago
Rene Krenn	8a09b9ab48	TT#37115 normalize line endings Change-Id: Icac176ba667d5fc613654b13a458babb39181f64	8 years ago
Rene Krenn	5a07957ff3	TT#23594 ppa and modifications + fixed block iterator counts + removed voip_cf_destinations.announcement_id from trunk dao + prevent "mysql gone away" error: - xa_db connection for ncos level lookups - reverted - set net_read_timeout to a higher value than default 30 secs - implement sql connection pinger for managed conenctions + fix processor thread wrong rowcount + write trusted sources for permanent registration's contact IP addresses + write a default ncos level for subscribers without barring + set mysql connection encoding to utf8 + create multi-subscriber contracts properly + properly skip subscribers with non-unique contracts + generate sip password if empty Change-Id: I533149a2d6328a0aa1f20ab7eab795ffff720020	9 years ago
Rene Krenn	bfa6575581	TT#18883 implement teletek importer #8 + prepare/merge/clean callforward+voicemail Y/N data + add voip_cf_destinations dao + add voip_cf_destination_sets dao + voip_cf_mappings, destination_sets and destinations insert dao method + write callforwards + write callforward related preference values + not well-formed enough: fixed issues popped up when trying to view/edit created callfowards in panel + fix "database locked" error - properly handle SQLite's serialized transactions (single transaction at a time). + write report file for debugging/review - json graph of merged data of a subscriber - including fields info/warning/error messages for a subscriber - write it snychronized now + get rid of JSON::XS + extend NGCPRestApi connector to support file transfers + heuristic for missing "channels" (by subscriber number count) + prevent mysql deadlocks when writing to ngcp + strictly consider record order from imports + task end result stats polished + cleanup code a bit + add kmailio.location dao + add kmailio.location insert dao method + writing "permanent registrations" to kamailio.location + generate location "ruid" and "partition" according to kamailio Change-Id: Ief9a7634b4930e51d79ac5e963ba48769d3708ea	9 years ago
Rene Krenn	0a8d34836c	TT#18886 implement teletek importer #7 + parse permanent registrations file Change-Id: If82fbe133b2645e760fc7243ab572c823b804fa9	9 years ago
Rene Krenn	5b04e7653a	TT#18882 implement teletek importer #6 + parse callforwards file + populate sip username Change-Id: I1a53b343e23dbf3b6745eefdfa5228a9fba57ae7	9 years ago
Rene Krenn	52ad964c53	TT#18879 implement teletek importer #5 + introduce support to manipulate contract, domain, etc. voip_preferences + write concurrent_max_total preference + error in invalid "channels = 0" + try to find non-empty sip-password of a subscriber, if any + try to find nonempty web username+password, if any + set emtpy web_password, if web_username is empty + auto-generate web_username, if duplicate + auto-generate web_password, if web_username is not emtpy but web_password is empty + parse export_CLIR.csv + write clir preference + write allowed_ips_grp preference + use maximum of concurrent_max_total for a subscriber, when inconsisten + use combined list of allowed ips, when inconsistent + write adm_ncos, derive barrings combination if inconsistent for a subscriber + log created items, cleanup code a bit + range unfolding for numbers in allowedcli files Change-Id: I26bab2cb9b4ef349777ebef2e883c9e41af3eeba	9 years ago
Rene Krenn	275afbbfb3	TT#18881 implement teletek importer #4 + "allowed_cli" import gets a different meaning, it are additional "numbers" (alias+allowed_cli) to import + unique cc+ac+sn in subscriber file + unique cc+ac+sn in allowed_cli file + logging of cc+ac+sn of allowed_cli records already found in subscriber file + logging of sip_usernames of allowed_cli records not found in subscriber file + reseller mapping Change-Id: I620db415f5dab91e8d5c6336b7a45b3a0ffeacb9	9 years ago
Rene Krenn	7dbb015f27	TT#21083 implement teletek importer #3 + allow to specify multiple subscriber files to import + allow to specify multiple allowed_cli files to import Change-Id: I80f83542f541a0d8857d477158dc043cfabb93ba	9 years ago
Rene Krenn	13c1a35d6f	TT#18878 implement Teletek/generic importer #1 - CSV importer: escaped field enclosing, mutliline values, comment char, constant memory - SQLite table to hold flat file content - multithread import for large files - concept of single flatfile abandonend as teletek also wants to import AllowedIPs, MaxConcurrentCalls, NCOS levels, CallForwards - load teletek's main subscriber flatfile - single insert/upsert txn import to identify duplicate cc+ac+sn - alias range unfolding - alias range unfolding fix, analysis of duplicate cc+ac+sn in export_kundinfo_leica2.csv - fixed one-off bug in parser - aliases sorting - aliases dupe check - check for sip account used by different contacts - reseller cache/check for missing reseller - domain cache/check for missing domain - billing profile cache/check for missing billing profile - rest api cert-authentification, multi-user, thread safe, tested - contact create, no update - contract create, no update - billing mapping creaet, no update - contract balance create, no update - billing subscriber, prov subscriber, primary voip_number and voip_dbalias - prefs: account_id, cc, ac - prefs: allowed_cli, cli - load allowed clis file, identify dupes - todo: remove partly adjusted old code parts, depending on this will be extended or not. - add aliases, tested, panel can display 1000+ aliases. - disable multithreading Change-Id: I4f5ae61610bab744e3d0644f7a56afa8874a2c3c	9 years ago

10 Commits (819e8763dd7d55fb94de569e6eefef33a2886e1c)