PAXATA Automations

Owned by Jeanne Martle (Deactivated)
Nov 07, 2022
4 min read

PAXATA Files and flow supplemental documentation:

Originally Paxata was acquired to solve the issue of data prep, data hygiene and data access/segmentation for the digital marketing team. We started with cleaning and merging the DMSV base database (Direct Mail/Magazine and State Verified Licensure file) with the records of those individuals from the backend of Nurse.com that had opted in to receive marketing material. These files are called: VW_NurseMarketoLocal and DMSV.

These files are held on what is called the “OMEGA SERVER”. Things have changed since the start of this server in 2016. The “OMEGA SERVER” now contains the following files:

  1. VW_NurseMarketoLocal

  2. DMSV

  3. Marketo UCE

  4. Marketo Completions

  5. OngageSummaryActionsByEmail

  6. FreeCME

  7. FreeCME_OngageSummaryActionsByEmail

 

 

 

 

Files for Unlimited CE, Focus CE, Nurse.com are contained within the Omega database designation. FreeCME was given its own database to keep the files separated. PAXATA can access the files from here. All daily pushes were set up by the IT department. Within the Omega structure the DMSV has a stored procedure that is triggered with new records are added to the “staged DMSV” table. This process was originally set up/written by vender called “Aptitive”. This process was outlined in the original documentation already passed over. Below is a graphic that will cover base data flow for The Omega database, Unlimited CE and Focus CE:

Unlimited CE:

Unlimited CE (MarketoUCE) is a daily push from Nurse.com that contains all Unlimited CE users from 2006 forward. Our IT department Set up a data push to the Omega Server on a daily basis. Paxata then pulls this file into the project called: UPDATED_2021-UNLIMITED CE USER PROJECT where paxata makes some data Transforms some of the data and updates email validation codes and dates.

The file is then pushed out to be Manually integrated into Ongage. (1,223,345 records)

___________

Focus CE:

Focus CE (MarketoCompletions) is a daily push from Nurse.com that contains all completions for the last 10 years. Our IT department Set up a data push to the Omega Server on a daily basis. Paxata then pulls this file into the project called: Updated_Focus_CE_Completions_By Category_Ver:2 where paxata makes some data Transforms some of the data and updates email validation codes and dates.

The file is then pushed out to be Manually integrated into Ongage. (1,140,191 records)

_________

 

 

Omega Database

The Omega Database combines the files from the Direct Magazine state licensure database (DMSV) and the “OPT IN” records from the back in of nurse.com (VW_NurseMarketoLocal). It then pulls in and flags records the Ongage Email Activity file and data from project submarine (MongoDB). Because of the large number of files and transformations being done, there are 12 projects in the sequence and the flow is as follows:

  1. Updated_DMSV_MarketoLocal_Seq_1

  2. Updated_V3_DMSV_MarketoLocal_unmatched_processing_Seq_1b

  3. Updated_DMSV_MarketoLocal_Seq_2

  4. Updated_DMSV_MarketoLocal_Seq_3

  5. Updated_DMSV_MarketoLocal_Seq_4

  6. Updated_DMSV_MarketoLocal_Seq_5

  7. Updated_DMSV_MarketoLocal_Seq_6

  8. Updated_DMSV_MarketoLocal_Seq_7

  9. Updated_DMSV_MarketoLocal_API-Unmatched_Seq_7b

  10. Updated_DMSV_MarketoLocal_Seq_8

  11. Updated_DMSV_MarketoLocal_unmatched_processing_Seq_8b

  12. Updated_DMSV_MarketoLocal_Seq_9

Because there is a fairly sizable cross over between the Omega Database, Unlimited CE and Focus CE… Email validation codes are matched and shared between these files. This reduces the number of clicks that are used for email validation.

The file is then pushed out to be Manually integrated into Ongage. (6,460,097 records)

_________

FreeCME:

Our IT Team set up a push that sends all FCME “Rievent Records” to the Omega Server on a daily basis. Paxata then pulls this file in and combines: the Old Mail Chimp data, historical Opt outs, list Purchases. Because of the large number of files and transformations being done, there are 3 projects in the sequence and the flow is as follows:

  1. Freecme-(Rievent_Epublishing)

  2. Freecme-(Rievent_Epublishing)-SEQ_2

  3. Freecme-(Rievent_Epublishing)-SEQ_3

 

The file is then pushed out to be Manually integrated into Ongage. (1,207,814 records)

__________________

WCEI

WCEI data is pulled manually from Kentico each month. Two files are pulled: The Member report selecting “ALL” members and the Course Registration Report pulling all records from 2012 forward. Additionally, there has been cases where tradeshow files for WOW have been incorporated into this combined file. Paxata takes these 3 inputs and merges the files together along with the monthly Email validation files and pushes a file out to be manually integrated into Ongage. Because of the number of files and the large data transformation there are a total of 3 projects in the WCEI sequence. They are:

  1. Updated_WCEI_Member_Kentico_Database_Evaluation_project -V2

  2. Updated_WCEI_Member_Kentico_Database_Evaluation_project -V2-SEQ_2

  3. Updated_WCEI_Kentico_Course_Registration_Consolidation

 

The file is then pushed out to be Manually integrated into Ongage. (116,685 records)

____________

DCME

 

DCME began with the import of the base file: dcme_magento_customers_101221-111521adj.csv. With the large number of the large number of transformations being done the DCME project is split into 2 projects. The sequence and flow is as follows:

  1. 2021-DCME_MAGENTO-PROJECT

  2. 2021_DCME Base Project SEQ_2 (Final-AdOps)

 

The file is then pushed out to be Manually integrated into Ongage. (216,939 records)