HOW TO HANDLE DEV & TEST & PROD FOR ORACLE DATA INTEGRATOR Gürcan Orhan Principal Datawarehouse Consultant Global Maksimum Data & Information Tech. Ltd. 8 August 2014 WHO AM I? +20 years of IT experience. +11 years of DWH experience. +8 years of Oracle Data Integrator experience. +6 years of Oracle Warehouse Builder experience. Sybase Power Designer, ERwin Data Modeler, SQL Developer OBIEE, Cognos, Microstrategy, Business Objects, Tableau. Oracle Excellence Awards - Technologist of the Year 2011 : Enterprise Architect (Oracle Magazine Editors’ Choice of Awards, Enterprise Architect) DWH & BI Chair : TROUG (Turkish Oracle User Group) Published Customer Snapshot for NODI @Oracle.com Published video about ODI @Oracle.com (Oracle Media Network) Published OTN Podcast about “Data Warehousing and ODI” Articles in OTech Magazine, SearchSoftwareQuality.com Annual panelist for ODTUG “Ask the Experts Panel : ODI” Presenter Presenter Presenter Presenter in in in in Oracle Open World since 2010 ODTUG Kscope’11-13 UKOUG, other OUGs various universities in Turkey First time in Latin America & México... 😊 08 AUGUST 2014 / #LAOTNTOUR http://gurcanorhan.wordpress.com gurcan_orhan http://tr.linkedin.com/in/gurcanorhan Global Maksimum! Data & Information Technologies Data Visualization Big & Fast Data Processing Data Science MY DEFINITION OF ODI ODI (Oracle Data Integrator) is a tool, that can talk, or learn how to talk, with any database system, or any operating system, in its own language. This is the power of ODI. 08 AUGUST 2014 / #LAOTNTOUR AGENDA 08 AUGUST 2014 / #LAOTNTOUR ODI REPOSITORY ARCHITECTURE MASTER REPOSITORY   Information related to DB/OS connections Contexts, Repositories, Logical Architecture   Information related to ODI internal security   Versions 08 AUGUST 2014 / #LAOTNTOUR ODI REPOSITORY ARCHITECTURE WORK REPOSITORY (DEVELOPMENT)   Source / Staging / Target metadata Models in Designer Navigator   Projects and beneath : Folders, Interfaces, Packages, Procedures, Variables, Sequences, Knowledge Modules, User Functions   Scenarios, Load Plans, Schedules   All the logs related to execution 08 AUGUST 2014 / #LAOTNTOUR ODI REPOSITORY ARCHITECTURE WORK REPOSITORY (EXECUTION)   Scenarios   Load Plans   Schedules   Execution Logs 08 AUGUST 2014 / #LAOTNTOUR CONTEXTS KEY TO JOIN PHYSICAL ARCHITECTURE AND LOGICAL ARCHITECTURE SRC A (dev) Source-A SRC A (prod) SRC B (dev) Source-B SRC B (prod) Source-C SRC C (prod) 08 AUGUST 2014 / #LAOTNTOUR AGENDA 08 AUGUST 2014 / #LAOTNTOUR START-UP PROJECT : INITIAL ARCHITECTURE MASTER Topology Versioning Security SRC A (dev) DEV WORK SRC B (dev) Execution SRC B (prod) Models Projects SRC A (test) Execution SRC B (test) DEV & TEST 08 AUGUST 2014 / #LAOTNTOUR EXEC WORK SRC A (prod) SRC C (prod) PROD START-UP PROJECT : MANUAL EXPORT-IMPORT 08 AUGUST 2014 / #LAOTNTOUR START-UP PROJECT : MANUAL EXPORT-IMPORT 08 AUGUST 2014 / #LAOTNTOUR START-UP PROJECT : MANUAL EXPORT-IMPORT 08 AUGUST 2014 / #LAOTNTOUR AGENDA 08 AUGUST 2014 / #LAOTNTOUR WE’RE ON PRODUCTION We need to make some changes… 08 AUGUST 2014 / #LAOTNTOUR ADMINS AT WORK MASTER * New Topology Versioning Security DEV WORK EXEC WORK Models Projects Execution Execution DEV Context 08 AUGUST 2014 / #LAOTNTOUR TEST & PROD* Context ADMINS AT WORK * New MASTER Topology Versioning Security EXEC WORK DEV WORK IMPORT Models Projects Execution DEV Context 08 AUGUST 2014 / #LAOTNTOUR EXPORT Execution TEST & PROD* Context ADMINS AT WORK MASTER Insert manually Insert manually MASTER Topology Topology Versioning Versioning Security Security DEV WORK EXEC WORK Models Projects Execution DEV & TEST Context 08 AUGUST 2014 / #LAOTNTOUR IMPORT EXPORT Execution PROD* Context AGENDA 08 AUGUST 2014 / #LAOTNTOUR MORE TESTERS IN TEAM MASTER MASTER Topology Topology Versioning Versioning Security Security DEV WORK DEV WORK Models Models Projects Projects Execution Execution EXEC WORK IMPORT EXPORT DEVDEV Context TEST Context & TEST Context 08 AUGUST 2014 / #LAOTNTOUR Execution PROD* Context EXPORT-IMPORT WITH A PACKAGE http://sonra.io/odi-automating-deployment-of-scenarios-in-oracle-data-integrator/ 08 AUGUST 2014 / #LAOTNTOUR EXPORT-IMPORT WITH A PACKAGE 08 AUGUST 2014 / #LAOTNTOUR EXPORT-IMPORT WITH A PACKAGE 08 AUGUST 2014 / #LAOTNTOUR EXPORT-IMPORT WITH THE ODI SDK For(Object interface : interfaces) { OdiInterface odiInt = (OdiInterface) interface; String scenName = odiInt.getName(); OdiScenario newScen = gene.generateScenario(odiInt, scenName, newVersion); } for (Object scen : scenarioCollection) { OdiScenario odiscen =(OdiScenario)scen ; export.exportToXml(odiscen, ExportPath, OverWrite, RecursiveExport, Encoding); } for (String filename : XMLFiles) { import.importObjectFromXml( import.IMPORT_MODE_SYNONYM_INSERT_UPDATE, filename, true); } 08 AUGUST 2014 / #LAOTNTOUR AGENDA 08 AUGUST 2014 / #LAOTNTOUR ENTERPRISE ARCHITECTURE MASTER MASTER Topology Topology Topology Versioning Versioning Versioning Security Security Security EXEC WORK EXEC WORK Execution Execution PRE-PROD* Context PROD* Context MASTER * New DEV WORK DEV WORK Models Models Projects Projects Execution Execution DEV Context TEST Context 08 AUGUST 2014 / #LAOTNTOUR ENTERPRISE ARCHITECTURE MASTER MASTER MASTER Topology Topology Topology Versioning Versioning Versioning Security Security Security DEV WORK DEV WORK Models Models Projects Projects Execution Execution DEV TEST 08 AUGUST 2014 / #LAOTNTOUR EXEC WORK EXEC WORK DEV WORK EXEC WORK Models Execution Execution Projects Execution Execution SMOKE PRE-PROD* HOTFIX* PROD* http://gurcanorhan.wordpress.com gurcan_orhan http://tr.linkedin.com/in/gurcanorhan 08 AUGUST 2014 / #LAOTNTOUR