Source Code Directory Structure

Linkis hierarchical directory structure explanation, if you want to detail Linkis, please check Linkis related architecture design documents

  1. ├─assembly
  2. ├─bin
  3. ├─conf
  4. ├─core //Core abstraction, which contains all common modules
  5. │ ├─cloudModule //Modules that must be introduced by microservices, embedded Jetty + WebSocket + SpringBoot + Jersey
  6. │ ├─cloudMybatis //Mybatis module of SpringCloud
  7. │ ├─cloudProtocol //General protocol, such as RPC communication between Entrance and Engine
  8. │ ├─cloudRPC //RPC module, complex two-way communication based on Feign implementation
  9. │ ├─common //Common module, built-in many common tools
  10. │ ├─httpclient //Java SDK top-level interface
  11. │ └─scheduler //General scheduling module
  12. ├─db //Database information
  13. ├─docs //All documents
  14. ├─eurekaServer //Eureka module
  15. ├─extensions //plugin
  16. │ └─spark-excel //spark supports excel to DF/DF to excel plug-in
  17. ├─gateway //Gateway module
  18. │ ├─core //Gateway core implementation, including authentication/analysis/routing of front-end interfaces
  19. │ ├─gateway-httpclient-support //gateway support for Java SDK
  20. │ ├─gateway-ujes-support //Analysis and routing support for UJES interface
  21. │ └─springcloudgateway //Introduce spring cloud gateway, front-end requests are intercepted from here
  22. ├─publicService //public service
  23. │ ├─application //application module
  24. │ ├─bin
  25. │ ├─conf
  26. │ ├─configuration //Parameter module, get the engine parameters from here
  27. │ ├─database //Provide Hive metadata query service
  28. │ ├─query //Provide Job Manager and Job History
  29. │ ├─udf //UDF module
  30. │ ├─variable //User-defined variable module
  31. │ └─workspace //Workspace module, manage user scripts
  32. ├─resourceManager //Resource management service
  33. │ ├─resourcemanagerclient //resource management client
  34. │ ├─resourcemanagercommon //Common module
  35. │ └─resourcemanagerserver //Resource management server
  36. ├─storage //Unified storage service
  37. │ ├─pesIO //Remote storage service
  38. │ │ ├─io-engine //The engine side of remote storage, which actually accesses the bottom storage side
  39. │ │ ├─io-enginemanager //engineManger for remote storage
  40. │ │ └─io-entrance //Request entry for remote storage
  41. │ └─storage //Unified external interface for unified storage
  42. └─ujes //Unified operation execution service
  43. │ ├─client //Java SDK, users can directly access Linkis through Client
  44. │ ├─definedEngines //Implemented engines
  45. │ │ ├─hive //Hive engine
  46. │ │ │ ├─engine //The engine execution end of the actual docking with the underlying Hive
  47. │ │ │ ├─enginemanager
  48. │ │ │ └─entrance
  49. │ │ ├─pipeline //Import and export engine for mutual conduction between storage systems
  50. │ │ │ ├─engine
  51. │ │ │ ├─enginemanager
  52. │ │ │ └─entrance
  53. │ │ ├─python //stand-alone Python engine
  54. │ │ │ ├─engine //The engine execution end that actually docks with the underlying Python
  55. │ │ │ ├─enginemanager
  56. │ │ │ └─entrance
  57. │ │ ├─spark //spark engine
  58. │ │ │ ├─engine //The actual connection to the engine execution end of the underlying Spark
  59. │ │ │ ├─enginemanager
  60. │ │ │ └─entrance
  61. │ │ └─tispark //TiSpark engine, actually docking with TiSpark engine
  62. │ ├─engine //General low-level engine module
  63. │ ├─enginemanager //General low-level enginemanager module
  64. │ ├─entrance //General low-level entrance module
  65. │ └─entranceclient //Simplified version of entrance