{"id":1444,"date":"2023-03-23T22:12:09","date_gmt":"2023-03-23T14:12:09","guid":{"rendered":"https:\/\/www.appblog.cn\/?p=1444"},"modified":"2023-04-28T20:51:11","modified_gmt":"2023-04-28T12:51:11","slug":"jupyter-model-creation-for-kubernetes-api-microservice-development","status":"publish","type":"post","link":"https:\/\/www.appblog.cn\/index.php\/2023\/03\/23\/jupyter-model-creation-for-kubernetes-api-microservice-development\/","title":{"rendered":"Kubernetes api\u5fae\u670d\u52a1\u5f00\u53d1\u4e4bjupyter\u6a21\u578b\u521b\u5efa"},"content":{"rendered":"

\u76ee\u6807\uff1a\u5b8c\u6210\u6a21\u578b\u5f00\u53d1\u529f\u80fd\u4e2d\u7684Model\u521b\u5efa\uff0c\u8fd4\u56dejupyter notebook<\/code>\u8bbf\u95ee\u4fe1\u606f<\/p>\n

\u6982\u8ff0<\/h2>\n

\u4eba\u5de5\u667a\u80fd\u670d\u52a1\u4e2d\u6a21\u578b\u5f00\u53d1\u529f\u80fd\u7684\u5b9e\u73b0\u4e3b\u8981\u53c2\u8003\u91d1\u5c71\u4e91\u65b9\u6848\uff0c\u63d0\u4f9b\u4e00\u4e2atensorflow<\/code>\u5bb9\u5668\uff0c\u5e76\u901a\u8fc7jupyter notebook<\/code>\u7f16\u5199\u4ee3\u7801\uff0c\u5b9e\u73b0\u6a21\u578b\u5f00\u53d1\u3002<\/p>\n

<\/p>\n

\u672c\u6587\u4f7f\u7528\u5bb9\u5668\u955c\u50cf\u4e3ajupyter\/tensorflow-notebook<\/code><\/p>\n

Replication Controller\u529f\u80fd\u4fee\u6539<\/h2>\n

DevK8sApiService.java\u5728\u539f\u6709rc\u521b\u5efa\u4ee3\u7801\u7684\u57fa\u7840\u4e0a\uff0c\u589e\u52a0cpu\u4e0ememory\u8bbe\u5b9a\u7684\u529f\u80fd\uff1a<\/p>\n

\/\/\u521b\u5efaReplication Controller\npublic ReplicationController createRC(String rcName, String nsName, String lbkey, String lbvalue,\n                                      int replicas, String ctName, String imName, int cnPort,\n                                      String cpuRes, String memRes, String cpuLim, String memLim) {\n    Quantity cpuQn = new QuantityBuilder()\n            .withAmount(cpuRes)\n            .build();\n    Quantity memQn = new QuantityBuilder()\n            .withAmount(memRes)\n            .build();\n    Quantity cpuliQn = new QuantityBuilder()\n            .withAmount(cpuLim)\n            .build();\n    Quantity memliQn = new QuantityBuilder()\n            .withAmount(memLim)\n            .build();\n    ReplicationController rc = new ReplicationControllerBuilder()\n            .withApiVersion("v1")\n            .withKind("ReplicationController")\n            .withNewMetadata()\n            .withName(rcName)\n            .withNamespace(nsName)\n            .addToLabels(lbkey, lbvalue)\n            .endMetadata()\n            .withNewSpec()\n            .withReplicas(replicas)\n            .addToSelector(lbkey, lbvalue)\n            .withNewTemplate()\n            .withNewMetadata()\n            .addToLabels(lbkey, lbvalue)\n            .endMetadata()\n            .withNewSpec()\n            .addNewContainer()\n            .withName(ctName)\n            .withImage(imName)\n            .addNewPort()\n            .withContainerPort(cnPort)\n            .endPort()\n            .withNewResources()\n            .addToRequests("cpu", cpuQn)\n            .addToRequests("memory", memQn)\n            .addToLimits("cpu", cpuliQn)\n            .addToLimits("memory", memliQn)\n            .endResources()\n            .endContainer()\n            .endSpec()\n            .endTemplate()\n            .endSpec()\n            .build();\n    try {\n        kubernetesClient.replicationControllers().create(rc);\n        System.out.println("replication controller create success");\n    } catch (Exception e) {\n        System.out.println("replication controller create failed");\n    }\n    return rc;\n}<\/code><\/pre>\n
\u5176\u4e2drequest\u4e3a\u521d\u59cb\u8fd0\u884c\u65f6\u5360\u7528\u7684\u8d44\u6e90\u503c\uff0climit\u4e3a\u6700\u5927\u80fd\u4f7f\u7528\u7684\u8d44\u6e90\u503c\u3002<\/p>\n
\u5c06\u65b0\u589e\u53c2\u6570\u52a0\u5165DevK8sApiController.java<\/p>\n
\/\/k8s rc create\n@RequestMapping(value = "\/createRCWithinQuantity", method = RequestMethod.POST)\npublic ReplicationController createK8sRC(@RequestParam(value = "ReplicationControllerName") String rcName,\n                                         @RequestParam(value = "NamespaceName") String nsName,\n                                         @RequestParam(value = "LabelKey") String lbkey,\n                                         @RequestParam(value = "LabelValue") String lbvalue,\n                                         @RequestParam(value = "Replicas") int replicas,\n                                         @RequestParam(value = "ContainerName") String ctName,\n                                         @RequestParam(value = "ImageName") String imName,\n                                         @RequestParam(value = "ContainerPort") int cnPort,\n                                         @RequestParam(value = "CpuR") String cpurName,\n                                         @RequestParam(value = "MemR") String memrName,\n                                         @RequestParam(value = "CpuL") String cpulName,\n                                         @RequestParam(value = "MemL") String memlName) {\n    return devK8sApiService.createRC(rcName, nsName, lbkey, lbvalue, replicas, ctName, imName, cnPort, cpurName, memrName, cpulName, memlName);\n}<\/code><\/pre>\n
TensorFlow Jupyter Notebook\u5e94\u7528\u521b\u5efa<\/h2>\n
\u4fee\u6539\u5b8c\u6210\u540e\u91cd\u65b0\u6784\u5efa\u9879\u76ee\uff0c\u542f\u52a8\u5e94\u7528<\/p>\n
\u521b\u5efareplication controller<\/h3>\n
POST<\/code>: http:\/\/127.0.0.1:8080\/k8s\/createRCWithinQuantity<\/code>
\nContent-Type<\/code>: application\/x-www-form-urlencoded<\/code>
\nBody<\/code>: {"NameSpaceName":"appblog", "ReplicationControllerName":"tf-nb-rc", "LabelKey":"name", "LabelValue":"tf-nb", "Replicas":"1", "ContainerName":"tf-nb", "ImageName":"jupyter\/tensorflow-notebook", "ContainerPort":"8888", "CpuR":"1", "MemR":"1Gi", "CpuL":"1", "MemL":"2Gi"}<\/p>\n
\n
\u6ce8\uff1ajupyter\/tensorflow-notebook<\/code>\u7684ContainerPort<\/code>\u5fc5\u987b\u4e3a8888<\/code><\/p>\n<\/blockquote>\n
{\n    "apiVersion": "v1",\n    "kind": "ReplicationController",\n    "metadata": {\n        "annotations": {},\n        "labels": {\n            "name": "tf-nb"\n        },\n        "name": "tf-nb-rc",\n        "namespace": "appblog"\n    },\n    "spec": {\n        "replicas": 1,\n        "selector": {\n            "name": "tf-nb"\n        },\n        "template": {\n            "metadata": {\n                "annotations": {},\n                "labels": {\n                    "name": "tf-nb"\n                }\n            },\n            "spec": {\n                "containers": [\n                    {\n                        "image": "jupyter\/tensorflow-notebook",\n                        "name": "tf-nb",\n                        "ports": [\n                            {\n                                "containerPort": 8888\n                            }\n                        ],\n                        "resources": {\n                            "limits": {\n                                "cpu": "1",\n                                "memory": "2Gi"\n                            },\n                            "requests": {\n                                "cpu": "1",\n                                "memory": "1Gi"\n                            }\n                        }\n                    }\n                ],\n                "nodeSelector": {}\n            }\n        }\n    }\n}<\/code><\/pre>\n
\u5728master\u8282\u70b9\u4e0a\u67e5\u770brc\u4fe1\u606f\uff1a<\/p>\n
[root@k8s-master ~]# kubectl get pods -n appblog\nNAME                    READY   STATUS    RESTARTS   AGE\ntf-nb-rc-vs52b          1\/1     Running   0          9m2s\n[root@k8s-master ~]# kubectl describe rc tf-nb-rc -n appblog\nName:         tf-nb-rc\nNamespace:    appblog\nSelector:     name=tf-nb\nLabels:       name=tf-nb\nAnnotations:  <none>\nReplicas:     1 current \/ 1 desired\nPods Status:  0 Running \/ 1 Waiting \/ 0 Succeeded \/ 0 Failed\nPod Template:\n  Labels:  name=tf-nb\n  Containers:\n   tf-nb:\n    Image:      jupyter\/tensorflow-notebook\n    Port:       8888\/TCP\n    Host Port:  0\/TCP\n    Limits:\n      cpu:     2\n      memory:  2Gi\n    Requests:\n      cpu:        1\n      memory:     1Gi\n    Environment:  <none>\n    Mounts:       <none>\n  Volumes:        <none>\nEvents:\n  Type    Reason            Age   From                    Message\n  ----    ------            ----  ----                    -------\n  Normal  SuccessfulCreate  10s   replication-controller  Created pod: tf-nb-rc-vs52b<\/code><\/pre>\n
\u521b\u5efaservice<\/h3>\n
POST<\/code>: http:\/\/127.0.0.1:8080\/k8s\/createService<\/code>
\nContent-Type<\/code>: application\/x-www-form-urlencoded<\/code>
\nBody<\/code>: {"ServiceName":"tf-nb-service", "NameSpaceName":"appblog", "LabelKey":"name", "LabelValue":"tf-nb", "ContainerPort":"80", "NodePort":"30050"}<\/p>\n
{\n    "apiVersion": "v1",\n    "kind": "Service",\n    "metadata": {\n        "annotations": {},\n        "labels": {\n            "name": "tf-nb"\n        },\n        "name": "tf-nb-service",\n        "namespace": "appblog"\n    },\n    "spec": {\n        "ports": [\n            {\n                "nodePort": 30050,\n                "port": 8888\n            }\n        ],\n        "selector": {\n            "name": "tf-nb"\n        },\n        "type": "NodePort"\n    }\n}<\/code><\/pre>\n
\u5728master\u8282\u70b9\u4e0a\u67e5\u770bservice\u4fe1\u606f\uff1a<\/p>\n
[root@k8s-master ~]# kubectl get service tf-nb-service -n appblog\nNAME            TYPE       CLUSTER-IP     EXTERNAL-IP   PORT(S)          AGE\ntf-nb-service   NodePort   10.98.57.109   <none>        8888:30050\/TCP   24s<\/code><\/pre>\n
\u8bbf\u95ee\uff1ahttp:\/\/NodeIP:30050<\/code><\/p>\n
\u9700\u8981\u83b7\u53d6notebook\u7684token\u624d\u80fd\u8bbf\u95ee\u3002<\/p>\n
\"jupyter\u767b\u9646\"<\/p>\n
\u83b7\u53d6notebook token<\/h2>\n
\u7f16\u5199token\u83b7\u53d6\u65b9\u6cd5\uff1a<\/p>\n
\/\/token\u67e5\u8be2\npublic Map<String, String> readToken(String nsName, String rcName, String lbKey, String lbValue) {\n    Map<String, String> resourceInfo = new HashMap<String, String>();\n\n    try {\n        \/\/ExecWatch tokenResult = kubernetesClient.pods().inNamespace(nsName).withName(rcName).exec("jupyter notebook list");\n        PodList podList = kubernetesClient.pods().inNamespace(nsName).withLabel(lbKey, lbValue).list();\n        for (Pod pod : podList.getItems()) {\n            String podName = pod.getMetadata().getName();\n            String podLog = kubernetesClient.pods().inNamespace(nsName).withName(podName).getLog();\n            resourceInfo.put(podName + "token: ", podLog);\n        }\n        \/\/resourceInfo.put("token: ", tokenResult.toString());\n        log.error("model token get success");\n    } catch (Exception e) {\n        log.error("model token get failed");\n        log.error("", e);\n    }\n    return resourceInfo;\n}<\/code><\/pre>\n
\u56e0\u6267\u884cexec\u4f1a\u6709\u8ba4\u8bc1\u7684\u95ee\u9898\uff0c\u6b64\u5904\u4f7f\u7528getLog\u7684\u65b9\u6cd5\u83b7\u53d6\u542f\u52a8\u65e5\u5fd7\uff0c\u5728\u65e5\u5fd7\u4e2d\u67e5\u8be2token\u3002<\/p>\n
\u540c\u65f6\u4fee\u6539DevK8sApiController.java<\/p>\n
\/\/token read\n@RequestMapping(value = "\/readToken", method = RequestMethod.GET)\npublic Map<String, String> readJNtoken(@RequestParam(value = "NamespaceName") String nsName,\n                                       @RequestParam(value = "ReplicationControllerName") String rcName,\n                                       @RequestParam(value = "LabelKey") String lbkey,\n                                       @RequestParam(value = "LabelValue") String lbvalue) {\n    return devK8sApiService.readToken(nsName, rcName, lbkey, lbvalue);\n}<\/code><\/pre>\n
\u56e0\u4e3arc\u521b\u5efa\u7684pod\u90fd\u4f1a\u968f\u673a\u751f\u62105\u4f4d\u5b57\u7b26\u4e32\uff0c\u6240\u4ee5\u901a\u8fc7Label\u67e5\u8be2pod\u540d\u79f0\uff0c\u5e76\u83b7\u53d6\u65e5\u5fd7\u3002<\/p>\n
URL<\/code>: http:\/\/127.0.0.1:8080\/k8s\/readToken?NamespaceName=appblog&ReplicationControllerName=tf-nb-rc&LabelKey=name&LabelValue=tf-nb<\/a><\/p>\n
{\n    "tf-nb-rc-gzz5jtoken: ": "Executing the command: jupyter notebook\\n[I 01:25:06.115 NotebookApp] Writing notebook server cookie secret to \/home\/jovyan\/.local\/share\/jupyter\/runtime\/notebook_cookie_secret\\n[I 01:25:07.998 NotebookApp] JupyterLab extension loaded from \/opt\/conda\/lib\/python3.7\/site-packages\/jupyterlab\\n[I 01:25:07.998 NotebookApp] JupyterLab application directory is \/opt\/conda\/share\/jupyter\/lab\\n[I 01:25:08.000 NotebookApp] Serving notebooks from local directory: \/home\/jovyan\\n[I 01:25:08.000 NotebookApp] The Jupyter Notebook is running at:\\n[I 01:25:08.000 NotebookApp] http:\/\/(tf-nb-rc-gzz5j or 127.0.0.1):8888\/?token=f94b3960fb6a1b50f06d07b1211f41b38c26a3a3ec3e9173\\n[I 01:25:08.000 NotebookApp] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation).\\n[C 01:25:08.005 NotebookApp] \\n    \\n    To access the notebook, open this file in a browser:\\n        file:\/\/\/home\/jovyan\/.local\/share\/jupyter\/runtime\/nbserver-6-open.html\\n    Or copy and paste one of these URLs:\\n        http:\/\/(tf-nb-rc-gzz5j or 127.0.0.1):8888\/?token=f94b3960fb6a1b50f06d07b1211f41b38c26a3a3ec3e9173\\n[I 01:28:48.071 NotebookApp] 302 GET \/ (192.168.0.10) 0.66ms\\n[I 01:28:48.124 NotebookApp] 302 GET \/tree? (192.168.0.10) 4.00ms\\n"\n}<\/code><\/pre>\n
token\u4fe1\u606f\uff1atoken=f94b3960fb6a1b50f06d07b1211f41b38c26a3a3ec3e9173<\/code><\/p>\n
\u8bbf\u95eejupyter notebook\u5e76\u6d4b\u8bd5<\/h2>\n
\u8f93\u5165\u4e0a\u4e00\u8282\u4e2d\u7684token\u5e76\u767b\u5f55\uff1a<\/p>\n
\"jupyter\u4e3b\u9875\"<\/p>\n
\u7f16\u5199tensorflow\u6d4b\u8bd5\u7a0b\u5e8f\uff1a<\/p>\n
import tensorflow as tf\n\nhello = tf.Variable('Hello TF')\n\nsess = tf.Session()\ninit = tf.global_variables_initializer()\n\nsess.run(init)\nsess.run(hello)<\/code><\/pre>\n
\u8fd0\u884c\u4ee3\u7801\uff1a<\/p>\n
\"jupyter\u7f16\u5199\u4ee3\u7801\"<\/p>\n
\u4ee5\u4e0a\uff0c\u5f00\u53d1\u6a21\u578b\u521b\u5efa\u5b8c\u6210\u3002<\/p>\n","protected":false},"excerpt":{"rendered":"
\u76ee\u6807\uff1a\u5b8c\u6210\u6a21\u578b\u5f00\u53d1\u529f\u80fd\u4e2d\u7684Model\u521b\u5efa\uff0c\u8fd4\u56dejupyter notebook\u8bbf\u95ee\u4fe1\u606f \u6982\u8ff0 \u4eba\u5de5\u667a\u80fd\u670d\u52a1\u4e2d\u6a21 […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[10],"tags":[356],"class_list":["post-1444","post","type-post","status-publish","format-standard","hentry","category-k8s","tag-kubernetes"],"_links":{"self":[{"href":"https:\/\/www.appblog.cn\/index.php\/wp-json\/wp\/v2\/posts\/1444","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.appblog.cn\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.appblog.cn\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.appblog.cn\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.appblog.cn\/index.php\/wp-json\/wp\/v2\/comments?post=1444"}],"version-history":[{"count":0,"href":"https:\/\/www.appblog.cn\/index.php\/wp-json\/wp\/v2\/posts\/1444\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.appblog.cn\/index.php\/wp-json\/wp\/v2\/media?parent=1444"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.appblog.cn\/index.php\/wp-json\/wp\/v2\/categories?post=1444"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.appblog.cn\/index.php\/wp-json\/wp\/v2\/tags?post=1444"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}