Jun 02 05:45:42.453018 ip-10-0-134-109 systemd[1]: Starting Kubernetes Kubelet... Jun 02 05:45:42.938216 ip-10-0-134-109 kubenswrapper[2549]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 05:45:42.938216 ip-10-0-134-109 kubenswrapper[2549]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 02 05:45:42.938216 ip-10-0-134-109 kubenswrapper[2549]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 05:45:42.938216 ip-10-0-134-109 kubenswrapper[2549]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 02 05:45:42.938216 ip-10-0-134-109 kubenswrapper[2549]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 02 05:45:42.941176 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.941099 2549 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 02 05:45:42.945458 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945442 2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 05:45:42.945458 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945458 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 05:45:42.945535 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945476 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 05:45:42.945535 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945481 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 05:45:42.945535 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945485 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 05:45:42.945535 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945488 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 05:45:42.945535 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945492 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 05:45:42.945535 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945495 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 05:45:42.945535 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945497 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 05:45:42.945535 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945500 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 05:45:42.945535 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945503 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 05:45:42.945535 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945506 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 05:45:42.945535 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945513 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 05:45:42.945535 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945515 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 05:45:42.945535 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945518 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 05:45:42.945535 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945521 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 05:45:42.945535 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945523 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 05:45:42.945535 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945526 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 05:45:42.945535 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945528 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 05:45:42.945535 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945531 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 05:45:42.945535 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945533 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 05:45:42.946018 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945536 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 05:45:42.946018 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945539 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 05:45:42.946018 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945542 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 02 05:45:42.946018 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945544 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 05:45:42.946018 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945547 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 05:45:42.946018 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945550 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 05:45:42.946018 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945552 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 05:45:42.946018 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945555 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 05:45:42.946018 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945557 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 05:45:42.946018 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945560 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 05:45:42.946018 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945562 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 05:45:42.946018 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945565 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 05:45:42.946018 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945567 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 05:45:42.946018 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945570 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 05:45:42.946018 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945573 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 05:45:42.946018 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945575 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 05:45:42.946018 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945578 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 05:45:42.946018 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945580 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 05:45:42.946018 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945582 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 05:45:42.946018 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945585 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 05:45:42.946544 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945587 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 05:45:42.946544 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945591 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 05:45:42.946544 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945594 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 05:45:42.946544 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945597 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 05:45:42.946544 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945599 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 05:45:42.946544 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945601 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 05:45:42.946544 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945604 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 05:45:42.946544 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945606 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 05:45:42.946544 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945608 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 05:45:42.946544 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945611 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 05:45:42.946544 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945613 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 05:45:42.946544 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945616 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 05:45:42.946544 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945618 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 05:45:42.946544 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945622 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 05:45:42.946544 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945625 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 05:45:42.946544 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945628 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 05:45:42.946544 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945630 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 05:45:42.946544 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945632 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 05:45:42.946544 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945635 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 05:45:42.946544 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945637 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 05:45:42.947048 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945640 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 05:45:42.947048 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945642 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 05:45:42.947048 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945645 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 05:45:42.947048 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945647 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 05:45:42.947048 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945650 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 05:45:42.947048 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945652 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 05:45:42.947048 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945654 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 05:45:42.947048 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945657 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 05:45:42.947048 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945660 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 05:45:42.947048 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945663 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 05:45:42.947048 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945665 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 05:45:42.947048 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945667 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 05:45:42.947048 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945670 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 05:45:42.947048 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945678 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 05:45:42.947048 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945681 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 05:45:42.947048 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945684 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 05:45:42.947048 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945686 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 05:45:42.947048 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945689 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 05:45:42.947048 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945691 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 05:45:42.947048 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945693 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 05:45:42.947536 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945696 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 05:45:42.947536 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945698 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 05:45:42.947536 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945701 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 05:45:42.947536 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945705 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 05:45:42.947536 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.945707 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 05:45:42.947536 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946073 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 05:45:42.947536 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946079 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 05:45:42.947536 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946081 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 05:45:42.947536 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946084 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 05:45:42.947536 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946087 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 05:45:42.947536 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946090 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 05:45:42.947536 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946092 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 05:45:42.947536 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946095 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 05:45:42.947536 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946097 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 05:45:42.947536 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946100 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 05:45:42.947536 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946102 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 05:45:42.947536 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946105 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 05:45:42.947536 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946107 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 05:45:42.947536 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946110 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 05:45:42.947536 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946113 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 05:45:42.948034 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946115 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 05:45:42.948034 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946118 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 05:45:42.948034 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946121 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 05:45:42.948034 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946124 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 05:45:42.948034 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946126 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 05:45:42.948034 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946129 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 05:45:42.948034 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946132 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 05:45:42.948034 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946136 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 05:45:42.948034 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946138 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 05:45:42.948034 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946141 2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 05:45:42.948034 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946144 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 05:45:42.948034 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946146 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 05:45:42.948034 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946148 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 05:45:42.948034 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946151 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 05:45:42.948034 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946153 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 05:45:42.948034 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946156 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 05:45:42.948034 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946159 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 05:45:42.948034 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946162 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 05:45:42.948034 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946164 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 05:45:42.948553 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946167 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 05:45:42.948553 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946169 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 05:45:42.948553 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946171 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 05:45:42.948553 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946174 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 05:45:42.948553 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946176 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 02 05:45:42.948553 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946179 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 05:45:42.948553 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946181 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 05:45:42.948553 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946184 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 05:45:42.948553 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946186 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 05:45:42.948553 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946189 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 05:45:42.948553 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946191 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 05:45:42.948553 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946194 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 05:45:42.948553 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946196 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 05:45:42.948553 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946199 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 05:45:42.948553 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946202 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 05:45:42.948553 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946204 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 05:45:42.948553 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946207 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 05:45:42.948553 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946210 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 05:45:42.948553 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946212 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 05:45:42.948553 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946214 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 05:45:42.948553 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946217 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 05:45:42.949100 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946219 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 05:45:42.949100 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946222 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 05:45:42.949100 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946224 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 05:45:42.949100 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946227 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 05:45:42.949100 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946229 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 05:45:42.949100 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946232 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 05:45:42.949100 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946234 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 05:45:42.949100 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946237 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 05:45:42.949100 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946240 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 05:45:42.949100 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946243 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 05:45:42.949100 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946245 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 05:45:42.949100 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946248 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 05:45:42.949100 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946250 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 05:45:42.949100 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946253 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 05:45:42.949100 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946256 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 05:45:42.949100 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946258 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 05:45:42.949100 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946261 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 05:45:42.949100 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946263 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 05:45:42.949100 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946268 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 05:45:42.949573 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946271 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 05:45:42.949573 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946274 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 05:45:42.949573 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946277 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 05:45:42.949573 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946280 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 05:45:42.949573 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946283 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 05:45:42.949573 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946286 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 05:45:42.949573 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946289 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 05:45:42.949573 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946292 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 05:45:42.949573 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946294 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 05:45:42.949573 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946297 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 05:45:42.949573 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946299 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 05:45:42.949573 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.946302 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 05:45:42.949573 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947065 2549 flags.go:64] FLAG: --address="0.0.0.0" Jun 02 05:45:42.949573 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947074 2549 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 02 05:45:42.949573 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947080 2549 flags.go:64] FLAG: --anonymous-auth="true" Jun 02 05:45:42.949573 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947085 2549 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 02 05:45:42.949573 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947092 2549 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 02 05:45:42.949573 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947095 2549 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 02 05:45:42.949573 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947099 2549 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 02 05:45:42.949573 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947104 2549 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 02 05:45:42.949573 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947108 2549 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947111 2549 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947114 2549 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947118 2549 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947121 2549 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947124 2549 flags.go:64] FLAG: --cgroup-root="" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947127 2549 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947130 2549 flags.go:64] FLAG: --client-ca-file="" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947133 2549 flags.go:64] FLAG: --cloud-config="" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947135 2549 flags.go:64] FLAG: --cloud-provider="external" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947138 2549 flags.go:64] FLAG: --cluster-dns="[]" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947142 2549 flags.go:64] FLAG: --cluster-domain="" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947145 2549 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947148 2549 flags.go:64] FLAG: --config-dir="" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947151 2549 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947154 2549 flags.go:64] FLAG: --container-log-max-files="5" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947158 2549 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947161 2549 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947164 2549 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947168 2549 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947171 2549 flags.go:64] FLAG: --contention-profiling="false" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947174 2549 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947177 2549 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947180 2549 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947183 2549 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 02 05:45:42.950110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947187 2549 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947190 2549 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947193 2549 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947199 2549 flags.go:64] FLAG: --enable-load-reader="false" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947202 2549 flags.go:64] FLAG: --enable-server="true" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947205 2549 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947210 2549 flags.go:64] FLAG: --event-burst="100" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947213 2549 flags.go:64] FLAG: --event-qps="50" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947216 2549 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947219 2549 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947222 2549 flags.go:64] FLAG: --eviction-hard="" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947226 2549 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947229 2549 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947231 2549 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947234 2549 flags.go:64] FLAG: --eviction-soft="" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947237 2549 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947240 2549 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947243 2549 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947246 2549 flags.go:64] FLAG: --experimental-mounter-path="" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947249 2549 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947251 2549 flags.go:64] FLAG: --fail-swap-on="true" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947254 2549 flags.go:64] FLAG: --feature-gates="" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947258 2549 flags.go:64] FLAG: --file-check-frequency="20s" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947261 2549 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947264 2549 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 02 05:45:42.950717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947267 2549 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947270 2549 flags.go:64] FLAG: --healthz-port="10248" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947274 2549 flags.go:64] FLAG: --help="false" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947277 2549 flags.go:64] FLAG: --hostname-override="ip-10-0-134-109.ec2.internal" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947280 2549 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947283 2549 flags.go:64] FLAG: --http-check-frequency="20s" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947286 2549 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947289 2549 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947292 2549 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947295 2549 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947299 2549 flags.go:64] FLAG: --image-service-endpoint="" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947302 2549 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947305 2549 flags.go:64] FLAG: --kube-api-burst="100" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947308 2549 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947311 2549 flags.go:64] FLAG: --kube-api-qps="50" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947313 2549 flags.go:64] FLAG: --kube-reserved="" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947317 2549 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947319 2549 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947322 2549 flags.go:64] FLAG: --kubelet-cgroups="" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947326 2549 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947328 2549 flags.go:64] FLAG: --lock-file="" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947331 2549 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947334 2549 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947337 2549 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 02 05:45:42.951366 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947343 2549 flags.go:64] FLAG: --log-json-split-stream="false" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947345 2549 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947348 2549 flags.go:64] FLAG: --log-text-split-stream="false" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947351 2549 flags.go:64] FLAG: --logging-format="text" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947354 2549 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947357 2549 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947360 2549 flags.go:64] FLAG: --manifest-url="" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947362 2549 flags.go:64] FLAG: --manifest-url-header="" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947366 2549 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947369 2549 flags.go:64] FLAG: --max-open-files="1000000" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947373 2549 flags.go:64] FLAG: --max-pods="110" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947379 2549 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947382 2549 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947385 2549 flags.go:64] FLAG: --memory-manager-policy="None" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947387 2549 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947390 2549 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947393 2549 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947396 2549 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947405 2549 flags.go:64] FLAG: --node-status-max-images="50" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947408 2549 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947411 2549 flags.go:64] FLAG: --oom-score-adj="-999" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947414 2549 flags.go:64] FLAG: --pod-cidr="" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947416 2549 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947422 2549 flags.go:64] FLAG: --pod-manifest-path="" Jun 02 05:45:42.951976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947425 2549 flags.go:64] FLAG: --pod-max-pids="-1" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947428 2549 flags.go:64] FLAG: --pods-per-core="0" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947431 2549 flags.go:64] FLAG: --port="10250" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947434 2549 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947437 2549 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e7d08758e10506a2" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947440 2549 flags.go:64] FLAG: --qos-reserved="" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947443 2549 flags.go:64] FLAG: --read-only-port="10255" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947446 2549 flags.go:64] FLAG: --register-node="true" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947449 2549 flags.go:64] FLAG: --register-schedulable="true" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947452 2549 flags.go:64] FLAG: --register-with-taints="" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947455 2549 flags.go:64] FLAG: --registry-burst="10" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947458 2549 flags.go:64] FLAG: --registry-qps="5" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947461 2549 flags.go:64] FLAG: --reserved-cpus="" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947464 2549 flags.go:64] FLAG: --reserved-memory="" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947468 2549 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947471 2549 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947474 2549 flags.go:64] FLAG: --rotate-certificates="false" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947476 2549 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947479 2549 flags.go:64] FLAG: --runonce="false" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947486 2549 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947490 2549 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947493 2549 flags.go:64] FLAG: --seccomp-default="false" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947495 2549 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947498 2549 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947501 2549 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947504 2549 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 02 05:45:42.952565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947507 2549 flags.go:64] FLAG: --storage-driver-password="root" Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947511 2549 flags.go:64] FLAG: --storage-driver-secure="false" Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947514 2549 flags.go:64] FLAG: --storage-driver-table="stats" Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947517 2549 flags.go:64] FLAG: --storage-driver-user="root" Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947520 2549 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947523 2549 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947525 2549 flags.go:64] FLAG: --system-cgroups="" Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947528 2549 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947533 2549 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947536 2549 flags.go:64] FLAG: --tls-cert-file="" Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947539 2549 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947543 2549 flags.go:64] FLAG: --tls-min-version="" Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947545 2549 flags.go:64] FLAG: --tls-private-key-file="" Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947549 2549 flags.go:64] FLAG: --topology-manager-policy="none" Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947552 2549 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947554 2549 flags.go:64] FLAG: --topology-manager-scope="container" Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947557 2549 flags.go:64] FLAG: --v="2" Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947561 2549 flags.go:64] FLAG: --version="false" Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947565 2549 flags.go:64] FLAG: --vmodule="" Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947569 2549 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947572 2549 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947667 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947671 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947674 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 05:45:42.953222 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947677 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 05:45:42.953966 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947680 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 05:45:42.953966 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947683 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 05:45:42.953966 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947686 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 05:45:42.953966 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947688 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 05:45:42.953966 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947691 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 05:45:42.953966 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947694 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 05:45:42.953966 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947696 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 05:45:42.953966 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947699 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 05:45:42.953966 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947703 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 05:45:42.953966 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947705 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 05:45:42.953966 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947708 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 05:45:42.953966 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947711 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 05:45:42.953966 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947713 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 05:45:42.953966 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947716 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 05:45:42.953966 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947720 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 05:45:42.953966 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947723 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 05:45:42.953966 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947726 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 05:45:42.953966 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947729 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 05:45:42.953966 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947732 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 05:45:42.953966 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947735 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 05:45:42.954745 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947738 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 05:45:42.954745 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947741 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 05:45:42.954745 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947744 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 05:45:42.954745 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947760 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 05:45:42.954745 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947763 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 05:45:42.954745 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947765 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 05:45:42.954745 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947768 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 05:45:42.954745 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947771 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 05:45:42.954745 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947775 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 05:45:42.954745 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947778 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 05:45:42.954745 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947780 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 05:45:42.954745 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947783 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 05:45:42.954745 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947786 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 05:45:42.954745 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947789 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 05:45:42.954745 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947791 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 05:45:42.954745 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947795 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 05:45:42.954745 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947798 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 05:45:42.954745 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947801 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 05:45:42.954745 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947803 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 05:45:42.955622 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947806 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 05:45:42.955622 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947809 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 05:45:42.955622 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947812 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 05:45:42.955622 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947814 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 05:45:42.955622 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947817 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 05:45:42.955622 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947820 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 05:45:42.955622 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947823 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 05:45:42.955622 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947825 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 05:45:42.955622 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947828 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 05:45:42.955622 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947830 2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 05:45:42.955622 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947833 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 05:45:42.955622 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947835 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 05:45:42.955622 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947838 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 05:45:42.955622 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947840 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 05:45:42.955622 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947843 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 05:45:42.955622 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947846 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 05:45:42.955622 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947848 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 05:45:42.955622 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947851 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 05:45:42.955622 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947853 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 05:45:42.955622 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947856 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 05:45:42.955622 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947859 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 05:45:42.956662 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947861 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 05:45:42.956662 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947864 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 05:45:42.956662 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947867 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 05:45:42.956662 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947869 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 05:45:42.956662 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947873 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 05:45:42.956662 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947875 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 02 05:45:42.956662 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947878 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 05:45:42.956662 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947881 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 05:45:42.956662 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947884 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 05:45:42.956662 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947886 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 05:45:42.956662 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947889 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 05:45:42.956662 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947891 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 05:45:42.956662 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947895 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 05:45:42.956662 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947898 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 05:45:42.956662 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947901 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 05:45:42.956662 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947903 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 05:45:42.956662 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947906 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 05:45:42.956662 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947908 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 05:45:42.956662 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947911 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 05:45:42.956662 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947913 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 05:45:42.957293 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947916 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 05:45:42.957293 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.947918 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 05:45:42.957293 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.947924 2549 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 05:45:42.957293 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.955687 2549 server.go:530] "Kubelet version" kubeletVersion="v1.33.12" Jun 02 05:45:42.957293 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.955707 2549 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 02 05:45:42.957293 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955796 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 05:45:42.957293 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955806 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 05:45:42.957293 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955812 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 05:45:42.957293 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955816 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 05:45:42.957293 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955821 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 05:45:42.957293 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955825 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 05:45:42.957293 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955829 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 05:45:42.957293 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955832 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 05:45:42.957293 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955836 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 05:45:42.957293 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955840 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 05:45:42.957771 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955844 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 05:45:42.957771 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955848 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 05:45:42.957771 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955851 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 05:45:42.957771 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955855 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 05:45:42.957771 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955859 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 05:45:42.957771 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955864 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 05:45:42.957771 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955868 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 05:45:42.957771 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955872 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 05:45:42.957771 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955877 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 05:45:42.957771 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955881 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 05:45:42.957771 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955885 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 05:45:42.957771 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955890 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 05:45:42.957771 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955894 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 05:45:42.957771 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955898 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 05:45:42.957771 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955902 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 05:45:42.957771 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955906 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 05:45:42.957771 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955910 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 05:45:42.957771 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955915 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 05:45:42.957771 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955920 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 05:45:42.957771 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955924 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 05:45:42.958447 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955928 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 05:45:42.958447 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955933 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 05:45:42.958447 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955940 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 05:45:42.958447 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955947 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 05:45:42.958447 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955952 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 05:45:42.958447 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955957 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 05:45:42.958447 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955962 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 05:45:42.958447 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955966 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 05:45:42.958447 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955971 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 05:45:42.958447 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955975 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 05:45:42.958447 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955980 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 05:45:42.958447 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955985 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 05:45:42.958447 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955989 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 05:45:42.958447 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955993 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 05:45:42.958447 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.955997 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 05:45:42.958447 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956001 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 05:45:42.958447 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956006 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 05:45:42.958447 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956010 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 05:45:42.958447 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956014 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 05:45:42.959025 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956018 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 05:45:42.959025 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956022 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 05:45:42.959025 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956026 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 05:45:42.959025 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956031 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 05:45:42.959025 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956035 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 05:45:42.959025 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956039 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 05:45:42.959025 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956044 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 05:45:42.959025 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956048 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 05:45:42.959025 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956052 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 05:45:42.959025 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956056 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 05:45:42.959025 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956060 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 05:45:42.959025 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956064 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 05:45:42.959025 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956068 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 05:45:42.959025 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956072 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 05:45:42.959025 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956078 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 05:45:42.959025 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956082 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 05:45:42.959025 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956086 2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 05:45:42.959025 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956090 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 05:45:42.959025 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956094 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 05:45:42.959025 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956098 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 05:45:42.959561 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956102 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 05:45:42.959561 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956106 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 05:45:42.959561 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956110 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 05:45:42.959561 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956115 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 02 05:45:42.959561 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956119 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 05:45:42.959561 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956123 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 05:45:42.959561 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956127 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 05:45:42.959561 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956144 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 05:45:42.959561 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956149 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 05:45:42.959561 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956153 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 05:45:42.959561 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956158 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 05:45:42.959561 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956162 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 05:45:42.959561 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956166 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 05:45:42.959561 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956170 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 05:45:42.959561 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956175 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 05:45:42.959561 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956179 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 05:45:42.959561 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956184 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 05:45:42.960386 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.956191 2549 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 05:45:42.960386 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956343 2549 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 02 05:45:42.960386 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956351 2549 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 02 05:45:42.960386 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956355 2549 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 02 05:45:42.960386 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956360 2549 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 02 05:45:42.960386 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956364 2549 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 02 05:45:42.960386 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956369 2549 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 02 05:45:42.960386 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956374 2549 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 02 05:45:42.960386 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956378 2549 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 02 05:45:42.960386 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956382 2549 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 02 05:45:42.960386 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956387 2549 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 02 05:45:42.960386 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956391 2549 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 02 05:45:42.960386 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956395 2549 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 02 05:45:42.960386 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956399 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 02 05:45:42.960386 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956403 2549 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 02 05:45:42.960386 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956407 2549 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 02 05:45:42.960915 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956411 2549 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 02 05:45:42.960915 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956416 2549 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 02 05:45:42.960915 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956420 2549 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 02 05:45:42.960915 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956424 2549 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 02 05:45:42.960915 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956428 2549 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 02 05:45:42.960915 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956432 2549 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 02 05:45:42.960915 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956437 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 02 05:45:42.960915 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956449 2549 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 02 05:45:42.960915 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956454 2549 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 02 05:45:42.960915 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956459 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 02 05:45:42.960915 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956463 2549 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 02 05:45:42.960915 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956467 2549 feature_gate.go:328] unrecognized feature gate: Example Jun 02 05:45:42.960915 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956472 2549 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 02 05:45:42.960915 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956479 2549 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 02 05:45:42.960915 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956485 2549 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 02 05:45:42.960915 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956490 2549 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 02 05:45:42.960915 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956495 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 02 05:45:42.960915 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956500 2549 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 02 05:45:42.960915 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956505 2549 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 02 05:45:42.960915 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956509 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 02 05:45:42.961531 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956513 2549 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 02 05:45:42.961531 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956518 2549 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS Jun 02 05:45:42.961531 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956522 2549 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 02 05:45:42.961531 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956527 2549 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations Jun 02 05:45:42.961531 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956531 2549 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 02 05:45:42.961531 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956535 2549 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 02 05:45:42.961531 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956540 2549 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 02 05:45:42.961531 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956544 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 02 05:45:42.961531 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956550 2549 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 02 05:45:42.961531 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956555 2549 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 02 05:45:42.961531 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956559 2549 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 02 05:45:42.961531 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956563 2549 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 02 05:45:42.961531 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956568 2549 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 02 05:45:42.961531 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956572 2549 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 02 05:45:42.961531 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956575 2549 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 02 05:45:42.961531 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956580 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI Jun 02 05:45:42.961531 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956585 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 02 05:45:42.961531 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956589 2549 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 02 05:45:42.961531 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956593 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 02 05:45:42.961531 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956598 2549 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 02 05:45:42.962060 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956617 2549 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController Jun 02 05:45:42.962060 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956622 2549 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 02 05:45:42.962060 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956626 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 02 05:45:42.962060 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956631 2549 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 02 05:45:42.962060 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956635 2549 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 02 05:45:42.962060 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956639 2549 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 02 05:45:42.962060 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956643 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 02 05:45:42.962060 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956648 2549 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 02 05:45:42.962060 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956652 2549 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 02 05:45:42.962060 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956656 2549 feature_gate.go:328] unrecognized feature gate: Example2 Jun 02 05:45:42.962060 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956660 2549 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 02 05:45:42.962060 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956664 2549 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 02 05:45:42.962060 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956667 2549 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 02 05:45:42.962060 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956672 2549 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 02 05:45:42.962060 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956676 2549 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 02 05:45:42.962060 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956679 2549 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 02 05:45:42.962060 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956683 2549 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 02 05:45:42.962060 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956687 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 02 05:45:42.962060 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956692 2549 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 02 05:45:42.962060 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956696 2549 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 02 05:45:42.962596 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956701 2549 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 02 05:45:42.962596 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956705 2549 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 02 05:45:42.962596 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956709 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 02 05:45:42.962596 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956713 2549 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 02 05:45:42.962596 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956717 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 02 05:45:42.962596 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956721 2549 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 02 05:45:42.962596 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956725 2549 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 02 05:45:42.962596 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956729 2549 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 02 05:45:42.962596 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956733 2549 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 02 05:45:42.962596 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956737 2549 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 02 05:45:42.962596 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:42.956742 2549 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 02 05:45:42.962596 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.956766 2549 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} Jun 02 05:45:42.962596 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.957535 2549 server.go:962] "Client rotation is on, will bootstrap in background" Jun 02 05:45:42.962596 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.961080 2549 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 02 05:45:42.962596 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.962134 2549 server.go:1019] "Starting client certificate rotation" Jun 02 05:45:42.962990 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.962246 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 05:45:42.962990 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.962284 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 02 05:45:42.990287 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.990266 2549 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 05:45:42.992899 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:42.992879 2549 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 02 05:45:43.004285 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.004270 2549 log.go:25] "Validated CRI v1 runtime API" Jun 02 05:45:43.011060 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.011046 2549 log.go:25] "Validated CRI v1 image API" Jun 02 05:45:43.012265 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.012251 2549 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 02 05:45:43.017805 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.017780 2549 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 af41bff2-39ab-4cb6-8d40-a2550cad61c5:/dev/nvme0n1p4 eb3a7d17-3ac2-4d4a-9de3-6f9a5bb0e3c4:/dev/nvme0n1p3] Jun 02 05:45:43.017878 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.017804 2549 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 02 05:45:43.019718 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.019699 2549 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 05:45:43.023156 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.023051 2549 manager.go:217] Machine: {Timestamp:2026-06-02 05:45:43.022572152 +0000 UTC m=+0.438868426 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099052 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d0a36d9f16ce14f5977d48803e54f SystemUUID:ec2d0a36-d9f1-6ce1-4f59-77d48803e54f BootID:b5d59c42-bf63-444f-9636-175e331ab436 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d4:e7:9d:cc:99 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d4:e7:9d:cc:99 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:fe:a8:68:39:29 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 02 05:45:43.023810 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.023800 2549 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 02 05:45:43.023906 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.023894 2549 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 02 05:45:43.025793 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.025771 2549 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 02 05:45:43.025922 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.025796 2549 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-109.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 02 05:45:43.025971 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.025931 2549 topology_manager.go:138] "Creating topology manager with none policy" Jun 02 05:45:43.025971 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.025939 2549 container_manager_linux.go:306] "Creating device plugin manager" Jun 02 05:45:43.025971 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.025946 2549 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 05:45:43.026561 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.026552 2549 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 02 05:45:43.027791 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.027781 2549 state_mem.go:36] "Initialized new in-memory state store" Jun 02 05:45:43.028012 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.028002 2549 server.go:1267] "Using root directory" path="/var/lib/kubelet" Jun 02 05:45:43.031805 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.031795 2549 kubelet.go:491] "Attempting to sync node with API server" Jun 02 05:45:43.031843 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.031809 2549 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 02 05:45:43.031843 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.031826 2549 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 02 05:45:43.031843 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.031835 2549 kubelet.go:397] "Adding apiserver pod source" Jun 02 05:45:43.031843 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.031843 2549 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 02 05:45:43.032899 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.032889 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 05:45:43.032958 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.032908 2549 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 02 05:45:43.036466 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.036450 2549 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1" Jun 02 05:45:43.038466 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.038451 2549 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 02 05:45:43.040810 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.040795 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 02 05:45:43.040863 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.040816 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 02 05:45:43.040863 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.040825 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 02 05:45:43.040863 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.040833 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 02 05:45:43.040863 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.040841 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 02 05:45:43.040863 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.040847 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 02 05:45:43.040863 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.040853 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 02 05:45:43.040863 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.040859 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 02 05:45:43.040863 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.040865 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 02 05:45:43.041093 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.040871 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 02 05:45:43.041093 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.040880 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 02 05:45:43.041093 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.040886 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 02 05:45:43.043543 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:43.043522 2549 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 02 05:45:43.043616 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:43.043563 2549 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 02 05:45:43.043911 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.043899 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 02 05:45:43.043947 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.043915 2549 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 02 05:45:43.046776 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.046764 2549 watchdog_linux.go:99] "Systemd watchdog is not enabled" Jun 02 05:45:43.046821 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.046797 2549 server.go:1295] "Started kubelet" Jun 02 05:45:43.046893 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.046854 2549 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 02 05:45:43.047155 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.047045 2549 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 02 05:45:43.047261 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.047244 2549 server_v1.go:47] "podresources" method="list" useActivePods=true Jun 02 05:45:43.047522 ip-10-0-134-109 systemd[1]: Started Kubernetes Kubelet. Jun 02 05:45:43.048375 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.048273 2549 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 02 05:45:43.049885 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.049871 2549 server.go:317] "Adding debug handlers to kubelet server" Jun 02 05:45:43.054801 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.054778 2549 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 02 05:45:43.055194 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.055177 2549 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-109.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 02 05:45:43.055569 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.055492 2549 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 02 05:45:43.059502 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:43.055421 2549 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-109.ec2.internal.18b52d65d2d142dc default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-109.ec2.internal,UID:ip-10-0-134-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-109.ec2.internal,},FirstTimestamp:2026-06-02 05:45:43.046775516 +0000 UTC m=+0.463071770,LastTimestamp:2026-06-02 05:45:43.046775516 +0000 UTC m=+0.463071770,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-109.ec2.internal,}" Jun 02 05:45:43.059851 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.059811 2549 volume_manager.go:295] "The desired_state_of_world populator starts" Jun 02 05:45:43.059851 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.059850 2549 volume_manager.go:297] "Starting Kubelet Volume Manager" Jun 02 05:45:43.060078 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.060062 2549 desired_state_of_world_populator.go:150] "Desired state populator starts to run" Jun 02 05:45:43.060170 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.060159 2549 reconstruct.go:97] "Volume reconstruction finished" Jun 02 05:45:43.060216 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.060173 2549 reconciler.go:26] "Reconciler: start to sync state" Jun 02 05:45:43.062387 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.062368 2549 factory.go:153] Registering CRI-O factory Jun 02 05:45:43.062494 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.062472 2549 factory.go:223] Registration of the crio container factory successfully Jun 02 05:45:43.062692 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.062680 2549 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 02 05:45:43.062770 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.062695 2549 factory.go:55] Registering systemd factory Jun 02 05:45:43.062770 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.062703 2549 factory.go:223] Registration of the systemd container factory successfully Jun 02 05:45:43.062770 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.062719 2549 factory.go:103] Registering Raw factory Jun 02 05:45:43.062925 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.062847 2549 manager.go:1196] Started watching for new ooms in manager Jun 02 05:45:43.063404 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.063384 2549 manager.go:319] Starting recovery of all containers Jun 02 05:45:43.065467 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.065439 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b7dmb" Jun 02 05:45:43.066217 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:43.066191 2549 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 02 05:45:43.066307 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:43.066246 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-109.ec2.internal\" not found" Jun 02 05:45:43.068121 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:43.068094 2549 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 02 05:45:43.070415 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:43.070388 2549 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 02 05:45:43.071180 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.071147 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-b7dmb" Jun 02 05:45:43.075454 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.075440 2549 manager.go:324] Recovery completed Jun 02 05:45:43.079704 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.079692 2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 05:45:43.081309 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.081289 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-109.ec2.internal" event="NodeHasSufficientMemory" Jun 02 05:45:43.081375 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.081313 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 05:45:43.081375 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.081322 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-109.ec2.internal" event="NodeHasSufficientPID" Jun 02 05:45:43.081774 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.081759 2549 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 02 05:45:43.081774 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.081771 2549 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 02 05:45:43.081862 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.081786 2549 state_mem.go:36] "Initialized new in-memory state store" Jun 02 05:45:43.085712 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.085695 2549 policy_none.go:49] "None policy: Start" Jun 02 05:45:43.085712 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.085712 2549 memory_manager.go:186] "Starting memorymanager" policy="None" Jun 02 05:45:43.085867 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.085721 2549 state_mem.go:35] "Initializing new in-memory state store" Jun 02 05:45:43.130336 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.130322 2549 manager.go:341] "Starting Device Plugin manager" Jun 02 05:45:43.137017 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:43.130372 2549 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 02 05:45:43.137017 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.130384 2549 server.go:85] "Starting device plugin registration server" Jun 02 05:45:43.137017 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.130554 2549 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 02 05:45:43.137017 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.130562 2549 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 02 05:45:43.137017 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.130672 2549 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 02 05:45:43.137017 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.130745 2549 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 02 05:45:43.137017 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.130772 2549 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 02 05:45:43.137017 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:43.131154 2549 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 02 05:45:43.137017 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:43.131183 2549 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-109.ec2.internal\" not found" Jun 02 05:45:43.183105 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.183083 2549 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" Jun 02 05:45:43.184178 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.184164 2549 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" Jun 02 05:45:43.184273 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.184189 2549 status_manager.go:230] "Starting to sync pod status with apiserver" Jun 02 05:45:43.184273 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.184206 2549 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 02 05:45:43.184273 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.184212 2549 kubelet.go:2451] "Starting kubelet main sync loop" Jun 02 05:45:43.184273 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:43.184242 2549 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 02 05:45:43.190455 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.190415 2549 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 05:45:43.231286 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.231260 2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 05:45:43.234839 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.234817 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-109.ec2.internal" event="NodeHasSufficientMemory" Jun 02 05:45:43.234931 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.234846 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 05:45:43.234931 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.234861 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-109.ec2.internal" event="NodeHasSufficientPID" Jun 02 05:45:43.234931 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.234888 2549 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-109.ec2.internal" Jun 02 05:45:43.244409 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.244394 2549 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-109.ec2.internal" Jun 02 05:45:43.244491 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:43.244416 2549 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-109.ec2.internal\": node \"ip-10-0-134-109.ec2.internal\" not found" Jun 02 05:45:43.256370 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:43.256348 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-109.ec2.internal\" not found" Jun 02 05:45:43.285309 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.285286 2549 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-109.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-109.ec2.internal"] Jun 02 05:45:43.285392 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.285340 2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 05:45:43.286129 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.286115 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-109.ec2.internal" event="NodeHasSufficientMemory" Jun 02 05:45:43.286192 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.286147 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 05:45:43.286192 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.286157 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-109.ec2.internal" event="NodeHasSufficientPID" Jun 02 05:45:43.287230 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.287219 2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 05:45:43.287384 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.287372 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-109.ec2.internal" Jun 02 05:45:43.287422 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.287399 2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 05:45:43.287910 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.287893 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-109.ec2.internal" event="NodeHasSufficientMemory" Jun 02 05:45:43.287991 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.287896 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-109.ec2.internal" event="NodeHasSufficientMemory" Jun 02 05:45:43.287991 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.287946 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 05:45:43.287991 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.287969 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-109.ec2.internal" event="NodeHasSufficientPID" Jun 02 05:45:43.287991 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.287923 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 05:45:43.288128 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.287995 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-109.ec2.internal" event="NodeHasSufficientPID" Jun 02 05:45:43.288975 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.288963 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-109.ec2.internal" Jun 02 05:45:43.289027 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.288986 2549 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" Jun 02 05:45:43.289665 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.289648 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-109.ec2.internal" event="NodeHasSufficientMemory" Jun 02 05:45:43.289765 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.289681 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-109.ec2.internal" event="NodeHasNoDiskPressure" Jun 02 05:45:43.289765 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.289696 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-109.ec2.internal" event="NodeHasSufficientPID" Jun 02 05:45:43.310326 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:43.310304 2549 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-109.ec2.internal\" not found" node="ip-10-0-134-109.ec2.internal" Jun 02 05:45:43.314588 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:43.314575 2549 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-109.ec2.internal\" not found" node="ip-10-0-134-109.ec2.internal" Jun 02 05:45:43.356782 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:43.356765 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-109.ec2.internal\" not found" Jun 02 05:45:43.361842 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.361826 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/720d1a64b25c8e7c73406333baa1c8d8-config\") pod \"kube-apiserver-proxy-ip-10-0-134-109.ec2.internal\" (UID: \"720d1a64b25c8e7c73406333baa1c8d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-109.ec2.internal" Jun 02 05:45:43.361890 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.361850 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88275a9e948ac352a48988b927e7086b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-109.ec2.internal\" (UID: \"88275a9e948ac352a48988b927e7086b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-109.ec2.internal" Jun 02 05:45:43.361890 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.361875 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88275a9e948ac352a48988b927e7086b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-109.ec2.internal\" (UID: \"88275a9e948ac352a48988b927e7086b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-109.ec2.internal" Jun 02 05:45:43.456932 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:43.456891 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-109.ec2.internal\" not found" Jun 02 05:45:43.462152 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.462137 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88275a9e948ac352a48988b927e7086b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-109.ec2.internal\" (UID: \"88275a9e948ac352a48988b927e7086b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-109.ec2.internal" Jun 02 05:45:43.462223 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.462167 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88275a9e948ac352a48988b927e7086b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-109.ec2.internal\" (UID: \"88275a9e948ac352a48988b927e7086b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-109.ec2.internal" Jun 02 05:45:43.462223 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.462193 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/720d1a64b25c8e7c73406333baa1c8d8-config\") pod \"kube-apiserver-proxy-ip-10-0-134-109.ec2.internal\" (UID: \"720d1a64b25c8e7c73406333baa1c8d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-109.ec2.internal" Jun 02 05:45:43.462467 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.462238 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/720d1a64b25c8e7c73406333baa1c8d8-config\") pod \"kube-apiserver-proxy-ip-10-0-134-109.ec2.internal\" (UID: \"720d1a64b25c8e7c73406333baa1c8d8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-109.ec2.internal" Jun 02 05:45:43.462530 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.462477 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88275a9e948ac352a48988b927e7086b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-109.ec2.internal\" (UID: \"88275a9e948ac352a48988b927e7086b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-109.ec2.internal" Jun 02 05:45:43.462889 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.462868 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88275a9e948ac352a48988b927e7086b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-109.ec2.internal\" (UID: \"88275a9e948ac352a48988b927e7086b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-109.ec2.internal" Jun 02 05:45:43.557541 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:43.557517 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-109.ec2.internal\" not found" Jun 02 05:45:43.612994 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.612973 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-109.ec2.internal" Jun 02 05:45:43.617410 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.617390 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-109.ec2.internal" Jun 02 05:45:43.657979 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:43.657953 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-109.ec2.internal\" not found" Jun 02 05:45:43.758468 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:43.758422 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-109.ec2.internal\" not found" Jun 02 05:45:43.858992 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:43.858967 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-109.ec2.internal\" not found" Jun 02 05:45:43.933685 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.933659 2549 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 05:45:43.959596 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:43.959567 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-109.ec2.internal\" not found" Jun 02 05:45:43.961758 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.961731 2549 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 02 05:45:43.961896 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.961880 2549 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 05:45:43.961948 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.961908 2549 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 02 05:45:43.988364 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:43.988343 2549 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 05:45:44.055852 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:44.055794 2549 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 02 05:45:44.060234 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:44.060215 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-109.ec2.internal\" not found" Jun 02 05:45:44.065286 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:44.065269 2549 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 02 05:45:44.072932 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:44.072909 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-01 05:40:43 +0000 UTC" deadline="2027-12-27 13:04:01.12908559 +0000 UTC" Jun 02 05:45:44.072932 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:44.072931 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13759h18m17.056157472s" Jun 02 05:45:44.123346 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:44.123327 2549 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sb6wb" Jun 02 05:45:44.129164 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:44.129145 2549 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sb6wb" Jun 02 05:45:44.160542 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:44.160521 2549 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-109.ec2.internal\" not found" Jun 02 05:45:44.188241 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:44.188211 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod720d1a64b25c8e7c73406333baa1c8d8.slice/crio-cd9de9dfa6088f59751295487387ccdee3d100f51ae120142a1c9b89d19f4a2f WatchSource:0}: Error finding container cd9de9dfa6088f59751295487387ccdee3d100f51ae120142a1c9b89d19f4a2f: Status 404 returned error can't find the container with id cd9de9dfa6088f59751295487387ccdee3d100f51ae120142a1c9b89d19f4a2f Jun 02 05:45:44.188376 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:44.188362 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88275a9e948ac352a48988b927e7086b.slice/crio-ca5aa1e6107bab53816067c3ee7425b2002b766323436a84e5de8bef257a608c WatchSource:0}: Error finding container ca5aa1e6107bab53816067c3ee7425b2002b766323436a84e5de8bef257a608c: Status 404 returned error can't find the container with id ca5aa1e6107bab53816067c3ee7425b2002b766323436a84e5de8bef257a608c Jun 02 05:45:44.189236 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:44.189221 2549 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 05:45:44.192395 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:44.192381 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 05:45:44.261227 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:44.261207 2549 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-109.ec2.internal" Jun 02 05:45:44.271395 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:44.271378 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 05:45:44.272421 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:44.272410 2549 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-109.ec2.internal" Jun 02 05:45:44.284136 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:44.284120 2549 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 02 05:45:44.916204 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:44.916154 2549 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 05:45:45.033448 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.033418 2549 apiserver.go:52] "Watching apiserver" Jun 02 05:45:45.040859 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.040835 2549 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 02 05:45:45.043596 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.043562 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-krddm","kube-system/konnectivity-agent-l29df","kube-system/kube-apiserver-proxy-ip-10-0-134-109.ec2.internal","openshift-cluster-node-tuning-operator/tuned-dtpw4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-109.ec2.internal","openshift-multus/multus-4b9mb","openshift-multus/network-metrics-daemon-gr5pg","openshift-network-diagnostics/network-check-target-hf8xq","openshift-network-operator/iptables-alerter-hx2gv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56","openshift-dns/node-resolver-k5p47","openshift-image-registry/node-ca-wplv9","openshift-multus/multus-additional-cni-plugins-2dbp8"] Jun 02 05:45:45.046071 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.046050 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:45:45.046173 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:45.046138 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr5pg" podUID="0a260826-64c9-465b-8e06-508f90b75d0f" Jun 02 05:45:45.047135 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.047107 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l29df" Jun 02 05:45:45.048125 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.048105 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.048231 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.048201 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.049479 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.049459 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b2dzm\"" Jun 02 05:45:45.049586 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.049510 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 02 05:45:45.050009 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.049806 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 02 05:45:45.050009 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.049823 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.051042 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.051022 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m5v8f\"" Jun 02 05:45:45.051384 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.051368 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 02 05:45:45.052287 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.052270 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-qq9pk\"" Jun 02 05:45:45.052445 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.052420 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 02 05:45:45.052489 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.052448 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 02 05:45:45.053481 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.052739 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 02 05:45:45.053481 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.053069 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:45:45.053481 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.053126 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 02 05:45:45.053481 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:45.053175 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf8xq" podUID="39308fd5-852d-48a5-8cd0-6a6d1bdc4f28" Jun 02 05:45:45.053481 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.053287 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4k2pt\"" Jun 02 05:45:45.053812 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.053573 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 02 05:45:45.054126 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.053885 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 02 05:45:45.054126 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.054055 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 02 05:45:45.054278 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.054207 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 02 05:45:45.054944 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.054909 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 02 05:45:45.054944 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.054927 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 02 05:45:45.055089 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.054982 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 02 05:45:45.055946 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.055930 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hx2gv" Jun 02 05:45:45.057660 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.056940 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" Jun 02 05:45:45.058488 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.058114 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 02 05:45:45.058488 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.058322 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k5p47" Jun 02 05:45:45.058488 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.058359 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 02 05:45:45.058735 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.058712 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 02 05:45:45.059155 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.059135 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 02 05:45:45.060150 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.059388 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9275p\"" Jun 02 05:45:45.060150 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.059483 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 02 05:45:45.060150 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.059388 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 02 05:45:45.060150 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.059526 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.060150 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.059662 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wplv9" Jun 02 05:45:45.060505 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.060167 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-4bvrl\"" Jun 02 05:45:45.060599 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.060576 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 02 05:45:45.060840 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.060823 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 02 05:45:45.061032 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.060872 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-s8ljd\"" Jun 02 05:45:45.061138 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.061110 2549 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" Jun 02 05:45:45.061665 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.061647 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 02 05:45:45.061907 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.061890 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5c9kn\"" Jun 02 05:45:45.061987 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.061926 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 02 05:45:45.062109 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.062093 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 02 05:45:45.062539 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.062524 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7nbjh\"" Jun 02 05:45:45.062615 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.062554 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 02 05:45:45.062719 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.062699 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 02 05:45:45.071004 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.070983 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-multus-conf-dir\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.071095 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071027 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29aa3f63-000c-4b90-8801-8cd477073052-host-slash\") pod \"iptables-alerter-hx2gv\" (UID: \"29aa3f63-000c-4b90-8801-8cd477073052\") " pod="openshift-network-operator/iptables-alerter-hx2gv" Jun 02 05:45:45.071095 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071053 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-etc-systemd\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.071204 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071094 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-host-run-netns\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.071204 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071123 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-node-log\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.071204 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071149 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-cnibin\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.071351 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071197 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-etc-kubernetes\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.071351 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071263 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29aa3f63-000c-4b90-8801-8cd477073052-iptables-alerter-script\") pod \"iptables-alerter-hx2gv\" (UID: \"29aa3f63-000c-4b90-8801-8cd477073052\") " pod="openshift-network-operator/iptables-alerter-hx2gv" Jun 02 05:45:45.071351 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071291 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.071351 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071319 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm555\" (UniqueName: \"kubernetes.io/projected/0a260826-64c9-465b-8e06-508f90b75d0f-kube-api-access-vm555\") pod \"network-metrics-daemon-gr5pg\" (UID: \"0a260826-64c9-465b-8e06-508f90b75d0f\") " pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:45:45.071351 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071343 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-var-lib-openvswitch\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.071576 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071367 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9117376b-287e-4816-91d1-944d41a716ff-hosts-file\") pod \"node-resolver-k5p47\" (UID: \"9117376b-287e-4816-91d1-944d41a716ff\") " pod="openshift-dns/node-resolver-k5p47" Jun 02 05:45:45.071576 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071412 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-host-run-multus-certs\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.071576 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071434 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-etc-modprobe-d\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.071576 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071456 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-etc-sysctl-conf\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.071576 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071474 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-host-slash\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.071576 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071496 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fcd8688e-1278-465b-a090-fb4b1b6cbd50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xxt56\" (UID: \"fcd8688e-1278-465b-a090-fb4b1b6cbd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" Jun 02 05:45:45.071576 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071517 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fcd8688e-1278-465b-a090-fb4b1b6cbd50-socket-dir\") pod \"aws-ebs-csi-driver-node-xxt56\" (UID: \"fcd8688e-1278-465b-a090-fb4b1b6cbd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" Jun 02 05:45:45.071576 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071551 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqwz4\" (UniqueName: \"kubernetes.io/projected/9117376b-287e-4816-91d1-944d41a716ff-kube-api-access-sqwz4\") pod \"node-resolver-k5p47\" (UID: \"9117376b-287e-4816-91d1-944d41a716ff\") " pod="openshift-dns/node-resolver-k5p47" Jun 02 05:45:45.071946 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071582 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-os-release\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.071946 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071601 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-var-lib-kubelet\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.071946 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071634 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-etc-openvswitch\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.071946 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071657 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-host-cni-bin\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.071946 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071671 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-system-cni-dir\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.071946 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071711 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7wns\" (UniqueName: \"kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns\") pod \"network-check-target-hf8xq\" (UID: \"39308fd5-852d-48a5-8cd0-6a6d1bdc4f28\") " pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:45:45.071946 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071732 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/08d597a1-897e-4cdb-bd1f-c08549cfd0c2-konnectivity-ca\") pod \"konnectivity-agent-l29df\" (UID: \"08d597a1-897e-4cdb-bd1f-c08549cfd0c2\") " pod="kube-system/konnectivity-agent-l29df" Jun 02 05:45:45.071946 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071780 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-host-kubelet\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.071946 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071803 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67gk5\" (UniqueName: \"kubernetes.io/projected/1609f43a-6da5-43ee-977c-53549e92c5b6-kube-api-access-67gk5\") pod \"node-ca-wplv9\" (UID: \"1609f43a-6da5-43ee-977c-53549e92c5b6\") " pod="openshift-image-registry/node-ca-wplv9" Jun 02 05:45:45.071946 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071870 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-multus-socket-dir-parent\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.071946 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071908 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws5kp\" (UniqueName: \"kubernetes.io/projected/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-kube-api-access-ws5kp\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.072471 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071962 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-etc-sysconfig\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.072471 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.071989 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-etc-sysctl-d\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.072471 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072015 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-host-run-ovn-kubernetes\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.072471 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072063 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psc28\" (UniqueName: \"kubernetes.io/projected/b555dfed-9082-4729-b404-612836ea30b6-kube-api-access-psc28\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.072471 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072110 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-host\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.072471 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072138 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-run-systemd\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.072471 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072164 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-run-ovn\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.072471 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072193 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9117376b-287e-4816-91d1-944d41a716ff-tmp-dir\") pod \"node-resolver-k5p47\" (UID: \"9117376b-287e-4816-91d1-944d41a716ff\") " pod="openshift-dns/node-resolver-k5p47" Jun 02 05:45:45.072471 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072223 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1609f43a-6da5-43ee-977c-53549e92c5b6-host\") pod \"node-ca-wplv9\" (UID: \"1609f43a-6da5-43ee-977c-53549e92c5b6\") " pod="openshift-image-registry/node-ca-wplv9" Jun 02 05:45:45.072471 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072243 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-cni-binary-copy\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.072471 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072265 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.072471 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072281 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs\") pod \"network-metrics-daemon-gr5pg\" (UID: \"0a260826-64c9-465b-8e06-508f90b75d0f\") " pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:45:45.072471 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072318 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.072471 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072352 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fcd8688e-1278-465b-a090-fb4b1b6cbd50-sys-fs\") pod \"aws-ebs-csi-driver-node-xxt56\" (UID: \"fcd8688e-1278-465b-a090-fb4b1b6cbd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" Jun 02 05:45:45.072471 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072379 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-host-run-k8s-cni-cncf-io\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.072471 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072405 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-host-var-lib-cni-bin\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.073231 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072437 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-host-var-lib-cni-multus\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.073231 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072460 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hnfs\" (UniqueName: \"kubernetes.io/projected/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-kube-api-access-6hnfs\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.073231 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072482 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-host-cni-netd\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.073231 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072517 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-cni-binary-copy\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.073231 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072559 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/835d076a-db77-4478-8398-b1866f8d3bbb-tmp\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.073231 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072587 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgkqx\" (UniqueName: \"kubernetes.io/projected/835d076a-db77-4478-8398-b1866f8d3bbb-kube-api-access-bgkqx\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.073231 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072609 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-log-socket\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.073231 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072634 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b555dfed-9082-4729-b404-612836ea30b6-env-overrides\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.073231 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072664 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fcd8688e-1278-465b-a090-fb4b1b6cbd50-etc-selinux\") pod \"aws-ebs-csi-driver-node-xxt56\" (UID: \"fcd8688e-1278-465b-a090-fb4b1b6cbd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" Jun 02 05:45:45.073231 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072713 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-cnibin\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.073231 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072742 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-run\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.073231 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072782 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b555dfed-9082-4729-b404-612836ea30b6-ovn-node-metrics-cert\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.073231 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072823 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-os-release\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.073231 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072847 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/08d597a1-897e-4cdb-bd1f-c08549cfd0c2-agent-certs\") pod \"konnectivity-agent-l29df\" (UID: \"08d597a1-897e-4cdb-bd1f-c08549cfd0c2\") " pod="kube-system/konnectivity-agent-l29df" Jun 02 05:45:45.073231 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072884 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/835d076a-db77-4478-8398-b1866f8d3bbb-etc-tuned\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.073231 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072912 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-systemd-units\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.074096 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.072970 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fcd8688e-1278-465b-a090-fb4b1b6cbd50-registration-dir\") pod \"aws-ebs-csi-driver-node-xxt56\" (UID: \"fcd8688e-1278-465b-a090-fb4b1b6cbd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" Jun 02 05:45:45.074096 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.073007 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fcd8688e-1278-465b-a090-fb4b1b6cbd50-device-dir\") pod \"aws-ebs-csi-driver-node-xxt56\" (UID: \"fcd8688e-1278-465b-a090-fb4b1b6cbd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" Jun 02 05:45:45.074096 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.073035 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-multus-cni-dir\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.074096 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.073058 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-hostroot\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.074096 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.073098 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-multus-daemon-config\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.074096 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.073129 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b555dfed-9082-4729-b404-612836ea30b6-ovnkube-config\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.074096 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.073154 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b555dfed-9082-4729-b404-612836ea30b6-ovnkube-script-lib\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.074096 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.073199 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgvv4\" (UniqueName: \"kubernetes.io/projected/fcd8688e-1278-465b-a090-fb4b1b6cbd50-kube-api-access-xgvv4\") pod \"aws-ebs-csi-driver-node-xxt56\" (UID: \"fcd8688e-1278-465b-a090-fb4b1b6cbd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" Jun 02 05:45:45.074096 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.073223 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-host-var-lib-kubelet\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.074096 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.073246 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.074096 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.073271 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-etc-kubernetes\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.074096 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.073295 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46zlr\" (UniqueName: \"kubernetes.io/projected/29aa3f63-000c-4b90-8801-8cd477073052-kube-api-access-46zlr\") pod \"iptables-alerter-hx2gv\" (UID: \"29aa3f63-000c-4b90-8801-8cd477073052\") " pod="openshift-network-operator/iptables-alerter-hx2gv" Jun 02 05:45:45.074096 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.073319 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-system-cni-dir\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.074096 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.073361 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-sys\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.074096 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.073393 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-lib-modules\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.074096 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.073424 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-run-openvswitch\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.074853 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.073479 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1609f43a-6da5-43ee-977c-53549e92c5b6-serviceca\") pod \"node-ca-wplv9\" (UID: \"1609f43a-6da5-43ee-977c-53549e92c5b6\") " pod="openshift-image-registry/node-ca-wplv9" Jun 02 05:45:45.074853 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.073507 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-host-run-netns\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.130808 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.130784 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 05:40:44 +0000 UTC" deadline="2027-11-06 14:35:48.931610481 +0000 UTC" Jun 02 05:45:45.130808 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.130807 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12536h50m3.800806584s" Jun 02 05:45:45.173832 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.173786 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-etc-systemd\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.173832 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.173815 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-host-run-netns\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.173967 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.173841 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-node-log\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.173967 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.173868 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-cnibin\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.173967 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.173891 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-etc-kubernetes\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.173967 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.173889 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-host-run-netns\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.173967 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.173877 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-etc-systemd\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.173967 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.173931 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-node-log\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.173967 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.173941 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29aa3f63-000c-4b90-8801-8cd477073052-iptables-alerter-script\") pod \"iptables-alerter-hx2gv\" (UID: \"29aa3f63-000c-4b90-8801-8cd477073052\") " pod="openshift-network-operator/iptables-alerter-hx2gv" Jun 02 05:45:45.173967 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.173966 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-cnibin\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.174248 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.173975 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.174248 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.173982 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-etc-kubernetes\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.174248 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174004 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vm555\" (UniqueName: \"kubernetes.io/projected/0a260826-64c9-465b-8e06-508f90b75d0f-kube-api-access-vm555\") pod \"network-metrics-daemon-gr5pg\" (UID: \"0a260826-64c9-465b-8e06-508f90b75d0f\") " pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:45:45.174248 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174033 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-var-lib-openvswitch\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.174248 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174056 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9117376b-287e-4816-91d1-944d41a716ff-hosts-file\") pod \"node-resolver-k5p47\" (UID: \"9117376b-287e-4816-91d1-944d41a716ff\") " pod="openshift-dns/node-resolver-k5p47" Jun 02 05:45:45.174248 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174079 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-host-run-multus-certs\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.174248 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174104 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-etc-modprobe-d\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.174248 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174125 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-etc-sysctl-conf\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.174248 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174144 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9117376b-287e-4816-91d1-944d41a716ff-hosts-file\") pod \"node-resolver-k5p47\" (UID: \"9117376b-287e-4816-91d1-944d41a716ff\") " pod="openshift-dns/node-resolver-k5p47" Jun 02 05:45:45.174248 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174184 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-host-run-multus-certs\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.174248 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174198 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-host-slash\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.174248 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174239 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-var-lib-openvswitch\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.174248 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174147 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-host-slash\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.174839 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174276 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fcd8688e-1278-465b-a090-fb4b1b6cbd50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xxt56\" (UID: \"fcd8688e-1278-465b-a090-fb4b1b6cbd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" Jun 02 05:45:45.174839 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174289 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-etc-modprobe-d\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.174839 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174301 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fcd8688e-1278-465b-a090-fb4b1b6cbd50-socket-dir\") pod \"aws-ebs-csi-driver-node-xxt56\" (UID: \"fcd8688e-1278-465b-a090-fb4b1b6cbd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" Jun 02 05:45:45.174839 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174325 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sqwz4\" (UniqueName: \"kubernetes.io/projected/9117376b-287e-4816-91d1-944d41a716ff-kube-api-access-sqwz4\") pod \"node-resolver-k5p47\" (UID: \"9117376b-287e-4816-91d1-944d41a716ff\") " pod="openshift-dns/node-resolver-k5p47" Jun 02 05:45:45.174839 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174349 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-os-release\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.174839 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174350 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fcd8688e-1278-465b-a090-fb4b1b6cbd50-kubelet-dir\") pod \"aws-ebs-csi-driver-node-xxt56\" (UID: \"fcd8688e-1278-465b-a090-fb4b1b6cbd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" Jun 02 05:45:45.174839 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174371 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-var-lib-kubelet\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.174839 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174377 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-etc-sysctl-conf\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.174839 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174392 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fcd8688e-1278-465b-a090-fb4b1b6cbd50-socket-dir\") pod \"aws-ebs-csi-driver-node-xxt56\" (UID: \"fcd8688e-1278-465b-a090-fb4b1b6cbd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" Jun 02 05:45:45.174839 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174393 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-etc-openvswitch\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.174839 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174437 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-host-cni-bin\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.174839 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174460 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-system-cni-dir\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.174839 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174463 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-os-release\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.174839 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174469 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-etc-openvswitch\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.174839 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174483 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7wns\" (UniqueName: \"kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns\") pod \"network-check-target-hf8xq\" (UID: \"39308fd5-852d-48a5-8cd0-6a6d1bdc4f28\") " pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:45:45.174839 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174439 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-var-lib-kubelet\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.174839 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174503 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-host-cni-bin\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.175567 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174509 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/08d597a1-897e-4cdb-bd1f-c08549cfd0c2-konnectivity-ca\") pod \"konnectivity-agent-l29df\" (UID: \"08d597a1-897e-4cdb-bd1f-c08549cfd0c2\") " pod="kube-system/konnectivity-agent-l29df" Jun 02 05:45:45.175567 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174521 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-system-cni-dir\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.175567 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174533 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-host-kubelet\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.175567 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174522 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/29aa3f63-000c-4b90-8801-8cd477073052-iptables-alerter-script\") pod \"iptables-alerter-hx2gv\" (UID: \"29aa3f63-000c-4b90-8801-8cd477073052\") " pod="openshift-network-operator/iptables-alerter-hx2gv" Jun 02 05:45:45.175567 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174545 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.175567 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174555 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-67gk5\" (UniqueName: \"kubernetes.io/projected/1609f43a-6da5-43ee-977c-53549e92c5b6-kube-api-access-67gk5\") pod \"node-ca-wplv9\" (UID: \"1609f43a-6da5-43ee-977c-53549e92c5b6\") " pod="openshift-image-registry/node-ca-wplv9" Jun 02 05:45:45.175567 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174607 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-host-kubelet\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.175567 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174619 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-multus-socket-dir-parent\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.175567 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174646 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ws5kp\" (UniqueName: \"kubernetes.io/projected/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-kube-api-access-ws5kp\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.175567 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174672 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-etc-sysconfig\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.175567 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174694 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-etc-sysctl-d\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.175567 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174718 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-host-run-ovn-kubernetes\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.175567 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174730 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-etc-sysconfig\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.175567 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174745 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-psc28\" (UniqueName: \"kubernetes.io/projected/b555dfed-9082-4729-b404-612836ea30b6-kube-api-access-psc28\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.175567 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174788 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-host\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.175567 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174791 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-host-run-ovn-kubernetes\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.175567 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174813 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-run-systemd\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.176257 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174837 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-run-ovn\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.176257 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174838 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-etc-sysctl-d\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.176257 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174847 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-host\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.176257 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174860 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9117376b-287e-4816-91d1-944d41a716ff-tmp-dir\") pod \"node-resolver-k5p47\" (UID: \"9117376b-287e-4816-91d1-944d41a716ff\") " pod="openshift-dns/node-resolver-k5p47" Jun 02 05:45:45.176257 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174885 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1609f43a-6da5-43ee-977c-53549e92c5b6-host\") pod \"node-ca-wplv9\" (UID: \"1609f43a-6da5-43ee-977c-53549e92c5b6\") " pod="openshift-image-registry/node-ca-wplv9" Jun 02 05:45:45.176257 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174891 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-run-systemd\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.176257 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174896 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-multus-socket-dir-parent\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.176257 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174930 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/08d597a1-897e-4cdb-bd1f-c08549cfd0c2-konnectivity-ca\") pod \"konnectivity-agent-l29df\" (UID: \"08d597a1-897e-4cdb-bd1f-c08549cfd0c2\") " pod="kube-system/konnectivity-agent-l29df" Jun 02 05:45:45.176257 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174933 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-run-ovn\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.176257 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174965 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1609f43a-6da5-43ee-977c-53549e92c5b6-host\") pod \"node-ca-wplv9\" (UID: \"1609f43a-6da5-43ee-977c-53549e92c5b6\") " pod="openshift-image-registry/node-ca-wplv9" Jun 02 05:45:45.176257 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.174993 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-cni-binary-copy\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.176257 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175010 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.176257 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175039 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs\") pod \"network-metrics-daemon-gr5pg\" (UID: \"0a260826-64c9-465b-8e06-508f90b75d0f\") " pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:45:45.176257 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:45.175115 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:45:45.176257 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175173 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9117376b-287e-4816-91d1-944d41a716ff-tmp-dir\") pod \"node-resolver-k5p47\" (UID: \"9117376b-287e-4816-91d1-944d41a716ff\") " pod="openshift-dns/node-resolver-k5p47" Jun 02 05:45:45.176257 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:45.175207 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs podName:0a260826-64c9-465b-8e06-508f90b75d0f nodeName:}" failed. No retries permitted until 2026-06-02 05:45:45.675159085 +0000 UTC m=+3.091455334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs") pod "network-metrics-daemon-gr5pg" (UID: "0a260826-64c9-465b-8e06-508f90b75d0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:45:45.176257 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175228 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.177062 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175259 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fcd8688e-1278-465b-a090-fb4b1b6cbd50-sys-fs\") pod \"aws-ebs-csi-driver-node-xxt56\" (UID: \"fcd8688e-1278-465b-a090-fb4b1b6cbd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" Jun 02 05:45:45.177062 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175285 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-host-run-k8s-cni-cncf-io\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.177062 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175286 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.177062 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175309 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-host-var-lib-cni-bin\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.177062 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175350 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fcd8688e-1278-465b-a090-fb4b1b6cbd50-sys-fs\") pod \"aws-ebs-csi-driver-node-xxt56\" (UID: \"fcd8688e-1278-465b-a090-fb4b1b6cbd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" Jun 02 05:45:45.177062 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175357 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-host-var-lib-cni-bin\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.177062 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175356 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-host-run-k8s-cni-cncf-io\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.177062 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175380 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-host-var-lib-cni-multus\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.177062 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175413 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6hnfs\" (UniqueName: \"kubernetes.io/projected/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-kube-api-access-6hnfs\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.177062 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175437 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-host-cni-netd\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.177062 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175463 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-cni-binary-copy\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.177062 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175481 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-host-var-lib-cni-multus\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.177062 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175491 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/835d076a-db77-4478-8398-b1866f8d3bbb-tmp\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.177062 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175500 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-cni-binary-copy\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.177062 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175520 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgkqx\" (UniqueName: \"kubernetes.io/projected/835d076a-db77-4478-8398-b1866f8d3bbb-kube-api-access-bgkqx\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.177062 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175535 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.177062 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175541 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-host-cni-netd\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.177773 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175593 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-log-socket\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.177773 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175546 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-log-socket\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.177773 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175636 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b555dfed-9082-4729-b404-612836ea30b6-env-overrides\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.177773 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175667 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fcd8688e-1278-465b-a090-fb4b1b6cbd50-etc-selinux\") pod \"aws-ebs-csi-driver-node-xxt56\" (UID: \"fcd8688e-1278-465b-a090-fb4b1b6cbd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" Jun 02 05:45:45.177773 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175694 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-cnibin\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.177773 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175717 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-run\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.177773 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175769 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b555dfed-9082-4729-b404-612836ea30b6-ovn-node-metrics-cert\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.177773 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175796 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-os-release\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.177773 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175833 2549 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 02 05:45:45.177773 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175848 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-cnibin\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.177773 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175867 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-os-release\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.177773 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175885 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/08d597a1-897e-4cdb-bd1f-c08549cfd0c2-agent-certs\") pod \"konnectivity-agent-l29df\" (UID: \"08d597a1-897e-4cdb-bd1f-c08549cfd0c2\") " pod="kube-system/konnectivity-agent-l29df" Jun 02 05:45:45.177773 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175913 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/835d076a-db77-4478-8398-b1866f8d3bbb-etc-tuned\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.177773 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175918 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-run\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.177773 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175939 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-cni-binary-copy\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.177773 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175945 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-systemd-units\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.177773 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175972 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-systemd-units\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.177773 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.175989 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fcd8688e-1278-465b-a090-fb4b1b6cbd50-registration-dir\") pod \"aws-ebs-csi-driver-node-xxt56\" (UID: \"fcd8688e-1278-465b-a090-fb4b1b6cbd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" Jun 02 05:45:45.178412 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176016 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fcd8688e-1278-465b-a090-fb4b1b6cbd50-device-dir\") pod \"aws-ebs-csi-driver-node-xxt56\" (UID: \"fcd8688e-1278-465b-a090-fb4b1b6cbd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" Jun 02 05:45:45.178412 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176027 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fcd8688e-1278-465b-a090-fb4b1b6cbd50-etc-selinux\") pod \"aws-ebs-csi-driver-node-xxt56\" (UID: \"fcd8688e-1278-465b-a090-fb4b1b6cbd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" Jun 02 05:45:45.178412 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176042 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-multus-cni-dir\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.178412 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176076 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-hostroot\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.178412 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176092 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-multus-cni-dir\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.178412 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176105 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-multus-daemon-config\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.178412 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176107 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b555dfed-9082-4729-b404-612836ea30b6-env-overrides\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.178412 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176133 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b555dfed-9082-4729-b404-612836ea30b6-ovnkube-config\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.178412 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176140 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fcd8688e-1278-465b-a090-fb4b1b6cbd50-registration-dir\") pod \"aws-ebs-csi-driver-node-xxt56\" (UID: \"fcd8688e-1278-465b-a090-fb4b1b6cbd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" Jun 02 05:45:45.178412 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176161 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b555dfed-9082-4729-b404-612836ea30b6-ovnkube-script-lib\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.178412 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176169 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fcd8688e-1278-465b-a090-fb4b1b6cbd50-device-dir\") pod \"aws-ebs-csi-driver-node-xxt56\" (UID: \"fcd8688e-1278-465b-a090-fb4b1b6cbd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" Jun 02 05:45:45.178412 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176180 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-hostroot\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.178412 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176186 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xgvv4\" (UniqueName: \"kubernetes.io/projected/fcd8688e-1278-465b-a090-fb4b1b6cbd50-kube-api-access-xgvv4\") pod \"aws-ebs-csi-driver-node-xxt56\" (UID: \"fcd8688e-1278-465b-a090-fb4b1b6cbd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" Jun 02 05:45:45.178412 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176213 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-host-var-lib-kubelet\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.178412 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176241 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.178412 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176296 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-etc-kubernetes\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.178412 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176326 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-46zlr\" (UniqueName: \"kubernetes.io/projected/29aa3f63-000c-4b90-8801-8cd477073052-kube-api-access-46zlr\") pod \"iptables-alerter-hx2gv\" (UID: \"29aa3f63-000c-4b90-8801-8cd477073052\") " pod="openshift-network-operator/iptables-alerter-hx2gv" Jun 02 05:45:45.179138 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176354 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-system-cni-dir\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.179138 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176378 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-sys\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.179138 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176402 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-lib-modules\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.179138 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176426 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-run-openvswitch\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.179138 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176451 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1609f43a-6da5-43ee-977c-53549e92c5b6-serviceca\") pod \"node-ca-wplv9\" (UID: \"1609f43a-6da5-43ee-977c-53549e92c5b6\") " pod="openshift-image-registry/node-ca-wplv9" Jun 02 05:45:45.179138 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176475 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-host-run-netns\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.179138 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176500 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-multus-conf-dir\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.179138 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176525 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29aa3f63-000c-4b90-8801-8cd477073052-host-slash\") pod \"iptables-alerter-hx2gv\" (UID: \"29aa3f63-000c-4b90-8801-8cd477073052\") " pod="openshift-network-operator/iptables-alerter-hx2gv" Jun 02 05:45:45.179138 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176601 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/29aa3f63-000c-4b90-8801-8cd477073052-host-slash\") pod \"iptables-alerter-hx2gv\" (UID: \"29aa3f63-000c-4b90-8801-8cd477073052\") " pod="openshift-network-operator/iptables-alerter-hx2gv" Jun 02 05:45:45.179138 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176619 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-multus-daemon-config\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.179138 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176696 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-sys\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.179138 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176736 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-host-var-lib-kubelet\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.179138 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176880 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.179138 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176906 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b555dfed-9082-4729-b404-612836ea30b6-ovnkube-script-lib\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.179138 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176938 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-etc-kubernetes\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.179138 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.176983 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-system-cni-dir\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.179138 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.177096 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b555dfed-9082-4729-b404-612836ea30b6-ovnkube-config\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.179138 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.177158 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-host-run-netns\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.179738 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.177199 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/835d076a-db77-4478-8398-b1866f8d3bbb-lib-modules\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.179738 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.177201 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-multus-conf-dir\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.179738 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.177248 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b555dfed-9082-4729-b404-612836ea30b6-run-openvswitch\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.179738 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.177360 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1609f43a-6da5-43ee-977c-53549e92c5b6-serviceca\") pod \"node-ca-wplv9\" (UID: \"1609f43a-6da5-43ee-977c-53549e92c5b6\") " pod="openshift-image-registry/node-ca-wplv9" Jun 02 05:45:45.179738 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.178930 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b555dfed-9082-4729-b404-612836ea30b6-ovn-node-metrics-cert\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.179738 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.178991 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/835d076a-db77-4478-8398-b1866f8d3bbb-etc-tuned\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.179738 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.179079 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/835d076a-db77-4478-8398-b1866f8d3bbb-tmp\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.179738 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.179323 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/08d597a1-897e-4cdb-bd1f-c08549cfd0c2-agent-certs\") pod \"konnectivity-agent-l29df\" (UID: \"08d597a1-897e-4cdb-bd1f-c08549cfd0c2\") " pod="kube-system/konnectivity-agent-l29df" Jun 02 05:45:45.181893 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:45.181877 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 05:45:45.181970 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:45.181899 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 05:45:45.181970 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:45.181910 2549 projected.go:194] Error preparing data for projected volume kube-api-access-t7wns for pod openshift-network-diagnostics/network-check-target-hf8xq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:45:45.181970 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:45.181968 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns podName:39308fd5-852d-48a5-8cd0-6a6d1bdc4f28 nodeName:}" failed. No retries permitted until 2026-06-02 05:45:45.68195296 +0000 UTC m=+3.098249226 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-t7wns" (UniqueName: "kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns") pod "network-check-target-hf8xq" (UID: "39308fd5-852d-48a5-8cd0-6a6d1bdc4f28") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:45:45.185209 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.185181 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws5kp\" (UniqueName: \"kubernetes.io/projected/03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9-kube-api-access-ws5kp\") pod \"multus-additional-cni-plugins-2dbp8\" (UID: \"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9\") " pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.185356 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.185305 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm555\" (UniqueName: \"kubernetes.io/projected/0a260826-64c9-465b-8e06-508f90b75d0f-kube-api-access-vm555\") pod \"network-metrics-daemon-gr5pg\" (UID: \"0a260826-64c9-465b-8e06-508f90b75d0f\") " pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:45:45.185883 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.185861 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46zlr\" (UniqueName: \"kubernetes.io/projected/29aa3f63-000c-4b90-8801-8cd477073052-kube-api-access-46zlr\") pod \"iptables-alerter-hx2gv\" (UID: \"29aa3f63-000c-4b90-8801-8cd477073052\") " pod="openshift-network-operator/iptables-alerter-hx2gv" Jun 02 05:45:45.186534 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.186487 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67gk5\" (UniqueName: \"kubernetes.io/projected/1609f43a-6da5-43ee-977c-53549e92c5b6-kube-api-access-67gk5\") pod \"node-ca-wplv9\" (UID: \"1609f43a-6da5-43ee-977c-53549e92c5b6\") " pod="openshift-image-registry/node-ca-wplv9" Jun 02 05:45:45.187424 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.187206 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgkqx\" (UniqueName: \"kubernetes.io/projected/835d076a-db77-4478-8398-b1866f8d3bbb-kube-api-access-bgkqx\") pod \"tuned-dtpw4\" (UID: \"835d076a-db77-4478-8398-b1866f8d3bbb\") " pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.187569 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.187551 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgvv4\" (UniqueName: \"kubernetes.io/projected/fcd8688e-1278-465b-a090-fb4b1b6cbd50-kube-api-access-xgvv4\") pod \"aws-ebs-csi-driver-node-xxt56\" (UID: \"fcd8688e-1278-465b-a090-fb4b1b6cbd50\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" Jun 02 05:45:45.187701 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.187681 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqwz4\" (UniqueName: \"kubernetes.io/projected/9117376b-287e-4816-91d1-944d41a716ff-kube-api-access-sqwz4\") pod \"node-resolver-k5p47\" (UID: \"9117376b-287e-4816-91d1-944d41a716ff\") " pod="openshift-dns/node-resolver-k5p47" Jun 02 05:45:45.188162 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.188141 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hnfs\" (UniqueName: \"kubernetes.io/projected/44e8d6de-2c23-4272-a006-8e6b5d12ef7b-kube-api-access-6hnfs\") pod \"multus-4b9mb\" (UID: \"44e8d6de-2c23-4272-a006-8e6b5d12ef7b\") " pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.188647 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.188629 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psc28\" (UniqueName: \"kubernetes.io/projected/b555dfed-9082-4729-b404-612836ea30b6-kube-api-access-psc28\") pod \"ovnkube-node-krddm\" (UID: \"b555dfed-9082-4729-b404-612836ea30b6\") " pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.188996 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.188940 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-109.ec2.internal" event={"ID":"88275a9e948ac352a48988b927e7086b","Type":"ContainerStarted","Data":"ca5aa1e6107bab53816067c3ee7425b2002b766323436a84e5de8bef257a608c"} Jun 02 05:45:45.190497 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.190458 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-109.ec2.internal" event={"ID":"720d1a64b25c8e7c73406333baa1c8d8","Type":"ContainerStarted","Data":"cd9de9dfa6088f59751295487387ccdee3d100f51ae120142a1c9b89d19f4a2f"} Jun 02 05:45:45.361046 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.361009 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l29df" Jun 02 05:45:45.369778 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.369739 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" Jun 02 05:45:45.379175 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.379154 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4b9mb" Jun 02 05:45:45.389777 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.389743 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:45:45.398388 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.398361 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hx2gv" Jun 02 05:45:45.406003 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.405983 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" Jun 02 05:45:45.413731 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.413710 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-k5p47" Jun 02 05:45:45.421256 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.421239 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2dbp8" Jun 02 05:45:45.426808 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.426791 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wplv9" Jun 02 05:45:45.679119 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.679032 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs\") pod \"network-metrics-daemon-gr5pg\" (UID: \"0a260826-64c9-465b-8e06-508f90b75d0f\") " pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:45:45.679281 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:45.679189 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:45:45.679281 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:45.679258 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs podName:0a260826-64c9-465b-8e06-508f90b75d0f nodeName:}" failed. No retries permitted until 2026-06-02 05:45:46.679237385 +0000 UTC m=+4.095533626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs") pod "network-metrics-daemon-gr5pg" (UID: "0a260826-64c9-465b-8e06-508f90b75d0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:45:45.779905 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:45.779868 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7wns\" (UniqueName: \"kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns\") pod \"network-check-target-hf8xq\" (UID: \"39308fd5-852d-48a5-8cd0-6a6d1bdc4f28\") " pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:45:45.780062 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:45.780041 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 05:45:45.780122 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:45.780066 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 05:45:45.780122 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:45.780081 2549 projected.go:194] Error preparing data for projected volume kube-api-access-t7wns for pod openshift-network-diagnostics/network-check-target-hf8xq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:45:45.780195 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:45.780145 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns podName:39308fd5-852d-48a5-8cd0-6a6d1bdc4f28 nodeName:}" failed. No retries permitted until 2026-06-02 05:45:46.780128977 +0000 UTC m=+4.196425222 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7wns" (UniqueName: "kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns") pod "network-check-target-hf8xq" (UID: "39308fd5-852d-48a5-8cd0-6a6d1bdc4f28") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:45:45.924155 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:45.923992 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod835d076a_db77_4478_8398_b1866f8d3bbb.slice/crio-2e4d1d1643c1bbc83b0204cd8df8dc7860d6fb744fb8858f4426cd24b272c220 WatchSource:0}: Error finding container 2e4d1d1643c1bbc83b0204cd8df8dc7860d6fb744fb8858f4426cd24b272c220: Status 404 returned error can't find the container with id 2e4d1d1643c1bbc83b0204cd8df8dc7860d6fb744fb8858f4426cd24b272c220 Jun 02 05:45:45.926993 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:45.926943 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44e8d6de_2c23_4272_a006_8e6b5d12ef7b.slice/crio-1fcaa73ef6c886cc6450d0ac8c75508d5639d335f45ff9b749c382d7298b4541 WatchSource:0}: Error finding container 1fcaa73ef6c886cc6450d0ac8c75508d5639d335f45ff9b749c382d7298b4541: Status 404 returned error can't find the container with id 1fcaa73ef6c886cc6450d0ac8c75508d5639d335f45ff9b749c382d7298b4541 Jun 02 05:45:45.930040 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:45.930018 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb555dfed_9082_4729_b404_612836ea30b6.slice/crio-718f8dbaae0ac6b604cfeaa83bd7669ed88698589a13f5a89c98308978dc462e WatchSource:0}: Error finding container 718f8dbaae0ac6b604cfeaa83bd7669ed88698589a13f5a89c98308978dc462e: Status 404 returned error can't find the container with id 718f8dbaae0ac6b604cfeaa83bd7669ed88698589a13f5a89c98308978dc462e Jun 02 05:45:45.930864 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:45.930823 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd8688e_1278_465b_a090_fb4b1b6cbd50.slice/crio-8677896ea6995aadd092aac9279831800f6ae82114acb5bce1cce0a48318e8fa WatchSource:0}: Error finding container 8677896ea6995aadd092aac9279831800f6ae82114acb5bce1cce0a48318e8fa: Status 404 returned error can't find the container with id 8677896ea6995aadd092aac9279831800f6ae82114acb5bce1cce0a48318e8fa Jun 02 05:45:45.931389 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:45.931365 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29aa3f63_000c_4b90_8801_8cd477073052.slice/crio-c5095e595ae263894c8fe82852334f4b2037e1e8c7348d0b0aac326862792bac WatchSource:0}: Error finding container c5095e595ae263894c8fe82852334f4b2037e1e8c7348d0b0aac326862792bac: Status 404 returned error can't find the container with id c5095e595ae263894c8fe82852334f4b2037e1e8c7348d0b0aac326862792bac Jun 02 05:45:45.932256 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:45.932166 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08d597a1_897e_4cdb_bd1f_c08549cfd0c2.slice/crio-6ae4e956b14d422b04424c9d80a0a5e50873502855f9b0f3a39aba9111d5b3c4 WatchSource:0}: Error finding container 6ae4e956b14d422b04424c9d80a0a5e50873502855f9b0f3a39aba9111d5b3c4: Status 404 returned error can't find the container with id 6ae4e956b14d422b04424c9d80a0a5e50873502855f9b0f3a39aba9111d5b3c4 Jun 02 05:45:45.933638 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:45.933610 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9117376b_287e_4816_91d1_944d41a716ff.slice/crio-d3ccf4fda036fa4bae2fac67b4357e6190009c3a64bf826091126c76446a50b9 WatchSource:0}: Error finding container d3ccf4fda036fa4bae2fac67b4357e6190009c3a64bf826091126c76446a50b9: Status 404 returned error can't find the container with id d3ccf4fda036fa4bae2fac67b4357e6190009c3a64bf826091126c76446a50b9 Jun 02 05:45:45.934876 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:45.934831 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03c05e6a_5bfc_4dea_b0fc_ca3d9b230ca9.slice/crio-6766a3ed6299edc1831e5dee0b70cee0aedf99f06fff03411853034174d78502 WatchSource:0}: Error finding container 6766a3ed6299edc1831e5dee0b70cee0aedf99f06fff03411853034174d78502: Status 404 returned error can't find the container with id 6766a3ed6299edc1831e5dee0b70cee0aedf99f06fff03411853034174d78502 Jun 02 05:45:45.936609 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:45:45.936154 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1609f43a_6da5_43ee_977c_53549e92c5b6.slice/crio-b4f9480517817e4e1c75f96f96dd749a9b97329ff7bf01bf68de9eb2087b963f WatchSource:0}: Error finding container b4f9480517817e4e1c75f96f96dd749a9b97329ff7bf01bf68de9eb2087b963f: Status 404 returned error can't find the container with id b4f9480517817e4e1c75f96f96dd749a9b97329ff7bf01bf68de9eb2087b963f Jun 02 05:45:46.131604 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:46.131566 2549 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-01 05:40:44 +0000 UTC" deadline="2027-11-25 07:11:04.622561869 +0000 UTC" Jun 02 05:45:46.131604 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:46.131603 2549 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12985h25m18.490962199s" Jun 02 05:45:46.185315 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:46.185294 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:45:46.185413 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:46.185396 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf8xq" podUID="39308fd5-852d-48a5-8cd0-6a6d1bdc4f28" Jun 02 05:45:46.192717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:46.192689 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krddm" event={"ID":"b555dfed-9082-4729-b404-612836ea30b6","Type":"ContainerStarted","Data":"718f8dbaae0ac6b604cfeaa83bd7669ed88698589a13f5a89c98308978dc462e"} Jun 02 05:45:46.193574 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:46.193541 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4b9mb" event={"ID":"44e8d6de-2c23-4272-a006-8e6b5d12ef7b","Type":"ContainerStarted","Data":"1fcaa73ef6c886cc6450d0ac8c75508d5639d335f45ff9b749c382d7298b4541"} Jun 02 05:45:46.194448 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:46.194401 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" event={"ID":"835d076a-db77-4478-8398-b1866f8d3bbb","Type":"ContainerStarted","Data":"2e4d1d1643c1bbc83b0204cd8df8dc7860d6fb744fb8858f4426cd24b272c220"} Jun 02 05:45:46.195653 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:46.195632 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-109.ec2.internal" event={"ID":"720d1a64b25c8e7c73406333baa1c8d8","Type":"ContainerStarted","Data":"c27a0a09fcf71ad421f38844468db9c46444446509a5ef739eb16cf017c89798"} Jun 02 05:45:46.196554 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:46.196530 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2dbp8" event={"ID":"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9","Type":"ContainerStarted","Data":"6766a3ed6299edc1831e5dee0b70cee0aedf99f06fff03411853034174d78502"} Jun 02 05:45:46.197418 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:46.197400 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l29df" event={"ID":"08d597a1-897e-4cdb-bd1f-c08549cfd0c2","Type":"ContainerStarted","Data":"6ae4e956b14d422b04424c9d80a0a5e50873502855f9b0f3a39aba9111d5b3c4"} Jun 02 05:45:46.198426 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:46.198407 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hx2gv" event={"ID":"29aa3f63-000c-4b90-8801-8cd477073052","Type":"ContainerStarted","Data":"c5095e595ae263894c8fe82852334f4b2037e1e8c7348d0b0aac326862792bac"} Jun 02 05:45:46.199365 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:46.199347 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" event={"ID":"fcd8688e-1278-465b-a090-fb4b1b6cbd50","Type":"ContainerStarted","Data":"8677896ea6995aadd092aac9279831800f6ae82114acb5bce1cce0a48318e8fa"} Jun 02 05:45:46.200197 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:46.200173 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wplv9" event={"ID":"1609f43a-6da5-43ee-977c-53549e92c5b6","Type":"ContainerStarted","Data":"b4f9480517817e4e1c75f96f96dd749a9b97329ff7bf01bf68de9eb2087b963f"} Jun 02 05:45:46.201005 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:46.200985 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k5p47" event={"ID":"9117376b-287e-4816-91d1-944d41a716ff","Type":"ContainerStarted","Data":"d3ccf4fda036fa4bae2fac67b4357e6190009c3a64bf826091126c76446a50b9"} Jun 02 05:45:46.207478 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:46.207446 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-109.ec2.internal" podStartSLOduration=2.207436895 podStartE2EDuration="2.207436895s" podCreationTimestamp="2026-06-02 05:45:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 05:45:46.207347587 +0000 UTC m=+3.623643849" watchObservedRunningTime="2026-06-02 05:45:46.207436895 +0000 UTC m=+3.623733158" Jun 02 05:45:46.465844 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:46.465743 2549 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 02 05:45:46.687582 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:46.687541 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs\") pod \"network-metrics-daemon-gr5pg\" (UID: \"0a260826-64c9-465b-8e06-508f90b75d0f\") " pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:45:46.687776 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:46.687709 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:45:46.687845 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:46.687785 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs podName:0a260826-64c9-465b-8e06-508f90b75d0f nodeName:}" failed. No retries permitted until 2026-06-02 05:45:48.687766801 +0000 UTC m=+6.104063055 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs") pod "network-metrics-daemon-gr5pg" (UID: "0a260826-64c9-465b-8e06-508f90b75d0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:45:46.788781 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:46.788667 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7wns\" (UniqueName: \"kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns\") pod \"network-check-target-hf8xq\" (UID: \"39308fd5-852d-48a5-8cd0-6a6d1bdc4f28\") " pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:45:46.788941 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:46.788860 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 05:45:46.788941 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:46.788879 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 05:45:46.788941 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:46.788892 2549 projected.go:194] Error preparing data for projected volume kube-api-access-t7wns for pod openshift-network-diagnostics/network-check-target-hf8xq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:45:46.789087 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:46.788949 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns podName:39308fd5-852d-48a5-8cd0-6a6d1bdc4f28 nodeName:}" failed. No retries permitted until 2026-06-02 05:45:48.788930124 +0000 UTC m=+6.205226370 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7wns" (UniqueName: "kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns") pod "network-check-target-hf8xq" (UID: "39308fd5-852d-48a5-8cd0-6a6d1bdc4f28") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:45:47.185929 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:47.185902 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:45:47.186498 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:47.186041 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr5pg" podUID="0a260826-64c9-465b-8e06-508f90b75d0f" Jun 02 05:45:47.236300 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:47.235538 2549 generic.go:358] "Generic (PLEG): container finished" podID="88275a9e948ac352a48988b927e7086b" containerID="5d461a8510091619384c4052af390197c7c0ec570546811f254f5da24936ffa8" exitCode=0 Jun 02 05:45:47.236300 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:47.235614 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-109.ec2.internal" event={"ID":"88275a9e948ac352a48988b927e7086b","Type":"ContainerDied","Data":"5d461a8510091619384c4052af390197c7c0ec570546811f254f5da24936ffa8"} Jun 02 05:45:48.185034 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:48.185001 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:45:48.185217 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:48.185148 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf8xq" podUID="39308fd5-852d-48a5-8cd0-6a6d1bdc4f28" Jun 02 05:45:48.249995 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:48.249961 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-109.ec2.internal" event={"ID":"88275a9e948ac352a48988b927e7086b","Type":"ContainerStarted","Data":"78f188dfa259ff6ea23cfc8fe7eabae49e3f61ea156f2af9faf4a9446f6e33af"} Jun 02 05:45:48.706381 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:48.706348 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs\") pod \"network-metrics-daemon-gr5pg\" (UID: \"0a260826-64c9-465b-8e06-508f90b75d0f\") " pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:45:48.706590 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:48.706540 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:45:48.706681 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:48.706603 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs podName:0a260826-64c9-465b-8e06-508f90b75d0f nodeName:}" failed. No retries permitted until 2026-06-02 05:45:52.706583984 +0000 UTC m=+10.122880240 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs") pod "network-metrics-daemon-gr5pg" (UID: "0a260826-64c9-465b-8e06-508f90b75d0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:45:48.807546 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:48.807506 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7wns\" (UniqueName: \"kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns\") pod \"network-check-target-hf8xq\" (UID: \"39308fd5-852d-48a5-8cd0-6a6d1bdc4f28\") " pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:45:48.807729 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:48.807692 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 05:45:48.807729 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:48.807713 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 05:45:48.807729 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:48.807727 2549 projected.go:194] Error preparing data for projected volume kube-api-access-t7wns for pod openshift-network-diagnostics/network-check-target-hf8xq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:45:48.807923 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:48.807802 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns podName:39308fd5-852d-48a5-8cd0-6a6d1bdc4f28 nodeName:}" failed. No retries permitted until 2026-06-02 05:45:52.807782083 +0000 UTC m=+10.224078337 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7wns" (UniqueName: "kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns") pod "network-check-target-hf8xq" (UID: "39308fd5-852d-48a5-8cd0-6a6d1bdc4f28") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:45:49.187557 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:49.186711 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:45:49.187557 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:49.186867 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr5pg" podUID="0a260826-64c9-465b-8e06-508f90b75d0f" Jun 02 05:45:50.184503 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:50.184469 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:45:50.184958 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:50.184598 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf8xq" podUID="39308fd5-852d-48a5-8cd0-6a6d1bdc4f28" Jun 02 05:45:51.184677 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:51.184645 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:45:51.185141 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:51.184797 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr5pg" podUID="0a260826-64c9-465b-8e06-508f90b75d0f" Jun 02 05:45:52.185255 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:52.185217 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:45:52.185657 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:52.185346 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf8xq" podUID="39308fd5-852d-48a5-8cd0-6a6d1bdc4f28" Jun 02 05:45:52.738039 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:52.738003 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs\") pod \"network-metrics-daemon-gr5pg\" (UID: \"0a260826-64c9-465b-8e06-508f90b75d0f\") " pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:45:52.738203 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:52.738156 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:45:52.738283 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:52.738227 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs podName:0a260826-64c9-465b-8e06-508f90b75d0f nodeName:}" failed. No retries permitted until 2026-06-02 05:46:00.738207411 +0000 UTC m=+18.154503655 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs") pod "network-metrics-daemon-gr5pg" (UID: "0a260826-64c9-465b-8e06-508f90b75d0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:45:52.838907 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:52.838824 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7wns\" (UniqueName: \"kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns\") pod \"network-check-target-hf8xq\" (UID: \"39308fd5-852d-48a5-8cd0-6a6d1bdc4f28\") " pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:45:52.839069 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:52.838979 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 05:45:52.839069 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:52.839005 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 05:45:52.839069 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:52.839018 2549 projected.go:194] Error preparing data for projected volume kube-api-access-t7wns for pod openshift-network-diagnostics/network-check-target-hf8xq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:45:52.839240 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:52.839083 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns podName:39308fd5-852d-48a5-8cd0-6a6d1bdc4f28 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:00.83906398 +0000 UTC m=+18.255360225 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7wns" (UniqueName: "kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns") pod "network-check-target-hf8xq" (UID: "39308fd5-852d-48a5-8cd0-6a6d1bdc4f28") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:45:53.186169 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:53.186146 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:45:53.186525 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:53.186241 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr5pg" podUID="0a260826-64c9-465b-8e06-508f90b75d0f" Jun 02 05:45:54.184615 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:54.184573 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:45:54.184814 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:54.184725 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf8xq" podUID="39308fd5-852d-48a5-8cd0-6a6d1bdc4f28" Jun 02 05:45:55.184482 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:55.184443 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:45:55.184972 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:55.184640 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr5pg" podUID="0a260826-64c9-465b-8e06-508f90b75d0f" Jun 02 05:45:56.185356 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:56.185316 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:45:56.185860 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:56.185438 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf8xq" podUID="39308fd5-852d-48a5-8cd0-6a6d1bdc4f28" Jun 02 05:45:56.265968 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:56.265933 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" event={"ID":"835d076a-db77-4478-8398-b1866f8d3bbb","Type":"ContainerStarted","Data":"9394fb9e286c5ebb19e48dfcccc3dc94c5e6e45b6f5dd236777ebcf5b38983d4"} Jun 02 05:45:56.267542 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:56.267517 2549 generic.go:358] "Generic (PLEG): container finished" podID="03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9" containerID="0b2a6ea600f663a1e7904ac1df23dd30e499b19e5b3c52a0c24bbabf6aa981f0" exitCode=0 Jun 02 05:45:56.267677 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:56.267588 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2dbp8" event={"ID":"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9","Type":"ContainerDied","Data":"0b2a6ea600f663a1e7904ac1df23dd30e499b19e5b3c52a0c24bbabf6aa981f0"} Jun 02 05:45:56.269112 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:56.269030 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l29df" event={"ID":"08d597a1-897e-4cdb-bd1f-c08549cfd0c2","Type":"ContainerStarted","Data":"68b09a979c249753bf385997cdab4ed6a5ac5a00815c4fc2500d9c421d7238a3"} Jun 02 05:45:56.270583 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:56.270507 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" event={"ID":"fcd8688e-1278-465b-a090-fb4b1b6cbd50","Type":"ContainerStarted","Data":"321564c695528b7d4e6245094acc23d2aab4c3309336fd7b59a69dc9cffacfcf"} Jun 02 05:45:56.271924 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:56.271900 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wplv9" event={"ID":"1609f43a-6da5-43ee-977c-53549e92c5b6","Type":"ContainerStarted","Data":"659a81e0973f9efb897297f6aaa827ecf480696a545f3bde2d0e27832e3e4583"} Jun 02 05:45:56.276498 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:56.276477 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-k5p47" event={"ID":"9117376b-287e-4816-91d1-944d41a716ff","Type":"ContainerStarted","Data":"1231d09d179ddd4c56923a3648623ab5b3d9ddd01365ff2caee822cb79895c81"} Jun 02 05:45:56.279648 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:56.279598 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-109.ec2.internal" podStartSLOduration=12.279584874 podStartE2EDuration="12.279584874s" podCreationTimestamp="2026-06-02 05:45:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 05:45:48.263546452 +0000 UTC m=+5.679842717" watchObservedRunningTime="2026-06-02 05:45:56.279584874 +0000 UTC m=+13.695881138" Jun 02 05:45:56.291677 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:56.291404 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-dtpw4" podStartSLOduration=3.779131178 podStartE2EDuration="13.291390816s" podCreationTimestamp="2026-06-02 05:45:43 +0000 UTC" firstStartedPulling="2026-06-02 05:45:45.925801897 +0000 UTC m=+3.342098139" lastFinishedPulling="2026-06-02 05:45:55.438061535 +0000 UTC m=+12.854357777" observedRunningTime="2026-06-02 05:45:56.279709062 +0000 UTC m=+13.696005324" watchObservedRunningTime="2026-06-02 05:45:56.291390816 +0000 UTC m=+13.707687081" Jun 02 05:45:56.291889 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:56.291862 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-k5p47" podStartSLOduration=3.803831799 podStartE2EDuration="13.291853639s" podCreationTimestamp="2026-06-02 05:45:43 +0000 UTC" firstStartedPulling="2026-06-02 05:45:45.934968982 +0000 UTC m=+3.351265224" lastFinishedPulling="2026-06-02 05:45:55.422990819 +0000 UTC m=+12.839287064" observedRunningTime="2026-06-02 05:45:56.291383936 +0000 UTC m=+13.707680200" watchObservedRunningTime="2026-06-02 05:45:56.291853639 +0000 UTC m=+13.708149903" Jun 02 05:45:56.348044 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:56.348007 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wplv9" podStartSLOduration=3.8720704980000002 podStartE2EDuration="13.347997727s" podCreationTimestamp="2026-06-02 05:45:43 +0000 UTC" firstStartedPulling="2026-06-02 05:45:45.938323927 +0000 UTC m=+3.354620168" lastFinishedPulling="2026-06-02 05:45:55.414251152 +0000 UTC m=+12.830547397" observedRunningTime="2026-06-02 05:45:56.330156298 +0000 UTC m=+13.746452561" watchObservedRunningTime="2026-06-02 05:45:56.347997727 +0000 UTC m=+13.764293990" Jun 02 05:45:56.348282 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:56.348258 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l29df" podStartSLOduration=3.875139564 podStartE2EDuration="13.348251995s" podCreationTimestamp="2026-06-02 05:45:43 +0000 UTC" firstStartedPulling="2026-06-02 05:45:45.934253138 +0000 UTC m=+3.350549394" lastFinishedPulling="2026-06-02 05:45:55.407365578 +0000 UTC m=+12.823661825" observedRunningTime="2026-06-02 05:45:56.347713107 +0000 UTC m=+13.764009371" watchObservedRunningTime="2026-06-02 05:45:56.348251995 +0000 UTC m=+13.764548257" Jun 02 05:45:56.847230 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:56.847205 2549 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 02 05:45:57.139080 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:57.138976 2549 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-02T05:45:56.847227234Z","UUID":"25adfc32-c0f1-4072-8190-0e3d0eaf7ed3","Handler":null,"Name":"","Endpoint":""} Jun 02 05:45:57.141164 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:57.140945 2549 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 02 05:45:57.141164 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:57.140978 2549 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 02 05:45:57.184927 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:57.184858 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:45:57.185064 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:57.185007 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr5pg" podUID="0a260826-64c9-465b-8e06-508f90b75d0f" Jun 02 05:45:57.279592 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:57.279548 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hx2gv" event={"ID":"29aa3f63-000c-4b90-8801-8cd477073052","Type":"ContainerStarted","Data":"e7bf778dc328f34d9a644afffcac1c7f314545a59bda8161876652367c0b833f"} Jun 02 05:45:57.282652 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:57.282601 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" event={"ID":"fcd8688e-1278-465b-a090-fb4b1b6cbd50","Type":"ContainerStarted","Data":"1537e81e8e6e14dfc79402584bc40114c71d86fbc20a20006f2ed4c56efd1054"} Jun 02 05:45:58.184764 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:58.184577 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:45:58.184764 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:58.184696 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf8xq" podUID="39308fd5-852d-48a5-8cd0-6a6d1bdc4f28" Jun 02 05:45:59.184940 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:45:59.184905 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:45:59.185560 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:45:59.185038 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr5pg" podUID="0a260826-64c9-465b-8e06-508f90b75d0f" Jun 02 05:46:00.185247 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:00.185215 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:46:00.185827 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:00.185316 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf8xq" podUID="39308fd5-852d-48a5-8cd0-6a6d1bdc4f28" Jun 02 05:46:00.411247 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:00.411044 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l29df" Jun 02 05:46:00.411833 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:00.411813 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l29df" Jun 02 05:46:00.440116 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:00.440045 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hx2gv" podStartSLOduration=7.963001101 podStartE2EDuration="17.440029354s" podCreationTimestamp="2026-06-02 05:45:43 +0000 UTC" firstStartedPulling="2026-06-02 05:45:45.933324771 +0000 UTC m=+3.349621016" lastFinishedPulling="2026-06-02 05:45:55.410353025 +0000 UTC m=+12.826649269" observedRunningTime="2026-06-02 05:45:57.306578196 +0000 UTC m=+14.722874460" watchObservedRunningTime="2026-06-02 05:46:00.440029354 +0000 UTC m=+17.856325619" Jun 02 05:46:00.802985 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:00.802880 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs\") pod \"network-metrics-daemon-gr5pg\" (UID: \"0a260826-64c9-465b-8e06-508f90b75d0f\") " pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:46:00.803152 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:00.803006 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:46:00.803152 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:00.803070 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs podName:0a260826-64c9-465b-8e06-508f90b75d0f nodeName:}" failed. No retries permitted until 2026-06-02 05:46:16.803051677 +0000 UTC m=+34.219347931 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs") pod "network-metrics-daemon-gr5pg" (UID: "0a260826-64c9-465b-8e06-508f90b75d0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:46:00.903303 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:00.903269 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7wns\" (UniqueName: \"kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns\") pod \"network-check-target-hf8xq\" (UID: \"39308fd5-852d-48a5-8cd0-6a6d1bdc4f28\") " pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:46:00.903475 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:00.903464 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 05:46:00.903547 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:00.903486 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 05:46:00.903547 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:00.903498 2549 projected.go:194] Error preparing data for projected volume kube-api-access-t7wns for pod openshift-network-diagnostics/network-check-target-hf8xq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:46:00.903643 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:00.903553 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns podName:39308fd5-852d-48a5-8cd0-6a6d1bdc4f28 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:16.903533035 +0000 UTC m=+34.319829287 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7wns" (UniqueName: "kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns") pod "network-check-target-hf8xq" (UID: "39308fd5-852d-48a5-8cd0-6a6d1bdc4f28") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:46:01.184583 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:01.184552 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:46:01.184743 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:01.184687 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr5pg" podUID="0a260826-64c9-465b-8e06-508f90b75d0f" Jun 02 05:46:01.289142 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:01.289107 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l29df" Jun 02 05:46:01.289724 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:01.289701 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l29df" Jun 02 05:46:02.184580 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:02.184546 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:46:02.184775 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:02.184672 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf8xq" podUID="39308fd5-852d-48a5-8cd0-6a6d1bdc4f28" Jun 02 05:46:02.541978 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:02.541908 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-bfp2s"] Jun 02 05:46:02.609701 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:02.609673 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:02.609875 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:02.609779 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfp2s" podUID="761b2e7f-ac2a-42c9-a7f4-580d427f04e9" Jun 02 05:46:02.715243 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:02.715215 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-kubelet-config\") pod \"global-pull-secret-syncer-bfp2s\" (UID: \"761b2e7f-ac2a-42c9-a7f4-580d427f04e9\") " pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:02.715243 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:02.715251 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-dbus\") pod \"global-pull-secret-syncer-bfp2s\" (UID: \"761b2e7f-ac2a-42c9-a7f4-580d427f04e9\") " pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:02.715447 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:02.715280 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-original-pull-secret\") pod \"global-pull-secret-syncer-bfp2s\" (UID: \"761b2e7f-ac2a-42c9-a7f4-580d427f04e9\") " pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:02.816055 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:02.815976 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-kubelet-config\") pod \"global-pull-secret-syncer-bfp2s\" (UID: \"761b2e7f-ac2a-42c9-a7f4-580d427f04e9\") " pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:02.816055 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:02.816007 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-dbus\") pod \"global-pull-secret-syncer-bfp2s\" (UID: \"761b2e7f-ac2a-42c9-a7f4-580d427f04e9\") " pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:02.816055 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:02.816026 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-original-pull-secret\") pod \"global-pull-secret-syncer-bfp2s\" (UID: \"761b2e7f-ac2a-42c9-a7f4-580d427f04e9\") " pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:02.816305 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:02.816097 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-kubelet-config\") pod \"global-pull-secret-syncer-bfp2s\" (UID: \"761b2e7f-ac2a-42c9-a7f4-580d427f04e9\") " pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:02.816305 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:02.816116 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 05:46:02.816305 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:02.816196 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-original-pull-secret podName:761b2e7f-ac2a-42c9-a7f4-580d427f04e9 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:03.316176011 +0000 UTC m=+20.732472268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-original-pull-secret") pod "global-pull-secret-syncer-bfp2s" (UID: "761b2e7f-ac2a-42c9-a7f4-580d427f04e9") : object "kube-system"/"original-pull-secret" not registered Jun 02 05:46:02.816305 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:02.816249 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-dbus\") pod \"global-pull-secret-syncer-bfp2s\" (UID: \"761b2e7f-ac2a-42c9-a7f4-580d427f04e9\") " pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:03.185937 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:03.185905 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:46:03.186106 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:03.186081 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr5pg" podUID="0a260826-64c9-465b-8e06-508f90b75d0f" Jun 02 05:46:03.319685 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:03.319650 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-original-pull-secret\") pod \"global-pull-secret-syncer-bfp2s\" (UID: \"761b2e7f-ac2a-42c9-a7f4-580d427f04e9\") " pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:03.319859 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:03.319803 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 05:46:03.319939 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:03.319867 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-original-pull-secret podName:761b2e7f-ac2a-42c9-a7f4-580d427f04e9 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:04.319847927 +0000 UTC m=+21.736144221 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-original-pull-secret") pod "global-pull-secret-syncer-bfp2s" (UID: "761b2e7f-ac2a-42c9-a7f4-580d427f04e9") : object "kube-system"/"original-pull-secret" not registered Jun 02 05:46:04.184928 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:04.184892 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:04.185345 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:04.184894 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:46:04.185345 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:04.185011 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfp2s" podUID="761b2e7f-ac2a-42c9-a7f4-580d427f04e9" Jun 02 05:46:04.185345 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:04.185069 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf8xq" podUID="39308fd5-852d-48a5-8cd0-6a6d1bdc4f28" Jun 02 05:46:04.325596 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:04.325522 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-original-pull-secret\") pod \"global-pull-secret-syncer-bfp2s\" (UID: \"761b2e7f-ac2a-42c9-a7f4-580d427f04e9\") " pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:04.325794 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:04.325664 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 05:46:04.325794 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:04.325738 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-original-pull-secret podName:761b2e7f-ac2a-42c9-a7f4-580d427f04e9 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:06.325723895 +0000 UTC m=+23.742020135 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-original-pull-secret") pod "global-pull-secret-syncer-bfp2s" (UID: "761b2e7f-ac2a-42c9-a7f4-580d427f04e9") : object "kube-system"/"original-pull-secret" not registered Jun 02 05:46:05.187829 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:05.187798 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:46:05.188242 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:05.187935 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr5pg" podUID="0a260826-64c9-465b-8e06-508f90b75d0f" Jun 02 05:46:06.184547 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:06.184516 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:06.184836 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:06.184643 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfp2s" podUID="761b2e7f-ac2a-42c9-a7f4-580d427f04e9" Jun 02 05:46:06.184836 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:06.184703 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:46:06.184836 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:06.184825 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf8xq" podUID="39308fd5-852d-48a5-8cd0-6a6d1bdc4f28" Jun 02 05:46:06.342465 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:06.342425 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-original-pull-secret\") pod \"global-pull-secret-syncer-bfp2s\" (UID: \"761b2e7f-ac2a-42c9-a7f4-580d427f04e9\") " pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:06.342845 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:06.342584 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 05:46:06.342845 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:06.342657 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-original-pull-secret podName:761b2e7f-ac2a-42c9-a7f4-580d427f04e9 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:10.342638703 +0000 UTC m=+27.758934950 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-original-pull-secret") pod "global-pull-secret-syncer-bfp2s" (UID: "761b2e7f-ac2a-42c9-a7f4-580d427f04e9") : object "kube-system"/"original-pull-secret" not registered Jun 02 05:46:07.185501 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:07.185470 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:46:07.185613 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:07.185596 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr5pg" podUID="0a260826-64c9-465b-8e06-508f90b75d0f" Jun 02 05:46:07.300693 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:07.300660 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krddm" event={"ID":"b555dfed-9082-4729-b404-612836ea30b6","Type":"ContainerStarted","Data":"45c68a2cedc6eff55ab6e6eeea98b8f97d07eca20d3acf112bd78ef142af6804"} Jun 02 05:46:07.302224 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:07.302189 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4b9mb" event={"ID":"44e8d6de-2c23-4272-a006-8e6b5d12ef7b","Type":"ContainerStarted","Data":"de5c299e254874d50330703de1324114ed3753de33da6c040b75b858b1ea8e8f"} Jun 02 05:46:07.305405 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:07.304951 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2dbp8" event={"ID":"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9","Type":"ContainerStarted","Data":"cb136f588d3d25e7f27181562091cfff709d955273b0595b53ab5eff2173ee07"} Jun 02 05:46:07.342044 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:07.341922 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-4b9mb" podStartSLOduration=3.1651209 podStartE2EDuration="24.341908015s" podCreationTimestamp="2026-06-02 05:45:43 +0000 UTC" firstStartedPulling="2026-06-02 05:45:45.928925366 +0000 UTC m=+3.345221621" lastFinishedPulling="2026-06-02 05:46:07.105712482 +0000 UTC m=+24.522008736" observedRunningTime="2026-06-02 05:46:07.320868792 +0000 UTC m=+24.737165055" watchObservedRunningTime="2026-06-02 05:46:07.341908015 +0000 UTC m=+24.758204296" Jun 02 05:46:08.184779 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:08.184730 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:46:08.184779 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:08.184779 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:08.185304 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:08.184837 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf8xq" podUID="39308fd5-852d-48a5-8cd0-6a6d1bdc4f28" Jun 02 05:46:08.185304 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:08.184941 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfp2s" podUID="761b2e7f-ac2a-42c9-a7f4-580d427f04e9" Jun 02 05:46:08.308421 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:08.308391 2549 generic.go:358] "Generic (PLEG): container finished" podID="03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9" containerID="cb136f588d3d25e7f27181562091cfff709d955273b0595b53ab5eff2173ee07" exitCode=0 Jun 02 05:46:08.308524 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:08.308458 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2dbp8" event={"ID":"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9","Type":"ContainerDied","Data":"cb136f588d3d25e7f27181562091cfff709d955273b0595b53ab5eff2173ee07"} Jun 02 05:46:08.310297 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:08.310272 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" event={"ID":"fcd8688e-1278-465b-a090-fb4b1b6cbd50","Type":"ContainerStarted","Data":"2c838497150db1a47885dc1ea8a9f4372ff9d222828b601d15a76cb94fc2d842"} Jun 02 05:46:08.313003 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:08.312979 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krddm" event={"ID":"b555dfed-9082-4729-b404-612836ea30b6","Type":"ContainerStarted","Data":"307678c5870ae277abd4f4714ad75105564cf29bdd75b47589ae85061fabd824"} Jun 02 05:46:08.313068 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:08.313012 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krddm" event={"ID":"b555dfed-9082-4729-b404-612836ea30b6","Type":"ContainerStarted","Data":"62cb92cc5955c7dfa75eaf75edd778736139ba26f334952f5dd77225ce1044ff"} Jun 02 05:46:08.313068 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:08.313026 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krddm" event={"ID":"b555dfed-9082-4729-b404-612836ea30b6","Type":"ContainerStarted","Data":"806c3e242122d546b5551d912ae5e19ffd574e4ea958b417fa91b4edf25fc8ec"} Jun 02 05:46:08.313068 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:08.313038 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krddm" event={"ID":"b555dfed-9082-4729-b404-612836ea30b6","Type":"ContainerStarted","Data":"76bf08fb992262faec7ac6ad3cabe15ae2663fad80d866047933f85d89cd3f99"} Jun 02 05:46:08.313068 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:08.313052 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krddm" event={"ID":"b555dfed-9082-4729-b404-612836ea30b6","Type":"ContainerStarted","Data":"a146e26b56c91b434d8fa83ff73e255c5408ffe728c8d043fe101bf7f635d510"} Jun 02 05:46:08.344868 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:08.344832 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-xxt56" podStartSLOduration=4.030066363 podStartE2EDuration="25.344821858s" podCreationTimestamp="2026-06-02 05:45:43 +0000 UTC" firstStartedPulling="2026-06-02 05:45:45.932532891 +0000 UTC m=+3.348829138" lastFinishedPulling="2026-06-02 05:46:07.24728838 +0000 UTC m=+24.663584633" observedRunningTime="2026-06-02 05:46:08.344653981 +0000 UTC m=+25.760950242" watchObservedRunningTime="2026-06-02 05:46:08.344821858 +0000 UTC m=+25.761118119" Jun 02 05:46:09.184960 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:09.184938 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:46:09.185234 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:09.185044 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr5pg" podUID="0a260826-64c9-465b-8e06-508f90b75d0f" Jun 02 05:46:09.316727 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:09.316671 2549 generic.go:358] "Generic (PLEG): container finished" podID="03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9" containerID="0242ac68475ba60cad6d963d96635ad523b27ad58e7dd61e01a40e4fcd289c81" exitCode=0 Jun 02 05:46:09.316830 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:09.316766 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2dbp8" event={"ID":"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9","Type":"ContainerDied","Data":"0242ac68475ba60cad6d963d96635ad523b27ad58e7dd61e01a40e4fcd289c81"} Jun 02 05:46:10.184509 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:10.184479 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:10.184590 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:10.184479 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:46:10.184624 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:10.184580 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfp2s" podUID="761b2e7f-ac2a-42c9-a7f4-580d427f04e9" Jun 02 05:46:10.184666 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:10.184646 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf8xq" podUID="39308fd5-852d-48a5-8cd0-6a6d1bdc4f28" Jun 02 05:46:10.320542 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:10.320516 2549 generic.go:358] "Generic (PLEG): container finished" podID="03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9" containerID="0f483df56c7f359d6f8cd727090a841da716717ee846e314857dadad5fbdb60a" exitCode=0 Jun 02 05:46:10.320835 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:10.320587 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2dbp8" event={"ID":"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9","Type":"ContainerDied","Data":"0f483df56c7f359d6f8cd727090a841da716717ee846e314857dadad5fbdb60a"} Jun 02 05:46:10.323585 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:10.323564 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krddm" event={"ID":"b555dfed-9082-4729-b404-612836ea30b6","Type":"ContainerStarted","Data":"a31920887161590e2539eacf3097909570c130f353f42f18fe0fea2ebd3c88a8"} Jun 02 05:46:10.373866 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:10.373841 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-original-pull-secret\") pod \"global-pull-secret-syncer-bfp2s\" (UID: \"761b2e7f-ac2a-42c9-a7f4-580d427f04e9\") " pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:10.373951 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:10.373945 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 05:46:10.373996 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:10.373986 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-original-pull-secret podName:761b2e7f-ac2a-42c9-a7f4-580d427f04e9 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:18.373973643 +0000 UTC m=+35.790269884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-original-pull-secret") pod "global-pull-secret-syncer-bfp2s" (UID: "761b2e7f-ac2a-42c9-a7f4-580d427f04e9") : object "kube-system"/"original-pull-secret" not registered Jun 02 05:46:11.185140 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:11.185111 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:46:11.185316 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:11.185202 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr5pg" podUID="0a260826-64c9-465b-8e06-508f90b75d0f" Jun 02 05:46:12.185113 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:12.184892 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:12.185652 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:12.184892 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:46:12.185652 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:12.185199 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfp2s" podUID="761b2e7f-ac2a-42c9-a7f4-580d427f04e9" Jun 02 05:46:12.185652 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:12.185278 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf8xq" podUID="39308fd5-852d-48a5-8cd0-6a6d1bdc4f28" Jun 02 05:46:12.329048 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:12.329016 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-krddm" event={"ID":"b555dfed-9082-4729-b404-612836ea30b6","Type":"ContainerStarted","Data":"a439a1aab1f40b09ff8c6b6858e14b99b4aa8b9650f7440f96929b1c7b1aea02"} Jun 02 05:46:12.329374 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:12.329343 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:46:12.329459 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:12.329376 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:46:12.329459 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:12.329389 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:46:12.344028 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:12.344008 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:46:12.349150 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:12.349133 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:46:12.353481 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:12.353448 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-krddm" podStartSLOduration=8.179708222 podStartE2EDuration="29.353436728s" podCreationTimestamp="2026-06-02 05:45:43 +0000 UTC" firstStartedPulling="2026-06-02 05:45:45.931989943 +0000 UTC m=+3.348286199" lastFinishedPulling="2026-06-02 05:46:07.105718457 +0000 UTC m=+24.522014705" observedRunningTime="2026-06-02 05:46:12.352135589 +0000 UTC m=+29.768431875" watchObservedRunningTime="2026-06-02 05:46:12.353436728 +0000 UTC m=+29.769732969" Jun 02 05:46:13.187506 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:13.187483 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:46:13.188156 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:13.187582 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr5pg" podUID="0a260826-64c9-465b-8e06-508f90b75d0f" Jun 02 05:46:13.921411 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:13.921381 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bfp2s"] Jun 02 05:46:13.921608 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:13.921488 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:13.921608 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:13.921559 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfp2s" podUID="761b2e7f-ac2a-42c9-a7f4-580d427f04e9" Jun 02 05:46:13.924142 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:13.924121 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hf8xq"] Jun 02 05:46:13.924236 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:13.924213 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:46:13.924296 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:13.924280 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf8xq" podUID="39308fd5-852d-48a5-8cd0-6a6d1bdc4f28" Jun 02 05:46:13.933210 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:13.933185 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gr5pg"] Jun 02 05:46:13.933321 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:13.933289 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:46:13.933448 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:13.933404 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr5pg" podUID="0a260826-64c9-465b-8e06-508f90b75d0f" Jun 02 05:46:15.184431 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:15.184398 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:46:15.184951 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:15.184536 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr5pg" podUID="0a260826-64c9-465b-8e06-508f90b75d0f" Jun 02 05:46:15.184951 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:15.184605 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:46:15.184951 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:15.184705 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf8xq" podUID="39308fd5-852d-48a5-8cd0-6a6d1bdc4f28" Jun 02 05:46:16.185410 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:16.185381 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:16.185784 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:16.185507 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfp2s" podUID="761b2e7f-ac2a-42c9-a7f4-580d427f04e9" Jun 02 05:46:16.821387 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:16.821350 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs\") pod \"network-metrics-daemon-gr5pg\" (UID: \"0a260826-64c9-465b-8e06-508f90b75d0f\") " pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:46:16.821569 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:16.821497 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:46:16.821569 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:16.821569 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs podName:0a260826-64c9-465b-8e06-508f90b75d0f nodeName:}" failed. No retries permitted until 2026-06-02 05:46:48.821548746 +0000 UTC m=+66.237845005 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs") pod "network-metrics-daemon-gr5pg" (UID: "0a260826-64c9-465b-8e06-508f90b75d0f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 02 05:46:16.922221 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:16.922181 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7wns\" (UniqueName: \"kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns\") pod \"network-check-target-hf8xq\" (UID: \"39308fd5-852d-48a5-8cd0-6a6d1bdc4f28\") " pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:46:16.922371 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:16.922342 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 02 05:46:16.922371 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:16.922368 2549 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 02 05:46:16.922459 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:16.922383 2549 projected.go:194] Error preparing data for projected volume kube-api-access-t7wns for pod openshift-network-diagnostics/network-check-target-hf8xq: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:46:16.922459 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:16.922434 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns podName:39308fd5-852d-48a5-8cd0-6a6d1bdc4f28 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:48.922420644 +0000 UTC m=+66.338716884 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-t7wns" (UniqueName: "kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns") pod "network-check-target-hf8xq" (UID: "39308fd5-852d-48a5-8cd0-6a6d1bdc4f28") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 02 05:46:17.185347 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:17.185318 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:46:17.185513 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:17.185449 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr5pg" podUID="0a260826-64c9-465b-8e06-508f90b75d0f" Jun 02 05:46:17.185513 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:17.185468 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:46:17.185941 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:17.185578 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf8xq" podUID="39308fd5-852d-48a5-8cd0-6a6d1bdc4f28" Jun 02 05:46:18.184991 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:18.184962 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:18.185151 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:18.185051 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfp2s" podUID="761b2e7f-ac2a-42c9-a7f4-580d427f04e9" Jun 02 05:46:18.434481 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:18.434455 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-original-pull-secret\") pod \"global-pull-secret-syncer-bfp2s\" (UID: \"761b2e7f-ac2a-42c9-a7f4-580d427f04e9\") " pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:18.434792 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:18.434552 2549 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 02 05:46:18.434792 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:18.434597 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-original-pull-secret podName:761b2e7f-ac2a-42c9-a7f4-580d427f04e9 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:34.434583977 +0000 UTC m=+51.850880217 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-original-pull-secret") pod "global-pull-secret-syncer-bfp2s" (UID: "761b2e7f-ac2a-42c9-a7f4-580d427f04e9") : object "kube-system"/"original-pull-secret" not registered Jun 02 05:46:19.184794 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.184614 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:46:19.184973 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.184617 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:46:19.184973 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:19.184873 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hf8xq" podUID="39308fd5-852d-48a5-8cd0-6a6d1bdc4f28" Jun 02 05:46:19.184973 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:19.184941 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gr5pg" podUID="0a260826-64c9-465b-8e06-508f90b75d0f" Jun 02 05:46:19.344959 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.344923 2549 generic.go:358] "Generic (PLEG): container finished" podID="03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9" containerID="e5525e3c2cc66f08ecd896666d170ed4523c7584d0ba1b8f9ee9b8f21da08895" exitCode=0 Jun 02 05:46:19.345121 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.344993 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2dbp8" event={"ID":"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9","Type":"ContainerDied","Data":"e5525e3c2cc66f08ecd896666d170ed4523c7584d0ba1b8f9ee9b8f21da08895"} Jun 02 05:46:19.896054 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.896002 2549 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-109.ec2.internal" event="NodeReady" Jun 02 05:46:19.896532 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.896086 2549 kubelet_node_status.go:550] "Fast updating node status as it just became ready" Jun 02 05:46:19.927860 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.927839 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-ff9bff4d8-274tq"] Jun 02 05:46:19.947295 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.947271 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd"] Jun 02 05:46:19.947429 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.947409 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-ff9bff4d8-274tq" Jun 02 05:46:19.949804 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.949786 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 02 05:46:19.949914 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.949815 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 02 05:46:19.949914 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.949869 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 02 05:46:19.949914 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.949890 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-g7jts\"" Jun 02 05:46:19.949914 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.949872 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 02 05:46:19.963905 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.963887 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz"] Jun 02 05:46:19.964031 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.964016 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:19.966582 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.966560 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 02 05:46:19.966734 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.966594 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 02 05:46:19.966734 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.966564 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 02 05:46:19.966929 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.966915 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-d76qq\"" Jun 02 05:46:19.984040 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.984023 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr"] Jun 02 05:46:19.984170 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.984157 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz" Jun 02 05:46:19.986462 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.986435 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 02 05:46:19.986726 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:19.986714 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 02 05:46:20.009043 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.009023 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-ff9bff4d8-274tq"] Jun 02 05:46:20.009043 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.009043 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz"] Jun 02 05:46:20.009157 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.009055 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr"] Jun 02 05:46:20.009157 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.009068 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd"] Jun 02 05:46:20.009157 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.009079 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dxf8h"] Jun 02 05:46:20.009157 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.009124 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" Jun 02 05:46:20.011680 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.011659 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 02 05:46:20.011788 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.011708 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 02 05:46:20.012394 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.012367 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 02 05:46:20.014955 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.013505 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 02 05:46:20.023099 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.023084 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dxf8h"] Jun 02 05:46:20.023172 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.023161 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dxf8h" Jun 02 05:46:20.025706 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.025688 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jz498\"" Jun 02 05:46:20.025894 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.025875 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 02 05:46:20.025993 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.025926 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 02 05:46:20.026047 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.026003 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 02 05:46:20.045397 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.045376 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n555m\" (UniqueName: \"kubernetes.io/projected/0ba196f7-8668-46f9-a7fd-3d8477f5c5fe-kube-api-access-n555m\") pod \"managed-serviceaccount-addon-agent-ff9bff4d8-274tq\" (UID: \"0ba196f7-8668-46f9-a7fd-3d8477f5c5fe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-ff9bff4d8-274tq" Jun 02 05:46:20.045472 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.045433 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ba196f7-8668-46f9-a7fd-3d8477f5c5fe-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-ff9bff4d8-274tq\" (UID: \"0ba196f7-8668-46f9-a7fd-3d8477f5c5fe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-ff9bff4d8-274tq" Jun 02 05:46:20.049009 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.048992 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lsp7v"] Jun 02 05:46:20.062775 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.062737 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lsp7v"] Jun 02 05:46:20.062867 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.062854 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lsp7v" Jun 02 05:46:20.065471 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.065449 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 02 05:46:20.065552 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.065514 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qs5xc\"" Jun 02 05:46:20.065552 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.065539 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 02 05:46:20.146394 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.146350 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/558d0202-c9e6-455e-8190-353adc5affc7-klusterlet-config\") pod \"klusterlet-addon-workmgr-86667cfd6f-7vzgz\" (UID: \"558d0202-c9e6-455e-8190-353adc5affc7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz" Jun 02 05:46:20.146394 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.146373 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zff57\" (UniqueName: \"kubernetes.io/projected/558d0202-c9e6-455e-8190-353adc5affc7-kube-api-access-zff57\") pod \"klusterlet-addon-workmgr-86667cfd6f-7vzgz\" (UID: \"558d0202-c9e6-455e-8190-353adc5affc7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz" Jun 02 05:46:20.146394 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.146391 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-certificates\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.146530 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.146406 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef01ef6e-47a8-473c-8130-95ebb333a1b8-trusted-ca\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.146530 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.146427 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ba196f7-8668-46f9-a7fd-3d8477f5c5fe-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-ff9bff4d8-274tq\" (UID: \"0ba196f7-8668-46f9-a7fd-3d8477f5c5fe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-ff9bff4d8-274tq" Jun 02 05:46:20.146591 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.146543 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/32df69d8-f782-40d8-a358-f6b6f472bbdc-hub\") pod \"cluster-proxy-proxy-agent-66b6f789bc-x8jvr\" (UID: \"32df69d8-f782-40d8-a358-f6b6f472bbdc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" Jun 02 05:46:20.146622 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.146585 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/32df69d8-f782-40d8-a358-f6b6f472bbdc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66b6f789bc-x8jvr\" (UID: \"32df69d8-f782-40d8-a358-f6b6f472bbdc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" Jun 02 05:46:20.146622 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.146613 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/32df69d8-f782-40d8-a358-f6b6f472bbdc-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-66b6f789bc-x8jvr\" (UID: \"32df69d8-f782-40d8-a358-f6b6f472bbdc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" Jun 02 05:46:20.146689 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.146630 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert\") pod \"ingress-canary-dxf8h\" (UID: \"25e274b9-daeb-464a-8b5a-7de86d58b2ca\") " pod="openshift-ingress-canary/ingress-canary-dxf8h" Jun 02 05:46:20.146689 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.146659 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-tmp-dir\") pod \"dns-default-lsp7v\" (UID: \"f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb\") " pod="openshift-dns/dns-default-lsp7v" Jun 02 05:46:20.146795 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.146687 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/558d0202-c9e6-455e-8190-353adc5affc7-tmp\") pod \"klusterlet-addon-workmgr-86667cfd6f-7vzgz\" (UID: \"558d0202-c9e6-455e-8190-353adc5affc7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz" Jun 02 05:46:20.146795 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.146707 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-bound-sa-token\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.146795 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.146729 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdpfr\" (UniqueName: \"kubernetes.io/projected/32df69d8-f782-40d8-a358-f6b6f472bbdc-kube-api-access-kdpfr\") pod \"cluster-proxy-proxy-agent-66b6f789bc-x8jvr\" (UID: \"32df69d8-f782-40d8-a358-f6b6f472bbdc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" Jun 02 05:46:20.146795 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.146765 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls\") pod \"dns-default-lsp7v\" (UID: \"f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb\") " pod="openshift-dns/dns-default-lsp7v" Jun 02 05:46:20.146989 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.146842 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.146989 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.146874 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ef01ef6e-47a8-473c-8130-95ebb333a1b8-ca-trust-extracted\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.146989 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.146903 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfmsf\" (UniqueName: \"kubernetes.io/projected/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-kube-api-access-rfmsf\") pod \"dns-default-lsp7v\" (UID: \"f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb\") " pod="openshift-dns/dns-default-lsp7v" Jun 02 05:46:20.146989 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.146938 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ef01ef6e-47a8-473c-8130-95ebb333a1b8-image-registry-private-configuration\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.146989 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.146965 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fttb6\" (UniqueName: \"kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-kube-api-access-fttb6\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.147204 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.146989 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/32df69d8-f782-40d8-a358-f6b6f472bbdc-ca\") pod \"cluster-proxy-proxy-agent-66b6f789bc-x8jvr\" (UID: \"32df69d8-f782-40d8-a358-f6b6f472bbdc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" Jun 02 05:46:20.147204 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.147023 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/32df69d8-f782-40d8-a358-f6b6f472bbdc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66b6f789bc-x8jvr\" (UID: \"32df69d8-f782-40d8-a358-f6b6f472bbdc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" Jun 02 05:46:20.147204 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.147064 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n555m\" (UniqueName: \"kubernetes.io/projected/0ba196f7-8668-46f9-a7fd-3d8477f5c5fe-kube-api-access-n555m\") pod \"managed-serviceaccount-addon-agent-ff9bff4d8-274tq\" (UID: \"0ba196f7-8668-46f9-a7fd-3d8477f5c5fe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-ff9bff4d8-274tq" Jun 02 05:46:20.147204 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.147089 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dntzl\" (UniqueName: \"kubernetes.io/projected/25e274b9-daeb-464a-8b5a-7de86d58b2ca-kube-api-access-dntzl\") pod \"ingress-canary-dxf8h\" (UID: \"25e274b9-daeb-464a-8b5a-7de86d58b2ca\") " pod="openshift-ingress-canary/ingress-canary-dxf8h" Jun 02 05:46:20.147204 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.147120 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ef01ef6e-47a8-473c-8130-95ebb333a1b8-installation-pull-secrets\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.147204 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.147149 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-config-volume\") pod \"dns-default-lsp7v\" (UID: \"f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb\") " pod="openshift-dns/dns-default-lsp7v" Jun 02 05:46:20.150486 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.150470 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0ba196f7-8668-46f9-a7fd-3d8477f5c5fe-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-ff9bff4d8-274tq\" (UID: \"0ba196f7-8668-46f9-a7fd-3d8477f5c5fe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-ff9bff4d8-274tq" Jun 02 05:46:20.156342 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.156323 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n555m\" (UniqueName: \"kubernetes.io/projected/0ba196f7-8668-46f9-a7fd-3d8477f5c5fe-kube-api-access-n555m\") pod \"managed-serviceaccount-addon-agent-ff9bff4d8-274tq\" (UID: \"0ba196f7-8668-46f9-a7fd-3d8477f5c5fe\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-ff9bff4d8-274tq" Jun 02 05:46:20.185353 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.185333 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:20.188115 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.188101 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 02 05:46:20.248212 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.248195 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.248306 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.248219 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ef01ef6e-47a8-473c-8130-95ebb333a1b8-ca-trust-extracted\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.248306 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.248235 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rfmsf\" (UniqueName: \"kubernetes.io/projected/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-kube-api-access-rfmsf\") pod \"dns-default-lsp7v\" (UID: \"f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb\") " pod="openshift-dns/dns-default-lsp7v" Jun 02 05:46:20.248306 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.248251 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ef01ef6e-47a8-473c-8130-95ebb333a1b8-image-registry-private-configuration\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.248306 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.248266 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fttb6\" (UniqueName: \"kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-kube-api-access-fttb6\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.248306 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.248282 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/32df69d8-f782-40d8-a358-f6b6f472bbdc-ca\") pod \"cluster-proxy-proxy-agent-66b6f789bc-x8jvr\" (UID: \"32df69d8-f782-40d8-a358-f6b6f472bbdc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" Jun 02 05:46:20.248306 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.248299 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/32df69d8-f782-40d8-a358-f6b6f472bbdc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66b6f789bc-x8jvr\" (UID: \"32df69d8-f782-40d8-a358-f6b6f472bbdc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" Jun 02 05:46:20.248587 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:20.248365 2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 05:46:20.248587 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:20.248380 2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd: secret "image-registry-tls" not found Jun 02 05:46:20.248587 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.248427 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dntzl\" (UniqueName: \"kubernetes.io/projected/25e274b9-daeb-464a-8b5a-7de86d58b2ca-kube-api-access-dntzl\") pod \"ingress-canary-dxf8h\" (UID: \"25e274b9-daeb-464a-8b5a-7de86d58b2ca\") " pod="openshift-ingress-canary/ingress-canary-dxf8h" Jun 02 05:46:20.248587 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.248470 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ef01ef6e-47a8-473c-8130-95ebb333a1b8-installation-pull-secrets\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.248587 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.248504 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-config-volume\") pod \"dns-default-lsp7v\" (UID: \"f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb\") " pod="openshift-dns/dns-default-lsp7v" Jun 02 05:46:20.248587 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.248539 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/558d0202-c9e6-455e-8190-353adc5affc7-klusterlet-config\") pod \"klusterlet-addon-workmgr-86667cfd6f-7vzgz\" (UID: \"558d0202-c9e6-455e-8190-353adc5affc7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz" Jun 02 05:46:20.248587 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.248565 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zff57\" (UniqueName: \"kubernetes.io/projected/558d0202-c9e6-455e-8190-353adc5affc7-kube-api-access-zff57\") pod \"klusterlet-addon-workmgr-86667cfd6f-7vzgz\" (UID: \"558d0202-c9e6-455e-8190-353adc5affc7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz" Jun 02 05:46:20.248587 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.248552 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ef01ef6e-47a8-473c-8130-95ebb333a1b8-ca-trust-extracted\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.248994 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:20.248981 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls podName:ef01ef6e-47a8-473c-8130-95ebb333a1b8 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:20.748961892 +0000 UTC m=+38.165258140 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls") pod "image-registry-6bbfbfb4dc-ntgsd" (UID: "ef01ef6e-47a8-473c-8130-95ebb333a1b8") : secret "image-registry-tls" not found Jun 02 05:46:20.249062 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.249008 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-certificates\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.249062 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.249032 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-config-volume\") pod \"dns-default-lsp7v\" (UID: \"f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb\") " pod="openshift-dns/dns-default-lsp7v" Jun 02 05:46:20.249167 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.249040 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef01ef6e-47a8-473c-8130-95ebb333a1b8-trusted-ca\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.249167 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.249112 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/32df69d8-f782-40d8-a358-f6b6f472bbdc-hub\") pod \"cluster-proxy-proxy-agent-66b6f789bc-x8jvr\" (UID: \"32df69d8-f782-40d8-a358-f6b6f472bbdc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" Jun 02 05:46:20.249167 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.249137 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/32df69d8-f782-40d8-a358-f6b6f472bbdc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66b6f789bc-x8jvr\" (UID: \"32df69d8-f782-40d8-a358-f6b6f472bbdc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" Jun 02 05:46:20.249301 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.249168 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/32df69d8-f782-40d8-a358-f6b6f472bbdc-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-66b6f789bc-x8jvr\" (UID: \"32df69d8-f782-40d8-a358-f6b6f472bbdc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" Jun 02 05:46:20.249301 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.249190 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert\") pod \"ingress-canary-dxf8h\" (UID: \"25e274b9-daeb-464a-8b5a-7de86d58b2ca\") " pod="openshift-ingress-canary/ingress-canary-dxf8h" Jun 02 05:46:20.249301 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.249214 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-tmp-dir\") pod \"dns-default-lsp7v\" (UID: \"f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb\") " pod="openshift-dns/dns-default-lsp7v" Jun 02 05:46:20.249301 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.249239 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/558d0202-c9e6-455e-8190-353adc5affc7-tmp\") pod \"klusterlet-addon-workmgr-86667cfd6f-7vzgz\" (UID: \"558d0202-c9e6-455e-8190-353adc5affc7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz" Jun 02 05:46:20.249301 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.249264 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-bound-sa-token\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.249301 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.249292 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kdpfr\" (UniqueName: \"kubernetes.io/projected/32df69d8-f782-40d8-a358-f6b6f472bbdc-kube-api-access-kdpfr\") pod \"cluster-proxy-proxy-agent-66b6f789bc-x8jvr\" (UID: \"32df69d8-f782-40d8-a358-f6b6f472bbdc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" Jun 02 05:46:20.249581 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.249315 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls\") pod \"dns-default-lsp7v\" (UID: \"f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb\") " pod="openshift-dns/dns-default-lsp7v" Jun 02 05:46:20.249581 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:20.249405 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 05:46:20.249581 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:20.249452 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls podName:f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb nodeName:}" failed. No retries permitted until 2026-06-02 05:46:20.74943659 +0000 UTC m=+38.165732839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls") pod "dns-default-lsp7v" (UID: "f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb") : secret "dns-default-metrics-tls" not found Jun 02 05:46:20.249581 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.249549 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-tmp-dir\") pod \"dns-default-lsp7v\" (UID: \"f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb\") " pod="openshift-dns/dns-default-lsp7v" Jun 02 05:46:20.250036 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:20.249946 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 05:46:20.250036 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:20.250004 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert podName:25e274b9-daeb-464a-8b5a-7de86d58b2ca nodeName:}" failed. No retries permitted until 2026-06-02 05:46:20.749989316 +0000 UTC m=+38.166285573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert") pod "ingress-canary-dxf8h" (UID: "25e274b9-daeb-464a-8b5a-7de86d58b2ca") : secret "canary-serving-cert" not found Jun 02 05:46:20.250036 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.250030 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/558d0202-c9e6-455e-8190-353adc5affc7-tmp\") pod \"klusterlet-addon-workmgr-86667cfd6f-7vzgz\" (UID: \"558d0202-c9e6-455e-8190-353adc5affc7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz" Jun 02 05:46:20.250247 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.250195 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/32df69d8-f782-40d8-a358-f6b6f472bbdc-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-66b6f789bc-x8jvr\" (UID: \"32df69d8-f782-40d8-a358-f6b6f472bbdc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" Jun 02 05:46:20.251090 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.251065 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/32df69d8-f782-40d8-a358-f6b6f472bbdc-ca\") pod \"cluster-proxy-proxy-agent-66b6f789bc-x8jvr\" (UID: \"32df69d8-f782-40d8-a358-f6b6f472bbdc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" Jun 02 05:46:20.251260 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.251230 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/32df69d8-f782-40d8-a358-f6b6f472bbdc-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-66b6f789bc-x8jvr\" (UID: \"32df69d8-f782-40d8-a358-f6b6f472bbdc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" Jun 02 05:46:20.251344 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.251293 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/558d0202-c9e6-455e-8190-353adc5affc7-klusterlet-config\") pod \"klusterlet-addon-workmgr-86667cfd6f-7vzgz\" (UID: \"558d0202-c9e6-455e-8190-353adc5affc7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz" Jun 02 05:46:20.251591 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.251571 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/32df69d8-f782-40d8-a358-f6b6f472bbdc-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-66b6f789bc-x8jvr\" (UID: \"32df69d8-f782-40d8-a358-f6b6f472bbdc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" Jun 02 05:46:20.252013 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.251993 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/32df69d8-f782-40d8-a358-f6b6f472bbdc-hub\") pod \"cluster-proxy-proxy-agent-66b6f789bc-x8jvr\" (UID: \"32df69d8-f782-40d8-a358-f6b6f472bbdc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" Jun 02 05:46:20.258601 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.258516 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfmsf\" (UniqueName: \"kubernetes.io/projected/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-kube-api-access-rfmsf\") pod \"dns-default-lsp7v\" (UID: \"f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb\") " pod="openshift-dns/dns-default-lsp7v" Jun 02 05:46:20.259145 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.259095 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dntzl\" (UniqueName: \"kubernetes.io/projected/25e274b9-daeb-464a-8b5a-7de86d58b2ca-kube-api-access-dntzl\") pod \"ingress-canary-dxf8h\" (UID: \"25e274b9-daeb-464a-8b5a-7de86d58b2ca\") " pod="openshift-ingress-canary/ingress-canary-dxf8h" Jun 02 05:46:20.259145 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.259120 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-certificates\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.259336 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.259286 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zff57\" (UniqueName: \"kubernetes.io/projected/558d0202-c9e6-455e-8190-353adc5affc7-kube-api-access-zff57\") pod \"klusterlet-addon-workmgr-86667cfd6f-7vzgz\" (UID: \"558d0202-c9e6-455e-8190-353adc5affc7\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz" Jun 02 05:46:20.259568 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.259535 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdpfr\" (UniqueName: \"kubernetes.io/projected/32df69d8-f782-40d8-a358-f6b6f472bbdc-kube-api-access-kdpfr\") pod \"cluster-proxy-proxy-agent-66b6f789bc-x8jvr\" (UID: \"32df69d8-f782-40d8-a358-f6b6f472bbdc\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" Jun 02 05:46:20.259939 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.259917 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef01ef6e-47a8-473c-8130-95ebb333a1b8-trusted-ca\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.260374 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.260345 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ef01ef6e-47a8-473c-8130-95ebb333a1b8-installation-pull-secrets\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.260499 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.260485 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ef01ef6e-47a8-473c-8130-95ebb333a1b8-image-registry-private-configuration\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.261417 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.261399 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-bound-sa-token\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.261490 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.261476 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fttb6\" (UniqueName: \"kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-kube-api-access-fttb6\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.268461 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.268445 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-ff9bff4d8-274tq" Jun 02 05:46:20.292209 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.292190 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz" Jun 02 05:46:20.318809 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.318784 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" Jun 02 05:46:20.351979 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.351695 2549 generic.go:358] "Generic (PLEG): container finished" podID="03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9" containerID="d822d13c47934dfbdf49b1573c5fcbb1b0b18e5a1e459c1568aa20ea82e1c3d8" exitCode=0 Jun 02 05:46:20.351979 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.351799 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2dbp8" event={"ID":"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9","Type":"ContainerDied","Data":"d822d13c47934dfbdf49b1573c5fcbb1b0b18e5a1e459c1568aa20ea82e1c3d8"} Jun 02 05:46:20.439378 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.439164 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz"] Jun 02 05:46:20.441630 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.441565 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-ff9bff4d8-274tq"] Jun 02 05:46:20.442829 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:46:20.442805 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod558d0202_c9e6_455e_8190_353adc5affc7.slice/crio-1be95e1d2726eb8e8a234629c62d7518cd02c229f7a90125f57ec38bfdc4be3a WatchSource:0}: Error finding container 1be95e1d2726eb8e8a234629c62d7518cd02c229f7a90125f57ec38bfdc4be3a: Status 404 returned error can't find the container with id 1be95e1d2726eb8e8a234629c62d7518cd02c229f7a90125f57ec38bfdc4be3a Jun 02 05:46:20.446540 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:46:20.446498 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0ba196f7_8668_46f9_a7fd_3d8477f5c5fe.slice/crio-b5c383204435430252973601f8cfee27e905697254934670c314cce60430c337 WatchSource:0}: Error finding container b5c383204435430252973601f8cfee27e905697254934670c314cce60430c337: Status 404 returned error can't find the container with id b5c383204435430252973601f8cfee27e905697254934670c314cce60430c337 Jun 02 05:46:20.466231 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.466191 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr"] Jun 02 05:46:20.471540 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:46:20.471516 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod32df69d8_f782_40d8_a358_f6b6f472bbdc.slice/crio-30020b33d0ca6f8aa7c0a596a7b4752d4a25195b6352578e6e709f9bf401bd21 WatchSource:0}: Error finding container 30020b33d0ca6f8aa7c0a596a7b4752d4a25195b6352578e6e709f9bf401bd21: Status 404 returned error can't find the container with id 30020b33d0ca6f8aa7c0a596a7b4752d4a25195b6352578e6e709f9bf401bd21 Jun 02 05:46:20.752855 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.752831 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert\") pod \"ingress-canary-dxf8h\" (UID: \"25e274b9-daeb-464a-8b5a-7de86d58b2ca\") " pod="openshift-ingress-canary/ingress-canary-dxf8h" Jun 02 05:46:20.753006 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.752864 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls\") pod \"dns-default-lsp7v\" (UID: \"f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb\") " pod="openshift-dns/dns-default-lsp7v" Jun 02 05:46:20.753006 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:20.752892 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:20.753006 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:20.752975 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 05:46:20.753006 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:20.752996 2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 05:46:20.753006 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:20.753007 2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd: secret "image-registry-tls" not found Jun 02 05:46:20.753169 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:20.752975 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 05:46:20.753169 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:20.753035 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls podName:f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb nodeName:}" failed. No retries permitted until 2026-06-02 05:46:21.753018745 +0000 UTC m=+39.169314985 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls") pod "dns-default-lsp7v" (UID: "f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb") : secret "dns-default-metrics-tls" not found Jun 02 05:46:20.753169 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:20.753064 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls podName:ef01ef6e-47a8-473c-8130-95ebb333a1b8 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:21.753054222 +0000 UTC m=+39.169350463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls") pod "image-registry-6bbfbfb4dc-ntgsd" (UID: "ef01ef6e-47a8-473c-8130-95ebb333a1b8") : secret "image-registry-tls" not found Jun 02 05:46:20.753169 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:20.753074 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert podName:25e274b9-daeb-464a-8b5a-7de86d58b2ca nodeName:}" failed. No retries permitted until 2026-06-02 05:46:21.753069132 +0000 UTC m=+39.169365372 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert") pod "ingress-canary-dxf8h" (UID: "25e274b9-daeb-464a-8b5a-7de86d58b2ca") : secret "canary-serving-cert" not found Jun 02 05:46:21.185114 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:21.185084 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:46:21.185895 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:21.185854 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:46:21.190556 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:21.188801 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 05:46:21.190556 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:21.189624 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 05:46:21.190556 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:21.189913 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9mk8f\"" Jun 02 05:46:21.190556 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:21.190151 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x8xws\"" Jun 02 05:46:21.190556 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:21.190372 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 05:46:21.363656 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:21.363565 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2dbp8" event={"ID":"03c05e6a-5bfc-4dea-b0fc-ca3d9b230ca9","Type":"ContainerStarted","Data":"653cbf2dc4075cfd5f0b1737accd1dc299b0e2f522f140ce94d241746134a318"} Jun 02 05:46:21.368829 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:21.366798 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" event={"ID":"32df69d8-f782-40d8-a358-f6b6f472bbdc","Type":"ContainerStarted","Data":"30020b33d0ca6f8aa7c0a596a7b4752d4a25195b6352578e6e709f9bf401bd21"} Jun 02 05:46:21.370911 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:21.370863 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-ff9bff4d8-274tq" event={"ID":"0ba196f7-8668-46f9-a7fd-3d8477f5c5fe","Type":"ContainerStarted","Data":"b5c383204435430252973601f8cfee27e905697254934670c314cce60430c337"} Jun 02 05:46:21.375288 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:21.375250 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz" event={"ID":"558d0202-c9e6-455e-8190-353adc5affc7","Type":"ContainerStarted","Data":"1be95e1d2726eb8e8a234629c62d7518cd02c229f7a90125f57ec38bfdc4be3a"} Jun 02 05:46:21.389876 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:21.389826 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2dbp8" podStartSLOduration=5.912642727 podStartE2EDuration="38.389811055s" podCreationTimestamp="2026-06-02 05:45:43 +0000 UTC" firstStartedPulling="2026-06-02 05:45:45.937402433 +0000 UTC m=+3.353698676" lastFinishedPulling="2026-06-02 05:46:18.414570748 +0000 UTC m=+35.830867004" observedRunningTime="2026-06-02 05:46:21.388079189 +0000 UTC m=+38.804375452" watchObservedRunningTime="2026-06-02 05:46:21.389811055 +0000 UTC m=+38.806107317" Jun 02 05:46:21.760697 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:21.760579 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert\") pod \"ingress-canary-dxf8h\" (UID: \"25e274b9-daeb-464a-8b5a-7de86d58b2ca\") " pod="openshift-ingress-canary/ingress-canary-dxf8h" Jun 02 05:46:21.760697 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:21.760626 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls\") pod \"dns-default-lsp7v\" (UID: \"f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb\") " pod="openshift-dns/dns-default-lsp7v" Jun 02 05:46:21.760697 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:21.760673 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:21.760996 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:21.760831 2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 05:46:21.760996 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:21.760846 2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd: secret "image-registry-tls" not found Jun 02 05:46:21.760996 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:21.760902 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls podName:ef01ef6e-47a8-473c-8130-95ebb333a1b8 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:23.760885179 +0000 UTC m=+41.177181421 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls") pod "image-registry-6bbfbfb4dc-ntgsd" (UID: "ef01ef6e-47a8-473c-8130-95ebb333a1b8") : secret "image-registry-tls" not found Jun 02 05:46:21.760996 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:21.760967 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 05:46:21.760996 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:21.760999 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert podName:25e274b9-daeb-464a-8b5a-7de86d58b2ca nodeName:}" failed. No retries permitted until 2026-06-02 05:46:23.760987852 +0000 UTC m=+41.177284097 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert") pod "ingress-canary-dxf8h" (UID: "25e274b9-daeb-464a-8b5a-7de86d58b2ca") : secret "canary-serving-cert" not found Jun 02 05:46:21.761225 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:21.761055 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 05:46:21.761225 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:21.761084 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls podName:f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb nodeName:}" failed. No retries permitted until 2026-06-02 05:46:23.761073898 +0000 UTC m=+41.177370142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls") pod "dns-default-lsp7v" (UID: "f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb") : secret "dns-default-metrics-tls" not found Jun 02 05:46:23.779612 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:23.779579 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls\") pod \"dns-default-lsp7v\" (UID: \"f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb\") " pod="openshift-dns/dns-default-lsp7v" Jun 02 05:46:23.779998 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:23.779652 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:23.779998 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:23.779688 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 05:46:23.779998 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:23.779773 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls podName:f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb nodeName:}" failed. No retries permitted until 2026-06-02 05:46:27.77973753 +0000 UTC m=+45.196033789 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls") pod "dns-default-lsp7v" (UID: "f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb") : secret "dns-default-metrics-tls" not found Jun 02 05:46:23.779998 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:23.779799 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert\") pod \"ingress-canary-dxf8h\" (UID: \"25e274b9-daeb-464a-8b5a-7de86d58b2ca\") " pod="openshift-ingress-canary/ingress-canary-dxf8h" Jun 02 05:46:23.779998 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:23.779810 2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 05:46:23.779998 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:23.779824 2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd: secret "image-registry-tls" not found Jun 02 05:46:23.779998 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:23.779861 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls podName:ef01ef6e-47a8-473c-8130-95ebb333a1b8 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:27.779849311 +0000 UTC m=+45.196145555 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls") pod "image-registry-6bbfbfb4dc-ntgsd" (UID: "ef01ef6e-47a8-473c-8130-95ebb333a1b8") : secret "image-registry-tls" not found Jun 02 05:46:23.779998 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:23.779887 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 05:46:23.779998 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:23.779920 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert podName:25e274b9-daeb-464a-8b5a-7de86d58b2ca nodeName:}" failed. No retries permitted until 2026-06-02 05:46:27.779909965 +0000 UTC m=+45.196206221 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert") pod "ingress-canary-dxf8h" (UID: "25e274b9-daeb-464a-8b5a-7de86d58b2ca") : secret "canary-serving-cert" not found Jun 02 05:46:27.812684 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:27.812515 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert\") pod \"ingress-canary-dxf8h\" (UID: \"25e274b9-daeb-464a-8b5a-7de86d58b2ca\") " pod="openshift-ingress-canary/ingress-canary-dxf8h" Jun 02 05:46:27.812684 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:27.812690 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls\") pod \"dns-default-lsp7v\" (UID: \"f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb\") " pod="openshift-dns/dns-default-lsp7v" Jun 02 05:46:27.813195 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:27.812720 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:27.813195 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:27.812651 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 05:46:27.813195 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:27.812813 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert podName:25e274b9-daeb-464a-8b5a-7de86d58b2ca nodeName:}" failed. No retries permitted until 2026-06-02 05:46:35.812798158 +0000 UTC m=+53.229094398 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert") pod "ingress-canary-dxf8h" (UID: "25e274b9-daeb-464a-8b5a-7de86d58b2ca") : secret "canary-serving-cert" not found Jun 02 05:46:27.813195 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:27.812843 2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 05:46:27.813195 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:27.812845 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 05:46:27.813195 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:27.812892 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls podName:f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb nodeName:}" failed. No retries permitted until 2026-06-02 05:46:35.812879948 +0000 UTC m=+53.229176191 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls") pod "dns-default-lsp7v" (UID: "f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb") : secret "dns-default-metrics-tls" not found Jun 02 05:46:27.813195 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:27.812854 2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd: secret "image-registry-tls" not found Jun 02 05:46:27.813195 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:27.812930 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls podName:ef01ef6e-47a8-473c-8130-95ebb333a1b8 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:35.812923146 +0000 UTC m=+53.229219386 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls") pod "image-registry-6bbfbfb4dc-ntgsd" (UID: "ef01ef6e-47a8-473c-8130-95ebb333a1b8") : secret "image-registry-tls" not found Jun 02 05:46:28.390626 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:28.390586 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz" event={"ID":"558d0202-c9e6-455e-8190-353adc5affc7","Type":"ContainerStarted","Data":"1b839d81bca481e92fe5ac2fc88a79b23399e13ac80f61eddd9be6e539e960cd"} Jun 02 05:46:28.390948 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:28.390774 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz" Jun 02 05:46:28.392353 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:28.392322 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz" Jun 02 05:46:28.392503 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:28.392481 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" event={"ID":"32df69d8-f782-40d8-a358-f6b6f472bbdc","Type":"ContainerStarted","Data":"1047b67f5af89d96c09e5c9bad80ecaa9d9ac6e625effea78c323780a7f25008"} Jun 02 05:46:28.393930 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:28.393910 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-ff9bff4d8-274tq" event={"ID":"0ba196f7-8668-46f9-a7fd-3d8477f5c5fe","Type":"ContainerStarted","Data":"ba052855b484af49b40226b0deaffe619252e01cc2f38a9a7268425ac5bb679b"} Jun 02 05:46:28.407191 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:28.407031 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz" podStartSLOduration=30.38628178 podStartE2EDuration="37.407016449s" podCreationTimestamp="2026-06-02 05:45:51 +0000 UTC" firstStartedPulling="2026-06-02 05:46:20.444801679 +0000 UTC m=+37.861097937" lastFinishedPulling="2026-06-02 05:46:27.465536364 +0000 UTC m=+44.881832606" observedRunningTime="2026-06-02 05:46:28.406541341 +0000 UTC m=+45.822837618" watchObservedRunningTime="2026-06-02 05:46:28.407016449 +0000 UTC m=+45.823312712" Jun 02 05:46:28.421994 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:28.421941 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-ff9bff4d8-274tq" podStartSLOduration=30.404664258 podStartE2EDuration="37.421929666s" podCreationTimestamp="2026-06-02 05:45:51 +0000 UTC" firstStartedPulling="2026-06-02 05:46:20.4486531 +0000 UTC m=+37.864949340" lastFinishedPulling="2026-06-02 05:46:27.465918506 +0000 UTC m=+44.882214748" observedRunningTime="2026-06-02 05:46:28.421368002 +0000 UTC m=+45.837664265" watchObservedRunningTime="2026-06-02 05:46:28.421929666 +0000 UTC m=+45.838225927" Jun 02 05:46:29.397111 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:29.397083 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" event={"ID":"32df69d8-f782-40d8-a358-f6b6f472bbdc","Type":"ContainerStarted","Data":"f68833751ae497af1bd2c84245d4a4bbc7699a72c9aa6b654cd0a874ab56a821"} Jun 02 05:46:29.397472 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:29.397119 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" event={"ID":"32df69d8-f782-40d8-a358-f6b6f472bbdc","Type":"ContainerStarted","Data":"5318dddc156e3efd71c53ff00b3995a302124357921e2d92dd4e6c089a09970c"} Jun 02 05:46:29.421413 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:29.421373 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" podStartSLOduration=29.692514723 podStartE2EDuration="38.421359536s" podCreationTimestamp="2026-06-02 05:45:51 +0000 UTC" firstStartedPulling="2026-06-02 05:46:20.474567835 +0000 UTC m=+37.890864075" lastFinishedPulling="2026-06-02 05:46:29.203412631 +0000 UTC m=+46.619708888" observedRunningTime="2026-06-02 05:46:29.421342448 +0000 UTC m=+46.837638713" watchObservedRunningTime="2026-06-02 05:46:29.421359536 +0000 UTC m=+46.837655780" Jun 02 05:46:34.461595 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:34.461561 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-original-pull-secret\") pod \"global-pull-secret-syncer-bfp2s\" (UID: \"761b2e7f-ac2a-42c9-a7f4-580d427f04e9\") " pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:34.465410 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:34.465379 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/761b2e7f-ac2a-42c9-a7f4-580d427f04e9-original-pull-secret\") pod \"global-pull-secret-syncer-bfp2s\" (UID: \"761b2e7f-ac2a-42c9-a7f4-580d427f04e9\") " pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:34.593075 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:34.593042 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfp2s" Jun 02 05:46:34.703677 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:34.703650 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bfp2s"] Jun 02 05:46:34.706589 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:46:34.706561 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod761b2e7f_ac2a_42c9_a7f4_580d427f04e9.slice/crio-1e9b1cbabec18fd25c3abf4f6de6c34aa86cbea9108af27c5334b16d467f3bd4 WatchSource:0}: Error finding container 1e9b1cbabec18fd25c3abf4f6de6c34aa86cbea9108af27c5334b16d467f3bd4: Status 404 returned error can't find the container with id 1e9b1cbabec18fd25c3abf4f6de6c34aa86cbea9108af27c5334b16d467f3bd4 Jun 02 05:46:35.408295 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:35.408257 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bfp2s" event={"ID":"761b2e7f-ac2a-42c9-a7f4-580d427f04e9","Type":"ContainerStarted","Data":"1e9b1cbabec18fd25c3abf4f6de6c34aa86cbea9108af27c5334b16d467f3bd4"} Jun 02 05:46:35.870269 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:35.870231 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls\") pod \"dns-default-lsp7v\" (UID: \"f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb\") " pod="openshift-dns/dns-default-lsp7v" Jun 02 05:46:35.870711 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:35.870294 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:35.870711 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:35.870374 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert\") pod \"ingress-canary-dxf8h\" (UID: \"25e274b9-daeb-464a-8b5a-7de86d58b2ca\") " pod="openshift-ingress-canary/ingress-canary-dxf8h" Jun 02 05:46:35.870711 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:35.870391 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 05:46:35.870711 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:35.870425 2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 05:46:35.870711 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:35.870440 2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd: secret "image-registry-tls" not found Jun 02 05:46:35.870711 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:35.870479 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls podName:f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb nodeName:}" failed. No retries permitted until 2026-06-02 05:46:51.870458876 +0000 UTC m=+69.286755130 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls") pod "dns-default-lsp7v" (UID: "f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb") : secret "dns-default-metrics-tls" not found Jun 02 05:46:35.870711 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:35.870494 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 05:46:35.870711 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:35.870497 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls podName:ef01ef6e-47a8-473c-8130-95ebb333a1b8 nodeName:}" failed. No retries permitted until 2026-06-02 05:46:51.870488431 +0000 UTC m=+69.286784675 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls") pod "image-registry-6bbfbfb4dc-ntgsd" (UID: "ef01ef6e-47a8-473c-8130-95ebb333a1b8") : secret "image-registry-tls" not found Jun 02 05:46:35.870711 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:35.870632 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert podName:25e274b9-daeb-464a-8b5a-7de86d58b2ca nodeName:}" failed. No retries permitted until 2026-06-02 05:46:51.870615023 +0000 UTC m=+69.286911272 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert") pod "ingress-canary-dxf8h" (UID: "25e274b9-daeb-464a-8b5a-7de86d58b2ca") : secret "canary-serving-cert" not found Jun 02 05:46:40.420953 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:40.420919 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bfp2s" event={"ID":"761b2e7f-ac2a-42c9-a7f4-580d427f04e9","Type":"ContainerStarted","Data":"d4d8c5ab55757e137867374dbc67769a3ca410713c7e35bff1ddec40198745a2"} Jun 02 05:46:40.434949 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:40.434908 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bfp2s" podStartSLOduration=33.856820699 podStartE2EDuration="38.434895106s" podCreationTimestamp="2026-06-02 05:46:02 +0000 UTC" firstStartedPulling="2026-06-02 05:46:34.70805703 +0000 UTC m=+52.124353280" lastFinishedPulling="2026-06-02 05:46:39.286131443 +0000 UTC m=+56.702427687" observedRunningTime="2026-06-02 05:46:40.434166442 +0000 UTC m=+57.850462703" watchObservedRunningTime="2026-06-02 05:46:40.434895106 +0000 UTC m=+57.851191374" Jun 02 05:46:44.343552 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:44.343526 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-krddm" Jun 02 05:46:48.864487 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:48.864452 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs\") pod \"network-metrics-daemon-gr5pg\" (UID: \"0a260826-64c9-465b-8e06-508f90b75d0f\") " pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:46:48.866951 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:48.866930 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 02 05:46:48.875006 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:48.874983 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 05:46:48.875083 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:48.875051 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs podName:0a260826-64c9-465b-8e06-508f90b75d0f nodeName:}" failed. No retries permitted until 2026-06-02 05:47:52.875034942 +0000 UTC m=+130.291331182 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs") pod "network-metrics-daemon-gr5pg" (UID: "0a260826-64c9-465b-8e06-508f90b75d0f") : secret "metrics-daemon-secret" not found Jun 02 05:46:48.965214 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:48.965186 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7wns\" (UniqueName: \"kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns\") pod \"network-check-target-hf8xq\" (UID: \"39308fd5-852d-48a5-8cd0-6a6d1bdc4f28\") " pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:46:48.967548 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:48.967532 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 02 05:46:48.978381 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:48.978358 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 02 05:46:48.989639 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:48.989613 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7wns\" (UniqueName: \"kubernetes.io/projected/39308fd5-852d-48a5-8cd0-6a6d1bdc4f28-kube-api-access-t7wns\") pod \"network-check-target-hf8xq\" (UID: \"39308fd5-852d-48a5-8cd0-6a6d1bdc4f28\") " pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:46:49.106600 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:49.106578 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-9mk8f\"" Jun 02 05:46:49.114782 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:49.114738 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:46:49.228874 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:49.228849 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hf8xq"] Jun 02 05:46:49.231723 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:46:49.231696 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39308fd5_852d_48a5_8cd0_6a6d1bdc4f28.slice/crio-b74f07084c40db7ca6c9123584022162a322911085fcd6aa0159bb896c5232d3 WatchSource:0}: Error finding container b74f07084c40db7ca6c9123584022162a322911085fcd6aa0159bb896c5232d3: Status 404 returned error can't find the container with id b74f07084c40db7ca6c9123584022162a322911085fcd6aa0159bb896c5232d3 Jun 02 05:46:49.443210 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:49.443182 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hf8xq" event={"ID":"39308fd5-852d-48a5-8cd0-6a6d1bdc4f28","Type":"ContainerStarted","Data":"b74f07084c40db7ca6c9123584022162a322911085fcd6aa0159bb896c5232d3"} Jun 02 05:46:51.886916 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:51.886876 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:46:51.887360 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:51.886977 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert\") pod \"ingress-canary-dxf8h\" (UID: \"25e274b9-daeb-464a-8b5a-7de86d58b2ca\") " pod="openshift-ingress-canary/ingress-canary-dxf8h" Jun 02 05:46:51.887360 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:51.887012 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls\") pod \"dns-default-lsp7v\" (UID: \"f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb\") " pod="openshift-dns/dns-default-lsp7v" Jun 02 05:46:51.887360 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:51.887034 2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 05:46:51.887360 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:51.887057 2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd: secret "image-registry-tls" not found Jun 02 05:46:51.887360 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:51.887125 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 05:46:51.887360 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:51.887132 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls podName:ef01ef6e-47a8-473c-8130-95ebb333a1b8 nodeName:}" failed. No retries permitted until 2026-06-02 05:47:23.887114128 +0000 UTC m=+101.303410394 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls") pod "image-registry-6bbfbfb4dc-ntgsd" (UID: "ef01ef6e-47a8-473c-8130-95ebb333a1b8") : secret "image-registry-tls" not found Jun 02 05:46:51.887360 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:51.887142 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 05:46:51.887360 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:51.887176 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls podName:f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb nodeName:}" failed. No retries permitted until 2026-06-02 05:47:23.887160544 +0000 UTC m=+101.303456801 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls") pod "dns-default-lsp7v" (UID: "f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb") : secret "dns-default-metrics-tls" not found Jun 02 05:46:51.887360 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:46:51.887194 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert podName:25e274b9-daeb-464a-8b5a-7de86d58b2ca nodeName:}" failed. No retries permitted until 2026-06-02 05:47:23.88718474 +0000 UTC m=+101.303480980 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert") pod "ingress-canary-dxf8h" (UID: "25e274b9-daeb-464a-8b5a-7de86d58b2ca") : secret "canary-serving-cert" not found Jun 02 05:46:52.453625 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:52.453597 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hf8xq" event={"ID":"39308fd5-852d-48a5-8cd0-6a6d1bdc4f28","Type":"ContainerStarted","Data":"a6602ecd2865938ba48129d809874da4c60a5dc031bb4e668cc4e6251bc9a049"} Jun 02 05:46:52.453803 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:52.453722 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:46:52.469011 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:46:52.468967 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hf8xq" podStartSLOduration=66.724794265 podStartE2EDuration="1m9.468953324s" podCreationTimestamp="2026-06-02 05:45:43 +0000 UTC" firstStartedPulling="2026-06-02 05:46:49.233572636 +0000 UTC m=+66.649868876" lastFinishedPulling="2026-06-02 05:46:51.977731678 +0000 UTC m=+69.394027935" observedRunningTime="2026-06-02 05:46:52.46786546 +0000 UTC m=+69.884161748" watchObservedRunningTime="2026-06-02 05:46:52.468953324 +0000 UTC m=+69.885249580" Jun 02 05:47:23.457955 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:47:23.457928 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hf8xq" Jun 02 05:47:23.895200 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:47:23.895161 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert\") pod \"ingress-canary-dxf8h\" (UID: \"25e274b9-daeb-464a-8b5a-7de86d58b2ca\") " pod="openshift-ingress-canary/ingress-canary-dxf8h" Jun 02 05:47:23.895388 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:47:23.895208 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls\") pod \"dns-default-lsp7v\" (UID: \"f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb\") " pod="openshift-dns/dns-default-lsp7v" Jun 02 05:47:23.895388 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:47:23.895238 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls\") pod \"image-registry-6bbfbfb4dc-ntgsd\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:47:23.895388 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:47:23.895301 2549 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found Jun 02 05:47:23.895388 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:47:23.895331 2549 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 02 05:47:23.895388 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:47:23.895369 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert podName:25e274b9-daeb-464a-8b5a-7de86d58b2ca nodeName:}" failed. No retries permitted until 2026-06-02 05:48:27.895354397 +0000 UTC m=+165.311650642 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert") pod "ingress-canary-dxf8h" (UID: "25e274b9-daeb-464a-8b5a-7de86d58b2ca") : secret "canary-serving-cert" not found Jun 02 05:47:23.895600 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:47:23.895406 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls podName:f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb nodeName:}" failed. No retries permitted until 2026-06-02 05:48:27.895386608 +0000 UTC m=+165.311682848 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls") pod "dns-default-lsp7v" (UID: "f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb") : secret "dns-default-metrics-tls" not found Jun 02 05:47:23.895600 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:47:23.895338 2549 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 02 05:47:23.895600 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:47:23.895426 2549 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd: secret "image-registry-tls" not found Jun 02 05:47:23.895600 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:47:23.895469 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls podName:ef01ef6e-47a8-473c-8130-95ebb333a1b8 nodeName:}" failed. No retries permitted until 2026-06-02 05:48:27.895458873 +0000 UTC m=+165.311755119 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls") pod "image-registry-6bbfbfb4dc-ntgsd" (UID: "ef01ef6e-47a8-473c-8130-95ebb333a1b8") : secret "image-registry-tls" not found Jun 02 05:47:30.139274 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:47:30.139248 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k5p47_9117376b-287e-4816-91d1-944d41a716ff/dns-node-resolver/0.log" Jun 02 05:47:31.338396 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:47:31.338371 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wplv9_1609f43a-6da5-43ee-977c-53549e92c5b6/node-ca/0.log" Jun 02 05:47:52.893111 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:47:52.893078 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs\") pod \"network-metrics-daemon-gr5pg\" (UID: \"0a260826-64c9-465b-8e06-508f90b75d0f\") " pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:47:52.893542 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:47:52.893197 2549 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 02 05:47:52.893542 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:47:52.893256 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs podName:0a260826-64c9-465b-8e06-508f90b75d0f nodeName:}" failed. No retries permitted until 2026-06-02 05:49:54.893239467 +0000 UTC m=+252.309535726 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs") pod "network-metrics-daemon-gr5pg" (UID: "0a260826-64c9-465b-8e06-508f90b75d0f") : secret "metrics-daemon-secret" not found Jun 02 05:48:04.010853 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.010810 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4bhlw"] Jun 02 05:48:04.013963 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.013948 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4bhlw" Jun 02 05:48:04.019364 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.019339 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 02 05:48:04.020447 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.020426 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 02 05:48:04.020543 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.020450 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n2hpl\"" Jun 02 05:48:04.020543 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.020484 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 02 05:48:04.020543 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.020514 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 02 05:48:04.034259 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.034232 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4bhlw"] Jun 02 05:48:04.174077 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.174045 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znnxz\" (UniqueName: \"kubernetes.io/projected/97c93db9-2020-4e6d-952b-69c5ca423a94-kube-api-access-znnxz\") pod \"insights-runtime-extractor-4bhlw\" (UID: \"97c93db9-2020-4e6d-952b-69c5ca423a94\") " pod="openshift-insights/insights-runtime-extractor-4bhlw" Jun 02 05:48:04.174244 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.174139 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97c93db9-2020-4e6d-952b-69c5ca423a94-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4bhlw\" (UID: \"97c93db9-2020-4e6d-952b-69c5ca423a94\") " pod="openshift-insights/insights-runtime-extractor-4bhlw" Jun 02 05:48:04.174244 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.174176 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/97c93db9-2020-4e6d-952b-69c5ca423a94-data-volume\") pod \"insights-runtime-extractor-4bhlw\" (UID: \"97c93db9-2020-4e6d-952b-69c5ca423a94\") " pod="openshift-insights/insights-runtime-extractor-4bhlw" Jun 02 05:48:04.174244 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.174218 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97c93db9-2020-4e6d-952b-69c5ca423a94-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4bhlw\" (UID: \"97c93db9-2020-4e6d-952b-69c5ca423a94\") " pod="openshift-insights/insights-runtime-extractor-4bhlw" Jun 02 05:48:04.174369 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.174314 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/97c93db9-2020-4e6d-952b-69c5ca423a94-crio-socket\") pod \"insights-runtime-extractor-4bhlw\" (UID: \"97c93db9-2020-4e6d-952b-69c5ca423a94\") " pod="openshift-insights/insights-runtime-extractor-4bhlw" Jun 02 05:48:04.274787 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.274701 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-znnxz\" (UniqueName: \"kubernetes.io/projected/97c93db9-2020-4e6d-952b-69c5ca423a94-kube-api-access-znnxz\") pod \"insights-runtime-extractor-4bhlw\" (UID: \"97c93db9-2020-4e6d-952b-69c5ca423a94\") " pod="openshift-insights/insights-runtime-extractor-4bhlw" Jun 02 05:48:04.274787 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.274765 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97c93db9-2020-4e6d-952b-69c5ca423a94-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4bhlw\" (UID: \"97c93db9-2020-4e6d-952b-69c5ca423a94\") " pod="openshift-insights/insights-runtime-extractor-4bhlw" Jun 02 05:48:04.274933 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.274806 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/97c93db9-2020-4e6d-952b-69c5ca423a94-data-volume\") pod \"insights-runtime-extractor-4bhlw\" (UID: \"97c93db9-2020-4e6d-952b-69c5ca423a94\") " pod="openshift-insights/insights-runtime-extractor-4bhlw" Jun 02 05:48:04.274933 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.274822 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97c93db9-2020-4e6d-952b-69c5ca423a94-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4bhlw\" (UID: \"97c93db9-2020-4e6d-952b-69c5ca423a94\") " pod="openshift-insights/insights-runtime-extractor-4bhlw" Jun 02 05:48:04.275197 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.275175 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/97c93db9-2020-4e6d-952b-69c5ca423a94-data-volume\") pod \"insights-runtime-extractor-4bhlw\" (UID: \"97c93db9-2020-4e6d-952b-69c5ca423a94\") " pod="openshift-insights/insights-runtime-extractor-4bhlw" Jun 02 05:48:04.275242 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.275201 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/97c93db9-2020-4e6d-952b-69c5ca423a94-crio-socket\") pod \"insights-runtime-extractor-4bhlw\" (UID: \"97c93db9-2020-4e6d-952b-69c5ca423a94\") " pod="openshift-insights/insights-runtime-extractor-4bhlw" Jun 02 05:48:04.275328 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.275310 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/97c93db9-2020-4e6d-952b-69c5ca423a94-crio-socket\") pod \"insights-runtime-extractor-4bhlw\" (UID: \"97c93db9-2020-4e6d-952b-69c5ca423a94\") " pod="openshift-insights/insights-runtime-extractor-4bhlw" Jun 02 05:48:04.275452 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.275436 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/97c93db9-2020-4e6d-952b-69c5ca423a94-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4bhlw\" (UID: \"97c93db9-2020-4e6d-952b-69c5ca423a94\") " pod="openshift-insights/insights-runtime-extractor-4bhlw" Jun 02 05:48:04.277121 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.277103 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/97c93db9-2020-4e6d-952b-69c5ca423a94-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4bhlw\" (UID: \"97c93db9-2020-4e6d-952b-69c5ca423a94\") " pod="openshift-insights/insights-runtime-extractor-4bhlw" Jun 02 05:48:04.285019 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.284995 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znnxz\" (UniqueName: \"kubernetes.io/projected/97c93db9-2020-4e6d-952b-69c5ca423a94-kube-api-access-znnxz\") pod \"insights-runtime-extractor-4bhlw\" (UID: \"97c93db9-2020-4e6d-952b-69c5ca423a94\") " pod="openshift-insights/insights-runtime-extractor-4bhlw" Jun 02 05:48:04.322982 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.322958 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4bhlw" Jun 02 05:48:04.439328 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.439298 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4bhlw"] Jun 02 05:48:04.442542 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:48:04.442510 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c93db9_2020_4e6d_952b_69c5ca423a94.slice/crio-c627dc406ba5c7bb35427dd2309db2bdb8f5ce91d6d4242e02a4ad7b8e13a936 WatchSource:0}: Error finding container c627dc406ba5c7bb35427dd2309db2bdb8f5ce91d6d4242e02a4ad7b8e13a936: Status 404 returned error can't find the container with id c627dc406ba5c7bb35427dd2309db2bdb8f5ce91d6d4242e02a4ad7b8e13a936 Jun 02 05:48:04.627565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.627483 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4bhlw" event={"ID":"97c93db9-2020-4e6d-952b-69c5ca423a94","Type":"ContainerStarted","Data":"6325be7c009df3444afd2290d2b62d5662f7c49d0ebd02bb3739efb8458b2d11"} Jun 02 05:48:04.627565 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:04.627517 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4bhlw" event={"ID":"97c93db9-2020-4e6d-952b-69c5ca423a94","Type":"ContainerStarted","Data":"c627dc406ba5c7bb35427dd2309db2bdb8f5ce91d6d4242e02a4ad7b8e13a936"} Jun 02 05:48:05.630767 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:05.630694 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4bhlw" event={"ID":"97c93db9-2020-4e6d-952b-69c5ca423a94","Type":"ContainerStarted","Data":"b6773758966dcf3d82cc9ce2c7431401403586d73c9489a59b5fa911a9442ec4"} Jun 02 05:48:07.637955 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:07.637923 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4bhlw" event={"ID":"97c93db9-2020-4e6d-952b-69c5ca423a94","Type":"ContainerStarted","Data":"73c0a33bee102b1b89d9ff933f194c7905dcc4d8b4cb79c3196f2add68f3d317"} Jun 02 05:48:07.655866 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:07.655812 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4bhlw" podStartSLOduration=2.041876723 podStartE2EDuration="4.655798263s" podCreationTimestamp="2026-06-02 05:48:03 +0000 UTC" firstStartedPulling="2026-06-02 05:48:04.501440538 +0000 UTC m=+141.917736778" lastFinishedPulling="2026-06-02 05:48:07.115362065 +0000 UTC m=+144.531658318" observedRunningTime="2026-06-02 05:48:07.655472128 +0000 UTC m=+145.071768390" watchObservedRunningTime="2026-06-02 05:48:07.655798263 +0000 UTC m=+145.072094525" Jun 02 05:48:12.441138 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.441110 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-86str"] Jun 02 05:48:12.444306 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.444271 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.447152 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.447129 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 02 05:48:12.447250 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.447129 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 02 05:48:12.448401 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.448376 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 02 05:48:12.448502 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.448403 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 02 05:48:12.448502 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.448435 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 02 05:48:12.448502 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.448405 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 02 05:48:12.448502 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.448378 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-v7nd9\"" Jun 02 05:48:12.530538 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.530518 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/66e0da3a-2441-4bce-ae31-ad688cb57c66-node-exporter-textfile\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.530652 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.530552 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/66e0da3a-2441-4bce-ae31-ad688cb57c66-node-exporter-wtmp\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.530652 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.530577 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/66e0da3a-2441-4bce-ae31-ad688cb57c66-root\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.530652 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.530633 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66e0da3a-2441-4bce-ae31-ad688cb57c66-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.530841 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.530686 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66e0da3a-2441-4bce-ae31-ad688cb57c66-metrics-client-ca\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.530841 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.530732 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66e0da3a-2441-4bce-ae31-ad688cb57c66-node-exporter-tls\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.530841 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.530782 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/66e0da3a-2441-4bce-ae31-ad688cb57c66-node-exporter-accelerators-collector-config\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.530934 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.530834 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66e0da3a-2441-4bce-ae31-ad688cb57c66-sys\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.530934 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.530876 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq8f5\" (UniqueName: \"kubernetes.io/projected/66e0da3a-2441-4bce-ae31-ad688cb57c66-kube-api-access-gq8f5\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.631665 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.631641 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66e0da3a-2441-4bce-ae31-ad688cb57c66-sys\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.631739 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.631694 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gq8f5\" (UniqueName: \"kubernetes.io/projected/66e0da3a-2441-4bce-ae31-ad688cb57c66-kube-api-access-gq8f5\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.631823 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.631768 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/66e0da3a-2441-4bce-ae31-ad688cb57c66-node-exporter-textfile\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.631823 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.631769 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/66e0da3a-2441-4bce-ae31-ad688cb57c66-sys\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.631921 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.631822 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/66e0da3a-2441-4bce-ae31-ad688cb57c66-node-exporter-wtmp\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.631921 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.631872 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/66e0da3a-2441-4bce-ae31-ad688cb57c66-root\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.631921 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.631904 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66e0da3a-2441-4bce-ae31-ad688cb57c66-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.632079 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.631949 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66e0da3a-2441-4bce-ae31-ad688cb57c66-metrics-client-ca\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.632079 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.631980 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/66e0da3a-2441-4bce-ae31-ad688cb57c66-node-exporter-wtmp\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.632079 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.631986 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66e0da3a-2441-4bce-ae31-ad688cb57c66-node-exporter-tls\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.632079 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.632030 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/66e0da3a-2441-4bce-ae31-ad688cb57c66-node-exporter-accelerators-collector-config\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.632079 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:48:12.632049 2549 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 02 05:48:12.632079 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.632063 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/66e0da3a-2441-4bce-ae31-ad688cb57c66-node-exporter-textfile\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.632352 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:48:12.632110 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66e0da3a-2441-4bce-ae31-ad688cb57c66-node-exporter-tls podName:66e0da3a-2441-4bce-ae31-ad688cb57c66 nodeName:}" failed. No retries permitted until 2026-06-02 05:48:13.132090767 +0000 UTC m=+150.548387023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/66e0da3a-2441-4bce-ae31-ad688cb57c66-node-exporter-tls") pod "node-exporter-86str" (UID: "66e0da3a-2441-4bce-ae31-ad688cb57c66") : secret "node-exporter-tls" not found Jun 02 05:48:12.632352 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.632141 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/66e0da3a-2441-4bce-ae31-ad688cb57c66-root\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.632489 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.632471 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66e0da3a-2441-4bce-ae31-ad688cb57c66-metrics-client-ca\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.632530 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.632480 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/66e0da3a-2441-4bce-ae31-ad688cb57c66-node-exporter-accelerators-collector-config\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.634047 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.634028 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66e0da3a-2441-4bce-ae31-ad688cb57c66-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:12.641887 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:12.641868 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq8f5\" (UniqueName: \"kubernetes.io/projected/66e0da3a-2441-4bce-ae31-ad688cb57c66-kube-api-access-gq8f5\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:13.136578 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:13.136546 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66e0da3a-2441-4bce-ae31-ad688cb57c66-node-exporter-tls\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:13.138671 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:13.138652 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/66e0da3a-2441-4bce-ae31-ad688cb57c66-node-exporter-tls\") pod \"node-exporter-86str\" (UID: \"66e0da3a-2441-4bce-ae31-ad688cb57c66\") " pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:13.352362 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:13.352333 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-86str" Jun 02 05:48:13.359796 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:48:13.359770 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66e0da3a_2441_4bce_ae31_ad688cb57c66.slice/crio-166ecc311f49d2e6596c8c30a8d753d4ec99761af8be564c12774fdd2ffc585a WatchSource:0}: Error finding container 166ecc311f49d2e6596c8c30a8d753d4ec99761af8be564c12774fdd2ffc585a: Status 404 returned error can't find the container with id 166ecc311f49d2e6596c8c30a8d753d4ec99761af8be564c12774fdd2ffc585a Jun 02 05:48:13.653959 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:13.653933 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-86str" event={"ID":"66e0da3a-2441-4bce-ae31-ad688cb57c66","Type":"ContainerStarted","Data":"166ecc311f49d2e6596c8c30a8d753d4ec99761af8be564c12774fdd2ffc585a"} Jun 02 05:48:14.657947 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:14.657867 2549 generic.go:358] "Generic (PLEG): container finished" podID="66e0da3a-2441-4bce-ae31-ad688cb57c66" containerID="9f7099ef2f5ae1b8a88cd6b9f72ea8aaf186185072f44da42ffb352bfc644845" exitCode=0 Jun 02 05:48:14.657947 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:14.657924 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-86str" event={"ID":"66e0da3a-2441-4bce-ae31-ad688cb57c66","Type":"ContainerDied","Data":"9f7099ef2f5ae1b8a88cd6b9f72ea8aaf186185072f44da42ffb352bfc644845"} Jun 02 05:48:15.662202 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:15.662171 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-86str" event={"ID":"66e0da3a-2441-4bce-ae31-ad688cb57c66","Type":"ContainerStarted","Data":"dbe3a4a6edf5d27edeb8d1619e105f44df9f4e838383454840a592add974a643"} Jun 02 05:48:15.662202 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:15.662209 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-86str" event={"ID":"66e0da3a-2441-4bce-ae31-ad688cb57c66","Type":"ContainerStarted","Data":"3e59942e20a8a0a43bdd7eec5f87e0d8d3b8b88f514f459f3596f2f001c05812"} Jun 02 05:48:15.683399 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:15.683354 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-86str" podStartSLOduration=2.7438032039999998 podStartE2EDuration="3.683341969s" podCreationTimestamp="2026-06-02 05:48:12 +0000 UTC" firstStartedPulling="2026-06-02 05:48:13.361567365 +0000 UTC m=+150.777863608" lastFinishedPulling="2026-06-02 05:48:14.301106097 +0000 UTC m=+151.717402373" observedRunningTime="2026-06-02 05:48:15.68138003 +0000 UTC m=+153.097676292" watchObservedRunningTime="2026-06-02 05:48:15.683341969 +0000 UTC m=+153.099638266" Jun 02 05:48:22.974949 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:48:22.974905 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" podUID="ef01ef6e-47a8-473c-8130-95ebb333a1b8" Jun 02 05:48:23.047864 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:48:23.047833 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-dxf8h" podUID="25e274b9-daeb-464a-8b5a-7de86d58b2ca" Jun 02 05:48:23.070997 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:48:23.070966 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-lsp7v" podUID="f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb" Jun 02 05:48:23.679880 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:23.679857 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:48:24.211603 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:48:24.211561 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gr5pg" podUID="0a260826-64c9-465b-8e06-508f90b75d0f" Jun 02 05:48:26.270655 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.270624 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd"] Jun 02 05:48:26.271053 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:48:26.270811 2549 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" podUID="ef01ef6e-47a8-473c-8130-95ebb333a1b8" Jun 02 05:48:26.686032 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.686005 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:48:26.689875 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.689857 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:48:26.727424 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.727405 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fttb6\" (UniqueName: \"kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-kube-api-access-fttb6\") pod \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " Jun 02 05:48:26.727502 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.727473 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-certificates\") pod \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " Jun 02 05:48:26.727534 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.727516 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-bound-sa-token\") pod \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " Jun 02 05:48:26.727563 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.727550 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef01ef6e-47a8-473c-8130-95ebb333a1b8-trusted-ca\") pod \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " Jun 02 05:48:26.727595 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.727575 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ef01ef6e-47a8-473c-8130-95ebb333a1b8-ca-trust-extracted\") pod \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " Jun 02 05:48:26.727635 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.727609 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ef01ef6e-47a8-473c-8130-95ebb333a1b8-installation-pull-secrets\") pod \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " Jun 02 05:48:26.727900 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.727873 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef01ef6e-47a8-473c-8130-95ebb333a1b8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ef01ef6e-47a8-473c-8130-95ebb333a1b8" (UID: "ef01ef6e-47a8-473c-8130-95ebb333a1b8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 02 05:48:26.728032 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.728006 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ef01ef6e-47a8-473c-8130-95ebb333a1b8" (UID: "ef01ef6e-47a8-473c-8130-95ebb333a1b8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 05:48:26.728257 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.728122 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ef01ef6e-47a8-473c-8130-95ebb333a1b8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ef01ef6e-47a8-473c-8130-95ebb333a1b8" (UID: "ef01ef6e-47a8-473c-8130-95ebb333a1b8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 02 05:48:26.729606 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.729584 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef01ef6e-47a8-473c-8130-95ebb333a1b8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ef01ef6e-47a8-473c-8130-95ebb333a1b8" (UID: "ef01ef6e-47a8-473c-8130-95ebb333a1b8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 05:48:26.729698 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.729617 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ef01ef6e-47a8-473c-8130-95ebb333a1b8" (UID: "ef01ef6e-47a8-473c-8130-95ebb333a1b8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 05:48:26.729698 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.729679 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-kube-api-access-fttb6" (OuterVolumeSpecName: "kube-api-access-fttb6") pod "ef01ef6e-47a8-473c-8130-95ebb333a1b8" (UID: "ef01ef6e-47a8-473c-8130-95ebb333a1b8"). InnerVolumeSpecName "kube-api-access-fttb6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 02 05:48:26.828337 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.828305 2549 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ef01ef6e-47a8-473c-8130-95ebb333a1b8-image-registry-private-configuration\") pod \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\" (UID: \"ef01ef6e-47a8-473c-8130-95ebb333a1b8\") " Jun 02 05:48:26.828480 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.828468 2549 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fttb6\" (UniqueName: \"kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-kube-api-access-fttb6\") on node \"ip-10-0-134-109.ec2.internal\" DevicePath \"\"" Jun 02 05:48:26.828519 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.828482 2549 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-certificates\") on node \"ip-10-0-134-109.ec2.internal\" DevicePath \"\"" Jun 02 05:48:26.828519 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.828492 2549 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-bound-sa-token\") on node \"ip-10-0-134-109.ec2.internal\" DevicePath \"\"" Jun 02 05:48:26.828519 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.828501 2549 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ef01ef6e-47a8-473c-8130-95ebb333a1b8-trusted-ca\") on node \"ip-10-0-134-109.ec2.internal\" DevicePath \"\"" Jun 02 05:48:26.828519 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.828508 2549 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ef01ef6e-47a8-473c-8130-95ebb333a1b8-ca-trust-extracted\") on node \"ip-10-0-134-109.ec2.internal\" DevicePath \"\"" Jun 02 05:48:26.828519 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.828518 2549 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ef01ef6e-47a8-473c-8130-95ebb333a1b8-installation-pull-secrets\") on node \"ip-10-0-134-109.ec2.internal\" DevicePath \"\"" Jun 02 05:48:26.829934 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.829914 2549 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef01ef6e-47a8-473c-8130-95ebb333a1b8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ef01ef6e-47a8-473c-8130-95ebb333a1b8" (UID: "ef01ef6e-47a8-473c-8130-95ebb333a1b8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 02 05:48:26.929313 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:26.929284 2549 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ef01ef6e-47a8-473c-8130-95ebb333a1b8-image-registry-private-configuration\") on node \"ip-10-0-134-109.ec2.internal\" DevicePath \"\"" Jun 02 05:48:27.689383 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:27.689357 2549 generic.go:358] "Generic (PLEG): container finished" podID="0ba196f7-8668-46f9-a7fd-3d8477f5c5fe" containerID="ba052855b484af49b40226b0deaffe619252e01cc2f38a9a7268425ac5bb679b" exitCode=255 Jun 02 05:48:27.689646 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:27.689438 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-ff9bff4d8-274tq" event={"ID":"0ba196f7-8668-46f9-a7fd-3d8477f5c5fe","Type":"ContainerDied","Data":"ba052855b484af49b40226b0deaffe619252e01cc2f38a9a7268425ac5bb679b"} Jun 02 05:48:27.689828 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:27.689810 2549 scope.go:117] "RemoveContainer" containerID="ba052855b484af49b40226b0deaffe619252e01cc2f38a9a7268425ac5bb679b" Jun 02 05:48:27.690811 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:27.690791 2549 generic.go:358] "Generic (PLEG): container finished" podID="558d0202-c9e6-455e-8190-353adc5affc7" containerID="1b839d81bca481e92fe5ac2fc88a79b23399e13ac80f61eddd9be6e539e960cd" exitCode=1 Jun 02 05:48:27.690892 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:27.690851 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz" event={"ID":"558d0202-c9e6-455e-8190-353adc5affc7","Type":"ContainerDied","Data":"1b839d81bca481e92fe5ac2fc88a79b23399e13ac80f61eddd9be6e539e960cd"} Jun 02 05:48:27.690949 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:27.690861 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd" Jun 02 05:48:27.691262 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:27.691248 2549 scope.go:117] "RemoveContainer" containerID="1b839d81bca481e92fe5ac2fc88a79b23399e13ac80f61eddd9be6e539e960cd" Jun 02 05:48:27.783411 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:27.783388 2549 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd"] Jun 02 05:48:27.788453 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:27.788427 2549 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6bbfbfb4dc-ntgsd"] Jun 02 05:48:27.836526 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:27.836498 2549 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ef01ef6e-47a8-473c-8130-95ebb333a1b8-registry-tls\") on node \"ip-10-0-134-109.ec2.internal\" DevicePath \"\"" Jun 02 05:48:27.937436 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:27.937407 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls\") pod \"dns-default-lsp7v\" (UID: \"f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb\") " pod="openshift-dns/dns-default-lsp7v" Jun 02 05:48:27.937630 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:27.937463 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert\") pod \"ingress-canary-dxf8h\" (UID: \"25e274b9-daeb-464a-8b5a-7de86d58b2ca\") " pod="openshift-ingress-canary/ingress-canary-dxf8h" Jun 02 05:48:27.939653 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:27.939626 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb-metrics-tls\") pod \"dns-default-lsp7v\" (UID: \"f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb\") " pod="openshift-dns/dns-default-lsp7v" Jun 02 05:48:27.939851 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:27.939835 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/25e274b9-daeb-464a-8b5a-7de86d58b2ca-cert\") pod \"ingress-canary-dxf8h\" (UID: \"25e274b9-daeb-464a-8b5a-7de86d58b2ca\") " pod="openshift-ingress-canary/ingress-canary-dxf8h" Jun 02 05:48:28.390983 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:28.390897 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz" Jun 02 05:48:28.695326 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:28.695291 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz" event={"ID":"558d0202-c9e6-455e-8190-353adc5affc7","Type":"ContainerStarted","Data":"1d88fed6b7adb6acaf34c8815184fc3ae7c3f8eb2d987fa131bb07d5df02a579"} Jun 02 05:48:28.695845 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:28.695538 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz" Jun 02 05:48:28.696166 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:28.696150 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-86667cfd6f-7vzgz" Jun 02 05:48:28.697111 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:28.697092 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-ff9bff4d8-274tq" event={"ID":"0ba196f7-8668-46f9-a7fd-3d8477f5c5fe","Type":"ContainerStarted","Data":"60218fcdc0496724a578530164c9e59d0841cbb8b3d02fad5b7b00a2b9e66b84"} Jun 02 05:48:29.187886 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:29.187863 2549 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef01ef6e-47a8-473c-8130-95ebb333a1b8" path="/var/lib/kubelet/pods/ef01ef6e-47a8-473c-8130-95ebb333a1b8/volumes" Jun 02 05:48:35.184510 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:35.184478 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lsp7v" Jun 02 05:48:35.201915 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:35.201895 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qs5xc\"" Jun 02 05:48:35.204880 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:35.204864 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lsp7v" Jun 02 05:48:35.330251 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:35.330219 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lsp7v"] Jun 02 05:48:35.332977 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:48:35.332946 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf58fc9f6_7a6b_405d_bd40_f7d18d36b0cb.slice/crio-afae3b8ad5a367a68e92a670122ecf195002691108ca36c48d71af12dd7265e6 WatchSource:0}: Error finding container afae3b8ad5a367a68e92a670122ecf195002691108ca36c48d71af12dd7265e6: Status 404 returned error can't find the container with id afae3b8ad5a367a68e92a670122ecf195002691108ca36c48d71af12dd7265e6 Jun 02 05:48:35.714379 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:35.714343 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lsp7v" event={"ID":"f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb","Type":"ContainerStarted","Data":"afae3b8ad5a367a68e92a670122ecf195002691108ca36c48d71af12dd7265e6"} Jun 02 05:48:37.721109 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:37.721068 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lsp7v" event={"ID":"f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb","Type":"ContainerStarted","Data":"6f0f3a4be0506befa95c6c36fb75c3d3eb51fdd399a54559689ab11dc3cf5500"} Jun 02 05:48:37.721109 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:37.721108 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lsp7v" event={"ID":"f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb","Type":"ContainerStarted","Data":"9617c65c845f8a512574fc637e3f41cb9852375d48faa2272bb6af8b128a3668"} Jun 02 05:48:37.721621 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:37.721215 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lsp7v" Jun 02 05:48:37.739039 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:37.738995 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-lsp7v" podStartSLOduration=136.002293249 podStartE2EDuration="2m17.738981533s" podCreationTimestamp="2026-06-02 05:46:20 +0000 UTC" firstStartedPulling="2026-06-02 05:48:35.334843223 +0000 UTC m=+172.751139467" lastFinishedPulling="2026-06-02 05:48:37.07153151 +0000 UTC m=+174.487827751" observedRunningTime="2026-06-02 05:48:37.738385462 +0000 UTC m=+175.154681719" watchObservedRunningTime="2026-06-02 05:48:37.738981533 +0000 UTC m=+175.155277796" Jun 02 05:48:38.185272 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:38.185244 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dxf8h" Jun 02 05:48:38.185426 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:38.185243 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:48:38.188211 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:38.188193 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jz498\"" Jun 02 05:48:38.196327 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:38.196308 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dxf8h" Jun 02 05:48:38.311341 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:38.311310 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dxf8h"] Jun 02 05:48:38.314122 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:48:38.314094 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25e274b9_daeb_464a_8b5a_7de86d58b2ca.slice/crio-eaeae13852386056911841d56cff615fe2196cab70c6f2cceb2abe2e1781ac9e WatchSource:0}: Error finding container eaeae13852386056911841d56cff615fe2196cab70c6f2cceb2abe2e1781ac9e: Status 404 returned error can't find the container with id eaeae13852386056911841d56cff615fe2196cab70c6f2cceb2abe2e1781ac9e Jun 02 05:48:38.727182 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:38.727153 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dxf8h" event={"ID":"25e274b9-daeb-464a-8b5a-7de86d58b2ca","Type":"ContainerStarted","Data":"eaeae13852386056911841d56cff615fe2196cab70c6f2cceb2abe2e1781ac9e"} Jun 02 05:48:40.733572 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:40.733541 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dxf8h" event={"ID":"25e274b9-daeb-464a-8b5a-7de86d58b2ca","Type":"ContainerStarted","Data":"f1140bc9979746be8638893edc8ed430242f3600393871eddb7b6fb858c18fc2"} Jun 02 05:48:40.749199 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:40.749156 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dxf8h" podStartSLOduration=139.839986304 podStartE2EDuration="2m21.749144185s" podCreationTimestamp="2026-06-02 05:46:19 +0000 UTC" firstStartedPulling="2026-06-02 05:48:38.316143823 +0000 UTC m=+175.732440079" lastFinishedPulling="2026-06-02 05:48:40.225301713 +0000 UTC m=+177.641597960" observedRunningTime="2026-06-02 05:48:40.748795601 +0000 UTC m=+178.165091863" watchObservedRunningTime="2026-06-02 05:48:40.749144185 +0000 UTC m=+178.165440448" Jun 02 05:48:47.730019 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:48:47.729985 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lsp7v" Jun 02 05:49:00.320578 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:49:00.320527 2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" podUID="32df69d8-f782-40d8-a358-f6b6f472bbdc" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 05:49:10.320717 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:49:10.320678 2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" podUID="32df69d8-f782-40d8-a358-f6b6f472bbdc" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 05:49:20.319962 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:49:20.319925 2549 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" podUID="32df69d8-f782-40d8-a358-f6b6f472bbdc" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 02 05:49:20.320409 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:49:20.319987 2549 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" Jun 02 05:49:20.320457 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:49:20.320428 2549 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"f68833751ae497af1bd2c84245d4a4bbc7699a72c9aa6b654cd0a874ab56a821"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 02 05:49:20.320504 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:49:20.320486 2549 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" podUID="32df69d8-f782-40d8-a358-f6b6f472bbdc" containerName="service-proxy" containerID="cri-o://f68833751ae497af1bd2c84245d4a4bbc7699a72c9aa6b654cd0a874ab56a821" gracePeriod=30 Jun 02 05:49:20.829560 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:49:20.829529 2549 generic.go:358] "Generic (PLEG): container finished" podID="32df69d8-f782-40d8-a358-f6b6f472bbdc" containerID="f68833751ae497af1bd2c84245d4a4bbc7699a72c9aa6b654cd0a874ab56a821" exitCode=2 Jun 02 05:49:20.829735 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:49:20.829568 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" event={"ID":"32df69d8-f782-40d8-a358-f6b6f472bbdc","Type":"ContainerDied","Data":"f68833751ae497af1bd2c84245d4a4bbc7699a72c9aa6b654cd0a874ab56a821"} Jun 02 05:49:20.829735 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:49:20.829588 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-66b6f789bc-x8jvr" event={"ID":"32df69d8-f782-40d8-a358-f6b6f472bbdc","Type":"ContainerStarted","Data":"40be6c562b1f8a0df5403dd486b328d1d084dcdb1f859ec655fae85116cd7954"} Jun 02 05:49:54.944399 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:49:54.944362 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs\") pod \"network-metrics-daemon-gr5pg\" (UID: \"0a260826-64c9-465b-8e06-508f90b75d0f\") " pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:49:54.946629 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:49:54.946610 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a260826-64c9-465b-8e06-508f90b75d0f-metrics-certs\") pod \"network-metrics-daemon-gr5pg\" (UID: \"0a260826-64c9-465b-8e06-508f90b75d0f\") " pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:49:54.987990 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:49:54.987965 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x8xws\"" Jun 02 05:49:54.995887 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:49:54.995870 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gr5pg" Jun 02 05:49:55.113479 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:49:55.113449 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gr5pg"] Jun 02 05:49:55.116151 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:49:55.116123 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a260826_64c9_465b_8e06_508f90b75d0f.slice/crio-00df4a18ce5f1dbc582b842402ff1db634cf42a3b3b551ed3e15f36df2229fe5 WatchSource:0}: Error finding container 00df4a18ce5f1dbc582b842402ff1db634cf42a3b3b551ed3e15f36df2229fe5: Status 404 returned error can't find the container with id 00df4a18ce5f1dbc582b842402ff1db634cf42a3b3b551ed3e15f36df2229fe5 Jun 02 05:49:55.912527 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:49:55.912487 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gr5pg" event={"ID":"0a260826-64c9-465b-8e06-508f90b75d0f","Type":"ContainerStarted","Data":"00df4a18ce5f1dbc582b842402ff1db634cf42a3b3b551ed3e15f36df2229fe5"} Jun 02 05:49:56.917110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:49:56.917075 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gr5pg" event={"ID":"0a260826-64c9-465b-8e06-508f90b75d0f","Type":"ContainerStarted","Data":"6fc883ceb77d43d734211f0e73f92abe1deb7b9542c7737bc2f0f6415a7f217c"} Jun 02 05:49:56.917110 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:49:56.917113 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gr5pg" event={"ID":"0a260826-64c9-465b-8e06-508f90b75d0f","Type":"ContainerStarted","Data":"a62b577b787f0918e13e8b2d747ab89a253a11a0fedaba4be2b722c096d31c09"} Jun 02 05:49:56.933611 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:49:56.933571 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gr5pg" podStartSLOduration=252.984925185 podStartE2EDuration="4m13.93355801s" podCreationTimestamp="2026-06-02 05:45:43 +0000 UTC" firstStartedPulling="2026-06-02 05:49:55.117881085 +0000 UTC m=+252.534177326" lastFinishedPulling="2026-06-02 05:49:56.066513897 +0000 UTC m=+253.482810151" observedRunningTime="2026-06-02 05:49:56.932470493 +0000 UTC m=+254.348766769" watchObservedRunningTime="2026-06-02 05:49:56.93355801 +0000 UTC m=+254.349854256" Jun 02 05:50:43.086487 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:50:43.086457 2549 kubelet.go:1628] "Image garbage collection succeeded" Jun 02 05:50:45.803593 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:50:45.803554 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-5kz9w"] Jun 02 05:50:45.806854 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:50:45.806833 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-5kz9w" Jun 02 05:50:45.809373 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:50:45.809353 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 02 05:50:45.810380 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:50:45.810360 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 02 05:50:45.810503 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:50:45.810359 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-bpps4\"" Jun 02 05:50:45.813207 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:50:45.813184 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-5kz9w"] Jun 02 05:50:45.862433 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:50:45.862411 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20231a3f-bf43-4cbb-be0c-cf93aa90995c-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-5kz9w\" (UID: \"20231a3f-bf43-4cbb-be0c-cf93aa90995c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-5kz9w" Jun 02 05:50:45.862544 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:50:45.862451 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wn7b\" (UniqueName: \"kubernetes.io/projected/20231a3f-bf43-4cbb-be0c-cf93aa90995c-kube-api-access-2wn7b\") pod \"cert-manager-cainjector-68b757865b-5kz9w\" (UID: \"20231a3f-bf43-4cbb-be0c-cf93aa90995c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-5kz9w" Jun 02 05:50:45.963533 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:50:45.963506 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20231a3f-bf43-4cbb-be0c-cf93aa90995c-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-5kz9w\" (UID: \"20231a3f-bf43-4cbb-be0c-cf93aa90995c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-5kz9w" Jun 02 05:50:45.963632 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:50:45.963551 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2wn7b\" (UniqueName: \"kubernetes.io/projected/20231a3f-bf43-4cbb-be0c-cf93aa90995c-kube-api-access-2wn7b\") pod \"cert-manager-cainjector-68b757865b-5kz9w\" (UID: \"20231a3f-bf43-4cbb-be0c-cf93aa90995c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-5kz9w" Jun 02 05:50:45.971290 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:50:45.971268 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/20231a3f-bf43-4cbb-be0c-cf93aa90995c-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-5kz9w\" (UID: \"20231a3f-bf43-4cbb-be0c-cf93aa90995c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-5kz9w" Jun 02 05:50:45.971559 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:50:45.971540 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wn7b\" (UniqueName: \"kubernetes.io/projected/20231a3f-bf43-4cbb-be0c-cf93aa90995c-kube-api-access-2wn7b\") pod \"cert-manager-cainjector-68b757865b-5kz9w\" (UID: \"20231a3f-bf43-4cbb-be0c-cf93aa90995c\") " pod="cert-manager/cert-manager-cainjector-68b757865b-5kz9w" Jun 02 05:50:46.116594 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:50:46.116533 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-5kz9w" Jun 02 05:50:46.235911 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:50:46.235883 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-5kz9w"] Jun 02 05:50:46.239340 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:50:46.239314 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20231a3f_bf43_4cbb_be0c_cf93aa90995c.slice/crio-3ae6f616fd868bce4e6b9adec28e685dba456b5557324963f89749e35cc0e4a4 WatchSource:0}: Error finding container 3ae6f616fd868bce4e6b9adec28e685dba456b5557324963f89749e35cc0e4a4: Status 404 returned error can't find the container with id 3ae6f616fd868bce4e6b9adec28e685dba456b5557324963f89749e35cc0e4a4 Jun 02 05:50:46.241221 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:50:46.241204 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 05:50:47.052332 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:50:47.052301 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-5kz9w" event={"ID":"20231a3f-bf43-4cbb-be0c-cf93aa90995c","Type":"ContainerStarted","Data":"3ae6f616fd868bce4e6b9adec28e685dba456b5557324963f89749e35cc0e4a4"} Jun 02 05:50:49.058376 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:50:49.058341 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-5kz9w" event={"ID":"20231a3f-bf43-4cbb-be0c-cf93aa90995c","Type":"ContainerStarted","Data":"1aed4bebc63b20c7a14d14bc910a52fc82d3296f4fa66104105ef9e3298ba92f"} Jun 02 05:50:49.073757 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:50:49.073695 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-5kz9w" podStartSLOduration=1.8131655690000001 podStartE2EDuration="4.07368262s" podCreationTimestamp="2026-06-02 05:50:45 +0000 UTC" firstStartedPulling="2026-06-02 05:50:46.24133121 +0000 UTC m=+303.657627451" lastFinishedPulling="2026-06-02 05:50:48.501848262 +0000 UTC m=+305.918144502" observedRunningTime="2026-06-02 05:50:49.073588075 +0000 UTC m=+306.489884332" watchObservedRunningTime="2026-06-02 05:50:49.07368262 +0000 UTC m=+306.489978882" Jun 02 05:51:19.489984 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.489954 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm"] Jun 02 05:51:19.493058 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.493040 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" Jun 02 05:51:19.496400 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.496378 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 02 05:51:19.496534 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.496386 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 02 05:51:19.496677 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.496663 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 02 05:51:19.497193 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.497177 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 02 05:51:19.497540 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.497526 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d2dbt\"" Jun 02 05:51:19.521249 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.521223 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm"] Jun 02 05:51:19.589188 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.589162 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a20c221-3563-4556-b307-59301c878d81-tmp\") pod \"opendatahub-operator-controller-manager-74d9c7f795-vdkzm\" (UID: \"1a20c221-3563-4556-b307-59301c878d81\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" Jun 02 05:51:19.589293 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.589197 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4wnb\" (UniqueName: \"kubernetes.io/projected/1a20c221-3563-4556-b307-59301c878d81-kube-api-access-s4wnb\") pod \"opendatahub-operator-controller-manager-74d9c7f795-vdkzm\" (UID: \"1a20c221-3563-4556-b307-59301c878d81\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" Jun 02 05:51:19.589293 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.589218 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1a20c221-3563-4556-b307-59301c878d81-manifests\") pod \"opendatahub-operator-controller-manager-74d9c7f795-vdkzm\" (UID: \"1a20c221-3563-4556-b307-59301c878d81\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" Jun 02 05:51:19.589375 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.589301 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a20c221-3563-4556-b307-59301c878d81-webhook-cert\") pod \"opendatahub-operator-controller-manager-74d9c7f795-vdkzm\" (UID: \"1a20c221-3563-4556-b307-59301c878d81\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" Jun 02 05:51:19.589375 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.589340 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1a20c221-3563-4556-b307-59301c878d81-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74d9c7f795-vdkzm\" (UID: \"1a20c221-3563-4556-b307-59301c878d81\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" Jun 02 05:51:19.690445 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.690419 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1a20c221-3563-4556-b307-59301c878d81-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74d9c7f795-vdkzm\" (UID: \"1a20c221-3563-4556-b307-59301c878d81\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" Jun 02 05:51:19.690546 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.690457 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a20c221-3563-4556-b307-59301c878d81-tmp\") pod \"opendatahub-operator-controller-manager-74d9c7f795-vdkzm\" (UID: \"1a20c221-3563-4556-b307-59301c878d81\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" Jun 02 05:51:19.690546 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.690483 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s4wnb\" (UniqueName: \"kubernetes.io/projected/1a20c221-3563-4556-b307-59301c878d81-kube-api-access-s4wnb\") pod \"opendatahub-operator-controller-manager-74d9c7f795-vdkzm\" (UID: \"1a20c221-3563-4556-b307-59301c878d81\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" Jun 02 05:51:19.690648 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.690586 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1a20c221-3563-4556-b307-59301c878d81-manifests\") pod \"opendatahub-operator-controller-manager-74d9c7f795-vdkzm\" (UID: \"1a20c221-3563-4556-b307-59301c878d81\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" Jun 02 05:51:19.690648 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.690632 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a20c221-3563-4556-b307-59301c878d81-webhook-cert\") pod \"opendatahub-operator-controller-manager-74d9c7f795-vdkzm\" (UID: \"1a20c221-3563-4556-b307-59301c878d81\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" Jun 02 05:51:19.690976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.690953 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1a20c221-3563-4556-b307-59301c878d81-manifests\") pod \"opendatahub-operator-controller-manager-74d9c7f795-vdkzm\" (UID: \"1a20c221-3563-4556-b307-59301c878d81\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" Jun 02 05:51:19.692639 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.692614 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1a20c221-3563-4556-b307-59301c878d81-tmp\") pod \"opendatahub-operator-controller-manager-74d9c7f795-vdkzm\" (UID: \"1a20c221-3563-4556-b307-59301c878d81\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" Jun 02 05:51:19.692874 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.692858 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1a20c221-3563-4556-b307-59301c878d81-webhook-cert\") pod \"opendatahub-operator-controller-manager-74d9c7f795-vdkzm\" (UID: \"1a20c221-3563-4556-b307-59301c878d81\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" Jun 02 05:51:19.692923 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.692899 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1a20c221-3563-4556-b307-59301c878d81-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74d9c7f795-vdkzm\" (UID: \"1a20c221-3563-4556-b307-59301c878d81\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" Jun 02 05:51:19.702113 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.702088 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4wnb\" (UniqueName: \"kubernetes.io/projected/1a20c221-3563-4556-b307-59301c878d81-kube-api-access-s4wnb\") pod \"opendatahub-operator-controller-manager-74d9c7f795-vdkzm\" (UID: \"1a20c221-3563-4556-b307-59301c878d81\") " pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" Jun 02 05:51:19.802987 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.802935 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" Jun 02 05:51:19.924775 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:19.924728 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm"] Jun 02 05:51:19.928470 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:51:19.928445 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a20c221_3563_4556_b307_59301c878d81.slice/crio-1579c79105bf79cbf8be48042a3b8d5498ae94b1bbc037aa456a6c23e7c89b3c WatchSource:0}: Error finding container 1579c79105bf79cbf8be48042a3b8d5498ae94b1bbc037aa456a6c23e7c89b3c: Status 404 returned error can't find the container with id 1579c79105bf79cbf8be48042a3b8d5498ae94b1bbc037aa456a6c23e7c89b3c Jun 02 05:51:20.149239 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:20.149164 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" event={"ID":"1a20c221-3563-4556-b307-59301c878d81","Type":"ContainerStarted","Data":"1579c79105bf79cbf8be48042a3b8d5498ae94b1bbc037aa456a6c23e7c89b3c"} Jun 02 05:51:23.158195 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:23.158120 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" event={"ID":"1a20c221-3563-4556-b307-59301c878d81","Type":"ContainerStarted","Data":"ffda8ff9a309028ae363da5760130eeff2fb4f863ede97417c10eabaace3d5d8"} Jun 02 05:51:24.163146 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:24.163061 2549 generic.go:358] "Generic (PLEG): container finished" podID="1a20c221-3563-4556-b307-59301c878d81" containerID="ffda8ff9a309028ae363da5760130eeff2fb4f863ede97417c10eabaace3d5d8" exitCode=0 Jun 02 05:51:24.163146 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:24.163099 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" event={"ID":"1a20c221-3563-4556-b307-59301c878d81","Type":"ContainerDied","Data":"ffda8ff9a309028ae363da5760130eeff2fb4f863ede97417c10eabaace3d5d8"} Jun 02 05:51:25.168097 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:25.168062 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" event={"ID":"1a20c221-3563-4556-b307-59301c878d81","Type":"ContainerStarted","Data":"d66a58a654e6ebedd8bbba17cbd0b127dfa8e52512fbcb568a2810a6326c378d"} Jun 02 05:51:25.168455 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:25.168182 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" Jun 02 05:51:25.191427 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:25.191382 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" podStartSLOduration=1.630111452 podStartE2EDuration="6.19137039s" podCreationTimestamp="2026-06-02 05:51:19 +0000 UTC" firstStartedPulling="2026-06-02 05:51:19.930052955 +0000 UTC m=+337.346349196" lastFinishedPulling="2026-06-02 05:51:24.49131188 +0000 UTC m=+341.907608134" observedRunningTime="2026-06-02 05:51:25.189856863 +0000 UTC m=+342.606153125" watchObservedRunningTime="2026-06-02 05:51:25.19137039 +0000 UTC m=+342.607666653" Jun 02 05:51:36.172949 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:36.172868 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74d9c7f795-vdkzm" Jun 02 05:51:38.843806 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:38.843769 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-76588b95-wf29k"] Jun 02 05:51:38.846697 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:38.846680 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-wf29k" Jun 02 05:51:38.849170 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:38.849148 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 02 05:51:38.849258 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:38.849231 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-m8mc5\"" Jun 02 05:51:38.854961 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:38.854940 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-wf29k"] Jun 02 05:51:38.920220 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:38.920195 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/502792f3-7368-4ffe-8ec5-514c9451da3b-cert\") pod \"odh-model-controller-76588b95-wf29k\" (UID: \"502792f3-7368-4ffe-8ec5-514c9451da3b\") " pod="opendatahub/odh-model-controller-76588b95-wf29k" Jun 02 05:51:38.920315 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:38.920225 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-576mq\" (UniqueName: \"kubernetes.io/projected/502792f3-7368-4ffe-8ec5-514c9451da3b-kube-api-access-576mq\") pod \"odh-model-controller-76588b95-wf29k\" (UID: \"502792f3-7368-4ffe-8ec5-514c9451da3b\") " pod="opendatahub/odh-model-controller-76588b95-wf29k" Jun 02 05:51:39.021340 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:39.021314 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/502792f3-7368-4ffe-8ec5-514c9451da3b-cert\") pod \"odh-model-controller-76588b95-wf29k\" (UID: \"502792f3-7368-4ffe-8ec5-514c9451da3b\") " pod="opendatahub/odh-model-controller-76588b95-wf29k" Jun 02 05:51:39.021429 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:39.021346 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-576mq\" (UniqueName: \"kubernetes.io/projected/502792f3-7368-4ffe-8ec5-514c9451da3b-kube-api-access-576mq\") pod \"odh-model-controller-76588b95-wf29k\" (UID: \"502792f3-7368-4ffe-8ec5-514c9451da3b\") " pod="opendatahub/odh-model-controller-76588b95-wf29k" Jun 02 05:51:39.021473 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:51:39.021456 2549 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 02 05:51:39.021538 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:51:39.021527 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/502792f3-7368-4ffe-8ec5-514c9451da3b-cert podName:502792f3-7368-4ffe-8ec5-514c9451da3b nodeName:}" failed. No retries permitted until 2026-06-02 05:51:39.521509908 +0000 UTC m=+356.937806154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/502792f3-7368-4ffe-8ec5-514c9451da3b-cert") pod "odh-model-controller-76588b95-wf29k" (UID: "502792f3-7368-4ffe-8ec5-514c9451da3b") : secret "odh-model-controller-webhook-cert" not found Jun 02 05:51:39.029394 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:39.029372 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-576mq\" (UniqueName: \"kubernetes.io/projected/502792f3-7368-4ffe-8ec5-514c9451da3b-kube-api-access-576mq\") pod \"odh-model-controller-76588b95-wf29k\" (UID: \"502792f3-7368-4ffe-8ec5-514c9451da3b\") " pod="opendatahub/odh-model-controller-76588b95-wf29k" Jun 02 05:51:39.433003 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:39.432969 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-vg2md"] Jun 02 05:51:39.436042 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:39.436027 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-vg2md" Jun 02 05:51:39.439682 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:39.439662 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 02 05:51:39.467108 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:39.467088 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-vg2md"] Jun 02 05:51:39.525921 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:39.525900 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12a4c070-babb-45c8-aca4-cca2c2fea515-tls-certs\") pod \"model-serving-api-6577596cd5-vg2md\" (UID: \"12a4c070-babb-45c8-aca4-cca2c2fea515\") " pod="opendatahub/model-serving-api-6577596cd5-vg2md" Jun 02 05:51:39.526037 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:39.525941 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbgsl\" (UniqueName: \"kubernetes.io/projected/12a4c070-babb-45c8-aca4-cca2c2fea515-kube-api-access-pbgsl\") pod \"model-serving-api-6577596cd5-vg2md\" (UID: \"12a4c070-babb-45c8-aca4-cca2c2fea515\") " pod="opendatahub/model-serving-api-6577596cd5-vg2md" Jun 02 05:51:39.526037 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:39.525972 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/502792f3-7368-4ffe-8ec5-514c9451da3b-cert\") pod \"odh-model-controller-76588b95-wf29k\" (UID: \"502792f3-7368-4ffe-8ec5-514c9451da3b\") " pod="opendatahub/odh-model-controller-76588b95-wf29k" Jun 02 05:51:39.528220 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:39.528196 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/502792f3-7368-4ffe-8ec5-514c9451da3b-cert\") pod \"odh-model-controller-76588b95-wf29k\" (UID: \"502792f3-7368-4ffe-8ec5-514c9451da3b\") " pod="opendatahub/odh-model-controller-76588b95-wf29k" Jun 02 05:51:39.626850 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:39.626815 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pbgsl\" (UniqueName: \"kubernetes.io/projected/12a4c070-babb-45c8-aca4-cca2c2fea515-kube-api-access-pbgsl\") pod \"model-serving-api-6577596cd5-vg2md\" (UID: \"12a4c070-babb-45c8-aca4-cca2c2fea515\") " pod="opendatahub/model-serving-api-6577596cd5-vg2md" Jun 02 05:51:39.626949 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:39.626878 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12a4c070-babb-45c8-aca4-cca2c2fea515-tls-certs\") pod \"model-serving-api-6577596cd5-vg2md\" (UID: \"12a4c070-babb-45c8-aca4-cca2c2fea515\") " pod="opendatahub/model-serving-api-6577596cd5-vg2md" Jun 02 05:51:39.626986 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:51:39.626956 2549 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 02 05:51:39.627059 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:51:39.627022 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12a4c070-babb-45c8-aca4-cca2c2fea515-tls-certs podName:12a4c070-babb-45c8-aca4-cca2c2fea515 nodeName:}" failed. No retries permitted until 2026-06-02 05:51:40.127008855 +0000 UTC m=+357.543305097 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/12a4c070-babb-45c8-aca4-cca2c2fea515-tls-certs") pod "model-serving-api-6577596cd5-vg2md" (UID: "12a4c070-babb-45c8-aca4-cca2c2fea515") : secret "model-serving-api-tls" not found Jun 02 05:51:39.638700 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:39.638680 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbgsl\" (UniqueName: \"kubernetes.io/projected/12a4c070-babb-45c8-aca4-cca2c2fea515-kube-api-access-pbgsl\") pod \"model-serving-api-6577596cd5-vg2md\" (UID: \"12a4c070-babb-45c8-aca4-cca2c2fea515\") " pod="opendatahub/model-serving-api-6577596cd5-vg2md" Jun 02 05:51:39.757016 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:39.756951 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-76588b95-wf29k" Jun 02 05:51:39.898253 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:39.898225 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-76588b95-wf29k"] Jun 02 05:51:39.901865 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:51:39.901829 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod502792f3_7368_4ffe_8ec5_514c9451da3b.slice/crio-1d343048794680798d3d463ce221f04d0050b850cc13a5c8dc081981102f882c WatchSource:0}: Error finding container 1d343048794680798d3d463ce221f04d0050b850cc13a5c8dc081981102f882c: Status 404 returned error can't find the container with id 1d343048794680798d3d463ce221f04d0050b850cc13a5c8dc081981102f882c Jun 02 05:51:40.130708 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:40.130637 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12a4c070-babb-45c8-aca4-cca2c2fea515-tls-certs\") pod \"model-serving-api-6577596cd5-vg2md\" (UID: \"12a4c070-babb-45c8-aca4-cca2c2fea515\") " pod="opendatahub/model-serving-api-6577596cd5-vg2md" Jun 02 05:51:40.130845 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:51:40.130745 2549 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 02 05:51:40.130845 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:51:40.130822 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12a4c070-babb-45c8-aca4-cca2c2fea515-tls-certs podName:12a4c070-babb-45c8-aca4-cca2c2fea515 nodeName:}" failed. No retries permitted until 2026-06-02 05:51:41.130807199 +0000 UTC m=+358.547103440 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/12a4c070-babb-45c8-aca4-cca2c2fea515-tls-certs") pod "model-serving-api-6577596cd5-vg2md" (UID: "12a4c070-babb-45c8-aca4-cca2c2fea515") : secret "model-serving-api-tls" not found Jun 02 05:51:40.206511 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:40.206484 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-wf29k" event={"ID":"502792f3-7368-4ffe-8ec5-514c9451da3b","Type":"ContainerStarted","Data":"1d343048794680798d3d463ce221f04d0050b850cc13a5c8dc081981102f882c"} Jun 02 05:51:41.146221 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:41.146186 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12a4c070-babb-45c8-aca4-cca2c2fea515-tls-certs\") pod \"model-serving-api-6577596cd5-vg2md\" (UID: \"12a4c070-babb-45c8-aca4-cca2c2fea515\") " pod="opendatahub/model-serving-api-6577596cd5-vg2md" Jun 02 05:51:41.148495 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:41.148474 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/12a4c070-babb-45c8-aca4-cca2c2fea515-tls-certs\") pod \"model-serving-api-6577596cd5-vg2md\" (UID: \"12a4c070-babb-45c8-aca4-cca2c2fea515\") " pod="opendatahub/model-serving-api-6577596cd5-vg2md" Jun 02 05:51:41.245952 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:41.245919 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-vg2md" Jun 02 05:51:41.383843 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:41.383812 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-vg2md"] Jun 02 05:51:41.999682 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:51:41.999637 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12a4c070_babb_45c8_aca4_cca2c2fea515.slice/crio-867fef3efe3b6e8894405a3397cfea63fd11c1833d9f17e4dc326a7fc946c8b5 WatchSource:0}: Error finding container 867fef3efe3b6e8894405a3397cfea63fd11c1833d9f17e4dc326a7fc946c8b5: Status 404 returned error can't find the container with id 867fef3efe3b6e8894405a3397cfea63fd11c1833d9f17e4dc326a7fc946c8b5 Jun 02 05:51:42.213555 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:42.213516 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-vg2md" event={"ID":"12a4c070-babb-45c8-aca4-cca2c2fea515","Type":"ContainerStarted","Data":"867fef3efe3b6e8894405a3397cfea63fd11c1833d9f17e4dc326a7fc946c8b5"} Jun 02 05:51:43.219002 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:43.218968 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-76588b95-wf29k" event={"ID":"502792f3-7368-4ffe-8ec5-514c9451da3b","Type":"ContainerStarted","Data":"3337347dfd1dcef05078183c2cfc2c8b037fe624c8b30b29611c9b97114c239a"} Jun 02 05:51:43.219418 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:43.219099 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-76588b95-wf29k" Jun 02 05:51:43.236693 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:43.236641 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/odh-model-controller-76588b95-wf29k" podStartSLOduration=2.399836962 podStartE2EDuration="5.236624228s" podCreationTimestamp="2026-06-02 05:51:38 +0000 UTC" firstStartedPulling="2026-06-02 05:51:39.903142656 +0000 UTC m=+357.319438897" lastFinishedPulling="2026-06-02 05:51:42.739929914 +0000 UTC m=+360.156226163" observedRunningTime="2026-06-02 05:51:43.235643431 +0000 UTC m=+360.651939708" watchObservedRunningTime="2026-06-02 05:51:43.236624228 +0000 UTC m=+360.652920494" Jun 02 05:51:45.226031 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:45.225994 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-vg2md" event={"ID":"12a4c070-babb-45c8-aca4-cca2c2fea515","Type":"ContainerStarted","Data":"5da2be27e91234baa5bf668eddb318a0890a00580b27b321672c8c94cde0db14"} Jun 02 05:51:45.226378 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:45.226139 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-vg2md" Jun 02 05:51:45.264659 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:45.264619 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-vg2md" podStartSLOduration=3.63496152 podStartE2EDuration="6.264604653s" podCreationTimestamp="2026-06-02 05:51:39 +0000 UTC" firstStartedPulling="2026-06-02 05:51:42.001797891 +0000 UTC m=+359.418094132" lastFinishedPulling="2026-06-02 05:51:44.631441024 +0000 UTC m=+362.047737265" observedRunningTime="2026-06-02 05:51:45.263424338 +0000 UTC m=+362.679720603" watchObservedRunningTime="2026-06-02 05:51:45.264604653 +0000 UTC m=+362.680900917" Jun 02 05:51:48.979238 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:48.979207 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-5c5rz"] Jun 02 05:51:48.981861 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:48.981843 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5c5rz" Jun 02 05:51:48.984768 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:48.984741 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 02 05:51:48.984879 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:48.984800 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-g9lb6\"" Jun 02 05:51:48.991470 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:48.991451 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-hgp57"] Jun 02 05:51:48.994361 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:48.994317 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-hgp57" Jun 02 05:51:48.995670 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:48.995650 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-5c5rz"] Jun 02 05:51:48.997637 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:48.997616 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 02 05:51:48.997944 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:48.997931 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-hh48d\"" Jun 02 05:51:49.003761 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.003725 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-hgp57"] Jun 02 05:51:49.106411 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.106388 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgkkf\" (UniqueName: \"kubernetes.io/projected/06f91f45-43da-47a4-a7d5-6fcd006ac721-kube-api-access-zgkkf\") pod \"llmisvc-controller-manager-c6b9847d7-hgp57\" (UID: \"06f91f45-43da-47a4-a7d5-6fcd006ac721\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-hgp57" Jun 02 05:51:49.106548 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.106418 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gxhp\" (UniqueName: \"kubernetes.io/projected/c62ef754-82df-4a19-8293-7de46ddab337-kube-api-access-5gxhp\") pod \"kserve-controller-manager-7c99ffcdcd-5c5rz\" (UID: \"c62ef754-82df-4a19-8293-7de46ddab337\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5c5rz" Jun 02 05:51:49.106548 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.106451 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06f91f45-43da-47a4-a7d5-6fcd006ac721-cert\") pod \"llmisvc-controller-manager-c6b9847d7-hgp57\" (UID: \"06f91f45-43da-47a4-a7d5-6fcd006ac721\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-hgp57" Jun 02 05:51:49.106548 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.106473 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c62ef754-82df-4a19-8293-7de46ddab337-cert\") pod \"kserve-controller-manager-7c99ffcdcd-5c5rz\" (UID: \"c62ef754-82df-4a19-8293-7de46ddab337\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5c5rz" Jun 02 05:51:49.206924 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.206891 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06f91f45-43da-47a4-a7d5-6fcd006ac721-cert\") pod \"llmisvc-controller-manager-c6b9847d7-hgp57\" (UID: \"06f91f45-43da-47a4-a7d5-6fcd006ac721\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-hgp57" Jun 02 05:51:49.206924 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.206924 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c62ef754-82df-4a19-8293-7de46ddab337-cert\") pod \"kserve-controller-manager-7c99ffcdcd-5c5rz\" (UID: \"c62ef754-82df-4a19-8293-7de46ddab337\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5c5rz" Jun 02 05:51:49.207117 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.206992 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zgkkf\" (UniqueName: \"kubernetes.io/projected/06f91f45-43da-47a4-a7d5-6fcd006ac721-kube-api-access-zgkkf\") pod \"llmisvc-controller-manager-c6b9847d7-hgp57\" (UID: \"06f91f45-43da-47a4-a7d5-6fcd006ac721\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-hgp57" Jun 02 05:51:49.207117 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.207018 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5gxhp\" (UniqueName: \"kubernetes.io/projected/c62ef754-82df-4a19-8293-7de46ddab337-kube-api-access-5gxhp\") pod \"kserve-controller-manager-7c99ffcdcd-5c5rz\" (UID: \"c62ef754-82df-4a19-8293-7de46ddab337\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5c5rz" Jun 02 05:51:49.207117 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:51:49.207086 2549 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 02 05:51:49.207240 ip-10-0-134-109 kubenswrapper[2549]: E0602 05:51:49.207171 2549 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06f91f45-43da-47a4-a7d5-6fcd006ac721-cert podName:06f91f45-43da-47a4-a7d5-6fcd006ac721 nodeName:}" failed. No retries permitted until 2026-06-02 05:51:49.707147995 +0000 UTC m=+367.123444240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/06f91f45-43da-47a4-a7d5-6fcd006ac721-cert") pod "llmisvc-controller-manager-c6b9847d7-hgp57" (UID: "06f91f45-43da-47a4-a7d5-6fcd006ac721") : secret "llmisvc-webhook-server-cert" not found Jun 02 05:51:49.209317 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.209300 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c62ef754-82df-4a19-8293-7de46ddab337-cert\") pod \"kserve-controller-manager-7c99ffcdcd-5c5rz\" (UID: \"c62ef754-82df-4a19-8293-7de46ddab337\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5c5rz" Jun 02 05:51:49.233537 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.233466 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgkkf\" (UniqueName: \"kubernetes.io/projected/06f91f45-43da-47a4-a7d5-6fcd006ac721-kube-api-access-zgkkf\") pod \"llmisvc-controller-manager-c6b9847d7-hgp57\" (UID: \"06f91f45-43da-47a4-a7d5-6fcd006ac721\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-hgp57" Jun 02 05:51:49.240556 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.240528 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gxhp\" (UniqueName: \"kubernetes.io/projected/c62ef754-82df-4a19-8293-7de46ddab337-kube-api-access-5gxhp\") pod \"kserve-controller-manager-7c99ffcdcd-5c5rz\" (UID: \"c62ef754-82df-4a19-8293-7de46ddab337\") " pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5c5rz" Jun 02 05:51:49.291722 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.291701 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5c5rz" Jun 02 05:51:49.403236 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.403209 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d6fbd88fb-65p7k"] Jun 02 05:51:49.408905 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.408876 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-65p7k" Jun 02 05:51:49.411506 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.411481 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 02 05:51:49.411628 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.411481 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qwt59\"" Jun 02 05:51:49.411628 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.411545 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 02 05:51:49.411628 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.411545 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 02 05:51:49.411812 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.411799 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 02 05:51:49.419185 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.419163 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7c99ffcdcd-5c5rz"] Jun 02 05:51:49.420614 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.420597 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d6fbd88fb-65p7k"] Jun 02 05:51:49.422463 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:51:49.422441 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc62ef754_82df_4a19_8293_7de46ddab337.slice/crio-d6a5ce28f7889b913a51afb7b2662e04f7e2a56a8778f771117039b6eb497e4b WatchSource:0}: Error finding container d6a5ce28f7889b913a51afb7b2662e04f7e2a56a8778f771117039b6eb497e4b: Status 404 returned error can't find the container with id d6a5ce28f7889b913a51afb7b2662e04f7e2a56a8778f771117039b6eb497e4b Jun 02 05:51:49.510052 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.510007 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8b7fbc4-45fb-4b1e-a2b6-90cbfe9ed46d-tmp\") pod \"kube-auth-proxy-7d6fbd88fb-65p7k\" (UID: \"b8b7fbc4-45fb-4b1e-a2b6-90cbfe9ed46d\") " pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-65p7k" Jun 02 05:51:49.510152 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.510059 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swqvf\" (UniqueName: \"kubernetes.io/projected/b8b7fbc4-45fb-4b1e-a2b6-90cbfe9ed46d-kube-api-access-swqvf\") pod \"kube-auth-proxy-7d6fbd88fb-65p7k\" (UID: \"b8b7fbc4-45fb-4b1e-a2b6-90cbfe9ed46d\") " pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-65p7k" Jun 02 05:51:49.510152 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.510133 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8b7fbc4-45fb-4b1e-a2b6-90cbfe9ed46d-tls-certs\") pod \"kube-auth-proxy-7d6fbd88fb-65p7k\" (UID: \"b8b7fbc4-45fb-4b1e-a2b6-90cbfe9ed46d\") " pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-65p7k" Jun 02 05:51:49.611392 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.611370 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8b7fbc4-45fb-4b1e-a2b6-90cbfe9ed46d-tls-certs\") pod \"kube-auth-proxy-7d6fbd88fb-65p7k\" (UID: \"b8b7fbc4-45fb-4b1e-a2b6-90cbfe9ed46d\") " pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-65p7k" Jun 02 05:51:49.611479 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.611404 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8b7fbc4-45fb-4b1e-a2b6-90cbfe9ed46d-tmp\") pod \"kube-auth-proxy-7d6fbd88fb-65p7k\" (UID: \"b8b7fbc4-45fb-4b1e-a2b6-90cbfe9ed46d\") " pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-65p7k" Jun 02 05:51:49.611479 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.611437 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-swqvf\" (UniqueName: \"kubernetes.io/projected/b8b7fbc4-45fb-4b1e-a2b6-90cbfe9ed46d-kube-api-access-swqvf\") pod \"kube-auth-proxy-7d6fbd88fb-65p7k\" (UID: \"b8b7fbc4-45fb-4b1e-a2b6-90cbfe9ed46d\") " pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-65p7k" Jun 02 05:51:49.613628 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.613605 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b8b7fbc4-45fb-4b1e-a2b6-90cbfe9ed46d-tmp\") pod \"kube-auth-proxy-7d6fbd88fb-65p7k\" (UID: \"b8b7fbc4-45fb-4b1e-a2b6-90cbfe9ed46d\") " pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-65p7k" Jun 02 05:51:49.613771 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.613734 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b8b7fbc4-45fb-4b1e-a2b6-90cbfe9ed46d-tls-certs\") pod \"kube-auth-proxy-7d6fbd88fb-65p7k\" (UID: \"b8b7fbc4-45fb-4b1e-a2b6-90cbfe9ed46d\") " pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-65p7k" Jun 02 05:51:49.624504 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.624482 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swqvf\" (UniqueName: \"kubernetes.io/projected/b8b7fbc4-45fb-4b1e-a2b6-90cbfe9ed46d-kube-api-access-swqvf\") pod \"kube-auth-proxy-7d6fbd88fb-65p7k\" (UID: \"b8b7fbc4-45fb-4b1e-a2b6-90cbfe9ed46d\") " pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-65p7k" Jun 02 05:51:49.712579 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.712555 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06f91f45-43da-47a4-a7d5-6fcd006ac721-cert\") pod \"llmisvc-controller-manager-c6b9847d7-hgp57\" (UID: \"06f91f45-43da-47a4-a7d5-6fcd006ac721\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-hgp57" Jun 02 05:51:49.714510 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.714489 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06f91f45-43da-47a4-a7d5-6fcd006ac721-cert\") pod \"llmisvc-controller-manager-c6b9847d7-hgp57\" (UID: \"06f91f45-43da-47a4-a7d5-6fcd006ac721\") " pod="opendatahub/llmisvc-controller-manager-c6b9847d7-hgp57" Jun 02 05:51:49.719315 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.719300 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-65p7k" Jun 02 05:51:49.843087 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.843065 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d6fbd88fb-65p7k"] Jun 02 05:51:49.845103 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:51:49.845078 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8b7fbc4_45fb_4b1e_a2b6_90cbfe9ed46d.slice/crio-fd8c74469d9307cd8cf4b599425869cfb7d08fdcfa6f192309b22cd05af54954 WatchSource:0}: Error finding container fd8c74469d9307cd8cf4b599425869cfb7d08fdcfa6f192309b22cd05af54954: Status 404 returned error can't find the container with id fd8c74469d9307cd8cf4b599425869cfb7d08fdcfa6f192309b22cd05af54954 Jun 02 05:51:49.905193 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:49.905169 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-hgp57" Jun 02 05:51:50.036650 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:50.036627 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-c6b9847d7-hgp57"] Jun 02 05:51:50.038956 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:51:50.038925 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod06f91f45_43da_47a4_a7d5_6fcd006ac721.slice/crio-e18a7a040bccac71f056a5b04a6ef597b6b789b4963b6ac1491d00fb177532c3 WatchSource:0}: Error finding container e18a7a040bccac71f056a5b04a6ef597b6b789b4963b6ac1491d00fb177532c3: Status 404 returned error can't find the container with id e18a7a040bccac71f056a5b04a6ef597b6b789b4963b6ac1491d00fb177532c3 Jun 02 05:51:50.243254 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:50.243222 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-hgp57" event={"ID":"06f91f45-43da-47a4-a7d5-6fcd006ac721","Type":"ContainerStarted","Data":"e18a7a040bccac71f056a5b04a6ef597b6b789b4963b6ac1491d00fb177532c3"} Jun 02 05:51:50.244455 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:50.244419 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5c5rz" event={"ID":"c62ef754-82df-4a19-8293-7de46ddab337","Type":"ContainerStarted","Data":"d6a5ce28f7889b913a51afb7b2662e04f7e2a56a8778f771117039b6eb497e4b"} Jun 02 05:51:50.245404 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:50.245379 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-65p7k" event={"ID":"b8b7fbc4-45fb-4b1e-a2b6-90cbfe9ed46d","Type":"ContainerStarted","Data":"fd8c74469d9307cd8cf4b599425869cfb7d08fdcfa6f192309b22cd05af54954"} Jun 02 05:51:54.223606 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:54.223573 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-76588b95-wf29k" Jun 02 05:51:54.258484 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:54.258450 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-65p7k" event={"ID":"b8b7fbc4-45fb-4b1e-a2b6-90cbfe9ed46d","Type":"ContainerStarted","Data":"32fc59ed2b9c375cd77b17d187a8fcc369731fc1b0f6c73fb6fcfed661b69e3c"} Jun 02 05:51:54.259962 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:54.259932 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-hgp57" event={"ID":"06f91f45-43da-47a4-a7d5-6fcd006ac721","Type":"ContainerStarted","Data":"61afecf40c2749d1c9c53d2c9efe7598b71bb5255a922186406bdf207a3909c1"} Jun 02 05:51:54.260104 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:54.260061 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-hgp57" Jun 02 05:51:54.261525 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:54.261501 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5c5rz" event={"ID":"c62ef754-82df-4a19-8293-7de46ddab337","Type":"ContainerStarted","Data":"2c53ca0e91daceef9911f7dc0171fe7fd765c2e819082bd4e9a2767a4359459f"} Jun 02 05:51:54.261652 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:54.261627 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5c5rz" Jun 02 05:51:54.275073 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:54.275021 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d6fbd88fb-65p7k" podStartSLOduration=1.644378282 podStartE2EDuration="5.275009326s" podCreationTimestamp="2026-06-02 05:51:49 +0000 UTC" firstStartedPulling="2026-06-02 05:51:49.846855884 +0000 UTC m=+367.263152126" lastFinishedPulling="2026-06-02 05:51:53.477486916 +0000 UTC m=+370.893783170" observedRunningTime="2026-06-02 05:51:54.274595199 +0000 UTC m=+371.690891462" watchObservedRunningTime="2026-06-02 05:51:54.275009326 +0000 UTC m=+371.691305590" Jun 02 05:51:54.291540 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:54.291488 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5c5rz" podStartSLOduration=2.243181596 podStartE2EDuration="6.291472008s" podCreationTimestamp="2026-06-02 05:51:48 +0000 UTC" firstStartedPulling="2026-06-02 05:51:49.423742682 +0000 UTC m=+366.840038922" lastFinishedPulling="2026-06-02 05:51:53.472033079 +0000 UTC m=+370.888329334" observedRunningTime="2026-06-02 05:51:54.290068021 +0000 UTC m=+371.706364286" watchObservedRunningTime="2026-06-02 05:51:54.291472008 +0000 UTC m=+371.707768272" Jun 02 05:51:54.307876 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:54.307832 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-hgp57" podStartSLOduration=2.865592588 podStartE2EDuration="6.307819148s" podCreationTimestamp="2026-06-02 05:51:48 +0000 UTC" firstStartedPulling="2026-06-02 05:51:50.040265801 +0000 UTC m=+367.456562042" lastFinishedPulling="2026-06-02 05:51:53.482492361 +0000 UTC m=+370.898788602" observedRunningTime="2026-06-02 05:51:54.306520172 +0000 UTC m=+371.722816435" watchObservedRunningTime="2026-06-02 05:51:54.307819148 +0000 UTC m=+371.724115410" Jun 02 05:51:56.235858 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:51:56.235827 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-vg2md" Jun 02 05:52:02.314005 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:02.313974 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-v74t6"] Jun 02 05:52:02.317318 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:02.317298 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-v74t6" Jun 02 05:52:02.319895 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:02.319871 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 02 05:52:02.320020 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:02.319929 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-7kpxl\"" Jun 02 05:52:02.320020 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:02.319941 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 02 05:52:02.329077 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:02.329054 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-v74t6"] Jun 02 05:52:02.407038 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:02.407012 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a8f385f1-441d-4b9f-a6af-0d977e2ccf76-operator-config\") pod \"servicemesh-operator3-55f49c5f94-v74t6\" (UID: \"a8f385f1-441d-4b9f-a6af-0d977e2ccf76\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-v74t6" Jun 02 05:52:02.407156 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:02.407042 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5pzh\" (UniqueName: \"kubernetes.io/projected/a8f385f1-441d-4b9f-a6af-0d977e2ccf76-kube-api-access-g5pzh\") pod \"servicemesh-operator3-55f49c5f94-v74t6\" (UID: \"a8f385f1-441d-4b9f-a6af-0d977e2ccf76\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-v74t6" Jun 02 05:52:02.507953 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:02.507924 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a8f385f1-441d-4b9f-a6af-0d977e2ccf76-operator-config\") pod \"servicemesh-operator3-55f49c5f94-v74t6\" (UID: \"a8f385f1-441d-4b9f-a6af-0d977e2ccf76\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-v74t6" Jun 02 05:52:02.508079 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:02.507961 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g5pzh\" (UniqueName: \"kubernetes.io/projected/a8f385f1-441d-4b9f-a6af-0d977e2ccf76-kube-api-access-g5pzh\") pod \"servicemesh-operator3-55f49c5f94-v74t6\" (UID: \"a8f385f1-441d-4b9f-a6af-0d977e2ccf76\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-v74t6" Jun 02 05:52:02.510231 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:02.510212 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a8f385f1-441d-4b9f-a6af-0d977e2ccf76-operator-config\") pod \"servicemesh-operator3-55f49c5f94-v74t6\" (UID: \"a8f385f1-441d-4b9f-a6af-0d977e2ccf76\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-v74t6" Jun 02 05:52:02.516479 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:02.516460 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5pzh\" (UniqueName: \"kubernetes.io/projected/a8f385f1-441d-4b9f-a6af-0d977e2ccf76-kube-api-access-g5pzh\") pod \"servicemesh-operator3-55f49c5f94-v74t6\" (UID: \"a8f385f1-441d-4b9f-a6af-0d977e2ccf76\") " pod="openshift-operators/servicemesh-operator3-55f49c5f94-v74t6" Jun 02 05:52:02.626516 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:02.626464 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-55f49c5f94-v74t6" Jun 02 05:52:02.748927 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:02.748897 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-55f49c5f94-v74t6"] Jun 02 05:52:02.751178 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:52:02.751130 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8f385f1_441d_4b9f_a6af_0d977e2ccf76.slice/crio-2a6f78b3035f5202fb698a0eac9e40eca29769e16725d738f081a2e74697a073 WatchSource:0}: Error finding container 2a6f78b3035f5202fb698a0eac9e40eca29769e16725d738f081a2e74697a073: Status 404 returned error can't find the container with id 2a6f78b3035f5202fb698a0eac9e40eca29769e16725d738f081a2e74697a073 Jun 02 05:52:03.287246 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:03.287211 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-v74t6" event={"ID":"a8f385f1-441d-4b9f-a6af-0d977e2ccf76","Type":"ContainerStarted","Data":"2a6f78b3035f5202fb698a0eac9e40eca29769e16725d738f081a2e74697a073"} Jun 02 05:52:04.757405 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:04.757372 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7bfb4755b7-wjvl8"] Jun 02 05:52:04.760710 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:04.760689 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7bfb4755b7-wjvl8" Jun 02 05:52:04.763539 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:04.763517 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 02 05:52:04.763655 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:04.763517 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-m69l4\"" Jun 02 05:52:04.769060 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:04.769029 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7bfb4755b7-wjvl8"] Jun 02 05:52:04.925267 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:04.925229 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/464b0ec3-e74c-425c-b908-a1bb49dc6835-redirect-config\") pod \"dashboard-redirect-7bfb4755b7-wjvl8\" (UID: \"464b0ec3-e74c-425c-b908-a1bb49dc6835\") " pod="opendatahub/dashboard-redirect-7bfb4755b7-wjvl8" Jun 02 05:52:04.925432 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:04.925281 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82f7q\" (UniqueName: \"kubernetes.io/projected/464b0ec3-e74c-425c-b908-a1bb49dc6835-kube-api-access-82f7q\") pod \"dashboard-redirect-7bfb4755b7-wjvl8\" (UID: \"464b0ec3-e74c-425c-b908-a1bb49dc6835\") " pod="opendatahub/dashboard-redirect-7bfb4755b7-wjvl8" Jun 02 05:52:05.026825 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:05.026731 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/464b0ec3-e74c-425c-b908-a1bb49dc6835-redirect-config\") pod \"dashboard-redirect-7bfb4755b7-wjvl8\" (UID: \"464b0ec3-e74c-425c-b908-a1bb49dc6835\") " pod="opendatahub/dashboard-redirect-7bfb4755b7-wjvl8" Jun 02 05:52:05.026825 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:05.026796 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-82f7q\" (UniqueName: \"kubernetes.io/projected/464b0ec3-e74c-425c-b908-a1bb49dc6835-kube-api-access-82f7q\") pod \"dashboard-redirect-7bfb4755b7-wjvl8\" (UID: \"464b0ec3-e74c-425c-b908-a1bb49dc6835\") " pod="opendatahub/dashboard-redirect-7bfb4755b7-wjvl8" Jun 02 05:52:05.027573 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:05.027540 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/464b0ec3-e74c-425c-b908-a1bb49dc6835-redirect-config\") pod \"dashboard-redirect-7bfb4755b7-wjvl8\" (UID: \"464b0ec3-e74c-425c-b908-a1bb49dc6835\") " pod="opendatahub/dashboard-redirect-7bfb4755b7-wjvl8" Jun 02 05:52:05.034640 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:05.034615 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82f7q\" (UniqueName: \"kubernetes.io/projected/464b0ec3-e74c-425c-b908-a1bb49dc6835-kube-api-access-82f7q\") pod \"dashboard-redirect-7bfb4755b7-wjvl8\" (UID: \"464b0ec3-e74c-425c-b908-a1bb49dc6835\") " pod="opendatahub/dashboard-redirect-7bfb4755b7-wjvl8" Jun 02 05:52:05.071329 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:05.071303 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7bfb4755b7-wjvl8" Jun 02 05:52:05.794538 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:05.794516 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7bfb4755b7-wjvl8"] Jun 02 05:52:05.796775 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:52:05.796737 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod464b0ec3_e74c_425c_b908_a1bb49dc6835.slice/crio-6ce77303c6acd43349d78241bb332328a230433d09db8589593e8206f73fd1e9 WatchSource:0}: Error finding container 6ce77303c6acd43349d78241bb332328a230433d09db8589593e8206f73fd1e9: Status 404 returned error can't find the container with id 6ce77303c6acd43349d78241bb332328a230433d09db8589593e8206f73fd1e9 Jun 02 05:52:06.298639 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:06.298601 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-55f49c5f94-v74t6" event={"ID":"a8f385f1-441d-4b9f-a6af-0d977e2ccf76","Type":"ContainerStarted","Data":"01932a81b521853f162229c42d2323fc3524c8ed3ab6911b6b8e5e6fa7be01fc"} Jun 02 05:52:06.298849 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:06.298653 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-v74t6" Jun 02 05:52:06.299902 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:06.299868 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7bfb4755b7-wjvl8" event={"ID":"464b0ec3-e74c-425c-b908-a1bb49dc6835","Type":"ContainerStarted","Data":"6ce77303c6acd43349d78241bb332328a230433d09db8589593e8206f73fd1e9"} Jun 02 05:52:06.320810 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:06.320741 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-55f49c5f94-v74t6" podStartSLOduration=1.333747529 podStartE2EDuration="4.320726059s" podCreationTimestamp="2026-06-02 05:52:02 +0000 UTC" firstStartedPulling="2026-06-02 05:52:02.753632046 +0000 UTC m=+380.169928291" lastFinishedPulling="2026-06-02 05:52:05.74061058 +0000 UTC m=+383.156906821" observedRunningTime="2026-06-02 05:52:06.318601718 +0000 UTC m=+383.734897982" watchObservedRunningTime="2026-06-02 05:52:06.320726059 +0000 UTC m=+383.737022324" Jun 02 05:52:08.308104 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:08.308071 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7bfb4755b7-wjvl8" event={"ID":"464b0ec3-e74c-425c-b908-a1bb49dc6835","Type":"ContainerStarted","Data":"fb04c13f80b5697e82ae818663ae0e2b7766fa5f4f93f0a134fe2184d7b32727"} Jun 02 05:52:08.325266 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:08.325216 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7bfb4755b7-wjvl8" podStartSLOduration=2.724018413 podStartE2EDuration="4.325202916s" podCreationTimestamp="2026-06-02 05:52:04 +0000 UTC" firstStartedPulling="2026-06-02 05:52:05.798152367 +0000 UTC m=+383.214448615" lastFinishedPulling="2026-06-02 05:52:07.399336863 +0000 UTC m=+384.815633118" observedRunningTime="2026-06-02 05:52:08.323641525 +0000 UTC m=+385.739937788" watchObservedRunningTime="2026-06-02 05:52:08.325202916 +0000 UTC m=+385.741499178" Jun 02 05:52:15.275300 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.275271 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b"] Jun 02 05:52:15.279033 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.279017 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:15.281679 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.281657 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 02 05:52:15.281802 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.281686 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bdsh8\"" Jun 02 05:52:15.282155 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.282141 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 02 05:52:15.282311 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.282292 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 02 05:52:15.282311 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.282303 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 02 05:52:15.291764 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.291729 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b"] Jun 02 05:52:15.303245 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.303224 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/74b3893e-d36d-4309-b3b5-bbcbe90695d4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-zvx9b\" (UID: \"74b3893e-d36d-4309-b3b5-bbcbe90695d4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:15.303355 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.303258 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/74b3893e-d36d-4309-b3b5-bbcbe90695d4-local-certs\") pod \"istiod-openshift-gateway-798958bb55-zvx9b\" (UID: \"74b3893e-d36d-4309-b3b5-bbcbe90695d4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:15.303355 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.303278 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwtzn\" (UniqueName: \"kubernetes.io/projected/74b3893e-d36d-4309-b3b5-bbcbe90695d4-kube-api-access-rwtzn\") pod \"istiod-openshift-gateway-798958bb55-zvx9b\" (UID: \"74b3893e-d36d-4309-b3b5-bbcbe90695d4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:15.303463 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.303376 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/74b3893e-d36d-4309-b3b5-bbcbe90695d4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-zvx9b\" (UID: \"74b3893e-d36d-4309-b3b5-bbcbe90695d4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:15.303463 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.303428 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74b3893e-d36d-4309-b3b5-bbcbe90695d4-istio-token\") pod \"istiod-openshift-gateway-798958bb55-zvx9b\" (UID: \"74b3893e-d36d-4309-b3b5-bbcbe90695d4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:15.303562 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.303488 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/74b3893e-d36d-4309-b3b5-bbcbe90695d4-cacerts\") pod \"istiod-openshift-gateway-798958bb55-zvx9b\" (UID: \"74b3893e-d36d-4309-b3b5-bbcbe90695d4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:15.303562 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.303524 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/74b3893e-d36d-4309-b3b5-bbcbe90695d4-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-zvx9b\" (UID: \"74b3893e-d36d-4309-b3b5-bbcbe90695d4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:15.404673 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.404651 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/74b3893e-d36d-4309-b3b5-bbcbe90695d4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-zvx9b\" (UID: \"74b3893e-d36d-4309-b3b5-bbcbe90695d4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:15.404808 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.404679 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/74b3893e-d36d-4309-b3b5-bbcbe90695d4-local-certs\") pod \"istiod-openshift-gateway-798958bb55-zvx9b\" (UID: \"74b3893e-d36d-4309-b3b5-bbcbe90695d4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:15.404808 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.404700 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rwtzn\" (UniqueName: \"kubernetes.io/projected/74b3893e-d36d-4309-b3b5-bbcbe90695d4-kube-api-access-rwtzn\") pod \"istiod-openshift-gateway-798958bb55-zvx9b\" (UID: \"74b3893e-d36d-4309-b3b5-bbcbe90695d4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:15.404808 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.404734 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/74b3893e-d36d-4309-b3b5-bbcbe90695d4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-zvx9b\" (UID: \"74b3893e-d36d-4309-b3b5-bbcbe90695d4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:15.404808 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.404794 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74b3893e-d36d-4309-b3b5-bbcbe90695d4-istio-token\") pod \"istiod-openshift-gateway-798958bb55-zvx9b\" (UID: \"74b3893e-d36d-4309-b3b5-bbcbe90695d4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:15.405035 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.404851 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/74b3893e-d36d-4309-b3b5-bbcbe90695d4-cacerts\") pod \"istiod-openshift-gateway-798958bb55-zvx9b\" (UID: \"74b3893e-d36d-4309-b3b5-bbcbe90695d4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:15.405035 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.404883 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/74b3893e-d36d-4309-b3b5-bbcbe90695d4-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-zvx9b\" (UID: \"74b3893e-d36d-4309-b3b5-bbcbe90695d4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:15.405473 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.405450 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/74b3893e-d36d-4309-b3b5-bbcbe90695d4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-798958bb55-zvx9b\" (UID: \"74b3893e-d36d-4309-b3b5-bbcbe90695d4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:15.407171 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.407146 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/74b3893e-d36d-4309-b3b5-bbcbe90695d4-local-certs\") pod \"istiod-openshift-gateway-798958bb55-zvx9b\" (UID: \"74b3893e-d36d-4309-b3b5-bbcbe90695d4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:15.407293 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.407231 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/74b3893e-d36d-4309-b3b5-bbcbe90695d4-istio-kubeconfig\") pod \"istiod-openshift-gateway-798958bb55-zvx9b\" (UID: \"74b3893e-d36d-4309-b3b5-bbcbe90695d4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:15.407450 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.407433 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/74b3893e-d36d-4309-b3b5-bbcbe90695d4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-798958bb55-zvx9b\" (UID: \"74b3893e-d36d-4309-b3b5-bbcbe90695d4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:15.407550 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.407528 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/74b3893e-d36d-4309-b3b5-bbcbe90695d4-cacerts\") pod \"istiod-openshift-gateway-798958bb55-zvx9b\" (UID: \"74b3893e-d36d-4309-b3b5-bbcbe90695d4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:15.412379 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.412354 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74b3893e-d36d-4309-b3b5-bbcbe90695d4-istio-token\") pod \"istiod-openshift-gateway-798958bb55-zvx9b\" (UID: \"74b3893e-d36d-4309-b3b5-bbcbe90695d4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:15.412860 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.412839 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwtzn\" (UniqueName: \"kubernetes.io/projected/74b3893e-d36d-4309-b3b5-bbcbe90695d4-kube-api-access-rwtzn\") pod \"istiod-openshift-gateway-798958bb55-zvx9b\" (UID: \"74b3893e-d36d-4309-b3b5-bbcbe90695d4\") " pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:15.588895 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.588822 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:15.732519 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:15.732488 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b"] Jun 02 05:52:15.734908 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:52:15.734877 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74b3893e_d36d_4309_b3b5_bbcbe90695d4.slice/crio-d2b692985bd29d7e51fb0a23d714cd7a7f27aa307d20d4e01d581486f52d56cc WatchSource:0}: Error finding container d2b692985bd29d7e51fb0a23d714cd7a7f27aa307d20d4e01d581486f52d56cc: Status 404 returned error can't find the container with id d2b692985bd29d7e51fb0a23d714cd7a7f27aa307d20d4e01d581486f52d56cc Jun 02 05:52:16.335888 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:16.335850 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" event={"ID":"74b3893e-d36d-4309-b3b5-bbcbe90695d4","Type":"ContainerStarted","Data":"d2b692985bd29d7e51fb0a23d714cd7a7f27aa307d20d4e01d581486f52d56cc"} Jun 02 05:52:17.305911 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:17.305883 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-55f49c5f94-v74t6" Jun 02 05:52:18.070308 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:18.070267 2549 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 05:52:18.070599 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:18.070335 2549 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 02 05:52:18.343647 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:18.343563 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" event={"ID":"74b3893e-d36d-4309-b3b5-bbcbe90695d4","Type":"ContainerStarted","Data":"a5d9265bf2215e4ff752a7d3d4d898a594fed4f0764c1075a51f68e82f18be13"} Jun 02 05:52:18.343820 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:18.343682 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:18.373049 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:18.372999 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" podStartSLOduration=1.040119543 podStartE2EDuration="3.372986995s" podCreationTimestamp="2026-06-02 05:52:15 +0000 UTC" firstStartedPulling="2026-06-02 05:52:15.737185013 +0000 UTC m=+393.153481254" lastFinishedPulling="2026-06-02 05:52:18.070052461 +0000 UTC m=+395.486348706" observedRunningTime="2026-06-02 05:52:18.37164588 +0000 UTC m=+395.787942142" watchObservedRunningTime="2026-06-02 05:52:18.372986995 +0000 UTC m=+395.789283257" Jun 02 05:52:19.348984 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:19.348953 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-798958bb55-zvx9b" Jun 02 05:52:25.266496 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:25.266466 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-c6b9847d7-hgp57" Jun 02 05:52:25.269394 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:52:25.269373 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7c99ffcdcd-5c5rz" Jun 02 05:53:15.917482 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:53:15.917409 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-pdlt2"] Jun 02 05:53:15.919457 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:53:15.919439 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-pdlt2" Jun 02 05:53:15.921987 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:53:15.921968 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 02 05:53:15.922875 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:53:15.922857 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 02 05:53:15.922968 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:53:15.922859 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-x9l8s\"" Jun 02 05:53:15.928348 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:53:15.928326 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-pdlt2"] Jun 02 05:53:16.028392 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:53:16.028371 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nclb7\" (UniqueName: \"kubernetes.io/projected/325a1efc-85a7-4767-8311-0e6eb81de90b-kube-api-access-nclb7\") pod \"authorino-operator-657f44b778-pdlt2\" (UID: \"325a1efc-85a7-4767-8311-0e6eb81de90b\") " pod="kuadrant-system/authorino-operator-657f44b778-pdlt2" Jun 02 05:53:16.128913 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:53:16.128873 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nclb7\" (UniqueName: \"kubernetes.io/projected/325a1efc-85a7-4767-8311-0e6eb81de90b-kube-api-access-nclb7\") pod \"authorino-operator-657f44b778-pdlt2\" (UID: \"325a1efc-85a7-4767-8311-0e6eb81de90b\") " pod="kuadrant-system/authorino-operator-657f44b778-pdlt2" Jun 02 05:53:16.139687 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:53:16.139668 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nclb7\" (UniqueName: \"kubernetes.io/projected/325a1efc-85a7-4767-8311-0e6eb81de90b-kube-api-access-nclb7\") pod \"authorino-operator-657f44b778-pdlt2\" (UID: \"325a1efc-85a7-4767-8311-0e6eb81de90b\") " pod="kuadrant-system/authorino-operator-657f44b778-pdlt2" Jun 02 05:53:16.229660 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:53:16.229635 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-pdlt2" Jun 02 05:53:16.349896 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:53:16.349872 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-pdlt2"] Jun 02 05:53:16.352535 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:53:16.352504 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod325a1efc_85a7_4767_8311_0e6eb81de90b.slice/crio-07f4278eb2a496ba2cfdb22180bf37e01e3d77661051ee737f14ba0e3f285398 WatchSource:0}: Error finding container 07f4278eb2a496ba2cfdb22180bf37e01e3d77661051ee737f14ba0e3f285398: Status 404 returned error can't find the container with id 07f4278eb2a496ba2cfdb22180bf37e01e3d77661051ee737f14ba0e3f285398 Jun 02 05:53:16.521861 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:53:16.521779 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-pdlt2" event={"ID":"325a1efc-85a7-4767-8311-0e6eb81de90b","Type":"ContainerStarted","Data":"07f4278eb2a496ba2cfdb22180bf37e01e3d77661051ee737f14ba0e3f285398"} Jun 02 05:53:19.533698 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:53:19.533661 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-pdlt2" event={"ID":"325a1efc-85a7-4767-8311-0e6eb81de90b","Type":"ContainerStarted","Data":"9d688e49b90da6eb5b78d540ae9d470a4fe72699ee0ef69661278914a4362ff4"} Jun 02 05:53:19.534121 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:53:19.533818 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-pdlt2" Jun 02 05:53:19.552782 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:53:19.552722 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-pdlt2" podStartSLOduration=2.391844521 podStartE2EDuration="4.552710519s" podCreationTimestamp="2026-06-02 05:53:15 +0000 UTC" firstStartedPulling="2026-06-02 05:53:16.354590997 +0000 UTC m=+453.770887238" lastFinishedPulling="2026-06-02 05:53:18.515456984 +0000 UTC m=+455.931753236" observedRunningTime="2026-06-02 05:53:19.552136458 +0000 UTC m=+456.968432734" watchObservedRunningTime="2026-06-02 05:53:19.552710519 +0000 UTC m=+456.969006781" Jun 02 05:53:30.538445 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:53:30.538419 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-pdlt2" Jun 02 05:55:04.556252 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:55:04.556213 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-n2g4v"] Jun 02 05:55:04.558413 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:55:04.558393 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-n2g4v" Jun 02 05:55:04.560900 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:55:04.560879 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 02 05:55:04.560984 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:55:04.560946 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 02 05:55:04.561826 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:55:04.561812 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-88v2t\"" Jun 02 05:55:04.568820 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:55:04.568801 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-n2g4v"] Jun 02 05:55:04.744192 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:55:04.744154 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4c8z\" (UniqueName: \"kubernetes.io/projected/4c438f28-c5b7-416d-abe7-bf6ff45a646e-kube-api-access-v4c8z\") pod \"keycloak-operator-7864d68cbd-n2g4v\" (UID: \"4c438f28-c5b7-416d-abe7-bf6ff45a646e\") " pod="keycloak-system/keycloak-operator-7864d68cbd-n2g4v" Jun 02 05:55:04.845617 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:55:04.845533 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v4c8z\" (UniqueName: \"kubernetes.io/projected/4c438f28-c5b7-416d-abe7-bf6ff45a646e-kube-api-access-v4c8z\") pod \"keycloak-operator-7864d68cbd-n2g4v\" (UID: \"4c438f28-c5b7-416d-abe7-bf6ff45a646e\") " pod="keycloak-system/keycloak-operator-7864d68cbd-n2g4v" Jun 02 05:55:04.854219 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:55:04.854188 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4c8z\" (UniqueName: \"kubernetes.io/projected/4c438f28-c5b7-416d-abe7-bf6ff45a646e-kube-api-access-v4c8z\") pod \"keycloak-operator-7864d68cbd-n2g4v\" (UID: \"4c438f28-c5b7-416d-abe7-bf6ff45a646e\") " pod="keycloak-system/keycloak-operator-7864d68cbd-n2g4v" Jun 02 05:55:04.868265 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:55:04.868244 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-7864d68cbd-n2g4v" Jun 02 05:55:04.991117 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:55:04.991094 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-7864d68cbd-n2g4v"] Jun 02 05:55:04.993403 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:55:04.993379 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c438f28_c5b7_416d_abe7_bf6ff45a646e.slice/crio-45cc41b00660170166c6d959336021a5579f8e30ab4ccd6c31dd94d99d2ff3da WatchSource:0}: Error finding container 45cc41b00660170166c6d959336021a5579f8e30ab4ccd6c31dd94d99d2ff3da: Status 404 returned error can't find the container with id 45cc41b00660170166c6d959336021a5579f8e30ab4ccd6c31dd94d99d2ff3da Jun 02 05:55:05.872596 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:55:05.872537 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-n2g4v" event={"ID":"4c438f28-c5b7-416d-abe7-bf6ff45a646e","Type":"ContainerStarted","Data":"45cc41b00660170166c6d959336021a5579f8e30ab4ccd6c31dd94d99d2ff3da"} Jun 02 05:55:10.891816 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:55:10.891780 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-7864d68cbd-n2g4v" event={"ID":"4c438f28-c5b7-416d-abe7-bf6ff45a646e","Type":"ContainerStarted","Data":"7c620256afa64e989af85793a5bafbc63415152f5c001ac116cd93473351cf94"} Jun 02 05:55:10.906875 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:55:10.906568 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-7864d68cbd-n2g4v" podStartSLOduration=1.634061473 podStartE2EDuration="6.90655267s" podCreationTimestamp="2026-06-02 05:55:04 +0000 UTC" firstStartedPulling="2026-06-02 05:55:04.994772792 +0000 UTC m=+562.411069033" lastFinishedPulling="2026-06-02 05:55:10.267263974 +0000 UTC m=+567.683560230" observedRunningTime="2026-06-02 05:55:10.906231141 +0000 UTC m=+568.322527395" watchObservedRunningTime="2026-06-02 05:55:10.90655267 +0000 UTC m=+568.322848933" Jun 02 05:57:39.708542 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.708461 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh"] Jun 02 05:57:39.712052 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.712031 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:57:39.715583 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.715561 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mbvq6\"" Jun 02 05:57:39.715690 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.715602 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 02 05:57:39.715690 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.715565 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 02 05:57:39.715690 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.715563 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 02 05:57:39.721653 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.721633 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh"] Jun 02 05:57:39.861688 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.861652 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6e3ff925-2e5b-4f33-a15c-e58ffbcd223d-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh\" (UID: \"6e3ff925-2e5b-4f33-a15c-e58ffbcd223d\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:57:39.861878 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.861697 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqs26\" (UniqueName: \"kubernetes.io/projected/6e3ff925-2e5b-4f33-a15c-e58ffbcd223d-kube-api-access-hqs26\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh\" (UID: \"6e3ff925-2e5b-4f33-a15c-e58ffbcd223d\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:57:39.861878 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.861758 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e3ff925-2e5b-4f33-a15c-e58ffbcd223d-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh\" (UID: \"6e3ff925-2e5b-4f33-a15c-e58ffbcd223d\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:57:39.861878 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.861819 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e3ff925-2e5b-4f33-a15c-e58ffbcd223d-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh\" (UID: \"6e3ff925-2e5b-4f33-a15c-e58ffbcd223d\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:57:39.861878 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.861839 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e3ff925-2e5b-4f33-a15c-e58ffbcd223d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh\" (UID: \"6e3ff925-2e5b-4f33-a15c-e58ffbcd223d\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:57:39.861878 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.861854 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e3ff925-2e5b-4f33-a15c-e58ffbcd223d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh\" (UID: \"6e3ff925-2e5b-4f33-a15c-e58ffbcd223d\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:57:39.962772 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.962675 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6e3ff925-2e5b-4f33-a15c-e58ffbcd223d-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh\" (UID: \"6e3ff925-2e5b-4f33-a15c-e58ffbcd223d\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:57:39.962772 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.962718 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hqs26\" (UniqueName: \"kubernetes.io/projected/6e3ff925-2e5b-4f33-a15c-e58ffbcd223d-kube-api-access-hqs26\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh\" (UID: \"6e3ff925-2e5b-4f33-a15c-e58ffbcd223d\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:57:39.962772 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.962742 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e3ff925-2e5b-4f33-a15c-e58ffbcd223d-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh\" (UID: \"6e3ff925-2e5b-4f33-a15c-e58ffbcd223d\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:57:39.963015 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.962789 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e3ff925-2e5b-4f33-a15c-e58ffbcd223d-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh\" (UID: \"6e3ff925-2e5b-4f33-a15c-e58ffbcd223d\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:57:39.963015 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.962805 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e3ff925-2e5b-4f33-a15c-e58ffbcd223d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh\" (UID: \"6e3ff925-2e5b-4f33-a15c-e58ffbcd223d\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:57:39.963015 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.962821 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e3ff925-2e5b-4f33-a15c-e58ffbcd223d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh\" (UID: \"6e3ff925-2e5b-4f33-a15c-e58ffbcd223d\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:57:39.963170 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.963138 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6e3ff925-2e5b-4f33-a15c-e58ffbcd223d-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh\" (UID: \"6e3ff925-2e5b-4f33-a15c-e58ffbcd223d\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:57:39.963226 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.963205 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e3ff925-2e5b-4f33-a15c-e58ffbcd223d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh\" (UID: \"6e3ff925-2e5b-4f33-a15c-e58ffbcd223d\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:57:39.963268 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.963237 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e3ff925-2e5b-4f33-a15c-e58ffbcd223d-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh\" (UID: \"6e3ff925-2e5b-4f33-a15c-e58ffbcd223d\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:57:39.965085 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.965063 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e3ff925-2e5b-4f33-a15c-e58ffbcd223d-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh\" (UID: \"6e3ff925-2e5b-4f33-a15c-e58ffbcd223d\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:57:39.965201 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.965185 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e3ff925-2e5b-4f33-a15c-e58ffbcd223d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh\" (UID: \"6e3ff925-2e5b-4f33-a15c-e58ffbcd223d\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:57:39.970864 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:39.970846 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqs26\" (UniqueName: \"kubernetes.io/projected/6e3ff925-2e5b-4f33-a15c-e58ffbcd223d-kube-api-access-hqs26\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh\" (UID: \"6e3ff925-2e5b-4f33-a15c-e58ffbcd223d\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:57:40.023114 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:40.023089 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:57:40.147803 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:40.147771 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh"] Jun 02 05:57:40.150130 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:57:40.150106 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e3ff925_2e5b_4f33_a15c_e58ffbcd223d.slice/crio-ad533ff7ff79ddeb8cdac5a25948c052560be68806ed0ad80c3b93dc9da66c9c WatchSource:0}: Error finding container ad533ff7ff79ddeb8cdac5a25948c052560be68806ed0ad80c3b93dc9da66c9c: Status 404 returned error can't find the container with id ad533ff7ff79ddeb8cdac5a25948c052560be68806ed0ad80c3b93dc9da66c9c Jun 02 05:57:40.151793 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:40.151775 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 05:57:40.366507 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:40.366434 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" event={"ID":"6e3ff925-2e5b-4f33-a15c-e58ffbcd223d","Type":"ContainerStarted","Data":"ad533ff7ff79ddeb8cdac5a25948c052560be68806ed0ad80c3b93dc9da66c9c"} Jun 02 05:57:44.381872 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:44.381838 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" event={"ID":"6e3ff925-2e5b-4f33-a15c-e58ffbcd223d","Type":"ContainerStarted","Data":"65f2fc2f708fe2c6c3d13383b095da170c2859d78341c26da747495bdde3bce5"} Jun 02 05:57:47.393249 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:47.393170 2549 generic.go:358] "Generic (PLEG): container finished" podID="6e3ff925-2e5b-4f33-a15c-e58ffbcd223d" containerID="65f2fc2f708fe2c6c3d13383b095da170c2859d78341c26da747495bdde3bce5" exitCode=0 Jun 02 05:57:47.393568 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:47.393242 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" event={"ID":"6e3ff925-2e5b-4f33-a15c-e58ffbcd223d","Type":"ContainerDied","Data":"65f2fc2f708fe2c6c3d13383b095da170c2859d78341c26da747495bdde3bce5"} Jun 02 05:57:49.401653 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:49.401620 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" event={"ID":"6e3ff925-2e5b-4f33-a15c-e58ffbcd223d","Type":"ContainerStarted","Data":"fd4c3de3646cec0e915dee3836573c70469deb6b863a33a74c3b30e32fde2680"} Jun 02 05:57:49.419234 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:49.419173 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" podStartSLOduration=1.978035641 podStartE2EDuration="10.419126016s" podCreationTimestamp="2026-06-02 05:57:39 +0000 UTC" firstStartedPulling="2026-06-02 05:57:40.151895776 +0000 UTC m=+717.568192017" lastFinishedPulling="2026-06-02 05:57:48.59298615 +0000 UTC m=+726.009282392" observedRunningTime="2026-06-02 05:57:49.418642805 +0000 UTC m=+726.834939070" watchObservedRunningTime="2026-06-02 05:57:49.419126016 +0000 UTC m=+726.835422278" Jun 02 05:57:50.023794 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:50.023729 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:57:50.023794 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:50.023800 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:57:50.039930 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:50.039907 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:57:50.416663 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:57:50.416586 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh" Jun 02 05:58:17.718917 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:17.718878 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9"] Jun 02 05:58:17.728515 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:17.728490 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:17.742817 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:17.742789 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9"] Jun 02 05:58:17.745039 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:17.745003 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 02 05:58:17.745331 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:17.745308 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62f7aa06-6fd9-4eb1-aa27-951aa550ab1d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9\" (UID: \"62f7aa06-6fd9-4eb1-aa27-951aa550ab1d\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:17.745411 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:17.745360 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62f7aa06-6fd9-4eb1-aa27-951aa550ab1d-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9\" (UID: \"62f7aa06-6fd9-4eb1-aa27-951aa550ab1d\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:17.745411 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:17.745402 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpsx8\" (UniqueName: \"kubernetes.io/projected/62f7aa06-6fd9-4eb1-aa27-951aa550ab1d-kube-api-access-kpsx8\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9\" (UID: \"62f7aa06-6fd9-4eb1-aa27-951aa550ab1d\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:17.745483 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:17.745448 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62f7aa06-6fd9-4eb1-aa27-951aa550ab1d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9\" (UID: \"62f7aa06-6fd9-4eb1-aa27-951aa550ab1d\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:17.745569 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:17.745548 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/62f7aa06-6fd9-4eb1-aa27-951aa550ab1d-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9\" (UID: \"62f7aa06-6fd9-4eb1-aa27-951aa550ab1d\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:17.745633 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:17.745616 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62f7aa06-6fd9-4eb1-aa27-951aa550ab1d-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9\" (UID: \"62f7aa06-6fd9-4eb1-aa27-951aa550ab1d\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:17.846259 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:17.846229 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62f7aa06-6fd9-4eb1-aa27-951aa550ab1d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9\" (UID: \"62f7aa06-6fd9-4eb1-aa27-951aa550ab1d\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:17.846396 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:17.846278 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/62f7aa06-6fd9-4eb1-aa27-951aa550ab1d-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9\" (UID: \"62f7aa06-6fd9-4eb1-aa27-951aa550ab1d\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:17.846396 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:17.846323 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62f7aa06-6fd9-4eb1-aa27-951aa550ab1d-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9\" (UID: \"62f7aa06-6fd9-4eb1-aa27-951aa550ab1d\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:17.846396 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:17.846349 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62f7aa06-6fd9-4eb1-aa27-951aa550ab1d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9\" (UID: \"62f7aa06-6fd9-4eb1-aa27-951aa550ab1d\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:17.846569 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:17.846481 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62f7aa06-6fd9-4eb1-aa27-951aa550ab1d-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9\" (UID: \"62f7aa06-6fd9-4eb1-aa27-951aa550ab1d\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:17.846569 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:17.846517 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kpsx8\" (UniqueName: \"kubernetes.io/projected/62f7aa06-6fd9-4eb1-aa27-951aa550ab1d-kube-api-access-kpsx8\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9\" (UID: \"62f7aa06-6fd9-4eb1-aa27-951aa550ab1d\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:17.846851 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:17.846829 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/62f7aa06-6fd9-4eb1-aa27-951aa550ab1d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9\" (UID: \"62f7aa06-6fd9-4eb1-aa27-951aa550ab1d\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:17.846851 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:17.846844 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/62f7aa06-6fd9-4eb1-aa27-951aa550ab1d-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9\" (UID: \"62f7aa06-6fd9-4eb1-aa27-951aa550ab1d\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:17.847018 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:17.846925 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/62f7aa06-6fd9-4eb1-aa27-951aa550ab1d-home\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9\" (UID: \"62f7aa06-6fd9-4eb1-aa27-951aa550ab1d\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:17.848570 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:17.848536 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/62f7aa06-6fd9-4eb1-aa27-951aa550ab1d-dshm\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9\" (UID: \"62f7aa06-6fd9-4eb1-aa27-951aa550ab1d\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:17.848777 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:17.848731 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/62f7aa06-6fd9-4eb1-aa27-951aa550ab1d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9\" (UID: \"62f7aa06-6fd9-4eb1-aa27-951aa550ab1d\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:17.854680 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:17.854657 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpsx8\" (UniqueName: \"kubernetes.io/projected/62f7aa06-6fd9-4eb1-aa27-951aa550ab1d-kube-api-access-kpsx8\") pod \"facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9\" (UID: \"62f7aa06-6fd9-4eb1-aa27-951aa550ab1d\") " pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:18.040802 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:18.040709 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:18.165413 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:18.165316 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9"] Jun 02 05:58:18.167843 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:58:18.167803 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f7aa06_6fd9_4eb1_aa27_951aa550ab1d.slice/crio-eb9929362210201f7c4488f2feda74b2c4d2264b5dc505f75ae1025ad8f6c519 WatchSource:0}: Error finding container eb9929362210201f7c4488f2feda74b2c4d2264b5dc505f75ae1025ad8f6c519: Status 404 returned error can't find the container with id eb9929362210201f7c4488f2feda74b2c4d2264b5dc505f75ae1025ad8f6c519 Jun 02 05:58:18.497129 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:18.497093 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" event={"ID":"62f7aa06-6fd9-4eb1-aa27-951aa550ab1d","Type":"ContainerStarted","Data":"df571a5ff2961f1639197be85771e7997f1b0a88546dbf9ee5bc7b5bbed2c5e9"} Jun 02 05:58:18.497129 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:18.497132 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" event={"ID":"62f7aa06-6fd9-4eb1-aa27-951aa550ab1d","Type":"ContainerStarted","Data":"eb9929362210201f7c4488f2feda74b2c4d2264b5dc505f75ae1025ad8f6c519"} Jun 02 05:58:20.506215 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:20.506186 2549 generic.go:358] "Generic (PLEG): container finished" podID="62f7aa06-6fd9-4eb1-aa27-951aa550ab1d" containerID="df571a5ff2961f1639197be85771e7997f1b0a88546dbf9ee5bc7b5bbed2c5e9" exitCode=0 Jun 02 05:58:20.506682 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:20.506264 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" event={"ID":"62f7aa06-6fd9-4eb1-aa27-951aa550ab1d","Type":"ContainerDied","Data":"df571a5ff2961f1639197be85771e7997f1b0a88546dbf9ee5bc7b5bbed2c5e9"} Jun 02 05:58:21.510838 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:21.510805 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" event={"ID":"62f7aa06-6fd9-4eb1-aa27-951aa550ab1d","Type":"ContainerStarted","Data":"7492e78ee7c09fd5f78c1f45de3f9a6ff63e6f7a4ce878e4907244d7d579876d"} Jun 02 05:58:21.532994 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:21.532949 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" podStartSLOduration=4.3445277 podStartE2EDuration="4.532936653s" podCreationTimestamp="2026-06-02 05:58:17 +0000 UTC" firstStartedPulling="2026-06-02 05:58:20.506960895 +0000 UTC m=+757.923257135" lastFinishedPulling="2026-06-02 05:58:20.695369831 +0000 UTC m=+758.111666088" observedRunningTime="2026-06-02 05:58:21.531689596 +0000 UTC m=+758.947985892" watchObservedRunningTime="2026-06-02 05:58:21.532936653 +0000 UTC m=+758.949232916" Jun 02 05:58:28.041730 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:28.041683 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:28.042286 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:28.041797 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:28.053976 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:28.053953 2549 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:28.544204 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:28.544176 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9" Jun 02 05:58:29.487368 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.487333 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw"] Jun 02 05:58:29.490497 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.490479 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw" Jun 02 05:58:29.492995 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.492976 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 02 05:58:29.498590 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.498566 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw"] Jun 02 05:58:29.529569 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.529538 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59e4da91-edb9-4aa9-89c0-4fadb176f43e-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw\" (UID: \"59e4da91-edb9-4aa9-89c0-4fadb176f43e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw" Jun 02 05:58:29.529684 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.529601 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59e4da91-edb9-4aa9-89c0-4fadb176f43e-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw\" (UID: \"59e4da91-edb9-4aa9-89c0-4fadb176f43e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw" Jun 02 05:58:29.529777 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.529702 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b5jc\" (UniqueName: \"kubernetes.io/projected/59e4da91-edb9-4aa9-89c0-4fadb176f43e-kube-api-access-6b5jc\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw\" (UID: \"59e4da91-edb9-4aa9-89c0-4fadb176f43e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw" Jun 02 05:58:29.529848 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.529781 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59e4da91-edb9-4aa9-89c0-4fadb176f43e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw\" (UID: \"59e4da91-edb9-4aa9-89c0-4fadb176f43e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw" Jun 02 05:58:29.529848 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.529809 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/59e4da91-edb9-4aa9-89c0-4fadb176f43e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw\" (UID: \"59e4da91-edb9-4aa9-89c0-4fadb176f43e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw" Jun 02 05:58:29.529848 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.529843 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59e4da91-edb9-4aa9-89c0-4fadb176f43e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw\" (UID: \"59e4da91-edb9-4aa9-89c0-4fadb176f43e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw" Jun 02 05:58:29.631199 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.631171 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59e4da91-edb9-4aa9-89c0-4fadb176f43e-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw\" (UID: \"59e4da91-edb9-4aa9-89c0-4fadb176f43e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw" Jun 02 05:58:29.631324 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.631216 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59e4da91-edb9-4aa9-89c0-4fadb176f43e-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw\" (UID: \"59e4da91-edb9-4aa9-89c0-4fadb176f43e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw" Jun 02 05:58:29.631324 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.631237 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6b5jc\" (UniqueName: \"kubernetes.io/projected/59e4da91-edb9-4aa9-89c0-4fadb176f43e-kube-api-access-6b5jc\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw\" (UID: \"59e4da91-edb9-4aa9-89c0-4fadb176f43e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw" Jun 02 05:58:29.631324 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.631270 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59e4da91-edb9-4aa9-89c0-4fadb176f43e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw\" (UID: \"59e4da91-edb9-4aa9-89c0-4fadb176f43e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw" Jun 02 05:58:29.631324 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.631296 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/59e4da91-edb9-4aa9-89c0-4fadb176f43e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw\" (UID: \"59e4da91-edb9-4aa9-89c0-4fadb176f43e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw" Jun 02 05:58:29.631498 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.631328 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59e4da91-edb9-4aa9-89c0-4fadb176f43e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw\" (UID: \"59e4da91-edb9-4aa9-89c0-4fadb176f43e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw" Jun 02 05:58:29.631639 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.631617 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/59e4da91-edb9-4aa9-89c0-4fadb176f43e-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw\" (UID: \"59e4da91-edb9-4aa9-89c0-4fadb176f43e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw" Jun 02 05:58:29.631720 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.631696 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/59e4da91-edb9-4aa9-89c0-4fadb176f43e-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw\" (UID: \"59e4da91-edb9-4aa9-89c0-4fadb176f43e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw" Jun 02 05:58:29.631797 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.631778 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/59e4da91-edb9-4aa9-89c0-4fadb176f43e-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw\" (UID: \"59e4da91-edb9-4aa9-89c0-4fadb176f43e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw" Jun 02 05:58:29.633423 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.633403 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/59e4da91-edb9-4aa9-89c0-4fadb176f43e-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw\" (UID: \"59e4da91-edb9-4aa9-89c0-4fadb176f43e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw" Jun 02 05:58:29.633862 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.633845 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/59e4da91-edb9-4aa9-89c0-4fadb176f43e-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw\" (UID: \"59e4da91-edb9-4aa9-89c0-4fadb176f43e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw" Jun 02 05:58:29.638355 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.638336 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b5jc\" (UniqueName: \"kubernetes.io/projected/59e4da91-edb9-4aa9-89c0-4fadb176f43e-kube-api-access-6b5jc\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw\" (UID: \"59e4da91-edb9-4aa9-89c0-4fadb176f43e\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw" Jun 02 05:58:29.800946 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.800881 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw" Jun 02 05:58:29.925545 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:29.925521 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw"] Jun 02 05:58:29.928303 ip-10-0-134-109 kubenswrapper[2549]: W0602 05:58:29.928268 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59e4da91_edb9_4aa9_89c0_4fadb176f43e.slice/crio-1247743359d2cbab7e325584785f2961b9bcc974fd77e3aa50bc5bf26301b85b WatchSource:0}: Error finding container 1247743359d2cbab7e325584785f2961b9bcc974fd77e3aa50bc5bf26301b85b: Status 404 returned error can't find the container with id 1247743359d2cbab7e325584785f2961b9bcc974fd77e3aa50bc5bf26301b85b Jun 02 05:58:30.542734 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:30.542699 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw" event={"ID":"59e4da91-edb9-4aa9-89c0-4fadb176f43e","Type":"ContainerStarted","Data":"5fccc39d217cdb8ca9015f7ec0d49ae2aeab6f9994b64e63739373b53a65438e"} Jun 02 05:58:30.542734 ip-10-0-134-109 kubenswrapper[2549]: I0602 05:58:30.542740 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw" event={"ID":"59e4da91-edb9-4aa9-89c0-4fadb176f43e","Type":"ContainerStarted","Data":"1247743359d2cbab7e325584785f2961b9bcc974fd77e3aa50bc5bf26301b85b"} Jun 02 06:04:13.510829 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:13.510802 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw_59e4da91-edb9-4aa9-89c0-4fadb176f43e/storage-initializer/0.log" Jun 02 06:04:19.269683 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:19.269652 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7bfb4755b7-wjvl8_464b0ec3-e74c-425c-b908-a1bb49dc6835/nginx/0.log" Jun 02 06:04:19.403378 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:19.403340 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-5c5rz_c62ef754-82df-4a19-8293-7de46ddab337/manager/0.log" Jun 02 06:04:19.533294 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:19.533222 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-hgp57_06f91f45-43da-47a4-a7d5-6fcd006ac721/manager/0.log" Jun 02 06:04:20.031692 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:20.031669 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-vg2md_12a4c070-babb-45c8-aca4-cca2c2fea515/server/0.log" Jun 02 06:04:20.162601 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:20.162574 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-wf29k_502792f3-7368-4ffe-8ec5-514c9451da3b/manager/0.log" Jun 02 06:04:20.616051 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:20.616024 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74d9c7f795-vdkzm_1a20c221-3563-4556-b307-59301c878d81/copy-manifests/0.log" Jun 02 06:04:20.636573 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:20.636543 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74d9c7f795-vdkzm_1a20c221-3563-4556-b307-59301c878d81/manager/0.log" Jun 02 06:04:22.332777 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:22.332734 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-pdlt2_325a1efc-85a7-4767-8311-0e6eb81de90b/manager/0.log" Jun 02 06:04:23.896328 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:23.896298 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-zvx9b_74b3893e-d36d-4309-b3b5-bbcbe90695d4/discovery/0.log" Jun 02 06:04:24.023538 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:24.023511 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d6fbd88fb-65p7k_b8b7fbc4-45fb-4b1e-a2b6-90cbfe9ed46d/kube-auth-proxy/0.log" Jun 02 06:04:24.937408 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:24.937373 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh_6e3ff925-2e5b-4f33-a15c-e58ffbcd223d/storage-initializer/0.log" Jun 02 06:04:24.957335 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:24.957310 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-x7mqh_6e3ff925-2e5b-4f33-a15c-e58ffbcd223d/main/0.log" Jun 02 06:04:25.511793 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:25.511770 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9_62f7aa06-6fd9-4eb1-aa27-951aa550ab1d/storage-initializer/0.log" Jun 02 06:04:25.521730 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:25.521707 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-59dcdf78f5-67zq9_62f7aa06-6fd9-4eb1-aa27-951aa550ab1d/main/0.log" Jun 02 06:04:25.648422 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:25.648402 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-228nw_59e4da91-edb9-4aa9-89c0-4fadb176f43e/storage-initializer/0.log" Jun 02 06:04:33.596039 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:33.596001 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bfp2s_761b2e7f-ac2a-42c9-a7f4-580d427f04e9/global-pull-secret-syncer/0.log" Jun 02 06:04:33.912107 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:33.912035 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l29df_08d597a1-897e-4cdb-bd1f-c08549cfd0c2/konnectivity-agent/0.log" Jun 02 06:04:34.120381 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:34.120352 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-109.ec2.internal_720d1a64b25c8e7c73406333baa1c8d8/haproxy/0.log" Jun 02 06:04:37.896668 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:37.896629 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-pdlt2_325a1efc-85a7-4767-8311-0e6eb81de90b/manager/0.log" Jun 02 06:04:41.483210 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:41.483183 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-86str_66e0da3a-2441-4bce-ae31-ad688cb57c66/node-exporter/0.log" Jun 02 06:04:41.635189 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:41.635163 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-86str_66e0da3a-2441-4bce-ae31-ad688cb57c66/kube-rbac-proxy/0.log" Jun 02 06:04:41.700861 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:41.700832 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-86str_66e0da3a-2441-4bce-ae31-ad688cb57c66/init-textfile/0.log" Jun 02 06:04:42.630984 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:42.630944 2549 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2"] Jun 02 06:04:42.636460 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:42.636437 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2" Jun 02 06:04:42.641738 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:42.641454 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nbsm2\"/\"kube-root-ca.crt\"" Jun 02 06:04:42.644354 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:42.643826 2549 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nbsm2\"/\"default-dockercfg-snjcw\"" Jun 02 06:04:42.644354 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:42.644112 2549 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nbsm2\"/\"openshift-service-ca.crt\"" Jun 02 06:04:42.683387 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:42.683290 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ff6bd21a-2a41-481c-b05b-0228db76459b-proc\") pod \"perf-node-gather-daemonset-lvgz2\" (UID: \"ff6bd21a-2a41-481c-b05b-0228db76459b\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2" Jun 02 06:04:42.683387 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:42.683356 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff6bd21a-2a41-481c-b05b-0228db76459b-lib-modules\") pod \"perf-node-gather-daemonset-lvgz2\" (UID: \"ff6bd21a-2a41-481c-b05b-0228db76459b\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2" Jun 02 06:04:42.683594 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:42.683444 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff6bd21a-2a41-481c-b05b-0228db76459b-sys\") pod \"perf-node-gather-daemonset-lvgz2\" (UID: \"ff6bd21a-2a41-481c-b05b-0228db76459b\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2" Jun 02 06:04:42.683594 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:42.683482 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ff6bd21a-2a41-481c-b05b-0228db76459b-podres\") pod \"perf-node-gather-daemonset-lvgz2\" (UID: \"ff6bd21a-2a41-481c-b05b-0228db76459b\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2" Jun 02 06:04:42.683594 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:42.683527 2549 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrsn9\" (UniqueName: \"kubernetes.io/projected/ff6bd21a-2a41-481c-b05b-0228db76459b-kube-api-access-lrsn9\") pod \"perf-node-gather-daemonset-lvgz2\" (UID: \"ff6bd21a-2a41-481c-b05b-0228db76459b\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2" Jun 02 06:04:42.693043 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:42.692994 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2"] Jun 02 06:04:42.784349 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:42.784318 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ff6bd21a-2a41-481c-b05b-0228db76459b-proc\") pod \"perf-node-gather-daemonset-lvgz2\" (UID: \"ff6bd21a-2a41-481c-b05b-0228db76459b\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2" Jun 02 06:04:42.784634 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:42.784611 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff6bd21a-2a41-481c-b05b-0228db76459b-lib-modules\") pod \"perf-node-gather-daemonset-lvgz2\" (UID: \"ff6bd21a-2a41-481c-b05b-0228db76459b\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2" Jun 02 06:04:42.784818 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:42.784801 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff6bd21a-2a41-481c-b05b-0228db76459b-sys\") pod \"perf-node-gather-daemonset-lvgz2\" (UID: \"ff6bd21a-2a41-481c-b05b-0228db76459b\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2" Jun 02 06:04:42.784938 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:42.784923 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ff6bd21a-2a41-481c-b05b-0228db76459b-podres\") pod \"perf-node-gather-daemonset-lvgz2\" (UID: \"ff6bd21a-2a41-481c-b05b-0228db76459b\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2" Jun 02 06:04:42.785054 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:42.785039 2549 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lrsn9\" (UniqueName: \"kubernetes.io/projected/ff6bd21a-2a41-481c-b05b-0228db76459b-kube-api-access-lrsn9\") pod \"perf-node-gather-daemonset-lvgz2\" (UID: \"ff6bd21a-2a41-481c-b05b-0228db76459b\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2" Jun 02 06:04:42.785547 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:42.785521 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ff6bd21a-2a41-481c-b05b-0228db76459b-proc\") pod \"perf-node-gather-daemonset-lvgz2\" (UID: \"ff6bd21a-2a41-481c-b05b-0228db76459b\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2" Jun 02 06:04:42.785810 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:42.785792 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ff6bd21a-2a41-481c-b05b-0228db76459b-lib-modules\") pod \"perf-node-gather-daemonset-lvgz2\" (UID: \"ff6bd21a-2a41-481c-b05b-0228db76459b\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2" Jun 02 06:04:42.785971 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:42.785954 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ff6bd21a-2a41-481c-b05b-0228db76459b-sys\") pod \"perf-node-gather-daemonset-lvgz2\" (UID: \"ff6bd21a-2a41-481c-b05b-0228db76459b\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2" Jun 02 06:04:42.786152 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:42.786135 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ff6bd21a-2a41-481c-b05b-0228db76459b-podres\") pod \"perf-node-gather-daemonset-lvgz2\" (UID: \"ff6bd21a-2a41-481c-b05b-0228db76459b\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2" Jun 02 06:04:42.835622 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:42.835589 2549 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrsn9\" (UniqueName: \"kubernetes.io/projected/ff6bd21a-2a41-481c-b05b-0228db76459b-kube-api-access-lrsn9\") pod \"perf-node-gather-daemonset-lvgz2\" (UID: \"ff6bd21a-2a41-481c-b05b-0228db76459b\") " pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2" Jun 02 06:04:42.950552 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:42.950519 2549 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2" Jun 02 06:04:43.157414 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:43.157387 2549 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2"] Jun 02 06:04:43.159657 ip-10-0-134-109 kubenswrapper[2549]: W0602 06:04:43.159629 2549 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podff6bd21a_2a41_481c_b05b_0228db76459b.slice/crio-c9100550699a8572401c5a7d2d1d78cb24724cc53fc2465962049780c76c7b81 WatchSource:0}: Error finding container c9100550699a8572401c5a7d2d1d78cb24724cc53fc2465962049780c76c7b81: Status 404 returned error can't find the container with id c9100550699a8572401c5a7d2d1d78cb24724cc53fc2465962049780c76c7b81 Jun 02 06:04:43.161257 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:43.161242 2549 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 02 06:04:43.793447 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:43.793401 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2" event={"ID":"ff6bd21a-2a41-481c-b05b-0228db76459b","Type":"ContainerStarted","Data":"13bd3d11a95a3be74e332e6c5a8152821c1e0ea73a275053575915888e61b830"} Jun 02 06:04:43.793944 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:43.793456 2549 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2" event={"ID":"ff6bd21a-2a41-481c-b05b-0228db76459b","Type":"ContainerStarted","Data":"c9100550699a8572401c5a7d2d1d78cb24724cc53fc2465962049780c76c7b81"} Jun 02 06:04:43.793944 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:43.793489 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2" Jun 02 06:04:43.823165 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:43.823103 2549 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2" podStartSLOduration=1.823084769 podStartE2EDuration="1.823084769s" podCreationTimestamp="2026-06-02 06:04:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-02 06:04:43.819343613 +0000 UTC m=+1141.235639876" watchObservedRunningTime="2026-06-02 06:04:43.823084769 +0000 UTC m=+1141.239381032" Jun 02 06:04:49.328643 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:49.328611 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lsp7v_f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb/dns/0.log" Jun 02 06:04:49.389791 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:49.389770 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lsp7v_f58fc9f6-7a6b-405d-bd40-f7d18d36b0cb/kube-rbac-proxy/0.log" Jun 02 06:04:49.743642 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:49.743618 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-k5p47_9117376b-287e-4816-91d1-944d41a716ff/dns-node-resolver/0.log" Jun 02 06:04:49.807148 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:49.807123 2549 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nbsm2/perf-node-gather-daemonset-lvgz2" Jun 02 06:04:50.732279 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:50.732246 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wplv9_1609f43a-6da5-43ee-977c-53549e92c5b6/node-ca/0.log" Jun 02 06:04:52.220642 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:52.220610 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-798958bb55-zvx9b_74b3893e-d36d-4309-b3b5-bbcbe90695d4/discovery/0.log" Jun 02 06:04:52.291405 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:52.291366 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d6fbd88fb-65p7k_b8b7fbc4-45fb-4b1e-a2b6-90cbfe9ed46d/kube-auth-proxy/0.log" Jun 02 06:04:53.649100 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:53.649030 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dxf8h_25e274b9-daeb-464a-8b5a-7de86d58b2ca/serve-healthcheck-canary/0.log" Jun 02 06:04:54.644154 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:54.644082 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4bhlw_97c93db9-2020-4e6d-952b-69c5ca423a94/kube-rbac-proxy/0.log" Jun 02 06:04:54.716136 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:54.716118 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4bhlw_97c93db9-2020-4e6d-952b-69c5ca423a94/exporter/0.log" Jun 02 06:04:54.844304 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:54.844280 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4bhlw_97c93db9-2020-4e6d-952b-69c5ca423a94/extractor/0.log" Jun 02 06:04:58.117002 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:58.116969 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7bfb4755b7-wjvl8_464b0ec3-e74c-425c-b908-a1bb49dc6835/nginx/0.log" Jun 02 06:04:58.178445 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:58.178416 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7c99ffcdcd-5c5rz_c62ef754-82df-4a19-8293-7de46ddab337/manager/0.log" Jun 02 06:04:58.257539 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:58.257514 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-c6b9847d7-hgp57_06f91f45-43da-47a4-a7d5-6fcd006ac721/manager/0.log" Jun 02 06:04:58.535528 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:58.535501 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-vg2md_12a4c070-babb-45c8-aca4-cca2c2fea515/server/0.log" Jun 02 06:04:58.667501 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:58.667471 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-76588b95-wf29k_502792f3-7368-4ffe-8ec5-514c9451da3b/manager/0.log" Jun 02 06:04:59.217783 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:59.217737 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74d9c7f795-vdkzm_1a20c221-3563-4556-b307-59301c878d81/manager/0.log" Jun 02 06:04:59.266511 ip-10-0-134-109 kubenswrapper[2549]: I0602 06:04:59.266483 2549 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74d9c7f795-vdkzm_1a20c221-3563-4556-b307-59301c878d81/copy-manifests/0.log"