Jun 08 23:56:43.435341 ip-10-0-129-4 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 08 23:56:43.435350 ip-10-0-129-4 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 08 23:56:43.435357 ip-10-0-129-4 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 08 23:56:43.435496 ip-10-0-129-4 systemd[1]: Failed to start Kubernetes Kubelet. Jun 08 23:56:53.684989 ip-10-0-129-4 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 08 23:56:53.685010 ip-10-0-129-4 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot ffe2ab6b1f5146128ea8d6bd42d5d790 -- Jun 08 23:59:19.271888 ip-10-0-129-4 systemd[1]: Starting Kubernetes Kubelet... Jun 08 23:59:19.695470 ip-10-0-129-4 kubenswrapper[2515]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 23:59:19.695470 ip-10-0-129-4 kubenswrapper[2515]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 23:59:19.695470 ip-10-0-129-4 kubenswrapper[2515]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 23:59:19.695470 ip-10-0-129-4 kubenswrapper[2515]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 23:59:19.695470 ip-10-0-129-4 kubenswrapper[2515]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 23:59:19.698278 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.698196 2515 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 23:59:19.704464 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704448 2515 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 23:59:19.704464 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704463 2515 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 23:59:19.704532 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704467 2515 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 23:59:19.704532 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704470 2515 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 23:59:19.704532 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704473 2515 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 23:59:19.704532 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704476 2515 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 23:59:19.704532 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704479 2515 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 23:59:19.704532 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704482 2515 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 23:59:19.704532 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704484 2515 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 23:59:19.704532 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704493 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 23:59:19.704532 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704497 2515 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 23:59:19.704532 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704499 2515 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 23:59:19.704532 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704502 2515 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 23:59:19.704532 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704505 2515 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 23:59:19.704532 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704508 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 23:59:19.704532 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704510 2515 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 23:59:19.704532 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704513 2515 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 23:59:19.704532 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704515 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 23:59:19.704532 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704518 2515 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 23:59:19.704532 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704520 2515 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 23:59:19.704532 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704524 2515 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 23:59:19.705077 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704526 2515 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 23:59:19.705077 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704529 2515 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 23:59:19.705077 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704531 2515 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 23:59:19.705077 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704535 2515 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 23:59:19.705077 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704538 2515 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 23:59:19.705077 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704540 2515 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 23:59:19.705077 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704543 2515 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 23:59:19.705077 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704547 2515 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 23:59:19.705077 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704549 2515 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 23:59:19.705077 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704552 2515 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 23:59:19.705077 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704554 2515 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 23:59:19.705077 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704557 2515 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 23:59:19.705077 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704560 2515 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 23:59:19.705077 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704562 2515 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 23:59:19.705077 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704565 2515 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 23:59:19.705077 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704567 2515 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 23:59:19.705077 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704570 2515 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 23:59:19.705077 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704572 2515 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 23:59:19.705077 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704575 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 23:59:19.705077 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704577 2515 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 23:59:19.705847 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704579 2515 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 23:59:19.705847 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704583 2515 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 23:59:19.705847 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704585 2515 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 23:59:19.705847 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704588 2515 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 23:59:19.705847 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704590 2515 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 23:59:19.705847 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704593 2515 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 23:59:19.705847 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704595 2515 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 23:59:19.705847 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704598 2515 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 23:59:19.705847 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704618 2515 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 23:59:19.705847 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704623 2515 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 23:59:19.705847 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704636 2515 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 23:59:19.705847 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704638 2515 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 23:59:19.705847 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704641 2515 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 23:59:19.705847 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704644 2515 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 23:59:19.705847 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704646 2515 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 23:59:19.705847 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704649 2515 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 23:59:19.705847 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704652 2515 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 23:59:19.705847 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704654 2515 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 23:59:19.705847 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704657 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 23:59:19.705847 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704660 2515 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 23:59:19.706342 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704663 2515 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 23:59:19.706342 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704665 2515 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 23:59:19.706342 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704667 2515 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 23:59:19.706342 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704670 2515 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 23:59:19.706342 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704672 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 23:59:19.706342 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704675 2515 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 23:59:19.706342 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704677 2515 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 23:59:19.706342 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704680 2515 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 23:59:19.706342 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704683 2515 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 23:59:19.706342 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704685 2515 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 23:59:19.706342 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704687 2515 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 23:59:19.706342 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704690 2515 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 23:59:19.706342 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704692 2515 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 23:59:19.706342 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704696 2515 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 23:59:19.706342 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704701 2515 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 23:59:19.706342 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704705 2515 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 23:59:19.706342 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704707 2515 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 23:59:19.706342 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704710 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 23:59:19.706342 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704713 2515 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 23:59:19.706906 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704716 2515 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 23:59:19.706906 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704718 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 23:59:19.706906 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704720 2515 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 23:59:19.706906 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704724 2515 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 23:59:19.706906 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704728 2515 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 23:59:19.706906 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704731 2515 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 23:59:19.706906 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704734 2515 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 23:59:19.706906 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704737 2515 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 23:59:19.706906 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704741 2515 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 23:59:19.706906 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704743 2515 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 23:59:19.706906 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704746 2515 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 23:59:19.706906 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704748 2515 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 23:59:19.706906 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704751 2515 feature_gate.go:328] unrecognized feature gate: Example Jun 08 23:59:19.706906 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704754 2515 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 23:59:19.706906 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704756 2515 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 23:59:19.706906 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704760 2515 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 23:59:19.706906 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704763 2515 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 23:59:19.706906 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704766 2515 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 23:59:19.706906 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.704769 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 23:59:19.707385 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707194 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 23:59:19.707385 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707206 2515 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 23:59:19.707385 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707210 2515 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 23:59:19.707385 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707213 2515 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 23:59:19.707385 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707216 2515 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 23:59:19.707385 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707219 2515 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 23:59:19.707385 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707222 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 23:59:19.707385 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707225 2515 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 23:59:19.707385 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707228 2515 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 23:59:19.707385 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707231 2515 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 23:59:19.707385 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707233 2515 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 23:59:19.707385 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707236 2515 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 23:59:19.707385 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707239 2515 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 23:59:19.707385 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707242 2515 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 23:59:19.707385 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707245 2515 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 23:59:19.707385 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707247 2515 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 23:59:19.707385 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707250 2515 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 23:59:19.707385 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707252 2515 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 23:59:19.707385 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707255 2515 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 23:59:19.707385 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707258 2515 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 23:59:19.707910 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707261 2515 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 23:59:19.707910 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707263 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 23:59:19.707910 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707266 2515 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 23:59:19.707910 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707269 2515 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 23:59:19.707910 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707271 2515 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 23:59:19.707910 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707274 2515 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 23:59:19.707910 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707276 2515 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 23:59:19.707910 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707279 2515 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 23:59:19.707910 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707281 2515 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 23:59:19.707910 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707284 2515 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 23:59:19.707910 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707287 2515 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 23:59:19.707910 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707290 2515 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 23:59:19.707910 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707300 2515 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 23:59:19.707910 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707306 2515 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 23:59:19.707910 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707309 2515 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 23:59:19.707910 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707311 2515 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 23:59:19.707910 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707314 2515 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 23:59:19.707910 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707319 2515 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 23:59:19.707910 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707322 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 23:59:19.708380 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707326 2515 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 23:59:19.708380 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707328 2515 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 23:59:19.708380 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707332 2515 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 23:59:19.708380 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707334 2515 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 23:59:19.708380 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707337 2515 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 23:59:19.708380 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707339 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 23:59:19.708380 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707342 2515 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 23:59:19.708380 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707345 2515 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 23:59:19.708380 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707347 2515 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 23:59:19.708380 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707350 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 23:59:19.708380 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707352 2515 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 23:59:19.708380 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707355 2515 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 23:59:19.708380 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707358 2515 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 23:59:19.708380 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707360 2515 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 23:59:19.708380 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707363 2515 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 23:59:19.708380 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707365 2515 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 23:59:19.708380 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707368 2515 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 23:59:19.708380 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707370 2515 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 23:59:19.708380 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707373 2515 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 23:59:19.708380 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707375 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 23:59:19.708883 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707378 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 23:59:19.708883 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707381 2515 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 23:59:19.708883 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707384 2515 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 23:59:19.708883 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707387 2515 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 23:59:19.708883 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707389 2515 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 23:59:19.708883 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707392 2515 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 23:59:19.708883 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707396 2515 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 23:59:19.708883 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707399 2515 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 23:59:19.708883 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707402 2515 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 23:59:19.708883 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707405 2515 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 23:59:19.708883 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707408 2515 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 23:59:19.708883 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707411 2515 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 23:59:19.708883 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707413 2515 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 23:59:19.708883 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707416 2515 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 23:59:19.708883 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707419 2515 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 23:59:19.708883 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707421 2515 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 23:59:19.708883 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707424 2515 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 23:59:19.708883 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707426 2515 feature_gate.go:328] unrecognized feature gate: Example Jun 08 23:59:19.708883 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707429 2515 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 23:59:19.708883 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707431 2515 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 23:59:19.709372 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707434 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 23:59:19.709372 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707437 2515 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 23:59:19.709372 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707439 2515 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 23:59:19.709372 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707441 2515 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 23:59:19.709372 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707445 2515 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 23:59:19.709372 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707448 2515 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 23:59:19.709372 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707451 2515 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 23:59:19.709372 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707453 2515 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 23:59:19.709372 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707456 2515 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 23:59:19.709372 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707459 2515 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 23:59:19.709372 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707461 2515 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 23:59:19.709372 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707465 2515 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 23:59:19.709372 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707469 2515 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 23:59:19.709372 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707472 2515 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 23:59:19.709372 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707475 2515 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 23:59:19.709372 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707477 2515 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 23:59:19.709372 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707480 2515 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 23:59:19.709372 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707482 2515 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 23:59:19.709372 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707485 2515 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 23:59:19.709851 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707488 2515 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 23:59:19.709851 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707893 2515 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 23:59:19.709851 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707899 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 23:59:19.709851 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707902 2515 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 23:59:19.709851 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707904 2515 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 23:59:19.709851 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707907 2515 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 23:59:19.709851 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707910 2515 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 23:59:19.709851 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707913 2515 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 23:59:19.709851 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707916 2515 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 23:59:19.709851 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707919 2515 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 23:59:19.709851 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707922 2515 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 23:59:19.709851 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707925 2515 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 23:59:19.709851 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707927 2515 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 23:59:19.709851 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707930 2515 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 23:59:19.709851 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707933 2515 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 23:59:19.709851 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707935 2515 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 23:59:19.709851 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707938 2515 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 23:59:19.709851 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707941 2515 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 23:59:19.709851 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707943 2515 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 23:59:19.710311 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707946 2515 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 23:59:19.710311 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707949 2515 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 23:59:19.710311 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707951 2515 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 23:59:19.710311 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707954 2515 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 23:59:19.710311 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707956 2515 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 23:59:19.710311 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707959 2515 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 23:59:19.710311 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707961 2515 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 23:59:19.710311 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707964 2515 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 23:59:19.710311 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707967 2515 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 23:59:19.710311 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707970 2515 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 23:59:19.710311 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707972 2515 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 23:59:19.710311 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707975 2515 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 23:59:19.710311 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707978 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 23:59:19.710311 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707980 2515 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 23:59:19.710311 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707983 2515 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 23:59:19.710311 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707985 2515 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 23:59:19.710311 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707988 2515 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 23:59:19.710311 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707990 2515 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 23:59:19.710311 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707993 2515 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 23:59:19.710311 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707995 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 23:59:19.710822 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.707998 2515 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 23:59:19.710822 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708000 2515 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 23:59:19.710822 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708002 2515 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 23:59:19.710822 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708005 2515 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 23:59:19.710822 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708007 2515 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 23:59:19.710822 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708010 2515 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 23:59:19.710822 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708012 2515 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 23:59:19.710822 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708015 2515 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 23:59:19.710822 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708017 2515 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 23:59:19.710822 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708020 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 23:59:19.710822 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708023 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 23:59:19.710822 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708026 2515 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 23:59:19.710822 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708029 2515 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 23:59:19.710822 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708031 2515 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 23:59:19.710822 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708034 2515 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 23:59:19.710822 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708038 2515 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 23:59:19.710822 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708041 2515 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 23:59:19.710822 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708043 2515 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 23:59:19.710822 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708046 2515 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 23:59:19.710822 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708049 2515 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 23:59:19.711302 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708051 2515 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 23:59:19.711302 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708054 2515 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 23:59:19.711302 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708056 2515 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 23:59:19.711302 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708059 2515 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 23:59:19.711302 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708062 2515 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 23:59:19.711302 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708065 2515 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 23:59:19.711302 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708067 2515 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 23:59:19.711302 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708070 2515 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 23:59:19.711302 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708072 2515 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 23:59:19.711302 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708075 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 23:59:19.711302 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708078 2515 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 23:59:19.711302 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708080 2515 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 23:59:19.711302 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708083 2515 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 23:59:19.711302 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708085 2515 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 23:59:19.711302 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708088 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 23:59:19.711302 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708090 2515 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 23:59:19.711302 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708092 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 23:59:19.711302 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708095 2515 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 23:59:19.711302 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708097 2515 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 23:59:19.711302 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708100 2515 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 23:59:19.711816 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708102 2515 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 23:59:19.711816 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708105 2515 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 23:59:19.711816 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708108 2515 feature_gate.go:328] unrecognized feature gate: Example Jun 08 23:59:19.711816 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708110 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 23:59:19.711816 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708113 2515 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 23:59:19.711816 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708116 2515 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 23:59:19.711816 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708118 2515 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 23:59:19.711816 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708121 2515 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 23:59:19.711816 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708123 2515 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 23:59:19.711816 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708126 2515 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 23:59:19.711816 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708128 2515 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 23:59:19.711816 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708131 2515 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 23:59:19.711816 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708135 2515 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 23:59:19.711816 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708139 2515 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 23:59:19.711816 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708143 2515 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 23:59:19.711816 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708147 2515 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 23:59:19.711816 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708150 2515 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 23:59:19.711816 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708153 2515 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 23:59:19.711816 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708156 2515 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708159 2515 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708162 2515 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708233 2515 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708240 2515 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708249 2515 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708255 2515 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708261 2515 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708266 2515 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708272 2515 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708276 2515 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708279 2515 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708282 2515 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708286 2515 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708290 2515 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708293 2515 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708298 2515 flags.go:64] FLAG: --cgroup-root="" Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708301 2515 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708304 2515 flags.go:64] FLAG: --client-ca-file="" Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708308 2515 flags.go:64] FLAG: --cloud-provider="external" Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708311 2515 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708315 2515 flags.go:64] FLAG: --cluster-domain="" Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708318 2515 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708320 2515 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 23:59:19.712275 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708323 2515 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708327 2515 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708335 2515 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708338 2515 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708341 2515 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708344 2515 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708347 2515 flags.go:64] FLAG: --contention-profiling="false" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708350 2515 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708353 2515 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708356 2515 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708359 2515 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708363 2515 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708366 2515 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708369 2515 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708372 2515 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708375 2515 flags.go:64] FLAG: --enable-server="true" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708378 2515 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708383 2515 flags.go:64] FLAG: --event-burst="100" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708386 2515 flags.go:64] FLAG: --event-qps="50" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708389 2515 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708393 2515 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708396 2515 flags.go:64] FLAG: --eviction-hard="" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708400 2515 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708402 2515 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708409 2515 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 23:59:19.712848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708412 2515 flags.go:64] FLAG: --eviction-soft="" Jun 08 23:59:19.713457 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708415 2515 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 23:59:19.713457 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708418 2515 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 23:59:19.713457 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708422 2515 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 23:59:19.713457 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708425 2515 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 23:59:19.713457 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708428 2515 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 23:59:19.713457 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708431 2515 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 23:59:19.713457 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708433 2515 flags.go:64] FLAG: --feature-gates="" Jun 08 23:59:19.713457 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708437 2515 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 23:59:19.713457 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708440 2515 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 23:59:19.713457 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708443 2515 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 23:59:19.713457 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708446 2515 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 23:59:19.713457 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708449 2515 flags.go:64] FLAG: --healthz-port="10248" Jun 08 23:59:19.713457 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708452 2515 flags.go:64] FLAG: --help="false" Jun 08 23:59:19.713457 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708455 2515 flags.go:64] FLAG: --hostname-override="ip-10-0-129-4.ec2.internal" Jun 08 23:59:19.713457 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708458 2515 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 23:59:19.713457 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708460 2515 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 23:59:19.713457 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708463 2515 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 23:59:19.713457 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708467 2515 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 23:59:19.713457 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708470 2515 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 23:59:19.713457 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708472 2515 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 23:59:19.713457 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708475 2515 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 23:59:19.713457 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708478 2515 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 23:59:19.713457 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708481 2515 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708483 2515 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708486 2515 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708489 2515 flags.go:64] FLAG: --kube-reserved="" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708492 2515 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708494 2515 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708497 2515 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708500 2515 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708504 2515 flags.go:64] FLAG: --lock-file="" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708507 2515 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708509 2515 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708512 2515 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708518 2515 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708521 2515 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708524 2515 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708527 2515 flags.go:64] FLAG: --logging-format="text" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708530 2515 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708533 2515 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708536 2515 flags.go:64] FLAG: --manifest-url="" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708538 2515 flags.go:64] FLAG: --manifest-url-header="" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708543 2515 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708545 2515 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708552 2515 flags.go:64] FLAG: --max-pods="110" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708555 2515 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708557 2515 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 23:59:19.714076 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708560 2515 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708563 2515 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708566 2515 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708569 2515 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708572 2515 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708579 2515 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708582 2515 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708585 2515 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708588 2515 flags.go:64] FLAG: --pod-cidr="" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708590 2515 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708596 2515 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708599 2515 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708615 2515 flags.go:64] FLAG: --pods-per-core="0" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708618 2515 flags.go:64] FLAG: --port="10250" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708621 2515 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708626 2515 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c481936b6c758caa" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708629 2515 flags.go:64] FLAG: --qos-reserved="" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708632 2515 flags.go:64] FLAG: --read-only-port="10255" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708635 2515 flags.go:64] FLAG: --register-node="true" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708638 2515 flags.go:64] FLAG: --register-with-taints="" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708641 2515 flags.go:64] FLAG: --registry-burst="10" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708648 2515 flags.go:64] FLAG: --registry-qps="5" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708651 2515 flags.go:64] FLAG: --reserved-cpus="" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708654 2515 flags.go:64] FLAG: --reserved-memory="" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708657 2515 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 23:59:19.714777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708660 2515 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708663 2515 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708666 2515 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708669 2515 flags.go:64] FLAG: --runonce="false" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708672 2515 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708675 2515 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708678 2515 flags.go:64] FLAG: --seccomp-default="false" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708681 2515 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708684 2515 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708687 2515 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708690 2515 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708693 2515 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708695 2515 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708698 2515 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708701 2515 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708704 2515 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708706 2515 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708709 2515 flags.go:64] FLAG: --system-cgroups="" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708712 2515 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708717 2515 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708720 2515 flags.go:64] FLAG: --tls-cert-file="" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708722 2515 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708727 2515 flags.go:64] FLAG: --tls-min-version="" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708730 2515 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708732 2515 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 23:59:19.715774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708735 2515 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 23:59:19.716860 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708738 2515 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 23:59:19.716860 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708741 2515 flags.go:64] FLAG: --v="2" Jun 08 23:59:19.716860 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708747 2515 flags.go:64] FLAG: --version="false" Jun 08 23:59:19.716860 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708751 2515 flags.go:64] FLAG: --vmodule="" Jun 08 23:59:19.716860 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708755 2515 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 23:59:19.716860 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.708758 2515 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 23:59:19.716860 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708868 2515 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 23:59:19.716860 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708872 2515 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 23:59:19.716860 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708874 2515 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 23:59:19.716860 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708877 2515 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 23:59:19.716860 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708880 2515 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 23:59:19.716860 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708883 2515 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 23:59:19.716860 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708886 2515 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 23:59:19.716860 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708889 2515 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 23:59:19.716860 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708892 2515 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 23:59:19.716860 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708895 2515 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 23:59:19.716860 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708897 2515 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 23:59:19.716860 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708900 2515 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 23:59:19.716860 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708903 2515 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 23:59:19.716860 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708906 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 23:59:19.716860 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708908 2515 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 23:59:19.717772 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708911 2515 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 23:59:19.717772 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708914 2515 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 23:59:19.717772 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708916 2515 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 23:59:19.717772 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708919 2515 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 23:59:19.717772 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708921 2515 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 23:59:19.717772 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708924 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 23:59:19.717772 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708926 2515 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 23:59:19.717772 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708930 2515 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 23:59:19.717772 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708933 2515 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 23:59:19.717772 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708936 2515 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 23:59:19.717772 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708939 2515 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 23:59:19.717772 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708941 2515 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 23:59:19.717772 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708945 2515 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 23:59:19.717772 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708950 2515 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 23:59:19.717772 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708952 2515 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 23:59:19.717772 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708956 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 23:59:19.717772 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708958 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 23:59:19.717772 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708961 2515 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 23:59:19.717772 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708964 2515 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 23:59:19.718594 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708966 2515 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 23:59:19.718594 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708968 2515 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 23:59:19.718594 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708971 2515 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 23:59:19.718594 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708973 2515 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 23:59:19.718594 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708976 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 23:59:19.718594 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708978 2515 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 23:59:19.718594 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708981 2515 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 23:59:19.718594 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708984 2515 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 23:59:19.718594 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708986 2515 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 23:59:19.718594 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708989 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 23:59:19.718594 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708991 2515 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 23:59:19.718594 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708994 2515 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 23:59:19.718594 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708996 2515 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 23:59:19.718594 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.708999 2515 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 23:59:19.718594 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709001 2515 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 23:59:19.718594 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709004 2515 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 23:59:19.718594 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709006 2515 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 23:59:19.718594 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709009 2515 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 23:59:19.718594 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709011 2515 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 23:59:19.718594 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709014 2515 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 23:59:19.719196 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709017 2515 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 23:59:19.719196 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709020 2515 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 23:59:19.719196 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709023 2515 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 23:59:19.719196 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709025 2515 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 23:59:19.719196 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709028 2515 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 23:59:19.719196 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709030 2515 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 23:59:19.719196 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709034 2515 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 23:59:19.719196 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709037 2515 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 23:59:19.719196 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709039 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 23:59:19.719196 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709042 2515 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 23:59:19.719196 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709045 2515 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 23:59:19.719196 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709048 2515 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 23:59:19.719196 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709050 2515 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 23:59:19.719196 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709053 2515 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 23:59:19.719196 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709055 2515 feature_gate.go:328] unrecognized feature gate: Example Jun 08 23:59:19.719196 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709058 2515 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 23:59:19.719196 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709060 2515 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 23:59:19.719196 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709063 2515 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 23:59:19.719196 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709065 2515 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 23:59:19.719196 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709068 2515 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 23:59:19.719976 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709070 2515 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 23:59:19.719976 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709073 2515 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 23:59:19.719976 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709077 2515 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 23:59:19.719976 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709080 2515 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 23:59:19.719976 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709083 2515 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 23:59:19.719976 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709086 2515 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 23:59:19.719976 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709089 2515 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 23:59:19.719976 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709091 2515 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 23:59:19.719976 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709094 2515 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 23:59:19.719976 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709096 2515 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 23:59:19.719976 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709099 2515 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 23:59:19.719976 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709101 2515 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 23:59:19.719976 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709105 2515 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 23:59:19.719976 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709107 2515 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 23:59:19.719976 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709110 2515 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 23:59:19.719976 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709112 2515 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 23:59:19.719976 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709114 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 23:59:19.719976 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709118 2515 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 23:59:19.719976 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709123 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 23:59:19.720792 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709126 2515 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 23:59:19.720792 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709129 2515 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 23:59:19.720792 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709131 2515 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 23:59:19.720792 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709134 2515 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 23:59:19.720792 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709137 2515 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 23:59:19.720792 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.709140 2515 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 23:59:19.720792 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.709796 2515 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 23:59:19.720792 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.717229 2515 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 23:59:19.720792 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.717247 2515 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 23:59:19.720792 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.717273 2515 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 23:59:19.720792 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.717281 2515 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 23:59:19.720792 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717365 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 23:59:19.720792 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717374 2515 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 23:59:19.720792 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717379 2515 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 23:59:19.720792 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717384 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 23:59:19.721187 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717388 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 23:59:19.721187 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717392 2515 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 23:59:19.721187 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717397 2515 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 23:59:19.721187 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717401 2515 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 23:59:19.721187 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717405 2515 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 23:59:19.721187 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717410 2515 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 23:59:19.721187 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717414 2515 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 23:59:19.721187 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717419 2515 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 23:59:19.721187 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717423 2515 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 23:59:19.721187 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717427 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 23:59:19.721187 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717432 2515 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 23:59:19.721187 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717436 2515 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 23:59:19.721187 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717440 2515 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 23:59:19.721187 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717444 2515 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 23:59:19.721187 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717448 2515 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 23:59:19.721187 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717453 2515 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 23:59:19.721187 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717457 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 23:59:19.721187 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717461 2515 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 23:59:19.721187 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717465 2515 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 23:59:19.721187 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717470 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 23:59:19.721835 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717474 2515 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 23:59:19.721835 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717479 2515 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 23:59:19.721835 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717483 2515 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 23:59:19.721835 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717487 2515 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 23:59:19.721835 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717491 2515 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 23:59:19.721835 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717497 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 23:59:19.721835 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717502 2515 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 23:59:19.721835 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717506 2515 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 23:59:19.721835 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717510 2515 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 23:59:19.721835 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717514 2515 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 23:59:19.721835 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717519 2515 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 23:59:19.721835 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717523 2515 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 23:59:19.721835 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717527 2515 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 23:59:19.721835 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717531 2515 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 23:59:19.721835 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717536 2515 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 23:59:19.721835 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717541 2515 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 23:59:19.721835 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717545 2515 feature_gate.go:328] unrecognized feature gate: Example Jun 08 23:59:19.721835 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717549 2515 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 23:59:19.721835 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717553 2515 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 23:59:19.721835 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717557 2515 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 23:59:19.722364 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717561 2515 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 23:59:19.722364 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717566 2515 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 23:59:19.722364 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717570 2515 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 23:59:19.722364 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717574 2515 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 23:59:19.722364 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717578 2515 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 23:59:19.722364 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717583 2515 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 23:59:19.722364 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717587 2515 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 23:59:19.722364 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717591 2515 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 23:59:19.722364 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717597 2515 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 23:59:19.722364 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717620 2515 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 23:59:19.722364 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717627 2515 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 23:59:19.722364 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717634 2515 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 23:59:19.722364 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717639 2515 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 23:59:19.722364 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717644 2515 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 23:59:19.722364 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717648 2515 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 23:59:19.722364 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717653 2515 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 23:59:19.722364 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717659 2515 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 23:59:19.722364 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717664 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 23:59:19.722364 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717670 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 23:59:19.722905 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717674 2515 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 23:59:19.722905 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717679 2515 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 23:59:19.722905 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717683 2515 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 23:59:19.722905 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717687 2515 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 23:59:19.722905 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717692 2515 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 23:59:19.722905 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717696 2515 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 23:59:19.722905 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717701 2515 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 23:59:19.722905 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717705 2515 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 23:59:19.722905 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717709 2515 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 23:59:19.722905 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717713 2515 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 23:59:19.722905 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717717 2515 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 23:59:19.722905 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717722 2515 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 23:59:19.722905 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717726 2515 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 23:59:19.722905 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717730 2515 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 23:59:19.722905 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717735 2515 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 23:59:19.722905 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717739 2515 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 23:59:19.722905 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717744 2515 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 23:59:19.722905 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717748 2515 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 23:59:19.722905 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717752 2515 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 23:59:19.722905 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717756 2515 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 23:59:19.723438 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717760 2515 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 23:59:19.723438 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717765 2515 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 23:59:19.723438 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717768 2515 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 23:59:19.723438 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717772 2515 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 23:59:19.723438 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717776 2515 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 23:59:19.723438 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717780 2515 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 23:59:19.723438 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717784 2515 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 23:59:19.723438 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717788 2515 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 23:59:19.723438 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717794 2515 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 23:59:19.723438 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717799 2515 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 23:59:19.723438 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717804 2515 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 23:59:19.723438 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717809 2515 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 23:59:19.723438 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717821 2515 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 23:59:19.723438 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717826 2515 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 23:59:19.723438 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717831 2515 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 23:59:19.723438 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.717835 2515 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 23:59:19.723848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.717843 2515 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 23:59:19.723848 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718024 2515 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 23:59:19.723848 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718032 2515 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 23:59:19.723848 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718037 2515 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 23:59:19.723848 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718042 2515 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 23:59:19.723848 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718047 2515 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 23:59:19.723848 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718051 2515 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 23:59:19.723848 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718055 2515 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 23:59:19.723848 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718060 2515 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 23:59:19.723848 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718064 2515 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 23:59:19.723848 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718068 2515 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 23:59:19.723848 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718072 2515 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 23:59:19.723848 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718076 2515 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 23:59:19.723848 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718080 2515 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 23:59:19.723848 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718084 2515 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 23:59:19.724281 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718088 2515 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 23:59:19.724281 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718092 2515 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 23:59:19.724281 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718097 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 23:59:19.724281 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718101 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 23:59:19.724281 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718108 2515 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 23:59:19.724281 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718114 2515 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 23:59:19.724281 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718119 2515 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 23:59:19.724281 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718123 2515 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 23:59:19.724281 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718127 2515 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 23:59:19.724281 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718132 2515 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 23:59:19.724281 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718136 2515 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 23:59:19.724281 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718142 2515 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 23:59:19.724281 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718146 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 23:59:19.724281 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718150 2515 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 23:59:19.724281 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718155 2515 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 23:59:19.724281 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718160 2515 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 23:59:19.724281 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718164 2515 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 23:59:19.724281 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718168 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 23:59:19.724281 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718172 2515 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 23:59:19.724761 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718177 2515 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 23:59:19.724761 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718181 2515 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 23:59:19.724761 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718186 2515 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 23:59:19.724761 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718190 2515 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 23:59:19.724761 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718194 2515 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 23:59:19.724761 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718198 2515 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 23:59:19.724761 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718202 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 23:59:19.724761 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718207 2515 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 23:59:19.724761 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718211 2515 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 23:59:19.724761 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718215 2515 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 23:59:19.724761 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718219 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 23:59:19.724761 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718223 2515 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 23:59:19.724761 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718227 2515 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 23:59:19.724761 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718232 2515 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 23:59:19.724761 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718236 2515 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 23:59:19.724761 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718240 2515 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 23:59:19.724761 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718244 2515 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 23:59:19.724761 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718248 2515 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 23:59:19.724761 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718253 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 23:59:19.725244 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718256 2515 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 23:59:19.725244 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718260 2515 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 23:59:19.725244 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718265 2515 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 23:59:19.725244 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718269 2515 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 23:59:19.725244 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718274 2515 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 23:59:19.725244 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718278 2515 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 23:59:19.725244 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718283 2515 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 23:59:19.725244 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718287 2515 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 23:59:19.725244 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718291 2515 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 23:59:19.725244 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718296 2515 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 23:59:19.725244 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718300 2515 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 23:59:19.725244 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718304 2515 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 23:59:19.725244 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718308 2515 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 23:59:19.725244 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718312 2515 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 23:59:19.725244 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718317 2515 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 23:59:19.725244 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718321 2515 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 23:59:19.725244 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718325 2515 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 23:59:19.725244 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718330 2515 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 23:59:19.725244 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718334 2515 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 23:59:19.725244 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718338 2515 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 23:59:19.725758 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718342 2515 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 23:59:19.725758 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718346 2515 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 23:59:19.725758 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718350 2515 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 23:59:19.725758 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718354 2515 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 23:59:19.725758 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718359 2515 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 23:59:19.725758 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718363 2515 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 23:59:19.725758 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718367 2515 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 23:59:19.725758 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718371 2515 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 23:59:19.725758 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718377 2515 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 23:59:19.725758 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718382 2515 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 23:59:19.725758 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718388 2515 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 23:59:19.725758 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718392 2515 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 23:59:19.725758 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718396 2515 feature_gate.go:328] unrecognized feature gate: Example Jun 08 23:59:19.725758 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718401 2515 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 23:59:19.725758 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718405 2515 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 23:59:19.725758 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718410 2515 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 23:59:19.725758 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718414 2515 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 23:59:19.725758 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718419 2515 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 23:59:19.725758 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718423 2515 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 23:59:19.725758 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718427 2515 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 23:59:19.726236 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718431 2515 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 23:59:19.726236 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718435 2515 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 23:59:19.726236 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718440 2515 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 23:59:19.726236 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718444 2515 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 23:59:19.726236 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718451 2515 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 23:59:19.726236 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718456 2515 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 23:59:19.726236 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:19.718461 2515 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 23:59:19.726236 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.718469 2515 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 23:59:19.726236 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.718635 2515 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 23:59:19.726236 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.721655 2515 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 23:59:19.726236 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.722974 2515 server.go:1019] "Starting client certificate rotation" Jun 08 23:59:19.726236 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.723080 2515 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 23:59:19.726236 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.723121 2515 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 23:59:19.727688 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.727671 2515 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 23:59:19.731312 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.731292 2515 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 23:59:19.741629 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.741596 2515 log.go:25] "Validated CRI v1 runtime API" Jun 08 23:59:19.744000 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.743980 2515 log.go:25] "Validated CRI v1 image API" Jun 08 23:59:19.745578 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.745563 2515 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 23:59:19.747992 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.747970 2515 fs.go:135] Filesystem UUIDs: map[5a4bc749-9f19-4a30-a190-a1b9c635ee2e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e80eac04-d0be-4a96-a475-5edc604c015e:/dev/nvme0n1p4] Jun 08 23:59:19.748047 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.747993 2515 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 23:59:19.749978 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.749960 2515 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 23:59:19.754092 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.753988 2515 manager.go:216] Machine: {Timestamp:2026-06-08 23:59:19.752798965 +0000 UTC m=+0.368862791 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099666 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec269456e2eb72097b35b9c3f58cf1cc SystemUUID:ec269456-e2eb-7209-7b35-b9c3f58cf1cc BootID:ffe2ab6b-1f51-4612-8ea8-d6bd42d5d790 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2d:31:b0:e2:ed Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2d:31:b0:e2:ed Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:1c:58:dd:05:8b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 23:59:19.754092 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.754090 2515 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 23:59:19.754198 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.754165 2515 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 23:59:19.757807 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.757786 2515 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 23:59:19.757946 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.757811 2515 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-4.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 23:59:19.758497 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.758488 2515 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 23:59:19.758565 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.758499 2515 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 23:59:19.758565 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.758506 2515 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 23:59:19.759095 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.759085 2515 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 23:59:19.760009 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.760000 2515 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 23:59:19.762955 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.762944 2515 state_mem.go:36] "Initialized new in-memory state store" Jun 08 23:59:19.763060 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.763051 2515 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 23:59:19.763090 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.763081 2515 kubelet.go:486] "Attempting to sync node with API server" Jun 08 23:59:19.763122 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.763090 2515 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 23:59:19.763122 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.763108 2515 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 23:59:19.763122 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.763118 2515 kubelet.go:398] "Adding apiserver pod source" Jun 08 23:59:19.763194 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.763127 2515 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 23:59:19.763468 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.763457 2515 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 23:59:19.763510 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.763475 2515 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 23:59:19.765588 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.765566 2515 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 23:59:19.767224 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.767203 2515 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-229hr" Jun 08 23:59:19.767525 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.767512 2515 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 23:59:19.767563 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.767542 2515 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 23:59:19.768729 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.768718 2515 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 23:59:19.768776 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.768733 2515 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 23:59:19.768776 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.768745 2515 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 23:59:19.768776 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.768751 2515 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 23:59:19.768776 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.768760 2515 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 23:59:19.768776 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.768765 2515 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 23:59:19.768776 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.768774 2515 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 23:59:19.768776 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.768779 2515 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 23:59:19.768961 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.768786 2515 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 23:59:19.768961 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.768792 2515 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 23:59:19.768961 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.768803 2515 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 23:59:19.768961 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.768809 2515 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 23:59:19.769810 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.769800 2515 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 23:59:19.769810 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.769810 2515 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 23:59:19.772570 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.772549 2515 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-4.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 23:59:19.772664 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:19.772624 2515 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 23:59:19.772715 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:19.772661 2515 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 23:59:19.773202 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.773190 2515 server.go:1268] "Started kubelet" Jun 08 23:59:19.773293 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.773273 2515 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 23:59:19.773380 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.773324 2515 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 23:59:19.773380 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.773375 2515 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 23:59:19.776477 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.776437 2515 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-229hr" Jun 08 23:59:19.776662 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.776619 2515 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 23:59:19.776737 ip-10-0-129-4 systemd[1]: Started Kubernetes Kubelet. Jun 08 23:59:19.780016 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.780001 2515 server.go:310] "Adding debug handlers to kubelet server" Jun 08 23:59:19.780813 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:19.780793 2515 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 23:59:19.781173 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:19.780180 2515 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-4.ec2.internal.18b7408ed0562e05 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-4.ec2.internal,UID:ip-10-0-129-4.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-4.ec2.internal,},FirstTimestamp:2026-06-08 23:59:19.773163013 +0000 UTC m=+0.389226840,LastTimestamp:2026-06-08 23:59:19.773163013 +0000 UTC m=+0.389226840,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-4.ec2.internal,}" Jun 08 23:59:19.782676 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.782661 2515 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 23:59:19.782738 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.782664 2515 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 23:59:19.782738 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:19.782729 2515 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-4.ec2.internal\" not found" Jun 08 23:59:19.783271 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.783253 2515 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 23:59:19.783271 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.783273 2515 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 23:59:19.783399 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.783389 2515 factory.go:55] Registering systemd factory Jun 08 23:59:19.783399 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.783396 2515 reconstruct.go:97] "Volume reconstruction finished" Jun 08 23:59:19.783508 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.783405 2515 factory.go:223] Registration of the systemd container factory successfully Jun 08 23:59:19.783508 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.783407 2515 reconciler.go:29] "Reconciler: start to sync state" Jun 08 23:59:19.783508 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.783438 2515 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 23:59:19.783743 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.783646 2515 factory.go:153] Registering CRI-O factory Jun 08 23:59:19.783743 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.783659 2515 factory.go:223] Registration of the crio container factory successfully Jun 08 23:59:19.783743 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.783713 2515 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 23:59:19.783743 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.783736 2515 factory.go:103] Registering Raw factory Jun 08 23:59:19.783931 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.783752 2515 manager.go:1196] Started watching for new ooms in manager Jun 08 23:59:19.784088 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.784078 2515 manager.go:349] Starting recovery of all containers Jun 08 23:59:19.792446 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.792292 2515 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 23:59:19.794881 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:19.794858 2515 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-4.ec2.internal\" not found" node="ip-10-0-129-4.ec2.internal" Jun 08 23:59:19.794964 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.794901 2515 manager.go:354] Recovery completed Jun 08 23:59:19.800014 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.800002 2515 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 23:59:19.801923 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.801907 2515 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-4.ec2.internal" event="NodeHasSufficientMemory" Jun 08 23:59:19.801976 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.801935 2515 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 23:59:19.801976 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.801946 2515 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-4.ec2.internal" event="NodeHasSufficientPID" Jun 08 23:59:19.802460 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.802447 2515 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 23:59:19.802460 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.802458 2515 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 23:59:19.802549 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.802476 2515 state_mem.go:36] "Initialized new in-memory state store" Jun 08 23:59:19.802549 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.802452 2515 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 23:59:19.803206 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.803190 2515 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-4.ec2.internal" event="NodeHasSufficientMemory" Jun 08 23:59:19.803278 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.803218 2515 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 23:59:19.803278 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.803231 2515 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-4.ec2.internal" event="NodeHasSufficientPID" Jun 08 23:59:19.803709 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.803699 2515 policy_none.go:49] "None policy: Start" Jun 08 23:59:19.803751 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.803713 2515 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 23:59:19.803751 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.803724 2515 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 23:59:19.804632 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.804619 2515 policy_none.go:47] "Start" Jun 08 23:59:19.842177 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.842162 2515 manager.go:337] "Starting Device Plugin manager" Jun 08 23:59:19.857389 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:19.842195 2515 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 23:59:19.857389 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.842207 2515 server.go:87] "Starting device plugin registration server" Jun 08 23:59:19.857389 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.842416 2515 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 23:59:19.857389 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.842429 2515 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 23:59:19.857389 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.842522 2515 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 23:59:19.857389 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.842625 2515 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 23:59:19.857389 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.842634 2515 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 23:59:19.857389 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:19.843313 2515 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 23:59:19.857389 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:19.843355 2515 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-4.ec2.internal\" not found" Jun 08 23:59:19.857389 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.855638 2515 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 23:59:19.857389 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.856879 2515 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 23:59:19.857389 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.856913 2515 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 23:59:19.857389 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.856931 2515 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 23:59:19.857389 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:19.856964 2515 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 23:59:19.858958 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.858944 2515 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 23:59:19.942673 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.942636 2515 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 23:59:19.943811 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.943796 2515 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-4.ec2.internal" event="NodeHasSufficientMemory" Jun 08 23:59:19.943909 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.943828 2515 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 23:59:19.943909 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.943842 2515 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-4.ec2.internal" event="NodeHasSufficientPID" Jun 08 23:59:19.943909 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.943870 2515 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-4.ec2.internal" Jun 08 23:59:19.950357 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.950313 2515 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-4.ec2.internal" Jun 08 23:59:19.950357 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:19.950335 2515 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-4.ec2.internal\": node \"ip-10-0-129-4.ec2.internal\" not found" Jun 08 23:59:19.957201 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.957180 2515 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-4.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-4.ec2.internal"] Jun 08 23:59:19.957281 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.957239 2515 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 23:59:19.958494 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.958472 2515 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-4.ec2.internal" event="NodeHasSufficientMemory" Jun 08 23:59:19.958576 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.958500 2515 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 23:59:19.958576 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.958514 2515 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-4.ec2.internal" event="NodeHasSufficientPID" Jun 08 23:59:19.959771 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.959756 2515 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 23:59:19.959893 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.959878 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-4.ec2.internal" Jun 08 23:59:19.960052 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.959909 2515 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 23:59:19.960449 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.960434 2515 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-4.ec2.internal" event="NodeHasSufficientMemory" Jun 08 23:59:19.960518 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.960459 2515 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 23:59:19.960518 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.960475 2515 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-4.ec2.internal" event="NodeHasSufficientPID" Jun 08 23:59:19.960518 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.960500 2515 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-4.ec2.internal" event="NodeHasSufficientMemory" Jun 08 23:59:19.960680 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.960521 2515 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 23:59:19.960680 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.960542 2515 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-4.ec2.internal" event="NodeHasSufficientPID" Jun 08 23:59:19.960786 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:19.960768 2515 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-4.ec2.internal\" not found" Jun 08 23:59:19.961587 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.961574 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-4.ec2.internal" Jun 08 23:59:19.961656 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.961596 2515 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 23:59:19.962206 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.962191 2515 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-4.ec2.internal" event="NodeHasSufficientMemory" Jun 08 23:59:19.962269 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.962234 2515 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 23:59:19.962269 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.962245 2515 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-4.ec2.internal" event="NodeHasSufficientPID" Jun 08 23:59:19.985054 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.985033 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f95ebfa4383488cee2a65aa0620795f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-4.ec2.internal\" (UID: \"f95ebfa4383488cee2a65aa0620795f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-4.ec2.internal" Jun 08 23:59:19.985119 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.985059 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f95ebfa4383488cee2a65aa0620795f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-4.ec2.internal\" (UID: \"f95ebfa4383488cee2a65aa0620795f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-4.ec2.internal" Jun 08 23:59:19.985119 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:19.985079 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2c664d5f65d16a479fdf40d82fa5ea09-config\") pod \"kube-apiserver-proxy-ip-10-0-129-4.ec2.internal\" (UID: \"2c664d5f65d16a479fdf40d82fa5ea09\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-4.ec2.internal" Jun 08 23:59:19.991176 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:19.991159 2515 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-4.ec2.internal\" not found" node="ip-10-0-129-4.ec2.internal" Jun 08 23:59:19.995438 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:19.995421 2515 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-4.ec2.internal\" not found" node="ip-10-0-129-4.ec2.internal" Jun 08 23:59:20.061719 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:20.061692 2515 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-4.ec2.internal\" not found" Jun 08 23:59:20.085359 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:20.085336 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f95ebfa4383488cee2a65aa0620795f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-4.ec2.internal\" (UID: \"f95ebfa4383488cee2a65aa0620795f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-4.ec2.internal" Jun 08 23:59:20.085491 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:20.085368 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f95ebfa4383488cee2a65aa0620795f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-4.ec2.internal\" (UID: \"f95ebfa4383488cee2a65aa0620795f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-4.ec2.internal" Jun 08 23:59:20.085491 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:20.085396 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2c664d5f65d16a479fdf40d82fa5ea09-config\") pod \"kube-apiserver-proxy-ip-10-0-129-4.ec2.internal\" (UID: \"2c664d5f65d16a479fdf40d82fa5ea09\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-4.ec2.internal" Jun 08 23:59:20.085491 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:20.085445 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2c664d5f65d16a479fdf40d82fa5ea09-config\") pod \"kube-apiserver-proxy-ip-10-0-129-4.ec2.internal\" (UID: \"2c664d5f65d16a479fdf40d82fa5ea09\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-4.ec2.internal" Jun 08 23:59:20.085491 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:20.085448 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f95ebfa4383488cee2a65aa0620795f3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-4.ec2.internal\" (UID: \"f95ebfa4383488cee2a65aa0620795f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-4.ec2.internal" Jun 08 23:59:20.085491 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:20.085460 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f95ebfa4383488cee2a65aa0620795f3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-4.ec2.internal\" (UID: \"f95ebfa4383488cee2a65aa0620795f3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-4.ec2.internal" Jun 08 23:59:20.162072 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:20.162044 2515 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-4.ec2.internal\" not found" Jun 08 23:59:20.262772 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:20.262696 2515 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-4.ec2.internal\" not found" Jun 08 23:59:20.295299 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:20.295272 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-4.ec2.internal" Jun 08 23:59:20.299966 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:20.299947 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-4.ec2.internal" Jun 08 23:59:20.363397 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:20.363365 2515 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-4.ec2.internal\" not found" Jun 08 23:59:20.463855 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:20.463829 2515 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-4.ec2.internal\" not found" Jun 08 23:59:20.564418 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:20.564352 2515 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-4.ec2.internal\" not found" Jun 08 23:59:20.664974 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:20.664944 2515 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-4.ec2.internal\" not found" Jun 08 23:59:20.722492 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:20.722466 2515 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 23:59:20.723119 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:20.722623 2515 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 23:59:20.723119 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:20.722664 2515 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 08 23:59:20.763726 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:20.763686 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c664d5f65d16a479fdf40d82fa5ea09.slice/crio-db7797431b43a061fe20182bbd2564bba335cf955bc47adb851e2b147114f15a WatchSource:0}: Error finding container db7797431b43a061fe20182bbd2564bba335cf955bc47adb851e2b147114f15a: Status 404 returned error can't find the container with id db7797431b43a061fe20182bbd2564bba335cf955bc47adb851e2b147114f15a Jun 08 23:59:20.764119 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:20.764105 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf95ebfa4383488cee2a65aa0620795f3.slice/crio-b0f6faa5864b482a941db6a56b886e586ef866c5d8b6c2a46e074ec7564511f5 WatchSource:0}: Error finding container b0f6faa5864b482a941db6a56b886e586ef866c5d8b6c2a46e074ec7564511f5: Status 404 returned error can't find the container with id b0f6faa5864b482a941db6a56b886e586ef866c5d8b6c2a46e074ec7564511f5 Jun 08 23:59:20.765210 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:20.765194 2515 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-4.ec2.internal\" not found" Jun 08 23:59:20.768709 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:20.768693 2515 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 23:59:20.781753 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:20.781714 2515 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 23:54:19 +0000 UTC" deadline="2028-02-16 07:02:36.070275952 +0000 UTC" Jun 08 23:59:20.781833 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:20.781753 2515 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14815h3m15.288527478s" Jun 08 23:59:20.860080 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:20.859994 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-4.ec2.internal" event={"ID":"2c664d5f65d16a479fdf40d82fa5ea09","Type":"ContainerStarted","Data":"db7797431b43a061fe20182bbd2564bba335cf955bc47adb851e2b147114f15a"} Jun 08 23:59:20.861045 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:20.861026 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-4.ec2.internal" event={"ID":"f95ebfa4383488cee2a65aa0620795f3","Type":"ContainerStarted","Data":"b0f6faa5864b482a941db6a56b886e586ef866c5d8b6c2a46e074ec7564511f5"} Jun 08 23:59:20.866205 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:20.866190 2515 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-4.ec2.internal\" not found" Jun 08 23:59:20.956289 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:20.956266 2515 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 23:59:20.983175 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:20.983153 2515 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-4.ec2.internal" Jun 08 23:59:20.993586 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:20.993568 2515 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 23:59:20.995517 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:20.995504 2515 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-4.ec2.internal" Jun 08 23:59:21.003359 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.003346 2515 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 23:59:21.324954 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.324873 2515 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 23:59:21.753190 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.753102 2515 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 23:59:21.764098 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.764062 2515 apiserver.go:52] "Watching apiserver" Jun 08 23:59:21.773768 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.772623 2515 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 23:59:21.773768 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.773416 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-pmqbj","openshift-multus/multus-bmm98","openshift-multus/network-metrics-daemon-np4v6","openshift-ovn-kubernetes/ovnkube-node-hh52h","kube-system/global-pull-secret-syncer-h7fk4","kube-system/konnectivity-agent-q4fjc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94","openshift-cluster-node-tuning-operator/tuned-74nf2","openshift-dns/node-resolver-z9m44","openshift-image-registry/node-ca-vmc2d","openshift-network-diagnostics/network-check-target-pwl8g","openshift-network-operator/iptables-alerter-wqgsf","kube-system/kube-apiserver-proxy-ip-10-0-129-4.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-4.ec2.internal"] Jun 08 23:59:21.775177 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.775150 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.776336 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.776314 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.777342 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.777324 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:21.777443 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:21.777388 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pwl8g" podUID="485792d6-e887-435c-a2cf-3dd55b769a7c" Jun 08 23:59:21.777700 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.777684 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 23:59:21.777798 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.777725 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 23:59:21.777798 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.777776 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qgpkg\"" Jun 08 23:59:21.778491 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.778468 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.778848 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.778718 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 23:59:21.779384 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.779095 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 23:59:21.779384 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.779180 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nlct9\"" Jun 08 23:59:21.779520 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.779497 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 23:59:21.779520 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.779503 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 23:59:21.779774 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.779745 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z9m44" Jun 08 23:59:21.780702 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.780670 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 23:59:21.781091 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.781075 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q4fjc" Jun 08 23:59:21.781189 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.781158 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 23:59:21.781519 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.781500 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 23:59:21.781651 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.781536 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 23:59:21.781753 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.781544 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 23:59:21.781812 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.781586 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tpt9z\"" Jun 08 23:59:21.781997 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.781974 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 23:59:21.782086 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.782023 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 23:59:21.782086 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.781976 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2rwlp\"" Jun 08 23:59:21.782571 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.782553 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" Jun 08 23:59:21.782923 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.782877 2515 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 23:59:21.783004 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.782929 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 23:59:21.783374 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.783356 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-r8pfz\"" Jun 08 23:59:21.783444 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.783376 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 23:59:21.783444 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.783399 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 23:59:21.784084 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.783935 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.784837 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.784816 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 23:59:21.784928 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.784878 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 23:59:21.785033 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.785014 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 23:59:21.785117 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.785099 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-p8xps\"" Jun 08 23:59:21.785456 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.785317 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:21.785456 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:21.785381 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7fk4" podUID="63467802-5568-4564-b2ed-b70d3e63703a" Jun 08 23:59:21.786193 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.786177 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 23:59:21.786279 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.786229 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 23:59:21.786361 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.786345 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-p98ng\"" Jun 08 23:59:21.786757 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.786728 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vmc2d" Jun 08 23:59:21.788164 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.788144 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:21.788267 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:21.788205 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-np4v6" podUID="1c75857e-660f-4c6b-a33d-6bd990f4089f" Jun 08 23:59:21.788934 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.788918 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cjhmx\"" Jun 08 23:59:21.789151 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.789134 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 23:59:21.789226 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.789137 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 23:59:21.789275 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.789262 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 23:59:21.789442 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.789403 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wqgsf" Jun 08 23:59:21.791651 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.791632 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 23:59:21.791865 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.791847 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fskzn\"" Jun 08 23:59:21.791950 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.791913 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 23:59:21.792098 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.792048 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 23:59:21.795477 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.795458 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-var-lib-kubelet\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.795585 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.795488 2515 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 23:59:21.795585 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.795491 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-host-cni-bin\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.795585 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.795572 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e27e1547-2a00-4410-aaf8-20f350f69220-sys-fs\") pod \"aws-ebs-csi-driver-node-m2n94\" (UID: \"e27e1547-2a00-4410-aaf8-20f350f69220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" Jun 08 23:59:21.795804 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.795622 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-multus-conf-dir\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.795804 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.795649 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-562kh\" (UniqueName: \"kubernetes.io/projected/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-kube-api-access-562kh\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.795804 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.795676 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e80985b9-2bd7-4d72-8059-a32ce4290fe7-cnibin\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.795804 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.795700 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e80985b9-2bd7-4d72-8059-a32ce4290fe7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.795804 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.795755 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-etc-systemd\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.796020 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.795826 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-host-run-ovn-kubernetes\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.796020 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.795862 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e27e1547-2a00-4410-aaf8-20f350f69220-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m2n94\" (UID: \"e27e1547-2a00-4410-aaf8-20f350f69220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" Jun 08 23:59:21.796020 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.795889 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e27e1547-2a00-4410-aaf8-20f350f69220-device-dir\") pod \"aws-ebs-csi-driver-node-m2n94\" (UID: \"e27e1547-2a00-4410-aaf8-20f350f69220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" Jun 08 23:59:21.796020 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.795924 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-host-var-lib-cni-multus\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.796020 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.795990 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-run-openvswitch\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.796227 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796045 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/24c10154-7f2b-4b8c-8000-2d4d7b781451-ovn-node-metrics-cert\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.796227 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796098 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-host-var-lib-kubelet\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.796227 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796138 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fc8a5201-8e7a-42b6-ad42-fdeeae119065-etc-tuned\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.796227 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796162 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-host-slash\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.796227 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796195 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-run-systemd\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.796439 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796225 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2sz4\" (UniqueName: \"kubernetes.io/projected/6b0fff56-c56a-4650-afd0-ac7fd0e1a935-kube-api-access-k2sz4\") pod \"node-resolver-z9m44\" (UID: \"6b0fff56-c56a-4650-afd0-ac7fd0e1a935\") " pod="openshift-dns/node-resolver-z9m44" Jun 08 23:59:21.796439 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796253 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-etc-modprobe-d\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.796439 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796277 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-lib-modules\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.796439 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796305 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-system-cni-dir\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.796439 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796333 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-multus-socket-dir-parent\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.796439 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796356 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-hostroot\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.796439 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796379 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfk5f\" (UniqueName: \"kubernetes.io/projected/e80985b9-2bd7-4d72-8059-a32ce4290fe7-kube-api-access-mfk5f\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.796439 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796402 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-etc-sysctl-conf\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.796439 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796427 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-run-ovn\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.796822 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796449 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-log-socket\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.796822 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796471 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/24c10154-7f2b-4b8c-8000-2d4d7b781451-ovnkube-config\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.796822 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796507 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b0fff56-c56a-4650-afd0-ac7fd0e1a935-hosts-file\") pod \"node-resolver-z9m44\" (UID: \"6b0fff56-c56a-4650-afd0-ac7fd0e1a935\") " pod="openshift-dns/node-resolver-z9m44" Jun 08 23:59:21.796822 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796535 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-cnibin\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.796822 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796561 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-host-run-k8s-cni-cncf-io\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.796822 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796585 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-etc-kubernetes\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.796822 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796626 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-host-run-netns\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.796822 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796652 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.796822 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796676 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-os-release\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.796822 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796698 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e80985b9-2bd7-4d72-8059-a32ce4290fe7-cni-binary-copy\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.796822 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796738 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-node-log\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.796822 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796764 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b0fff56-c56a-4650-afd0-ac7fd0e1a935-tmp-dir\") pod \"node-resolver-z9m44\" (UID: \"6b0fff56-c56a-4650-afd0-ac7fd0e1a935\") " pod="openshift-dns/node-resolver-z9m44" Jun 08 23:59:21.796822 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796778 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r642m\" (UniqueName: \"kubernetes.io/projected/e27e1547-2a00-4410-aaf8-20f350f69220-kube-api-access-r642m\") pod \"aws-ebs-csi-driver-node-m2n94\" (UID: \"e27e1547-2a00-4410-aaf8-20f350f69220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" Jun 08 23:59:21.796822 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796796 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4bdr\" (UniqueName: \"kubernetes.io/projected/fc8a5201-8e7a-42b6-ad42-fdeeae119065-kube-api-access-k4bdr\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.796822 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796811 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtrqc\" (UniqueName: \"kubernetes.io/projected/24c10154-7f2b-4b8c-8000-2d4d7b781451-kube-api-access-wtrqc\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.797322 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796833 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e27e1547-2a00-4410-aaf8-20f350f69220-registration-dir\") pod \"aws-ebs-csi-driver-node-m2n94\" (UID: \"e27e1547-2a00-4410-aaf8-20f350f69220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" Jun 08 23:59:21.797322 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796869 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e27e1547-2a00-4410-aaf8-20f350f69220-etc-selinux\") pod \"aws-ebs-csi-driver-node-m2n94\" (UID: \"e27e1547-2a00-4410-aaf8-20f350f69220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" Jun 08 23:59:21.797322 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796910 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-host-var-lib-cni-bin\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.797322 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796936 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-host-run-multus-certs\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.797322 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796966 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/46b88042-1753-4c68-b563-aea071370d78-agent-certs\") pod \"konnectivity-agent-q4fjc\" (UID: \"46b88042-1753-4c68-b563-aea071370d78\") " pod="kube-system/konnectivity-agent-q4fjc" Jun 08 23:59:21.797322 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.796988 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-etc-sysctl-d\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.797322 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.797011 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-sys\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.797322 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.797040 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-host-cni-netd\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.797322 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.797057 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/24c10154-7f2b-4b8c-8000-2d4d7b781451-env-overrides\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.797322 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.797077 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e27e1547-2a00-4410-aaf8-20f350f69220-socket-dir\") pod \"aws-ebs-csi-driver-node-m2n94\" (UID: \"e27e1547-2a00-4410-aaf8-20f350f69220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" Jun 08 23:59:21.797322 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.797100 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e80985b9-2bd7-4d72-8059-a32ce4290fe7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.797322 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.797160 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-run\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.797322 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.797198 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-cni-binary-copy\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.797322 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.797225 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-host-run-netns\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.797322 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.797253 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e80985b9-2bd7-4d72-8059-a32ce4290fe7-system-cni-dir\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.797322 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.797278 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-etc-kubernetes\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.797984 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.797300 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-systemd-units\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.797984 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.797350 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/24c10154-7f2b-4b8c-8000-2d4d7b781451-ovnkube-script-lib\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.797984 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.797372 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-multus-daemon-config\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.797984 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.797393 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-etc-sysconfig\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.797984 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.797413 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc8a5201-8e7a-42b6-ad42-fdeeae119065-tmp\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.797984 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.797434 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-host-kubelet\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.797984 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.797484 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-var-lib-openvswitch\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.797984 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.797506 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-etc-openvswitch\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.797984 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.797533 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29c5g\" (UniqueName: \"kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g\") pod \"network-check-target-pwl8g\" (UID: \"485792d6-e887-435c-a2cf-3dd55b769a7c\") " pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:21.797984 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.797554 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-host\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.797984 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.797640 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-multus-cni-dir\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.797984 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.797677 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/46b88042-1753-4c68-b563-aea071370d78-konnectivity-ca\") pod \"konnectivity-agent-q4fjc\" (UID: \"46b88042-1753-4c68-b563-aea071370d78\") " pod="kube-system/konnectivity-agent-q4fjc" Jun 08 23:59:21.797984 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.797708 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e80985b9-2bd7-4d72-8059-a32ce4290fe7-os-release\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.798698 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.798059 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e80985b9-2bd7-4d72-8059-a32ce4290fe7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.814450 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.814415 2515 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-562xg" Jun 08 23:59:21.821849 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.821827 2515 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-562xg" Jun 08 23:59:21.885063 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.885039 2515 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 23:59:21.898305 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898272 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-etc-sysctl-d\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.898438 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898327 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-sys\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.898438 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898356 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-host-cni-netd\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.898438 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898384 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/24c10154-7f2b-4b8c-8000-2d4d7b781451-env-overrides\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.898438 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898412 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e27e1547-2a00-4410-aaf8-20f350f69220-socket-dir\") pod \"aws-ebs-csi-driver-node-m2n94\" (UID: \"e27e1547-2a00-4410-aaf8-20f350f69220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" Jun 08 23:59:21.898672 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898441 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e80985b9-2bd7-4d72-8059-a32ce4290fe7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.898672 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898445 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-sys\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.898672 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898442 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-etc-sysctl-d\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.898672 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898446 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-host-cni-netd\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.898672 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898496 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs\") pod \"network-metrics-daemon-np4v6\" (UID: \"1c75857e-660f-4c6b-a33d-6bd990f4089f\") " pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:21.898672 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898548 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-run\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.898672 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898564 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e27e1547-2a00-4410-aaf8-20f350f69220-socket-dir\") pod \"aws-ebs-csi-driver-node-m2n94\" (UID: \"e27e1547-2a00-4410-aaf8-20f350f69220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" Jun 08 23:59:21.898672 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898575 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-cni-binary-copy\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.898672 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898614 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-host-run-netns\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.898672 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898639 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e80985b9-2bd7-4d72-8059-a32ce4290fe7-system-cni-dir\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.898672 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898648 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-run\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.898672 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898669 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd97edb7-dec0-40fc-85e0-9bb56a3e33eb-host\") pod \"node-ca-vmc2d\" (UID: \"dd97edb7-dec0-40fc-85e0-9bb56a3e33eb\") " pod="openshift-image-registry/node-ca-vmc2d" Jun 08 23:59:21.899234 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898679 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-host-run-netns\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.899234 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898692 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e80985b9-2bd7-4d72-8059-a32ce4290fe7-system-cni-dir\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.899234 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898692 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-etc-kubernetes\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.899234 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898737 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-systemd-units\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.899234 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898745 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-etc-kubernetes\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.899234 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898767 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/24c10154-7f2b-4b8c-8000-2d4d7b781451-ovnkube-script-lib\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.899234 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898791 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-systemd-units\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.899234 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898791 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-multus-daemon-config\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.899234 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898821 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-etc-sysconfig\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.899234 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898848 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc8a5201-8e7a-42b6-ad42-fdeeae119065-tmp\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.899234 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898875 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-host-kubelet\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.899234 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898903 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-var-lib-openvswitch\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.899234 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898930 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-etc-openvswitch\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.899234 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898971 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/24c10154-7f2b-4b8c-8000-2d4d7b781451-env-overrides\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.899234 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.898975 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-etc-openvswitch\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.899234 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899016 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-host-kubelet\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.899234 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899044 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-etc-sysconfig\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.899234 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899062 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-var-lib-openvswitch\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.900146 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899073 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29c5g\" (UniqueName: \"kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g\") pod \"network-check-target-pwl8g\" (UID: \"485792d6-e887-435c-a2cf-3dd55b769a7c\") " pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:21.900146 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899100 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret\") pod \"global-pull-secret-syncer-h7fk4\" (UID: \"63467802-5568-4564-b2ed-b70d3e63703a\") " pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:21.900146 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899123 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e80985b9-2bd7-4d72-8059-a32ce4290fe7-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.900146 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899132 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-host\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.900146 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899172 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-multus-cni-dir\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.900146 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899174 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-host\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.900146 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899136 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-cni-binary-copy\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.900146 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899243 2515 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 23:59:21.900146 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899307 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-multus-cni-dir\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.900146 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899324 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-multus-daemon-config\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.900146 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899269 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/46b88042-1753-4c68-b563-aea071370d78-konnectivity-ca\") pod \"konnectivity-agent-q4fjc\" (UID: \"46b88042-1753-4c68-b563-aea071370d78\") " pod="kube-system/konnectivity-agent-q4fjc" Jun 08 23:59:21.900146 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899378 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e80985b9-2bd7-4d72-8059-a32ce4290fe7-os-release\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.900146 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899406 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e80985b9-2bd7-4d72-8059-a32ce4290fe7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.900146 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899434 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-var-lib-kubelet\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.900146 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899439 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/24c10154-7f2b-4b8c-8000-2d4d7b781451-ovnkube-script-lib\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.900146 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899459 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-host-cni-bin\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.900146 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899474 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e80985b9-2bd7-4d72-8059-a32ce4290fe7-os-release\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.900146 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899513 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-host-cni-bin\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.901075 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899515 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-var-lib-kubelet\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.901075 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899556 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e27e1547-2a00-4410-aaf8-20f350f69220-sys-fs\") pod \"aws-ebs-csi-driver-node-m2n94\" (UID: \"e27e1547-2a00-4410-aaf8-20f350f69220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" Jun 08 23:59:21.901075 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899588 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-multus-conf-dir\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.901075 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899626 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-562kh\" (UniqueName: \"kubernetes.io/projected/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-kube-api-access-562kh\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.901075 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899649 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e80985b9-2bd7-4d72-8059-a32ce4290fe7-cnibin\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.901075 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899652 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e27e1547-2a00-4410-aaf8-20f350f69220-sys-fs\") pod \"aws-ebs-csi-driver-node-m2n94\" (UID: \"e27e1547-2a00-4410-aaf8-20f350f69220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" Jun 08 23:59:21.901075 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899672 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e80985b9-2bd7-4d72-8059-a32ce4290fe7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.901075 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899693 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-multus-conf-dir\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.901075 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899698 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmtk7\" (UniqueName: \"kubernetes.io/projected/1c75857e-660f-4c6b-a33d-6bd990f4089f-kube-api-access-qmtk7\") pod \"network-metrics-daemon-np4v6\" (UID: \"1c75857e-660f-4c6b-a33d-6bd990f4089f\") " pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:21.901075 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899739 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e80985b9-2bd7-4d72-8059-a32ce4290fe7-cnibin\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.901075 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899746 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-etc-systemd\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.901075 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899773 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-host-run-ovn-kubernetes\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.901075 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899798 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e27e1547-2a00-4410-aaf8-20f350f69220-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m2n94\" (UID: \"e27e1547-2a00-4410-aaf8-20f350f69220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" Jun 08 23:59:21.901075 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899820 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e27e1547-2a00-4410-aaf8-20f350f69220-device-dir\") pod \"aws-ebs-csi-driver-node-m2n94\" (UID: \"e27e1547-2a00-4410-aaf8-20f350f69220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" Jun 08 23:59:21.901075 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899843 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-host-var-lib-cni-multus\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.901075 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899849 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/46b88042-1753-4c68-b563-aea071370d78-konnectivity-ca\") pod \"konnectivity-agent-q4fjc\" (UID: \"46b88042-1753-4c68-b563-aea071370d78\") " pod="kube-system/konnectivity-agent-q4fjc" Jun 08 23:59:21.901075 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899866 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e80985b9-2bd7-4d72-8059-a32ce4290fe7-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.901961 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899873 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e80985b9-2bd7-4d72-8059-a32ce4290fe7-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.901961 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899870 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/63467802-5568-4564-b2ed-b70d3e63703a-dbus\") pod \"global-pull-secret-syncer-h7fk4\" (UID: \"63467802-5568-4564-b2ed-b70d3e63703a\") " pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:21.901961 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899904 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-host-run-ovn-kubernetes\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.901961 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899906 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-etc-systemd\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.901961 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899914 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-host-var-lib-cni-multus\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.901961 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899909 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd97edb7-dec0-40fc-85e0-9bb56a3e33eb-serviceca\") pod \"node-ca-vmc2d\" (UID: \"dd97edb7-dec0-40fc-85e0-9bb56a3e33eb\") " pod="openshift-image-registry/node-ca-vmc2d" Jun 08 23:59:21.901961 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899925 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e27e1547-2a00-4410-aaf8-20f350f69220-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m2n94\" (UID: \"e27e1547-2a00-4410-aaf8-20f350f69220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" Jun 08 23:59:21.901961 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899955 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e27e1547-2a00-4410-aaf8-20f350f69220-device-dir\") pod \"aws-ebs-csi-driver-node-m2n94\" (UID: \"e27e1547-2a00-4410-aaf8-20f350f69220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" Jun 08 23:59:21.901961 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899959 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-run-openvswitch\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.901961 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.899994 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/24c10154-7f2b-4b8c-8000-2d4d7b781451-ovn-node-metrics-cert\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.901961 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900018 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-run-openvswitch\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.901961 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900055 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-host-var-lib-kubelet\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.901961 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900098 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-host-var-lib-kubelet\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.901961 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900113 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fc8a5201-8e7a-42b6-ad42-fdeeae119065-etc-tuned\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.901961 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900139 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-host-slash\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.901961 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900163 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-run-systemd\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.901961 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900185 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2sz4\" (UniqueName: \"kubernetes.io/projected/6b0fff56-c56a-4650-afd0-ac7fd0e1a935-kube-api-access-k2sz4\") pod \"node-resolver-z9m44\" (UID: \"6b0fff56-c56a-4650-afd0-ac7fd0e1a935\") " pod="openshift-dns/node-resolver-z9m44" Jun 08 23:59:21.902814 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900209 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-etc-modprobe-d\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.902814 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900227 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-host-slash\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.902814 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900232 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-lib-modules\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.902814 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900263 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-system-cni-dir\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.902814 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900289 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-multus-socket-dir-parent\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.902814 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900311 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-hostroot\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.902814 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900330 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-lib-modules\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.902814 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900333 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfk5f\" (UniqueName: \"kubernetes.io/projected/e80985b9-2bd7-4d72-8059-a32ce4290fe7-kube-api-access-mfk5f\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.902814 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900366 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l47sg\" (UniqueName: \"kubernetes.io/projected/5ff57530-115c-4264-852d-fea35e4252f7-kube-api-access-l47sg\") pod \"iptables-alerter-wqgsf\" (UID: \"5ff57530-115c-4264-852d-fea35e4252f7\") " pod="openshift-network-operator/iptables-alerter-wqgsf" Jun 08 23:59:21.902814 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900395 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45kdp\" (UniqueName: \"kubernetes.io/projected/dd97edb7-dec0-40fc-85e0-9bb56a3e33eb-kube-api-access-45kdp\") pod \"node-ca-vmc2d\" (UID: \"dd97edb7-dec0-40fc-85e0-9bb56a3e33eb\") " pod="openshift-image-registry/node-ca-vmc2d" Jun 08 23:59:21.902814 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900423 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-etc-sysctl-conf\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.902814 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900446 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-run-ovn\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.902814 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900476 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-log-socket\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.902814 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900520 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/24c10154-7f2b-4b8c-8000-2d4d7b781451-ovnkube-config\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.902814 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900545 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b0fff56-c56a-4650-afd0-ac7fd0e1a935-hosts-file\") pod \"node-resolver-z9m44\" (UID: \"6b0fff56-c56a-4650-afd0-ac7fd0e1a935\") " pod="openshift-dns/node-resolver-z9m44" Jun 08 23:59:21.902814 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900552 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-system-cni-dir\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.902814 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900572 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-cnibin\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.902814 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900583 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-multus-socket-dir-parent\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.903340 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900599 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-host-run-k8s-cni-cncf-io\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.903340 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900635 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-hostroot\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.903340 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900640 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-etc-kubernetes\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.903340 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900672 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-host-run-netns\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.903340 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900687 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-etc-kubernetes\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.903340 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900695 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-log-socket\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.903340 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900698 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.903340 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900730 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-os-release\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.903340 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900753 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e80985b9-2bd7-4d72-8059-a32ce4290fe7-cni-binary-copy\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.903340 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900776 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5ff57530-115c-4264-852d-fea35e4252f7-iptables-alerter-script\") pod \"iptables-alerter-wqgsf\" (UID: \"5ff57530-115c-4264-852d-fea35e4252f7\") " pod="openshift-network-operator/iptables-alerter-wqgsf" Jun 08 23:59:21.903340 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900802 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-etc-sysctl-conf\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.903340 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900844 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-host-run-netns\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.903340 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900878 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.903340 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900920 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6b0fff56-c56a-4650-afd0-ac7fd0e1a935-hosts-file\") pod \"node-resolver-z9m44\" (UID: \"6b0fff56-c56a-4650-afd0-ac7fd0e1a935\") " pod="openshift-dns/node-resolver-z9m44" Jun 08 23:59:21.903340 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900928 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-cnibin\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.903340 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900967 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-host-run-k8s-cni-cncf-io\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.903340 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.900975 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-run-systemd\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.903340 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.901051 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-run-ovn\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.903887 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.901112 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-os-release\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.903887 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.901143 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/24c10154-7f2b-4b8c-8000-2d4d7b781451-ovnkube-config\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.903887 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.901224 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fc8a5201-8e7a-42b6-ad42-fdeeae119065-etc-modprobe-d\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.903887 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.901379 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ff57530-115c-4264-852d-fea35e4252f7-host-slash\") pod \"iptables-alerter-wqgsf\" (UID: \"5ff57530-115c-4264-852d-fea35e4252f7\") " pod="openshift-network-operator/iptables-alerter-wqgsf" Jun 08 23:59:21.903887 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.901412 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-node-log\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.903887 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.901442 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b0fff56-c56a-4650-afd0-ac7fd0e1a935-tmp-dir\") pod \"node-resolver-z9m44\" (UID: \"6b0fff56-c56a-4650-afd0-ac7fd0e1a935\") " pod="openshift-dns/node-resolver-z9m44" Jun 08 23:59:21.903887 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.901473 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r642m\" (UniqueName: \"kubernetes.io/projected/e27e1547-2a00-4410-aaf8-20f350f69220-kube-api-access-r642m\") pod \"aws-ebs-csi-driver-node-m2n94\" (UID: \"e27e1547-2a00-4410-aaf8-20f350f69220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" Jun 08 23:59:21.903887 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.901499 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/63467802-5568-4564-b2ed-b70d3e63703a-kubelet-config\") pod \"global-pull-secret-syncer-h7fk4\" (UID: \"63467802-5568-4564-b2ed-b70d3e63703a\") " pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:21.903887 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.901527 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4bdr\" (UniqueName: \"kubernetes.io/projected/fc8a5201-8e7a-42b6-ad42-fdeeae119065-kube-api-access-k4bdr\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.903887 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.901552 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtrqc\" (UniqueName: \"kubernetes.io/projected/24c10154-7f2b-4b8c-8000-2d4d7b781451-kube-api-access-wtrqc\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.903887 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.901578 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e27e1547-2a00-4410-aaf8-20f350f69220-registration-dir\") pod \"aws-ebs-csi-driver-node-m2n94\" (UID: \"e27e1547-2a00-4410-aaf8-20f350f69220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" Jun 08 23:59:21.903887 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.901639 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e27e1547-2a00-4410-aaf8-20f350f69220-etc-selinux\") pod \"aws-ebs-csi-driver-node-m2n94\" (UID: \"e27e1547-2a00-4410-aaf8-20f350f69220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" Jun 08 23:59:21.903887 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.901665 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-host-var-lib-cni-bin\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.903887 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.901690 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-host-run-multus-certs\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.903887 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.901715 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/46b88042-1753-4c68-b563-aea071370d78-agent-certs\") pod \"konnectivity-agent-q4fjc\" (UID: \"46b88042-1753-4c68-b563-aea071370d78\") " pod="kube-system/konnectivity-agent-q4fjc" Jun 08 23:59:21.903887 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.901731 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e80985b9-2bd7-4d72-8059-a32ce4290fe7-cni-binary-copy\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.903887 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.902045 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6b0fff56-c56a-4650-afd0-ac7fd0e1a935-tmp-dir\") pod \"node-resolver-z9m44\" (UID: \"6b0fff56-c56a-4650-afd0-ac7fd0e1a935\") " pod="openshift-dns/node-resolver-z9m44" Jun 08 23:59:21.904689 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.902372 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e27e1547-2a00-4410-aaf8-20f350f69220-etc-selinux\") pod \"aws-ebs-csi-driver-node-m2n94\" (UID: \"e27e1547-2a00-4410-aaf8-20f350f69220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" Jun 08 23:59:21.904689 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.902556 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e27e1547-2a00-4410-aaf8-20f350f69220-registration-dir\") pod \"aws-ebs-csi-driver-node-m2n94\" (UID: \"e27e1547-2a00-4410-aaf8-20f350f69220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" Jun 08 23:59:21.904689 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.902556 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-host-run-multus-certs\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.904689 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.902596 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-host-var-lib-cni-bin\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.904689 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.902661 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc8a5201-8e7a-42b6-ad42-fdeeae119065-tmp\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.904689 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.902722 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fc8a5201-8e7a-42b6-ad42-fdeeae119065-etc-tuned\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.904689 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.902735 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/24c10154-7f2b-4b8c-8000-2d4d7b781451-node-log\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.904689 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.903509 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/24c10154-7f2b-4b8c-8000-2d4d7b781451-ovn-node-metrics-cert\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.904689 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:21.904105 2515 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 23:59:21.904689 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:21.904127 2515 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 23:59:21.904689 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:21.904142 2515 projected.go:196] Error preparing data for projected volume kube-api-access-29c5g for pod openshift-network-diagnostics/network-check-target-pwl8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:21.904689 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:21.904224 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g podName:485792d6-e887-435c-a2cf-3dd55b769a7c nodeName:}" failed. No retries permitted until 2026-06-08 23:59:22.404201423 +0000 UTC m=+3.020265256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-29c5g" (UniqueName: "kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g") pod "network-check-target-pwl8g" (UID: "485792d6-e887-435c-a2cf-3dd55b769a7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:21.904689 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.904486 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/46b88042-1753-4c68-b563-aea071370d78-agent-certs\") pod \"konnectivity-agent-q4fjc\" (UID: \"46b88042-1753-4c68-b563-aea071370d78\") " pod="kube-system/konnectivity-agent-q4fjc" Jun 08 23:59:21.906464 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.906405 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-562kh\" (UniqueName: \"kubernetes.io/projected/44bcb831-f0a8-40bd-ab4a-44cbd680d9e5-kube-api-access-562kh\") pod \"multus-bmm98\" (UID: \"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5\") " pod="openshift-multus/multus-bmm98" Jun 08 23:59:21.907248 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.907231 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfk5f\" (UniqueName: \"kubernetes.io/projected/e80985b9-2bd7-4d72-8059-a32ce4290fe7-kube-api-access-mfk5f\") pod \"multus-additional-cni-plugins-pmqbj\" (UID: \"e80985b9-2bd7-4d72-8059-a32ce4290fe7\") " pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:21.907944 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.907920 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2sz4\" (UniqueName: \"kubernetes.io/projected/6b0fff56-c56a-4650-afd0-ac7fd0e1a935-kube-api-access-k2sz4\") pod \"node-resolver-z9m44\" (UID: \"6b0fff56-c56a-4650-afd0-ac7fd0e1a935\") " pod="openshift-dns/node-resolver-z9m44" Jun 08 23:59:21.909715 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.909696 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtrqc\" (UniqueName: \"kubernetes.io/projected/24c10154-7f2b-4b8c-8000-2d4d7b781451-kube-api-access-wtrqc\") pod \"ovnkube-node-hh52h\" (UID: \"24c10154-7f2b-4b8c-8000-2d4d7b781451\") " pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:21.910034 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.910015 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4bdr\" (UniqueName: \"kubernetes.io/projected/fc8a5201-8e7a-42b6-ad42-fdeeae119065-kube-api-access-k4bdr\") pod \"tuned-74nf2\" (UID: \"fc8a5201-8e7a-42b6-ad42-fdeeae119065\") " pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:21.910075 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:21.910051 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r642m\" (UniqueName: \"kubernetes.io/projected/e27e1547-2a00-4410-aaf8-20f350f69220-kube-api-access-r642m\") pod \"aws-ebs-csi-driver-node-m2n94\" (UID: \"e27e1547-2a00-4410-aaf8-20f350f69220\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" Jun 08 23:59:22.002324 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.002278 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l47sg\" (UniqueName: \"kubernetes.io/projected/5ff57530-115c-4264-852d-fea35e4252f7-kube-api-access-l47sg\") pod \"iptables-alerter-wqgsf\" (UID: \"5ff57530-115c-4264-852d-fea35e4252f7\") " pod="openshift-network-operator/iptables-alerter-wqgsf" Jun 08 23:59:22.002324 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.002317 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45kdp\" (UniqueName: \"kubernetes.io/projected/dd97edb7-dec0-40fc-85e0-9bb56a3e33eb-kube-api-access-45kdp\") pod \"node-ca-vmc2d\" (UID: \"dd97edb7-dec0-40fc-85e0-9bb56a3e33eb\") " pod="openshift-image-registry/node-ca-vmc2d" Jun 08 23:59:22.002564 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.002340 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5ff57530-115c-4264-852d-fea35e4252f7-iptables-alerter-script\") pod \"iptables-alerter-wqgsf\" (UID: \"5ff57530-115c-4264-852d-fea35e4252f7\") " pod="openshift-network-operator/iptables-alerter-wqgsf" Jun 08 23:59:22.002564 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.002355 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ff57530-115c-4264-852d-fea35e4252f7-host-slash\") pod \"iptables-alerter-wqgsf\" (UID: \"5ff57530-115c-4264-852d-fea35e4252f7\") " pod="openshift-network-operator/iptables-alerter-wqgsf" Jun 08 23:59:22.002564 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.002376 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/63467802-5568-4564-b2ed-b70d3e63703a-kubelet-config\") pod \"global-pull-secret-syncer-h7fk4\" (UID: \"63467802-5568-4564-b2ed-b70d3e63703a\") " pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:22.002564 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.002410 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs\") pod \"network-metrics-daemon-np4v6\" (UID: \"1c75857e-660f-4c6b-a33d-6bd990f4089f\") " pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:22.002564 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.002471 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5ff57530-115c-4264-852d-fea35e4252f7-host-slash\") pod \"iptables-alerter-wqgsf\" (UID: \"5ff57530-115c-4264-852d-fea35e4252f7\") " pod="openshift-network-operator/iptables-alerter-wqgsf" Jun 08 23:59:22.002564 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:22.002495 2515 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:22.002564 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.002504 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/63467802-5568-4564-b2ed-b70d3e63703a-kubelet-config\") pod \"global-pull-secret-syncer-h7fk4\" (UID: \"63467802-5568-4564-b2ed-b70d3e63703a\") " pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:22.002564 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:22.002560 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs podName:1c75857e-660f-4c6b-a33d-6bd990f4089f nodeName:}" failed. No retries permitted until 2026-06-08 23:59:22.502536383 +0000 UTC m=+3.118600219 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs") pod "network-metrics-daemon-np4v6" (UID: "1c75857e-660f-4c6b-a33d-6bd990f4089f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:22.002971 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.002576 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd97edb7-dec0-40fc-85e0-9bb56a3e33eb-host\") pod \"node-ca-vmc2d\" (UID: \"dd97edb7-dec0-40fc-85e0-9bb56a3e33eb\") " pod="openshift-image-registry/node-ca-vmc2d" Jun 08 23:59:22.002971 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.002634 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret\") pod \"global-pull-secret-syncer-h7fk4\" (UID: \"63467802-5568-4564-b2ed-b70d3e63703a\") " pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:22.002971 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.002663 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmtk7\" (UniqueName: \"kubernetes.io/projected/1c75857e-660f-4c6b-a33d-6bd990f4089f-kube-api-access-qmtk7\") pod \"network-metrics-daemon-np4v6\" (UID: \"1c75857e-660f-4c6b-a33d-6bd990f4089f\") " pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:22.002971 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.002686 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/63467802-5568-4564-b2ed-b70d3e63703a-dbus\") pod \"global-pull-secret-syncer-h7fk4\" (UID: \"63467802-5568-4564-b2ed-b70d3e63703a\") " pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:22.002971 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.002684 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dd97edb7-dec0-40fc-85e0-9bb56a3e33eb-host\") pod \"node-ca-vmc2d\" (UID: \"dd97edb7-dec0-40fc-85e0-9bb56a3e33eb\") " pod="openshift-image-registry/node-ca-vmc2d" Jun 08 23:59:22.002971 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.002709 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd97edb7-dec0-40fc-85e0-9bb56a3e33eb-serviceca\") pod \"node-ca-vmc2d\" (UID: \"dd97edb7-dec0-40fc-85e0-9bb56a3e33eb\") " pod="openshift-image-registry/node-ca-vmc2d" Jun 08 23:59:22.002971 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:22.002755 2515 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:22.002971 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:22.002823 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret podName:63467802-5568-4564-b2ed-b70d3e63703a nodeName:}" failed. No retries permitted until 2026-06-08 23:59:22.502803761 +0000 UTC m=+3.118867584 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret") pod "global-pull-secret-syncer-h7fk4" (UID: "63467802-5568-4564-b2ed-b70d3e63703a") : object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:22.002971 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.002953 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/63467802-5568-4564-b2ed-b70d3e63703a-dbus\") pod \"global-pull-secret-syncer-h7fk4\" (UID: \"63467802-5568-4564-b2ed-b70d3e63703a\") " pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:22.003327 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.003088 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5ff57530-115c-4264-852d-fea35e4252f7-iptables-alerter-script\") pod \"iptables-alerter-wqgsf\" (UID: \"5ff57530-115c-4264-852d-fea35e4252f7\") " pod="openshift-network-operator/iptables-alerter-wqgsf" Jun 08 23:59:22.003327 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.003217 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/dd97edb7-dec0-40fc-85e0-9bb56a3e33eb-serviceca\") pod \"node-ca-vmc2d\" (UID: \"dd97edb7-dec0-40fc-85e0-9bb56a3e33eb\") " pod="openshift-image-registry/node-ca-vmc2d" Jun 08 23:59:22.011622 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.011575 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmtk7\" (UniqueName: \"kubernetes.io/projected/1c75857e-660f-4c6b-a33d-6bd990f4089f-kube-api-access-qmtk7\") pod \"network-metrics-daemon-np4v6\" (UID: \"1c75857e-660f-4c6b-a33d-6bd990f4089f\") " pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:22.011769 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.011751 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l47sg\" (UniqueName: \"kubernetes.io/projected/5ff57530-115c-4264-852d-fea35e4252f7-kube-api-access-l47sg\") pod \"iptables-alerter-wqgsf\" (UID: \"5ff57530-115c-4264-852d-fea35e4252f7\") " pod="openshift-network-operator/iptables-alerter-wqgsf" Jun 08 23:59:22.011941 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.011916 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45kdp\" (UniqueName: \"kubernetes.io/projected/dd97edb7-dec0-40fc-85e0-9bb56a3e33eb-kube-api-access-45kdp\") pod \"node-ca-vmc2d\" (UID: \"dd97edb7-dec0-40fc-85e0-9bb56a3e33eb\") " pod="openshift-image-registry/node-ca-vmc2d" Jun 08 23:59:22.089149 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.089121 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-74nf2" Jun 08 23:59:22.095133 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.095111 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bmm98" Jun 08 23:59:22.104873 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.104854 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:22.111434 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.111413 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-z9m44" Jun 08 23:59:22.117940 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.117922 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-q4fjc" Jun 08 23:59:22.125436 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.125417 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" Jun 08 23:59:22.133065 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.133046 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pmqbj" Jun 08 23:59:22.140587 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.140567 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vmc2d" Jun 08 23:59:22.146145 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.146129 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wqgsf" Jun 08 23:59:22.279917 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.279849 2515 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 23:59:22.406824 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.406800 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29c5g\" (UniqueName: \"kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g\") pod \"network-check-target-pwl8g\" (UID: \"485792d6-e887-435c-a2cf-3dd55b769a7c\") " pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:22.406989 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:22.406976 2515 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 23:59:22.407049 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:22.407000 2515 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 23:59:22.407049 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:22.407011 2515 projected.go:196] Error preparing data for projected volume kube-api-access-29c5g for pod openshift-network-diagnostics/network-check-target-pwl8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:22.407174 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:22.407080 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g podName:485792d6-e887-435c-a2cf-3dd55b769a7c nodeName:}" failed. No retries permitted until 2026-06-08 23:59:23.407060091 +0000 UTC m=+4.023123908 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-29c5g" (UniqueName: "kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g") pod "network-check-target-pwl8g" (UID: "485792d6-e887-435c-a2cf-3dd55b769a7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:22.508133 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.508096 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret\") pod \"global-pull-secret-syncer-h7fk4\" (UID: \"63467802-5568-4564-b2ed-b70d3e63703a\") " pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:22.508312 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.508159 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs\") pod \"network-metrics-daemon-np4v6\" (UID: \"1c75857e-660f-4c6b-a33d-6bd990f4089f\") " pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:22.508312 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:22.508254 2515 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:22.508312 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:22.508256 2515 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:22.508312 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:22.508313 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs podName:1c75857e-660f-4c6b-a33d-6bd990f4089f nodeName:}" failed. No retries permitted until 2026-06-08 23:59:23.508293115 +0000 UTC m=+4.124356931 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs") pod "network-metrics-daemon-np4v6" (UID: "1c75857e-660f-4c6b-a33d-6bd990f4089f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:22.508477 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:22.508329 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret podName:63467802-5568-4564-b2ed-b70d3e63703a nodeName:}" failed. No retries permitted until 2026-06-08 23:59:23.508322262 +0000 UTC m=+4.124386076 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret") pod "global-pull-secret-syncer-h7fk4" (UID: "63467802-5568-4564-b2ed-b70d3e63703a") : object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:22.560859 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:22.560831 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode80985b9_2bd7_4d72_8059_a32ce4290fe7.slice/crio-5cc6d7f7db189e1aaba1abab8ed91b86d2914b77e31611de7822a0c803d95ff7 WatchSource:0}: Error finding container 5cc6d7f7db189e1aaba1abab8ed91b86d2914b77e31611de7822a0c803d95ff7: Status 404 returned error can't find the container with id 5cc6d7f7db189e1aaba1abab8ed91b86d2914b77e31611de7822a0c803d95ff7 Jun 08 23:59:22.561934 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:22.561906 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc8a5201_8e7a_42b6_ad42_fdeeae119065.slice/crio-3cca92f3b8afda0e0938f1dbe17fca63619f6ba8fdceaccbfc30453f676b6ca0 WatchSource:0}: Error finding container 3cca92f3b8afda0e0938f1dbe17fca63619f6ba8fdceaccbfc30453f676b6ca0: Status 404 returned error can't find the container with id 3cca92f3b8afda0e0938f1dbe17fca63619f6ba8fdceaccbfc30453f676b6ca0 Jun 08 23:59:22.563501 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:22.563437 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b0fff56_c56a_4650_afd0_ac7fd0e1a935.slice/crio-775e38abf4e48071028edbbdb54282144ed592ba9a9ca01a5765d2c87fe8467f WatchSource:0}: Error finding container 775e38abf4e48071028edbbdb54282144ed592ba9a9ca01a5765d2c87fe8467f: Status 404 returned error can't find the container with id 775e38abf4e48071028edbbdb54282144ed592ba9a9ca01a5765d2c87fe8467f Jun 08 23:59:22.567102 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:22.567084 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24c10154_7f2b_4b8c_8000_2d4d7b781451.slice/crio-4a14d576133977f642a5a281035659ee9614d9b2d84818a9945bc29258ecf6c5 WatchSource:0}: Error finding container 4a14d576133977f642a5a281035659ee9614d9b2d84818a9945bc29258ecf6c5: Status 404 returned error can't find the container with id 4a14d576133977f642a5a281035659ee9614d9b2d84818a9945bc29258ecf6c5 Jun 08 23:59:22.568697 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:22.568646 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44bcb831_f0a8_40bd_ab4a_44cbd680d9e5.slice/crio-b40a7f5f6cec70d05747fea1cc0f0079190c3c9efc257bc120b4cbe918ca32c7 WatchSource:0}: Error finding container b40a7f5f6cec70d05747fea1cc0f0079190c3c9efc257bc120b4cbe918ca32c7: Status 404 returned error can't find the container with id b40a7f5f6cec70d05747fea1cc0f0079190c3c9efc257bc120b4cbe918ca32c7 Jun 08 23:59:22.569956 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:22.569934 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46b88042_1753_4c68_b563_aea071370d78.slice/crio-6900c96ad608a54fef0f7b52f95ef32746d6a187f6011dfc3a3697384fc75c86 WatchSource:0}: Error finding container 6900c96ad608a54fef0f7b52f95ef32746d6a187f6011dfc3a3697384fc75c86: Status 404 returned error can't find the container with id 6900c96ad608a54fef0f7b52f95ef32746d6a187f6011dfc3a3697384fc75c86 Jun 08 23:59:22.571524 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:22.571502 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ff57530_115c_4264_852d_fea35e4252f7.slice/crio-7f679d5958bbc90ea2f2ebb9f521c0bdf44e2e74a56350f98b1f07931d7f3bf1 WatchSource:0}: Error finding container 7f679d5958bbc90ea2f2ebb9f521c0bdf44e2e74a56350f98b1f07931d7f3bf1: Status 404 returned error can't find the container with id 7f679d5958bbc90ea2f2ebb9f521c0bdf44e2e74a56350f98b1f07931d7f3bf1 Jun 08 23:59:22.573010 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:22.572962 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd97edb7_dec0_40fc_85e0_9bb56a3e33eb.slice/crio-1902074c37810aacacbc48f22e40395067aac19749bd53257e080a9f985ca90e WatchSource:0}: Error finding container 1902074c37810aacacbc48f22e40395067aac19749bd53257e080a9f985ca90e: Status 404 returned error can't find the container with id 1902074c37810aacacbc48f22e40395067aac19749bd53257e080a9f985ca90e Jun 08 23:59:22.574440 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:22.574179 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode27e1547_2a00_4410_aaf8_20f350f69220.slice/crio-9936a7c3531271d060dfd919e1d2bcf210e87ad4ae86e77faf5f199e54b62785 WatchSource:0}: Error finding container 9936a7c3531271d060dfd919e1d2bcf210e87ad4ae86e77faf5f199e54b62785: Status 404 returned error can't find the container with id 9936a7c3531271d060dfd919e1d2bcf210e87ad4ae86e77faf5f199e54b62785 Jun 08 23:59:22.824305 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.824269 2515 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 23:54:21 +0000 UTC" deadline="2028-02-08 09:55:55.014340798 +0000 UTC" Jun 08 23:59:22.824305 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.824307 2515 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14625h56m32.190039801s" Jun 08 23:59:22.865497 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.865466 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bmm98" event={"ID":"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5","Type":"ContainerStarted","Data":"b40a7f5f6cec70d05747fea1cc0f0079190c3c9efc257bc120b4cbe918ca32c7"} Jun 08 23:59:22.866822 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.866786 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" event={"ID":"24c10154-7f2b-4b8c-8000-2d4d7b781451","Type":"ContainerStarted","Data":"4a14d576133977f642a5a281035659ee9614d9b2d84818a9945bc29258ecf6c5"} Jun 08 23:59:22.868018 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.867993 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-74nf2" event={"ID":"fc8a5201-8e7a-42b6-ad42-fdeeae119065","Type":"ContainerStarted","Data":"3cca92f3b8afda0e0938f1dbe17fca63619f6ba8fdceaccbfc30453f676b6ca0"} Jun 08 23:59:22.869253 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.869219 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pmqbj" event={"ID":"e80985b9-2bd7-4d72-8059-a32ce4290fe7","Type":"ContainerStarted","Data":"5cc6d7f7db189e1aaba1abab8ed91b86d2914b77e31611de7822a0c803d95ff7"} Jun 08 23:59:22.871115 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.871090 2515 generic.go:356] "Generic (PLEG): container finished" podID="f95ebfa4383488cee2a65aa0620795f3" containerID="d0752061e3fa1ffeb07209bc7536b9f4ae4a7dc6d6456ca5a06acd93fd3ee8d0" exitCode=0 Jun 08 23:59:22.871207 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.871159 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-4.ec2.internal" event={"ID":"f95ebfa4383488cee2a65aa0620795f3","Type":"ContainerDied","Data":"d0752061e3fa1ffeb07209bc7536b9f4ae4a7dc6d6456ca5a06acd93fd3ee8d0"} Jun 08 23:59:22.872447 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.872426 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" event={"ID":"e27e1547-2a00-4410-aaf8-20f350f69220","Type":"ContainerStarted","Data":"9936a7c3531271d060dfd919e1d2bcf210e87ad4ae86e77faf5f199e54b62785"} Jun 08 23:59:22.873579 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.873557 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z9m44" event={"ID":"6b0fff56-c56a-4650-afd0-ac7fd0e1a935","Type":"ContainerStarted","Data":"775e38abf4e48071028edbbdb54282144ed592ba9a9ca01a5765d2c87fe8467f"} Jun 08 23:59:22.875159 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.875107 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-4.ec2.internal" event={"ID":"2c664d5f65d16a479fdf40d82fa5ea09","Type":"ContainerStarted","Data":"ec4e9278f7f11156273cf3913534ce9045a587000c9967724b7131f7858383f6"} Jun 08 23:59:22.876385 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.876362 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vmc2d" event={"ID":"dd97edb7-dec0-40fc-85e0-9bb56a3e33eb","Type":"ContainerStarted","Data":"1902074c37810aacacbc48f22e40395067aac19749bd53257e080a9f985ca90e"} Jun 08 23:59:22.877653 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.877595 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wqgsf" event={"ID":"5ff57530-115c-4264-852d-fea35e4252f7","Type":"ContainerStarted","Data":"7f679d5958bbc90ea2f2ebb9f521c0bdf44e2e74a56350f98b1f07931d7f3bf1"} Jun 08 23:59:22.878732 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.878713 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q4fjc" event={"ID":"46b88042-1753-4c68-b563-aea071370d78","Type":"ContainerStarted","Data":"6900c96ad608a54fef0f7b52f95ef32746d6a187f6011dfc3a3697384fc75c86"} Jun 08 23:59:22.901302 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:22.901244 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-4.ec2.internal" podStartSLOduration=2.901223869 podStartE2EDuration="2.901223869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:22.897512439 +0000 UTC m=+3.513576276" watchObservedRunningTime="2026-06-08 23:59:22.901223869 +0000 UTC m=+3.517288003" Jun 08 23:59:23.414554 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:23.414517 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29c5g\" (UniqueName: \"kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g\") pod \"network-check-target-pwl8g\" (UID: \"485792d6-e887-435c-a2cf-3dd55b769a7c\") " pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:23.414755 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:23.414709 2515 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 23:59:23.414755 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:23.414731 2515 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 23:59:23.414755 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:23.414744 2515 projected.go:196] Error preparing data for projected volume kube-api-access-29c5g for pod openshift-network-diagnostics/network-check-target-pwl8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:23.414914 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:23.414802 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g podName:485792d6-e887-435c-a2cf-3dd55b769a7c nodeName:}" failed. No retries permitted until 2026-06-08 23:59:25.414784153 +0000 UTC m=+6.030847981 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-29c5g" (UniqueName: "kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g") pod "network-check-target-pwl8g" (UID: "485792d6-e887-435c-a2cf-3dd55b769a7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:23.514931 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:23.514881 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs\") pod \"network-metrics-daemon-np4v6\" (UID: \"1c75857e-660f-4c6b-a33d-6bd990f4089f\") " pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:23.515108 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:23.514963 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret\") pod \"global-pull-secret-syncer-h7fk4\" (UID: \"63467802-5568-4564-b2ed-b70d3e63703a\") " pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:23.515175 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:23.515116 2515 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:23.515232 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:23.515176 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret podName:63467802-5568-4564-b2ed-b70d3e63703a nodeName:}" failed. No retries permitted until 2026-06-08 23:59:25.515158188 +0000 UTC m=+6.131222017 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret") pod "global-pull-secret-syncer-h7fk4" (UID: "63467802-5568-4564-b2ed-b70d3e63703a") : object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:23.515289 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:23.515248 2515 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:23.515289 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:23.515282 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs podName:1c75857e-660f-4c6b-a33d-6bd990f4089f nodeName:}" failed. No retries permitted until 2026-06-08 23:59:25.515270563 +0000 UTC m=+6.131334381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs") pod "network-metrics-daemon-np4v6" (UID: "1c75857e-660f-4c6b-a33d-6bd990f4089f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:23.825295 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:23.825174 2515 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 23:54:21 +0000 UTC" deadline="2027-12-30 21:19:52.331397749 +0000 UTC" Jun 08 23:59:23.825295 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:23.825238 2515 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13677h20m28.50616417s" Jun 08 23:59:23.860762 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:23.859968 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:23.860762 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:23.860094 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-np4v6" podUID="1c75857e-660f-4c6b-a33d-6bd990f4089f" Jun 08 23:59:23.860762 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:23.860464 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:23.860762 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:23.860551 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pwl8g" podUID="485792d6-e887-435c-a2cf-3dd55b769a7c" Jun 08 23:59:23.861405 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:23.861199 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:23.861405 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:23.861299 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7fk4" podUID="63467802-5568-4564-b2ed-b70d3e63703a" Jun 08 23:59:23.890727 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:23.890671 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-4.ec2.internal" event={"ID":"f95ebfa4383488cee2a65aa0620795f3","Type":"ContainerStarted","Data":"30967ed28ef9531d8062c4eb94cfb0e65d69a45568072c9f6d368c3d3c850e64"} Jun 08 23:59:23.904410 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:23.904353 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-4.ec2.internal" podStartSLOduration=3.904333114 podStartE2EDuration="3.904333114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:23.903882279 +0000 UTC m=+4.519946115" watchObservedRunningTime="2026-06-08 23:59:23.904333114 +0000 UTC m=+4.520396953" Jun 08 23:59:25.430880 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:25.429830 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29c5g\" (UniqueName: \"kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g\") pod \"network-check-target-pwl8g\" (UID: \"485792d6-e887-435c-a2cf-3dd55b769a7c\") " pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:25.430880 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:25.430044 2515 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 23:59:25.430880 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:25.430066 2515 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 23:59:25.430880 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:25.430079 2515 projected.go:196] Error preparing data for projected volume kube-api-access-29c5g for pod openshift-network-diagnostics/network-check-target-pwl8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:25.430880 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:25.430135 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g podName:485792d6-e887-435c-a2cf-3dd55b769a7c nodeName:}" failed. No retries permitted until 2026-06-08 23:59:29.430117126 +0000 UTC m=+10.046180944 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-29c5g" (UniqueName: "kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g") pod "network-check-target-pwl8g" (UID: "485792d6-e887-435c-a2cf-3dd55b769a7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:25.531043 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:25.531004 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs\") pod \"network-metrics-daemon-np4v6\" (UID: \"1c75857e-660f-4c6b-a33d-6bd990f4089f\") " pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:25.531222 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:25.531074 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret\") pod \"global-pull-secret-syncer-h7fk4\" (UID: \"63467802-5568-4564-b2ed-b70d3e63703a\") " pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:25.531222 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:25.531209 2515 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:25.531333 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:25.531270 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret podName:63467802-5568-4564-b2ed-b70d3e63703a nodeName:}" failed. No retries permitted until 2026-06-08 23:59:29.53124978 +0000 UTC m=+10.147313597 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret") pod "global-pull-secret-syncer-h7fk4" (UID: "63467802-5568-4564-b2ed-b70d3e63703a") : object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:25.531394 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:25.531340 2515 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:25.531394 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:25.531378 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs podName:1c75857e-660f-4c6b-a33d-6bd990f4089f nodeName:}" failed. No retries permitted until 2026-06-08 23:59:29.531365795 +0000 UTC m=+10.147429613 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs") pod "network-metrics-daemon-np4v6" (UID: "1c75857e-660f-4c6b-a33d-6bd990f4089f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:25.858099 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:25.858008 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:25.858250 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:25.858150 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pwl8g" podUID="485792d6-e887-435c-a2cf-3dd55b769a7c" Jun 08 23:59:25.858250 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:25.858168 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:25.858349 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:25.858274 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7fk4" podUID="63467802-5568-4564-b2ed-b70d3e63703a" Jun 08 23:59:25.858440 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:25.858422 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:25.858539 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:25.858520 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-np4v6" podUID="1c75857e-660f-4c6b-a33d-6bd990f4089f" Jun 08 23:59:27.857405 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:27.857374 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:27.857815 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:27.857501 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pwl8g" podUID="485792d6-e887-435c-a2cf-3dd55b769a7c" Jun 08 23:59:27.857815 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:27.857569 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:27.857815 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:27.857692 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7fk4" podUID="63467802-5568-4564-b2ed-b70d3e63703a" Jun 08 23:59:27.857815 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:27.857751 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:27.858038 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:27.857871 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-np4v6" podUID="1c75857e-660f-4c6b-a33d-6bd990f4089f" Jun 08 23:59:29.466071 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:29.465413 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29c5g\" (UniqueName: \"kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g\") pod \"network-check-target-pwl8g\" (UID: \"485792d6-e887-435c-a2cf-3dd55b769a7c\") " pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:29.466071 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:29.465646 2515 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 23:59:29.466071 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:29.465669 2515 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 23:59:29.466071 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:29.465682 2515 projected.go:196] Error preparing data for projected volume kube-api-access-29c5g for pod openshift-network-diagnostics/network-check-target-pwl8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:29.466071 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:29.465737 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g podName:485792d6-e887-435c-a2cf-3dd55b769a7c nodeName:}" failed. No retries permitted until 2026-06-08 23:59:37.465719394 +0000 UTC m=+18.081783210 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-29c5g" (UniqueName: "kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g") pod "network-check-target-pwl8g" (UID: "485792d6-e887-435c-a2cf-3dd55b769a7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:29.566004 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:29.565962 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs\") pod \"network-metrics-daemon-np4v6\" (UID: \"1c75857e-660f-4c6b-a33d-6bd990f4089f\") " pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:29.566170 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:29.566028 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret\") pod \"global-pull-secret-syncer-h7fk4\" (UID: \"63467802-5568-4564-b2ed-b70d3e63703a\") " pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:29.566170 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:29.566144 2515 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:29.566170 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:29.566167 2515 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:29.566358 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:29.566211 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret podName:63467802-5568-4564-b2ed-b70d3e63703a nodeName:}" failed. No retries permitted until 2026-06-08 23:59:37.566192333 +0000 UTC m=+18.182256147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret") pod "global-pull-secret-syncer-h7fk4" (UID: "63467802-5568-4564-b2ed-b70d3e63703a") : object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:29.566358 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:29.566229 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs podName:1c75857e-660f-4c6b-a33d-6bd990f4089f nodeName:}" failed. No retries permitted until 2026-06-08 23:59:37.566219349 +0000 UTC m=+18.182283166 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs") pod "network-metrics-daemon-np4v6" (UID: "1c75857e-660f-4c6b-a33d-6bd990f4089f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:29.858297 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:29.857766 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:29.858297 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:29.857889 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7fk4" podUID="63467802-5568-4564-b2ed-b70d3e63703a" Jun 08 23:59:29.858297 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:29.858121 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:29.859630 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:29.859458 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-np4v6" podUID="1c75857e-660f-4c6b-a33d-6bd990f4089f" Jun 08 23:59:29.859630 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:29.859518 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:29.859786 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:29.859637 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pwl8g" podUID="485792d6-e887-435c-a2cf-3dd55b769a7c" Jun 08 23:59:31.857282 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:31.857243 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:31.857745 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:31.857295 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:31.857745 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:31.857243 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:31.857745 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:31.857386 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pwl8g" podUID="485792d6-e887-435c-a2cf-3dd55b769a7c" Jun 08 23:59:31.857745 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:31.857480 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7fk4" podUID="63467802-5568-4564-b2ed-b70d3e63703a" Jun 08 23:59:31.857745 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:31.857558 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-np4v6" podUID="1c75857e-660f-4c6b-a33d-6bd990f4089f" Jun 08 23:59:33.857732 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:33.857700 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:33.858172 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:33.857700 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:33.858172 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:33.857842 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-np4v6" podUID="1c75857e-660f-4c6b-a33d-6bd990f4089f" Jun 08 23:59:33.858172 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:33.857892 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pwl8g" podUID="485792d6-e887-435c-a2cf-3dd55b769a7c" Jun 08 23:59:33.858172 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:33.857709 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:33.858172 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:33.857969 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7fk4" podUID="63467802-5568-4564-b2ed-b70d3e63703a" Jun 08 23:59:35.858495 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:35.858098 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:35.858495 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:35.858098 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:35.858495 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:35.858226 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7fk4" podUID="63467802-5568-4564-b2ed-b70d3e63703a" Jun 08 23:59:35.858495 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:35.858098 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:35.858495 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:35.858294 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pwl8g" podUID="485792d6-e887-435c-a2cf-3dd55b769a7c" Jun 08 23:59:35.858495 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:35.858416 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-np4v6" podUID="1c75857e-660f-4c6b-a33d-6bd990f4089f" Jun 08 23:59:37.530527 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:37.530445 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29c5g\" (UniqueName: \"kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g\") pod \"network-check-target-pwl8g\" (UID: \"485792d6-e887-435c-a2cf-3dd55b769a7c\") " pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:37.530957 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:37.530615 2515 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 23:59:37.530957 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:37.530632 2515 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 23:59:37.530957 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:37.530641 2515 projected.go:196] Error preparing data for projected volume kube-api-access-29c5g for pod openshift-network-diagnostics/network-check-target-pwl8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:37.530957 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:37.530695 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g podName:485792d6-e887-435c-a2cf-3dd55b769a7c nodeName:}" failed. No retries permitted until 2026-06-08 23:59:53.530677918 +0000 UTC m=+34.146741749 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-29c5g" (UniqueName: "kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g") pod "network-check-target-pwl8g" (UID: "485792d6-e887-435c-a2cf-3dd55b769a7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:37.631409 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:37.631377 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs\") pod \"network-metrics-daemon-np4v6\" (UID: \"1c75857e-660f-4c6b-a33d-6bd990f4089f\") " pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:37.631577 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:37.631439 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret\") pod \"global-pull-secret-syncer-h7fk4\" (UID: \"63467802-5568-4564-b2ed-b70d3e63703a\") " pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:37.631577 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:37.631559 2515 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:37.631771 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:37.631643 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret podName:63467802-5568-4564-b2ed-b70d3e63703a nodeName:}" failed. No retries permitted until 2026-06-08 23:59:53.631623673 +0000 UTC m=+34.247687493 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret") pod "global-pull-secret-syncer-h7fk4" (UID: "63467802-5568-4564-b2ed-b70d3e63703a") : object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:37.631771 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:37.631747 2515 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:37.631882 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:37.631842 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs podName:1c75857e-660f-4c6b-a33d-6bd990f4089f nodeName:}" failed. No retries permitted until 2026-06-08 23:59:53.631797263 +0000 UTC m=+34.247861085 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs") pod "network-metrics-daemon-np4v6" (UID: "1c75857e-660f-4c6b-a33d-6bd990f4089f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:37.858241 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:37.858155 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:37.858404 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:37.858155 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:37.858404 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:37.858290 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-np4v6" podUID="1c75857e-660f-4c6b-a33d-6bd990f4089f" Jun 08 23:59:37.858404 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:37.858155 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:37.858404 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:37.858367 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7fk4" podUID="63467802-5568-4564-b2ed-b70d3e63703a" Jun 08 23:59:37.858639 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:37.858428 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pwl8g" podUID="485792d6-e887-435c-a2cf-3dd55b769a7c" Jun 08 23:59:39.858097 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:39.858065 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:39.858553 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:39.858161 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7fk4" podUID="63467802-5568-4564-b2ed-b70d3e63703a" Jun 08 23:59:39.858553 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:39.858245 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:39.858553 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:39.858366 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-np4v6" podUID="1c75857e-660f-4c6b-a33d-6bd990f4089f" Jun 08 23:59:39.858553 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:39.858387 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:39.858553 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:39.858471 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pwl8g" podUID="485792d6-e887-435c-a2cf-3dd55b769a7c" Jun 08 23:59:41.858242 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:41.857947 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:41.858892 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:41.857948 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:41.858892 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:41.858013 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:41.858892 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:41.858331 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pwl8g" podUID="485792d6-e887-435c-a2cf-3dd55b769a7c" Jun 08 23:59:41.858892 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:41.858719 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7fk4" podUID="63467802-5568-4564-b2ed-b70d3e63703a" Jun 08 23:59:41.859079 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:41.858957 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-np4v6" podUID="1c75857e-660f-4c6b-a33d-6bd990f4089f" Jun 08 23:59:41.935038 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:41.935009 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" event={"ID":"e27e1547-2a00-4410-aaf8-20f350f69220","Type":"ContainerStarted","Data":"c55d624d3ae5ca57612e5cf5a38204092728491f3a00799111833f4d28d78be0"} Jun 08 23:59:41.936458 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:41.936433 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-z9m44" event={"ID":"6b0fff56-c56a-4650-afd0-ac7fd0e1a935","Type":"ContainerStarted","Data":"447ace08bcf538f1c7fa79fcceebba19a827bc56f35b425b8ef5337ec8e62167"} Jun 08 23:59:41.937853 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:41.937832 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vmc2d" event={"ID":"dd97edb7-dec0-40fc-85e0-9bb56a3e33eb","Type":"ContainerStarted","Data":"ccb778b7decfd59a930c93ea4607cd9edf4181515780ccc49a21c10349b7868f"} Jun 08 23:59:41.939048 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:41.939024 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-q4fjc" event={"ID":"46b88042-1753-4c68-b563-aea071370d78","Type":"ContainerStarted","Data":"a97758a60a6baa99687fe64234d15750c24dea9d2cd4d3297f42df76a8b4e654"} Jun 08 23:59:41.939384 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:41.939368 2515 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-q4fjc" Jun 08 23:59:41.939883 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:41.939865 2515 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-q4fjc" Jun 08 23:59:41.940396 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:41.940380 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bmm98" event={"ID":"44bcb831-f0a8-40bd-ab4a-44cbd680d9e5","Type":"ContainerStarted","Data":"1b39c6c0b0c33f06714da056fc7934c7d6fe19b3cbafacabc9320d55e50d0eca"} Jun 08 23:59:41.942561 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:41.942542 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" event={"ID":"24c10154-7f2b-4b8c-8000-2d4d7b781451","Type":"ContainerStarted","Data":"e1698aa2fe0d4c4fa4b576f7d80bb32f05f2249af2c74ede6b4aa1555e04e15f"} Jun 08 23:59:41.942659 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:41.942592 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" event={"ID":"24c10154-7f2b-4b8c-8000-2d4d7b781451","Type":"ContainerStarted","Data":"cfb19db0b4f304d7dd6752d5def4fbb0c9bc7ec2ae29f09063ee1cfa510d8fea"} Jun 08 23:59:41.942659 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:41.942650 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" event={"ID":"24c10154-7f2b-4b8c-8000-2d4d7b781451","Type":"ContainerStarted","Data":"e5495245ef006348a83b1468eded88bf923149b60f3a81e8f700ed88f8ddc3df"} Jun 08 23:59:41.942749 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:41.942680 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" event={"ID":"24c10154-7f2b-4b8c-8000-2d4d7b781451","Type":"ContainerStarted","Data":"6b0c06b2edd9e4183081dfebe7637331c9b56326f58e63e575ae04d7d656ee52"} Jun 08 23:59:41.943719 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:41.943701 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-74nf2" event={"ID":"fc8a5201-8e7a-42b6-ad42-fdeeae119065","Type":"ContainerStarted","Data":"1d1ed0955b6550c0b2a7da0c201973a80914fc8b10333a639d059c460f998523"} Jun 08 23:59:41.944808 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:41.944790 2515 generic.go:356] "Generic (PLEG): container finished" podID="e80985b9-2bd7-4d72-8059-a32ce4290fe7" containerID="8f0fd1ba8cf85c3ddb36ad0b3608df033a4224135c9c055f305f8f19f430bfd8" exitCode=0 Jun 08 23:59:41.944875 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:41.944815 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pmqbj" event={"ID":"e80985b9-2bd7-4d72-8059-a32ce4290fe7","Type":"ContainerDied","Data":"8f0fd1ba8cf85c3ddb36ad0b3608df033a4224135c9c055f305f8f19f430bfd8"} Jun 08 23:59:41.949464 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:41.949432 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-z9m44" podStartSLOduration=4.120577729 podStartE2EDuration="22.949421913s" totalImagesPullingTime="18.828844184s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:41.949115703 +0000 UTC m=+22.565179535" watchObservedRunningTime="2026-06-08 23:59:41.949421913 +0000 UTC m=+22.565485748" Jun 08 23:59:41.963524 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:41.963477 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-74nf2" podStartSLOduration=4.110249399 podStartE2EDuration="22.963457978s" totalImagesPullingTime="18.853208579s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:41.963237486 +0000 UTC m=+22.579301321" watchObservedRunningTime="2026-06-08 23:59:41.963457978 +0000 UTC m=+22.579521816" Jun 08 23:59:41.976283 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:41.976241 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-q4fjc" podStartSLOduration=8.306427382 podStartE2EDuration="22.976223683s" totalImagesPullingTime="14.669796301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 23:59:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:41.975861379 +0000 UTC m=+22.591925216" watchObservedRunningTime="2026-06-08 23:59:41.976223683 +0000 UTC m=+22.592287521" Jun 08 23:59:41.991027 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:41.990992 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bmm98" podStartSLOduration=4.102798057 podStartE2EDuration="22.990977726s" totalImagesPullingTime="18.888179669s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:41.990938551 +0000 UTC m=+22.607002395" watchObservedRunningTime="2026-06-08 23:59:41.990977726 +0000 UTC m=+22.607041561" Jun 08 23:59:42.024918 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:42.024884 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vmc2d" podStartSLOduration=3.183740559 podStartE2EDuration="22.024865895s" totalImagesPullingTime="18.841125336s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:42.024614062 +0000 UTC m=+22.640677911" watchObservedRunningTime="2026-06-08 23:59:42.024865895 +0000 UTC m=+22.640929730" Jun 08 23:59:42.854049 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:42.854026 2515 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 23:59:42.857107 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:42.857008 2515 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T23:59:42.854044025Z","UUID":"54417a4c-b024-4f47-92a3-c3d9868ac975","Handler":null,"Name":"","Endpoint":""} Jun 08 23:59:42.858699 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:42.858672 2515 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 23:59:42.859043 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:42.858710 2515 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 23:59:42.949705 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:42.949443 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" event={"ID":"e27e1547-2a00-4410-aaf8-20f350f69220","Type":"ContainerStarted","Data":"4859c2ae1e25ad6219c6e9bd6c6cb6c7ce3b3f2e56b0ad60f3c23768e8634b66"} Jun 08 23:59:42.953324 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:42.953296 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wqgsf" event={"ID":"5ff57530-115c-4264-852d-fea35e4252f7","Type":"ContainerStarted","Data":"abcc27395d2363f1e27dd8182349678c7f84299891fa10e76d52f4d700321189"} Jun 08 23:59:42.957050 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:42.957020 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" event={"ID":"24c10154-7f2b-4b8c-8000-2d4d7b781451","Type":"ContainerStarted","Data":"9b3e65d3fea5f370bb0b3b77c37d33600ead33e4cdf4c2606d0f61983f6baf01"} Jun 08 23:59:42.957165 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:42.957097 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" event={"ID":"24c10154-7f2b-4b8c-8000-2d4d7b781451","Type":"ContainerStarted","Data":"39a91d4dcb2edf6913b10d0a122c37dda96794d4d3af5a98fc17deaa6692c5d8"} Jun 08 23:59:42.957683 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:42.957663 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-q4fjc" Jun 08 23:59:42.957777 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:42.957721 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-q4fjc" Jun 08 23:59:42.966801 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:42.966762 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wqgsf" podStartSLOduration=4.124156283 podStartE2EDuration="22.966747968s" totalImagesPullingTime="18.842591685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:42.966383842 +0000 UTC m=+23.582447678" watchObservedRunningTime="2026-06-08 23:59:42.966747968 +0000 UTC m=+23.582811818" Jun 08 23:59:43.858003 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:43.857970 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:43.858295 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:43.857975 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:43.858295 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:43.858112 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-np4v6" podUID="1c75857e-660f-4c6b-a33d-6bd990f4089f" Jun 08 23:59:43.858295 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:43.858174 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pwl8g" podUID="485792d6-e887-435c-a2cf-3dd55b769a7c" Jun 08 23:59:43.858295 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:43.857976 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:43.858295 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:43.858269 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7fk4" podUID="63467802-5568-4564-b2ed-b70d3e63703a" Jun 08 23:59:44.966224 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:44.966031 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" event={"ID":"24c10154-7f2b-4b8c-8000-2d4d7b781451","Type":"ContainerStarted","Data":"22800010bd80b773d24b9d23d3a94633661df65796d4dd62a6c19d4ad3732ac7"} Jun 08 23:59:44.968426 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:44.968402 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" event={"ID":"e27e1547-2a00-4410-aaf8-20f350f69220","Type":"ContainerStarted","Data":"ed13aea5b37b3d99369856b67621e3f1b9eaf27553d9c34f070ab45ecb94d91e"} Jun 08 23:59:44.986112 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:44.986064 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m2n94" podStartSLOduration=3.98713814 podStartE2EDuration="24.986044198s" totalImagesPullingTime="20.998906058s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:44.985408766 +0000 UTC m=+25.601472666" watchObservedRunningTime="2026-06-08 23:59:44.986044198 +0000 UTC m=+25.602108033" Jun 08 23:59:45.857418 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:45.857390 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:45.857582 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:45.857423 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:45.857582 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:45.857390 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:45.857582 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:45.857497 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7fk4" podUID="63467802-5568-4564-b2ed-b70d3e63703a" Jun 08 23:59:45.857582 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:45.857571 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pwl8g" podUID="485792d6-e887-435c-a2cf-3dd55b769a7c" Jun 08 23:59:45.857790 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:45.857701 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-np4v6" podUID="1c75857e-660f-4c6b-a33d-6bd990f4089f" Jun 08 23:59:46.975895 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:46.975683 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" event={"ID":"24c10154-7f2b-4b8c-8000-2d4d7b781451","Type":"ContainerStarted","Data":"b573d8889c7ef301688c80917a349f72a28d90747336bba52bd6c287d0a5fdfb"} Jun 08 23:59:46.976716 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:46.975952 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:46.978589 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:46.978004 2515 generic.go:356] "Generic (PLEG): container finished" podID="e80985b9-2bd7-4d72-8059-a32ce4290fe7" containerID="fbcf3d304a8b6388ba06030940449b93093081f234e9382cc6c3bbb96e46efa8" exitCode=0 Jun 08 23:59:46.978589 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:46.978056 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pmqbj" event={"ID":"e80985b9-2bd7-4d72-8059-a32ce4290fe7","Type":"ContainerDied","Data":"fbcf3d304a8b6388ba06030940449b93093081f234e9382cc6c3bbb96e46efa8"} Jun 08 23:59:46.993581 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:46.993561 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:47.000403 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:47.000362 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" podStartSLOduration=9.075555033 podStartE2EDuration="28.000349239s" totalImagesPullingTime="18.924794206s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:46.999797074 +0000 UTC m=+27.615860923" watchObservedRunningTime="2026-06-08 23:59:47.000349239 +0000 UTC m=+27.616413076" Jun 08 23:59:47.860674 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:47.860651 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:47.860879 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:47.860651 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:47.860879 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:47.860750 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7fk4" podUID="63467802-5568-4564-b2ed-b70d3e63703a" Jun 08 23:59:47.860879 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:47.860657 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:47.860879 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:47.860813 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pwl8g" podUID="485792d6-e887-435c-a2cf-3dd55b769a7c" Jun 08 23:59:47.861036 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:47.860891 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-np4v6" podUID="1c75857e-660f-4c6b-a33d-6bd990f4089f" Jun 08 23:59:47.980086 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:47.980061 2515 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 08 23:59:47.980541 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:47.980516 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:47.996724 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:47.996684 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:48.263765 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:48.263579 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h7fk4"] Jun 08 23:59:48.263913 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:48.263835 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:48.263960 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:48.263914 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7fk4" podUID="63467802-5568-4564-b2ed-b70d3e63703a" Jun 08 23:59:48.266729 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:48.266701 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pwl8g"] Jun 08 23:59:48.266865 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:48.266782 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:48.266926 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:48.266864 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pwl8g" podUID="485792d6-e887-435c-a2cf-3dd55b769a7c" Jun 08 23:59:48.267327 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:48.267308 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-np4v6"] Jun 08 23:59:48.267421 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:48.267400 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:48.267520 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:48.267502 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-np4v6" podUID="1c75857e-660f-4c6b-a33d-6bd990f4089f" Jun 08 23:59:48.984274 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:48.984236 2515 generic.go:356] "Generic (PLEG): container finished" podID="e80985b9-2bd7-4d72-8059-a32ce4290fe7" containerID="f8d53e85ce789dd0f664d564e0b10409757f06974d7ffdcb6faedb48c1000d4f" exitCode=0 Jun 08 23:59:48.984765 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:48.984323 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pmqbj" event={"ID":"e80985b9-2bd7-4d72-8059-a32ce4290fe7","Type":"ContainerDied","Data":"f8d53e85ce789dd0f664d564e0b10409757f06974d7ffdcb6faedb48c1000d4f"} Jun 08 23:59:48.984765 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:48.984420 2515 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 08 23:59:49.862693 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:49.862659 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:49.862693 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:49.862687 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:49.862693 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:49.862695 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:49.862978 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:49.862780 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-np4v6" podUID="1c75857e-660f-4c6b-a33d-6bd990f4089f" Jun 08 23:59:49.862978 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:49.862883 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pwl8g" podUID="485792d6-e887-435c-a2cf-3dd55b769a7c" Jun 08 23:59:49.862978 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:49.862951 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7fk4" podUID="63467802-5568-4564-b2ed-b70d3e63703a" Jun 08 23:59:49.986770 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:49.986745 2515 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 08 23:59:50.905420 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:50.905374 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 08 23:59:50.990887 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:50.990860 2515 generic.go:356] "Generic (PLEG): container finished" podID="e80985b9-2bd7-4d72-8059-a32ce4290fe7" containerID="c3b305604388e9ebfe7261a0d60252cdfeb88eaed7b41c24149cc0e4a6a680e3" exitCode=0 Jun 08 23:59:50.991651 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:50.990948 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pmqbj" event={"ID":"e80985b9-2bd7-4d72-8059-a32ce4290fe7","Type":"ContainerDied","Data":"c3b305604388e9ebfe7261a0d60252cdfeb88eaed7b41c24149cc0e4a6a680e3"} Jun 08 23:59:51.858111 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:51.858071 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:51.858111 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:51.858098 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:51.858355 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:51.858072 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:51.858355 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:51.858195 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7fk4" podUID="63467802-5568-4564-b2ed-b70d3e63703a" Jun 08 23:59:51.858355 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:51.858299 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-np4v6" podUID="1c75857e-660f-4c6b-a33d-6bd990f4089f" Jun 08 23:59:51.858502 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:51.858406 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pwl8g" podUID="485792d6-e887-435c-a2cf-3dd55b769a7c" Jun 08 23:59:53.548921 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:53.548885 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29c5g\" (UniqueName: \"kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g\") pod \"network-check-target-pwl8g\" (UID: \"485792d6-e887-435c-a2cf-3dd55b769a7c\") " pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:53.549413 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:53.549027 2515 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 23:59:53.549413 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:53.549049 2515 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 23:59:53.549413 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:53.549058 2515 projected.go:196] Error preparing data for projected volume kube-api-access-29c5g for pod openshift-network-diagnostics/network-check-target-pwl8g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:53.549413 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:53.549108 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g podName:485792d6-e887-435c-a2cf-3dd55b769a7c nodeName:}" failed. No retries permitted until 2026-06-09 00:00:25.549096136 +0000 UTC m=+66.165159950 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-29c5g" (UniqueName: "kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g") pod "network-check-target-pwl8g" (UID: "485792d6-e887-435c-a2cf-3dd55b769a7c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 23:59:53.650072 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:53.650039 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs\") pod \"network-metrics-daemon-np4v6\" (UID: \"1c75857e-660f-4c6b-a33d-6bd990f4089f\") " pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:53.650243 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:53.650086 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret\") pod \"global-pull-secret-syncer-h7fk4\" (UID: \"63467802-5568-4564-b2ed-b70d3e63703a\") " pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:53.650243 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:53.650188 2515 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:53.650243 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:53.650195 2515 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:53.650365 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:53.650245 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret podName:63467802-5568-4564-b2ed-b70d3e63703a nodeName:}" failed. No retries permitted until 2026-06-09 00:00:25.650229305 +0000 UTC m=+66.266293140 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret") pod "global-pull-secret-syncer-h7fk4" (UID: "63467802-5568-4564-b2ed-b70d3e63703a") : object "kube-system"/"original-pull-secret" not registered Jun 08 23:59:53.650365 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:53.650261 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs podName:1c75857e-660f-4c6b-a33d-6bd990f4089f nodeName:}" failed. No retries permitted until 2026-06-09 00:00:25.650254955 +0000 UTC m=+66.266318770 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs") pod "network-metrics-daemon-np4v6" (UID: "1c75857e-660f-4c6b-a33d-6bd990f4089f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 23:59:53.857364 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:53.857331 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:53.857552 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:53.857452 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:53.857552 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:53.857462 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h7fk4" podUID="63467802-5568-4564-b2ed-b70d3e63703a" Jun 08 23:59:53.857703 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:53.857578 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-np4v6" podUID="1c75857e-660f-4c6b-a33d-6bd990f4089f" Jun 08 23:59:53.857703 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:53.857591 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:53.857808 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:53.857723 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pwl8g" podUID="485792d6-e887-435c-a2cf-3dd55b769a7c" Jun 08 23:59:54.241937 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.241852 2515 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-4.ec2.internal" event="NodeReady" Jun 08 23:59:54.242090 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.241990 2515 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 23:59:54.283516 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.283482 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bfrbb"] Jun 08 23:59:54.286682 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.286354 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bfrbb" Jun 08 23:59:54.286682 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.286659 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-q4pkm"] Jun 08 23:59:54.288279 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.288259 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-q4pkm" Jun 08 23:59:54.289189 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.289167 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 23:59:54.289296 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.289167 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cw7xv\"" Jun 08 23:59:54.289296 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.289254 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 23:59:54.290625 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.290593 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 23:59:54.290945 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.290713 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-x8dqb\"" Jun 08 23:59:54.290945 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.290726 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 23:59:54.291116 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.291100 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 23:59:54.295552 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.295528 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bfrbb"] Jun 08 23:59:54.299139 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.298917 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-q4pkm"] Jun 08 23:59:54.456140 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.456099 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls\") pod \"dns-default-bfrbb\" (UID: \"16c6b841-08b7-4fd3-9892-e91359f0b9da\") " pod="openshift-dns/dns-default-bfrbb" Jun 08 23:59:54.456140 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.456146 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdm97\" (UniqueName: \"kubernetes.io/projected/477599c7-e5d0-41d4-b3e2-93b56c4ae38b-kube-api-access-tdm97\") pod \"ingress-canary-q4pkm\" (UID: \"477599c7-e5d0-41d4-b3e2-93b56c4ae38b\") " pod="openshift-ingress-canary/ingress-canary-q4pkm" Jun 08 23:59:54.456364 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.456217 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/477599c7-e5d0-41d4-b3e2-93b56c4ae38b-cert\") pod \"ingress-canary-q4pkm\" (UID: \"477599c7-e5d0-41d4-b3e2-93b56c4ae38b\") " pod="openshift-ingress-canary/ingress-canary-q4pkm" Jun 08 23:59:54.456364 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.456284 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhwrd\" (UniqueName: \"kubernetes.io/projected/16c6b841-08b7-4fd3-9892-e91359f0b9da-kube-api-access-bhwrd\") pod \"dns-default-bfrbb\" (UID: \"16c6b841-08b7-4fd3-9892-e91359f0b9da\") " pod="openshift-dns/dns-default-bfrbb" Jun 08 23:59:54.456364 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.456314 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16c6b841-08b7-4fd3-9892-e91359f0b9da-config-volume\") pod \"dns-default-bfrbb\" (UID: \"16c6b841-08b7-4fd3-9892-e91359f0b9da\") " pod="openshift-dns/dns-default-bfrbb" Jun 08 23:59:54.456364 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.456339 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16c6b841-08b7-4fd3-9892-e91359f0b9da-tmp-dir\") pod \"dns-default-bfrbb\" (UID: \"16c6b841-08b7-4fd3-9892-e91359f0b9da\") " pod="openshift-dns/dns-default-bfrbb" Jun 08 23:59:54.557530 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.557450 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls\") pod \"dns-default-bfrbb\" (UID: \"16c6b841-08b7-4fd3-9892-e91359f0b9da\") " pod="openshift-dns/dns-default-bfrbb" Jun 08 23:59:54.557530 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.557499 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdm97\" (UniqueName: \"kubernetes.io/projected/477599c7-e5d0-41d4-b3e2-93b56c4ae38b-kube-api-access-tdm97\") pod \"ingress-canary-q4pkm\" (UID: \"477599c7-e5d0-41d4-b3e2-93b56c4ae38b\") " pod="openshift-ingress-canary/ingress-canary-q4pkm" Jun 08 23:59:54.558054 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.557535 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/477599c7-e5d0-41d4-b3e2-93b56c4ae38b-cert\") pod \"ingress-canary-q4pkm\" (UID: \"477599c7-e5d0-41d4-b3e2-93b56c4ae38b\") " pod="openshift-ingress-canary/ingress-canary-q4pkm" Jun 08 23:59:54.558054 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.557583 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhwrd\" (UniqueName: \"kubernetes.io/projected/16c6b841-08b7-4fd3-9892-e91359f0b9da-kube-api-access-bhwrd\") pod \"dns-default-bfrbb\" (UID: \"16c6b841-08b7-4fd3-9892-e91359f0b9da\") " pod="openshift-dns/dns-default-bfrbb" Jun 08 23:59:54.558054 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.557627 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16c6b841-08b7-4fd3-9892-e91359f0b9da-config-volume\") pod \"dns-default-bfrbb\" (UID: \"16c6b841-08b7-4fd3-9892-e91359f0b9da\") " pod="openshift-dns/dns-default-bfrbb" Jun 08 23:59:54.558054 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.557657 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16c6b841-08b7-4fd3-9892-e91359f0b9da-tmp-dir\") pod \"dns-default-bfrbb\" (UID: \"16c6b841-08b7-4fd3-9892-e91359f0b9da\") " pod="openshift-dns/dns-default-bfrbb" Jun 08 23:59:54.558054 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:54.557628 2515 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 23:59:54.558054 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:54.557784 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls podName:16c6b841-08b7-4fd3-9892-e91359f0b9da nodeName:}" failed. No retries permitted until 2026-06-08 23:59:55.05775936 +0000 UTC m=+35.673823194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls") pod "dns-default-bfrbb" (UID: "16c6b841-08b7-4fd3-9892-e91359f0b9da") : secret "dns-default-metrics-tls" not found Jun 08 23:59:54.558054 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.558018 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16c6b841-08b7-4fd3-9892-e91359f0b9da-tmp-dir\") pod \"dns-default-bfrbb\" (UID: \"16c6b841-08b7-4fd3-9892-e91359f0b9da\") " pod="openshift-dns/dns-default-bfrbb" Jun 08 23:59:54.558430 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.558409 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16c6b841-08b7-4fd3-9892-e91359f0b9da-config-volume\") pod \"dns-default-bfrbb\" (UID: \"16c6b841-08b7-4fd3-9892-e91359f0b9da\") " pod="openshift-dns/dns-default-bfrbb" Jun 08 23:59:54.562508 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.562481 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/477599c7-e5d0-41d4-b3e2-93b56c4ae38b-cert\") pod \"ingress-canary-q4pkm\" (UID: \"477599c7-e5d0-41d4-b3e2-93b56c4ae38b\") " pod="openshift-ingress-canary/ingress-canary-q4pkm" Jun 08 23:59:54.565852 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.565830 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdm97\" (UniqueName: \"kubernetes.io/projected/477599c7-e5d0-41d4-b3e2-93b56c4ae38b-kube-api-access-tdm97\") pod \"ingress-canary-q4pkm\" (UID: \"477599c7-e5d0-41d4-b3e2-93b56c4ae38b\") " pod="openshift-ingress-canary/ingress-canary-q4pkm" Jun 08 23:59:54.565852 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.565857 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhwrd\" (UniqueName: \"kubernetes.io/projected/16c6b841-08b7-4fd3-9892-e91359f0b9da-kube-api-access-bhwrd\") pod \"dns-default-bfrbb\" (UID: \"16c6b841-08b7-4fd3-9892-e91359f0b9da\") " pod="openshift-dns/dns-default-bfrbb" Jun 08 23:59:54.606243 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.606214 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-q4pkm" Jun 08 23:59:54.903016 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:54.902819 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-q4pkm"] Jun 08 23:59:54.906211 ip-10-0-129-4 kubenswrapper[2515]: W0608 23:59:54.906188 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod477599c7_e5d0_41d4_b3e2_93b56c4ae38b.slice/crio-0ba9bf7d451aa865b4dfa8b320ba2317bb6bf8b3e066a1cee7e11cc3188a50a1 WatchSource:0}: Error finding container 0ba9bf7d451aa865b4dfa8b320ba2317bb6bf8b3e066a1cee7e11cc3188a50a1: Status 404 returned error can't find the container with id 0ba9bf7d451aa865b4dfa8b320ba2317bb6bf8b3e066a1cee7e11cc3188a50a1 Jun 08 23:59:55.003858 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:55.003833 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pmqbj" event={"ID":"e80985b9-2bd7-4d72-8059-a32ce4290fe7","Type":"ContainerStarted","Data":"b7675bb618db73ada853b82daec23dc203f66cd210befba46432a4ed9c7e333b"} Jun 08 23:59:55.004948 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:55.004924 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-q4pkm" event={"ID":"477599c7-e5d0-41d4-b3e2-93b56c4ae38b","Type":"ContainerStarted","Data":"0ba9bf7d451aa865b4dfa8b320ba2317bb6bf8b3e066a1cee7e11cc3188a50a1"} Jun 08 23:59:55.065305 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:55.065219 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls\") pod \"dns-default-bfrbb\" (UID: \"16c6b841-08b7-4fd3-9892-e91359f0b9da\") " pod="openshift-dns/dns-default-bfrbb" Jun 08 23:59:55.065407 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:55.065342 2515 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 23:59:55.065407 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:55.065392 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls podName:16c6b841-08b7-4fd3-9892-e91359f0b9da nodeName:}" failed. No retries permitted until 2026-06-08 23:59:56.065378611 +0000 UTC m=+36.681442426 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls") pod "dns-default-bfrbb" (UID: "16c6b841-08b7-4fd3-9892-e91359f0b9da") : secret "dns-default-metrics-tls" not found Jun 08 23:59:55.857827 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:55.857791 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 08 23:59:55.858262 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:55.857796 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 08 23:59:55.858262 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:55.858101 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-np4v6" Jun 08 23:59:55.861894 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:55.861871 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 23:59:55.861894 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:55.861888 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k7v6c\"" Jun 08 23:59:55.862061 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:55.861964 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 23:59:55.862061 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:55.861989 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hgn2x\"" Jun 08 23:59:55.862270 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:55.862240 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 23:59:55.862389 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:55.862322 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 23:59:56.011249 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:56.011219 2515 generic.go:356] "Generic (PLEG): container finished" podID="e80985b9-2bd7-4d72-8059-a32ce4290fe7" containerID="b7675bb618db73ada853b82daec23dc203f66cd210befba46432a4ed9c7e333b" exitCode=0 Jun 08 23:59:56.011249 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:56.011242 2515 generic.go:356] "Generic (PLEG): container finished" podID="e80985b9-2bd7-4d72-8059-a32ce4290fe7" containerID="c6b4103524233201d263f6f5dcafffb6edefd37c7227589f1b466ded1698fe9f" exitCode=0 Jun 08 23:59:56.011500 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:56.011289 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pmqbj" event={"ID":"e80985b9-2bd7-4d72-8059-a32ce4290fe7","Type":"ContainerDied","Data":"b7675bb618db73ada853b82daec23dc203f66cd210befba46432a4ed9c7e333b"} Jun 08 23:59:56.011500 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:56.011332 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pmqbj" event={"ID":"e80985b9-2bd7-4d72-8059-a32ce4290fe7","Type":"ContainerDied","Data":"c6b4103524233201d263f6f5dcafffb6edefd37c7227589f1b466ded1698fe9f"} Jun 08 23:59:56.072700 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:56.072668 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls\") pod \"dns-default-bfrbb\" (UID: \"16c6b841-08b7-4fd3-9892-e91359f0b9da\") " pod="openshift-dns/dns-default-bfrbb" Jun 08 23:59:56.072835 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:56.072816 2515 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 23:59:56.072967 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:56.072886 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls podName:16c6b841-08b7-4fd3-9892-e91359f0b9da nodeName:}" failed. No retries permitted until 2026-06-08 23:59:58.072864982 +0000 UTC m=+38.688928800 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls") pod "dns-default-bfrbb" (UID: "16c6b841-08b7-4fd3-9892-e91359f0b9da") : secret "dns-default-metrics-tls" not found Jun 08 23:59:57.015432 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:57.015136 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-q4pkm" event={"ID":"477599c7-e5d0-41d4-b3e2-93b56c4ae38b","Type":"ContainerStarted","Data":"244335655bbd8155755c794d72786e5f645799a5b53685ad027c169ee502fc22"} Jun 08 23:59:57.018915 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:57.018884 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pmqbj" event={"ID":"e80985b9-2bd7-4d72-8059-a32ce4290fe7","Type":"ContainerStarted","Data":"ad0efc0ce9d5f819506bbc81493adae175e02fad25077bb6e591b66c34aa0a37"} Jun 08 23:59:57.031520 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:57.031472 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-q4pkm" podStartSLOduration=1.31026776 podStartE2EDuration="3.031456756s" totalImagesPullingTime="1.721188996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 23:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:57.03100605 +0000 UTC m=+37.647069886" watchObservedRunningTime="2026-06-08 23:59:57.031456756 +0000 UTC m=+37.647520570" Jun 08 23:59:57.051006 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:57.050953 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pmqbj" podStartSLOduration=8.095969866 podStartE2EDuration="37.050937747s" totalImagesPullingTime="28.954967881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 23:59:57.050325731 +0000 UTC m=+37.666389567" watchObservedRunningTime="2026-06-08 23:59:57.050937747 +0000 UTC m=+37.667001600" Jun 08 23:59:58.086637 ip-10-0-129-4 kubenswrapper[2515]: I0608 23:59:58.086541 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls\") pod \"dns-default-bfrbb\" (UID: \"16c6b841-08b7-4fd3-9892-e91359f0b9da\") " pod="openshift-dns/dns-default-bfrbb" Jun 08 23:59:58.087082 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:58.086673 2515 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 23:59:58.087082 ip-10-0-129-4 kubenswrapper[2515]: E0608 23:59:58.086733 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls podName:16c6b841-08b7-4fd3-9892-e91359f0b9da nodeName:}" failed. No retries permitted until 2026-06-09 00:00:02.086719097 +0000 UTC m=+42.702782910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls") pod "dns-default-bfrbb" (UID: "16c6b841-08b7-4fd3-9892-e91359f0b9da") : secret "dns-default-metrics-tls" not found Jun 09 00:00:02.113887 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:02.113848 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls\") pod \"dns-default-bfrbb\" (UID: \"16c6b841-08b7-4fd3-9892-e91359f0b9da\") " pod="openshift-dns/dns-default-bfrbb" Jun 09 00:00:02.114347 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:00:02.113973 2515 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:00:02.114347 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:00:02.114060 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls podName:16c6b841-08b7-4fd3-9892-e91359f0b9da nodeName:}" failed. No retries permitted until 2026-06-09 00:00:10.114045425 +0000 UTC m=+50.730109239 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls") pod "dns-default-bfrbb" (UID: "16c6b841-08b7-4fd3-9892-e91359f0b9da") : secret "dns-default-metrics-tls" not found Jun 09 00:00:10.166756 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:10.166707 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls\") pod \"dns-default-bfrbb\" (UID: \"16c6b841-08b7-4fd3-9892-e91359f0b9da\") " pod="openshift-dns/dns-default-bfrbb" Jun 09 00:00:10.167223 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:00:10.166856 2515 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:00:10.167223 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:00:10.166920 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls podName:16c6b841-08b7-4fd3-9892-e91359f0b9da nodeName:}" failed. No retries permitted until 2026-06-09 00:00:26.166903428 +0000 UTC m=+66.782967246 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls") pod "dns-default-bfrbb" (UID: "16c6b841-08b7-4fd3-9892-e91359f0b9da") : secret "dns-default-metrics-tls" not found Jun 09 00:00:21.001020 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.000992 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hh52h" Jun 09 00:00:21.857008 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.856969 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796967cdd-hw8fg"] Jun 09 00:00:21.862224 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.861509 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796967cdd-hw8fg" Jun 09 00:00:21.864342 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.864319 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 00:00:21.864477 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.864319 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-f7cvc\"" Jun 09 00:00:21.864477 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.864433 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 09 00:00:21.864773 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.864668 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 00:00:21.864868 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.864851 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 00:00:21.864920 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.864887 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr"] Jun 09 00:00:21.866933 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.866681 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796967cdd-hw8fg"] Jun 09 00:00:21.866933 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.866710 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm"] Jun 09 00:00:21.866933 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.866889 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr" Jun 09 00:00:21.869112 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.869093 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 09 00:00:21.869401 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.869381 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" Jun 09 00:00:21.870574 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.870555 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr"] Jun 09 00:00:21.871738 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.871711 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 09 00:00:21.871840 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.871814 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 09 00:00:21.871977 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.871954 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 09 00:00:21.872126 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.872106 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 09 00:00:21.877303 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.877282 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm"] Jun 09 00:00:21.957074 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.957034 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a302388a-ab5f-466a-b4f7-5e86bf8c989e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f9b894846-9fplm\" (UID: \"a302388a-ab5f-466a-b4f7-5e86bf8c989e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" Jun 09 00:00:21.957074 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.957075 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a302388a-ab5f-466a-b4f7-5e86bf8c989e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f9b894846-9fplm\" (UID: \"a302388a-ab5f-466a-b4f7-5e86bf8c989e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" Jun 09 00:00:21.957265 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.957099 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw85b\" (UniqueName: \"kubernetes.io/projected/a302388a-ab5f-466a-b4f7-5e86bf8c989e-kube-api-access-mw85b\") pod \"cluster-proxy-proxy-agent-6f9b894846-9fplm\" (UID: \"a302388a-ab5f-466a-b4f7-5e86bf8c989e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" Jun 09 00:00:21.957265 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.957121 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69ddc\" (UniqueName: \"kubernetes.io/projected/9c1b563b-2bea-414c-8d50-003ef13478c9-kube-api-access-69ddc\") pod \"klusterlet-addon-workmgr-7f8f54cd98-jcfqr\" (UID: \"9c1b563b-2bea-414c-8d50-003ef13478c9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr" Jun 09 00:00:21.957265 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.957211 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a302388a-ab5f-466a-b4f7-5e86bf8c989e-ca\") pod \"cluster-proxy-proxy-agent-6f9b894846-9fplm\" (UID: \"a302388a-ab5f-466a-b4f7-5e86bf8c989e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" Jun 09 00:00:21.957265 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.957241 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a302388a-ab5f-466a-b4f7-5e86bf8c989e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f9b894846-9fplm\" (UID: \"a302388a-ab5f-466a-b4f7-5e86bf8c989e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" Jun 09 00:00:21.957392 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.957295 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a302388a-ab5f-466a-b4f7-5e86bf8c989e-hub\") pod \"cluster-proxy-proxy-agent-6f9b894846-9fplm\" (UID: \"a302388a-ab5f-466a-b4f7-5e86bf8c989e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" Jun 09 00:00:21.957392 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.957327 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f8d9d1d5-79a9-43ed-b0cf-ac8d6dc9b563-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-796967cdd-hw8fg\" (UID: \"f8d9d1d5-79a9-43ed-b0cf-ac8d6dc9b563\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796967cdd-hw8fg" Jun 09 00:00:21.957392 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.957350 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c1b563b-2bea-414c-8d50-003ef13478c9-tmp\") pod \"klusterlet-addon-workmgr-7f8f54cd98-jcfqr\" (UID: \"9c1b563b-2bea-414c-8d50-003ef13478c9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr" Jun 09 00:00:21.957392 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.957375 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9c1b563b-2bea-414c-8d50-003ef13478c9-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f8f54cd98-jcfqr\" (UID: \"9c1b563b-2bea-414c-8d50-003ef13478c9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr" Jun 09 00:00:21.957510 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:21.957395 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmsfv\" (UniqueName: \"kubernetes.io/projected/f8d9d1d5-79a9-43ed-b0cf-ac8d6dc9b563-kube-api-access-pmsfv\") pod \"managed-serviceaccount-addon-agent-796967cdd-hw8fg\" (UID: \"f8d9d1d5-79a9-43ed-b0cf-ac8d6dc9b563\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796967cdd-hw8fg" Jun 09 00:00:22.058226 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.058179 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a302388a-ab5f-466a-b4f7-5e86bf8c989e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f9b894846-9fplm\" (UID: \"a302388a-ab5f-466a-b4f7-5e86bf8c989e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" Jun 09 00:00:22.058226 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.058224 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a302388a-ab5f-466a-b4f7-5e86bf8c989e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f9b894846-9fplm\" (UID: \"a302388a-ab5f-466a-b4f7-5e86bf8c989e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" Jun 09 00:00:22.058703 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.058242 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw85b\" (UniqueName: \"kubernetes.io/projected/a302388a-ab5f-466a-b4f7-5e86bf8c989e-kube-api-access-mw85b\") pod \"cluster-proxy-proxy-agent-6f9b894846-9fplm\" (UID: \"a302388a-ab5f-466a-b4f7-5e86bf8c989e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" Jun 09 00:00:22.058703 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.058364 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69ddc\" (UniqueName: \"kubernetes.io/projected/9c1b563b-2bea-414c-8d50-003ef13478c9-kube-api-access-69ddc\") pod \"klusterlet-addon-workmgr-7f8f54cd98-jcfqr\" (UID: \"9c1b563b-2bea-414c-8d50-003ef13478c9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr" Jun 09 00:00:22.058703 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.058438 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a302388a-ab5f-466a-b4f7-5e86bf8c989e-ca\") pod \"cluster-proxy-proxy-agent-6f9b894846-9fplm\" (UID: \"a302388a-ab5f-466a-b4f7-5e86bf8c989e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" Jun 09 00:00:22.058703 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.058467 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a302388a-ab5f-466a-b4f7-5e86bf8c989e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f9b894846-9fplm\" (UID: \"a302388a-ab5f-466a-b4f7-5e86bf8c989e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" Jun 09 00:00:22.058703 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.058521 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a302388a-ab5f-466a-b4f7-5e86bf8c989e-hub\") pod \"cluster-proxy-proxy-agent-6f9b894846-9fplm\" (UID: \"a302388a-ab5f-466a-b4f7-5e86bf8c989e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" Jun 09 00:00:22.058703 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.058563 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f8d9d1d5-79a9-43ed-b0cf-ac8d6dc9b563-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-796967cdd-hw8fg\" (UID: \"f8d9d1d5-79a9-43ed-b0cf-ac8d6dc9b563\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796967cdd-hw8fg" Jun 09 00:00:22.058703 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.058585 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c1b563b-2bea-414c-8d50-003ef13478c9-tmp\") pod \"klusterlet-addon-workmgr-7f8f54cd98-jcfqr\" (UID: \"9c1b563b-2bea-414c-8d50-003ef13478c9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr" Jun 09 00:00:22.058703 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.058641 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9c1b563b-2bea-414c-8d50-003ef13478c9-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f8f54cd98-jcfqr\" (UID: \"9c1b563b-2bea-414c-8d50-003ef13478c9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr" Jun 09 00:00:22.058703 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.058672 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmsfv\" (UniqueName: \"kubernetes.io/projected/f8d9d1d5-79a9-43ed-b0cf-ac8d6dc9b563-kube-api-access-pmsfv\") pod \"managed-serviceaccount-addon-agent-796967cdd-hw8fg\" (UID: \"f8d9d1d5-79a9-43ed-b0cf-ac8d6dc9b563\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796967cdd-hw8fg" Jun 09 00:00:22.059134 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.058956 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/a302388a-ab5f-466a-b4f7-5e86bf8c989e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f9b894846-9fplm\" (UID: \"a302388a-ab5f-466a-b4f7-5e86bf8c989e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" Jun 09 00:00:22.059407 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.059289 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c1b563b-2bea-414c-8d50-003ef13478c9-tmp\") pod \"klusterlet-addon-workmgr-7f8f54cd98-jcfqr\" (UID: \"9c1b563b-2bea-414c-8d50-003ef13478c9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr" Jun 09 00:00:22.062707 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.062675 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/a302388a-ab5f-466a-b4f7-5e86bf8c989e-ca\") pod \"cluster-proxy-proxy-agent-6f9b894846-9fplm\" (UID: \"a302388a-ab5f-466a-b4f7-5e86bf8c989e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" Jun 09 00:00:22.062817 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.062680 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f8d9d1d5-79a9-43ed-b0cf-ac8d6dc9b563-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-796967cdd-hw8fg\" (UID: \"f8d9d1d5-79a9-43ed-b0cf-ac8d6dc9b563\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796967cdd-hw8fg" Jun 09 00:00:22.062817 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.062785 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/a302388a-ab5f-466a-b4f7-5e86bf8c989e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f9b894846-9fplm\" (UID: \"a302388a-ab5f-466a-b4f7-5e86bf8c989e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" Jun 09 00:00:22.062817 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.062804 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/9c1b563b-2bea-414c-8d50-003ef13478c9-klusterlet-config\") pod \"klusterlet-addon-workmgr-7f8f54cd98-jcfqr\" (UID: \"9c1b563b-2bea-414c-8d50-003ef13478c9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr" Jun 09 00:00:22.063126 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.063107 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a302388a-ab5f-466a-b4f7-5e86bf8c989e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f9b894846-9fplm\" (UID: \"a302388a-ab5f-466a-b4f7-5e86bf8c989e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" Jun 09 00:00:22.063201 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.063183 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/a302388a-ab5f-466a-b4f7-5e86bf8c989e-hub\") pod \"cluster-proxy-proxy-agent-6f9b894846-9fplm\" (UID: \"a302388a-ab5f-466a-b4f7-5e86bf8c989e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" Jun 09 00:00:22.066537 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.066508 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw85b\" (UniqueName: \"kubernetes.io/projected/a302388a-ab5f-466a-b4f7-5e86bf8c989e-kube-api-access-mw85b\") pod \"cluster-proxy-proxy-agent-6f9b894846-9fplm\" (UID: \"a302388a-ab5f-466a-b4f7-5e86bf8c989e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" Jun 09 00:00:22.066790 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.066773 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69ddc\" (UniqueName: \"kubernetes.io/projected/9c1b563b-2bea-414c-8d50-003ef13478c9-kube-api-access-69ddc\") pod \"klusterlet-addon-workmgr-7f8f54cd98-jcfqr\" (UID: \"9c1b563b-2bea-414c-8d50-003ef13478c9\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr" Jun 09 00:00:22.067046 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.067031 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmsfv\" (UniqueName: \"kubernetes.io/projected/f8d9d1d5-79a9-43ed-b0cf-ac8d6dc9b563-kube-api-access-pmsfv\") pod \"managed-serviceaccount-addon-agent-796967cdd-hw8fg\" (UID: \"f8d9d1d5-79a9-43ed-b0cf-ac8d6dc9b563\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796967cdd-hw8fg" Jun 09 00:00:22.189208 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.189126 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796967cdd-hw8fg" Jun 09 00:00:22.195467 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.195447 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr" Jun 09 00:00:22.201412 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.201389 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" Jun 09 00:00:22.329179 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.329151 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796967cdd-hw8fg"] Jun 09 00:00:22.331781 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:00:22.331742 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf8d9d1d5_79a9_43ed_b0cf_ac8d6dc9b563.slice/crio-872233b3cb741875806871f4498e782caf881da42124caa4ef029cb68a9dbdc5 WatchSource:0}: Error finding container 872233b3cb741875806871f4498e782caf881da42124caa4ef029cb68a9dbdc5: Status 404 returned error can't find the container with id 872233b3cb741875806871f4498e782caf881da42124caa4ef029cb68a9dbdc5 Jun 09 00:00:22.343193 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.343163 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr"] Jun 09 00:00:22.345758 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:00:22.345732 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c1b563b_2bea_414c_8d50_003ef13478c9.slice/crio-4303d3ee682c52e13f5fb1793a5d601247984f7071a73f4127b031403adfd3fd WatchSource:0}: Error finding container 4303d3ee682c52e13f5fb1793a5d601247984f7071a73f4127b031403adfd3fd: Status 404 returned error can't find the container with id 4303d3ee682c52e13f5fb1793a5d601247984f7071a73f4127b031403adfd3fd Jun 09 00:00:22.360595 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:22.360571 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm"] Jun 09 00:00:22.362779 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:00:22.362761 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda302388a_ab5f_466a_b4f7_5e86bf8c989e.slice/crio-11cb9c0d903fedf053604db30e62f2229450102b4ca8fccb1cd10e4d142833a4 WatchSource:0}: Error finding container 11cb9c0d903fedf053604db30e62f2229450102b4ca8fccb1cd10e4d142833a4: Status 404 returned error can't find the container with id 11cb9c0d903fedf053604db30e62f2229450102b4ca8fccb1cd10e4d142833a4 Jun 09 00:00:23.079127 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:23.079093 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr" event={"ID":"9c1b563b-2bea-414c-8d50-003ef13478c9","Type":"ContainerStarted","Data":"4303d3ee682c52e13f5fb1793a5d601247984f7071a73f4127b031403adfd3fd"} Jun 09 00:00:23.080093 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:23.080074 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796967cdd-hw8fg" event={"ID":"f8d9d1d5-79a9-43ed-b0cf-ac8d6dc9b563","Type":"ContainerStarted","Data":"872233b3cb741875806871f4498e782caf881da42124caa4ef029cb68a9dbdc5"} Jun 09 00:00:23.080965 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:23.080944 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" event={"ID":"a302388a-ab5f-466a-b4f7-5e86bf8c989e","Type":"ContainerStarted","Data":"11cb9c0d903fedf053604db30e62f2229450102b4ca8fccb1cd10e4d142833a4"} Jun 09 00:00:25.585621 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:25.585520 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29c5g\" (UniqueName: \"kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g\") pod \"network-check-target-pwl8g\" (UID: \"485792d6-e887-435c-a2cf-3dd55b769a7c\") " pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 09 00:00:25.588701 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:25.588675 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 00:00:25.598314 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:25.598290 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 00:00:25.609674 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:25.609623 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29c5g\" (UniqueName: \"kubernetes.io/projected/485792d6-e887-435c-a2cf-3dd55b769a7c-kube-api-access-29c5g\") pod \"network-check-target-pwl8g\" (UID: \"485792d6-e887-435c-a2cf-3dd55b769a7c\") " pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 09 00:00:25.686050 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:25.686016 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs\") pod \"network-metrics-daemon-np4v6\" (UID: \"1c75857e-660f-4c6b-a33d-6bd990f4089f\") " pod="openshift-multus/network-metrics-daemon-np4v6" Jun 09 00:00:25.686237 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:25.686077 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret\") pod \"global-pull-secret-syncer-h7fk4\" (UID: \"63467802-5568-4564-b2ed-b70d3e63703a\") " pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 09 00:00:25.688617 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:25.688569 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 00:00:25.688755 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:25.688726 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 00:00:25.696934 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:00:25.696912 2515 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 00:00:25.697061 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:00:25.696989 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs podName:1c75857e-660f-4c6b-a33d-6bd990f4089f nodeName:}" failed. No retries permitted until 2026-06-09 00:01:29.696965454 +0000 UTC m=+130.313029280 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs") pod "network-metrics-daemon-np4v6" (UID: "1c75857e-660f-4c6b-a33d-6bd990f4089f") : secret "metrics-daemon-secret" not found Jun 09 00:00:25.699786 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:25.699747 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/63467802-5568-4564-b2ed-b70d3e63703a-original-pull-secret\") pod \"global-pull-secret-syncer-h7fk4\" (UID: \"63467802-5568-4564-b2ed-b70d3e63703a\") " pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 09 00:00:25.871960 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:25.871932 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hgn2x\"" Jun 09 00:00:25.876161 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:25.876126 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h7fk4" Jun 09 00:00:25.880655 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:25.880556 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 09 00:00:26.067038 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:26.067008 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h7fk4"] Jun 09 00:00:26.073117 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:00:26.073080 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63467802_5568_4564_b2ed_b70d3e63703a.slice/crio-a69e034a970a383c4db9b9ab4060dae47e7c46562b974cde46727706a32b10b3 WatchSource:0}: Error finding container a69e034a970a383c4db9b9ab4060dae47e7c46562b974cde46727706a32b10b3: Status 404 returned error can't find the container with id a69e034a970a383c4db9b9ab4060dae47e7c46562b974cde46727706a32b10b3 Jun 09 00:00:26.088744 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:26.088715 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pwl8g"] Jun 09 00:00:26.091896 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:26.091862 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h7fk4" event={"ID":"63467802-5568-4564-b2ed-b70d3e63703a","Type":"ContainerStarted","Data":"a69e034a970a383c4db9b9ab4060dae47e7c46562b974cde46727706a32b10b3"} Jun 09 00:00:26.093366 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:00:26.093342 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod485792d6_e887_435c_a2cf_3dd55b769a7c.slice/crio-ad40d63f858550228462352425879f44b34e4effab821f26bddde75b1874109b WatchSource:0}: Error finding container ad40d63f858550228462352425879f44b34e4effab821f26bddde75b1874109b: Status 404 returned error can't find the container with id ad40d63f858550228462352425879f44b34e4effab821f26bddde75b1874109b Jun 09 00:00:26.190469 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:26.190380 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls\") pod \"dns-default-bfrbb\" (UID: \"16c6b841-08b7-4fd3-9892-e91359f0b9da\") " pod="openshift-dns/dns-default-bfrbb" Jun 09 00:00:26.190648 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:00:26.190538 2515 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:00:26.190648 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:00:26.190629 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls podName:16c6b841-08b7-4fd3-9892-e91359f0b9da nodeName:}" failed. No retries permitted until 2026-06-09 00:00:58.190578631 +0000 UTC m=+98.806642464 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls") pod "dns-default-bfrbb" (UID: "16c6b841-08b7-4fd3-9892-e91359f0b9da") : secret "dns-default-metrics-tls" not found Jun 09 00:00:27.097150 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:27.097072 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pwl8g" event={"ID":"485792d6-e887-435c-a2cf-3dd55b769a7c","Type":"ContainerStarted","Data":"ad40d63f858550228462352425879f44b34e4effab821f26bddde75b1874109b"} Jun 09 00:00:33.117598 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:33.117554 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h7fk4" event={"ID":"63467802-5568-4564-b2ed-b70d3e63703a","Type":"ContainerStarted","Data":"9996748c718d714abda70eda60d6f938b8e070afc7c476aaef3da17fd3b1029e"} Jun 09 00:00:33.119651 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:33.119592 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pwl8g" event={"ID":"485792d6-e887-435c-a2cf-3dd55b769a7c","Type":"ContainerStarted","Data":"183157331a0d8f16642519de04ba29c60de3e4eb4d80716b60ff802cede5129b"} Jun 09 00:00:33.119830 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:33.119747 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 09 00:00:33.121340 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:33.121313 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr" event={"ID":"9c1b563b-2bea-414c-8d50-003ef13478c9","Type":"ContainerStarted","Data":"71cd30b198d4f11ec701a2b8c45f90d90e0cc339453bca736d940d381ac6273c"} Jun 09 00:00:33.121727 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:33.121579 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr" Jun 09 00:00:33.123029 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:33.123000 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796967cdd-hw8fg" event={"ID":"f8d9d1d5-79a9-43ed-b0cf-ac8d6dc9b563","Type":"ContainerStarted","Data":"3d083654edebe9f8541619bd72e1e3e5367c0ddedc129149ca335fdae434a499"} Jun 09 00:00:33.123428 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:33.123409 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr" Jun 09 00:00:33.132702 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:33.132656 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-h7fk4" podStartSLOduration=66.677832097 podStartE2EDuration="1m13.132644528s" totalImagesPullingTime="6.454812431s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 23:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:00:33.132107326 +0000 UTC m=+73.748171192" watchObservedRunningTime="2026-06-09 00:00:33.132644528 +0000 UTC m=+73.748708342" Jun 09 00:00:33.145567 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:33.145530 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pwl8g" podStartSLOduration=67.713682265 podStartE2EDuration="1m14.145517911s" totalImagesPullingTime="6.431835646s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 23:59:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:00:33.145229561 +0000 UTC m=+73.761293397" watchObservedRunningTime="2026-06-09 00:00:33.145517911 +0000 UTC m=+73.761581747" Jun 09 00:00:33.172785 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:33.172742 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr" podStartSLOduration=2.007893799 podStartE2EDuration="12.172724877s" totalImagesPullingTime="10.164831078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:00:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:00:33.159838752 +0000 UTC m=+73.775902587" watchObservedRunningTime="2026-06-09 00:00:33.172724877 +0000 UTC m=+73.788788713" Jun 09 00:00:33.173051 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:33.173017 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796967cdd-hw8fg" podStartSLOduration=2.019325756 podStartE2EDuration="12.173007925s" totalImagesPullingTime="10.153682169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:00:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:00:33.172653282 +0000 UTC m=+73.788717117" watchObservedRunningTime="2026-06-09 00:00:33.173007925 +0000 UTC m=+73.789071760" Jun 09 00:00:36.132480 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:36.132455 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" event={"ID":"a302388a-ab5f-466a-b4f7-5e86bf8c989e","Type":"ContainerStarted","Data":"61c789158dec5b9d33a094ef9e9059cfeb55dac7c9841a69bbba9fc102b62635"} Jun 09 00:00:36.132744 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:36.132494 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" event={"ID":"a302388a-ab5f-466a-b4f7-5e86bf8c989e","Type":"ContainerStarted","Data":"44abfe7895f1b94db658aef909e048cff64b85de1a72f2385bd31799969bedae"} Jun 09 00:00:37.138106 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:37.138074 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" event={"ID":"a302388a-ab5f-466a-b4f7-5e86bf8c989e","Type":"ContainerStarted","Data":"cfaa881a2ed02efbcca0cdc72be7ba7356914ed0dbbe888525febd34710235ef"} Jun 09 00:00:37.156706 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:37.156660 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" podStartSLOduration=2.492588098 podStartE2EDuration="16.156645978s" totalImagesPullingTime="13.66405788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:00:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:00:37.154810065 +0000 UTC m=+77.770873902" watchObservedRunningTime="2026-06-09 00:00:37.156645978 +0000 UTC m=+77.772709813" Jun 09 00:00:58.217109 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:00:58.217070 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls\") pod \"dns-default-bfrbb\" (UID: \"16c6b841-08b7-4fd3-9892-e91359f0b9da\") " pod="openshift-dns/dns-default-bfrbb" Jun 09 00:00:58.217538 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:00:58.217219 2515 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:00:58.217538 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:00:58.217297 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls podName:16c6b841-08b7-4fd3-9892-e91359f0b9da nodeName:}" failed. No retries permitted until 2026-06-09 00:02:02.217275949 +0000 UTC m=+162.833339762 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls") pod "dns-default-bfrbb" (UID: "16c6b841-08b7-4fd3-9892-e91359f0b9da") : secret "dns-default-metrics-tls" not found Jun 09 00:01:04.128506 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:01:04.128471 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pwl8g" Jun 09 00:01:29.732040 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:01:29.731998 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs\") pod \"network-metrics-daemon-np4v6\" (UID: \"1c75857e-660f-4c6b-a33d-6bd990f4089f\") " pod="openshift-multus/network-metrics-daemon-np4v6" Jun 09 00:01:29.732509 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:01:29.732120 2515 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 00:01:29.732509 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:01:29.732199 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs podName:1c75857e-660f-4c6b-a33d-6bd990f4089f nodeName:}" failed. No retries permitted until 2026-06-09 00:03:31.732185274 +0000 UTC m=+252.348249088 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs") pod "network-metrics-daemon-np4v6" (UID: "1c75857e-660f-4c6b-a33d-6bd990f4089f") : secret "metrics-daemon-secret" not found Jun 09 00:01:57.299876 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:01:57.299831 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bfrbb" podUID="16c6b841-08b7-4fd3-9892-e91359f0b9da" Jun 09 00:01:57.369240 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:01:57.369213 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bfrbb" Jun 09 00:01:58.883080 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:01:58.883038 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-np4v6" podUID="1c75857e-660f-4c6b-a33d-6bd990f4089f" Jun 09 00:02:02.238996 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:02:02.238955 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls\") pod \"dns-default-bfrbb\" (UID: \"16c6b841-08b7-4fd3-9892-e91359f0b9da\") " pod="openshift-dns/dns-default-bfrbb" Jun 09 00:02:02.239400 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:02:02.239103 2515 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 00:02:02.239400 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:02:02.239179 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls podName:16c6b841-08b7-4fd3-9892-e91359f0b9da nodeName:}" failed. No retries permitted until 2026-06-09 00:04:04.239159432 +0000 UTC m=+284.855223259 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls") pod "dns-default-bfrbb" (UID: "16c6b841-08b7-4fd3-9892-e91359f0b9da") : secret "dns-default-metrics-tls" not found Jun 09 00:02:13.858179 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:02:13.858096 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-np4v6" Jun 09 00:02:33.122337 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:02:33.122289 2515 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr" podUID="9c1b563b-2bea-414c-8d50-003ef13478c9" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.9:8000/readyz\": dial tcp 10.134.0.9:8000: connect: connection refused" Jun 09 00:02:33.473528 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:02:33.473443 2515 generic.go:356] "Generic (PLEG): container finished" podID="9c1b563b-2bea-414c-8d50-003ef13478c9" containerID="71cd30b198d4f11ec701a2b8c45f90d90e0cc339453bca736d940d381ac6273c" exitCode=1 Jun 09 00:02:33.473702 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:02:33.473521 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr" event={"ID":"9c1b563b-2bea-414c-8d50-003ef13478c9","Type":"ContainerDied","Data":"71cd30b198d4f11ec701a2b8c45f90d90e0cc339453bca736d940d381ac6273c"} Jun 09 00:02:33.473916 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:02:33.473892 2515 scope.go:117] "RemoveContainer" containerID="71cd30b198d4f11ec701a2b8c45f90d90e0cc339453bca736d940d381ac6273c" Jun 09 00:02:33.474841 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:02:33.474812 2515 generic.go:356] "Generic (PLEG): container finished" podID="f8d9d1d5-79a9-43ed-b0cf-ac8d6dc9b563" containerID="3d083654edebe9f8541619bd72e1e3e5367c0ddedc129149ca335fdae434a499" exitCode=255 Jun 09 00:02:33.474963 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:02:33.474844 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796967cdd-hw8fg" event={"ID":"f8d9d1d5-79a9-43ed-b0cf-ac8d6dc9b563","Type":"ContainerDied","Data":"3d083654edebe9f8541619bd72e1e3e5367c0ddedc129149ca335fdae434a499"} Jun 09 00:02:33.475099 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:02:33.475084 2515 scope.go:117] "RemoveContainer" containerID="3d083654edebe9f8541619bd72e1e3e5367c0ddedc129149ca335fdae434a499" Jun 09 00:02:34.480807 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:02:34.480772 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr" event={"ID":"9c1b563b-2bea-414c-8d50-003ef13478c9","Type":"ContainerStarted","Data":"0e1569178b74d0ff6b4e5063a5ac56220dd70ac0e4b4b38fdb3f81e5e8c7110d"} Jun 09 00:02:34.481257 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:02:34.481026 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr" Jun 09 00:02:34.481656 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:02:34.481638 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7f8f54cd98-jcfqr" Jun 09 00:02:34.482512 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:02:34.482484 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-796967cdd-hw8fg" event={"ID":"f8d9d1d5-79a9-43ed-b0cf-ac8d6dc9b563","Type":"ContainerStarted","Data":"aaeb263c0726987302bcd8e04ac26bf4f612582f3ab52d8fa9d1c5be23ff1d8c"} Jun 09 00:02:56.926364 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:02:56.926331 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z9m44_6b0fff56-c56a-4650-afd0-ac7fd0e1a935/dns-node-resolver/0.log" Jun 09 00:02:58.129391 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:02:58.129365 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vmc2d_dd97edb7-dec0-40fc-85e0-9bb56a3e33eb/node-ca/0.log" Jun 09 00:02:58.726687 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:02:58.726654 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q4pkm_477599c7-e5d0-41d4-b3e2-93b56c4ae38b/serve-healthcheck-canary/0.log" Jun 09 00:03:14.649889 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.649856 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zk2kp"] Jun 09 00:03:14.651859 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.651839 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zk2kp" Jun 09 00:03:14.654421 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.654390 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 00:03:14.654559 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.654495 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rvkn7\"" Jun 09 00:03:14.655755 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.655736 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 00:03:14.655855 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.655802 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 00:03:14.655904 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.655888 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 00:03:14.665188 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.665161 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zk2kp"] Jun 09 00:03:14.729461 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.729435 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b7359f6-2691-4826-b282-a4a7be87fc3f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk2kp\" (UID: \"3b7359f6-2691-4826-b282-a4a7be87fc3f\") " pod="openshift-insights/insights-runtime-extractor-zk2kp" Jun 09 00:03:14.729461 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.729465 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b7359f6-2691-4826-b282-a4a7be87fc3f-data-volume\") pod \"insights-runtime-extractor-zk2kp\" (UID: \"3b7359f6-2691-4826-b282-a4a7be87fc3f\") " pod="openshift-insights/insights-runtime-extractor-zk2kp" Jun 09 00:03:14.729644 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.729484 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b7359f6-2691-4826-b282-a4a7be87fc3f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk2kp\" (UID: \"3b7359f6-2691-4826-b282-a4a7be87fc3f\") " pod="openshift-insights/insights-runtime-extractor-zk2kp" Jun 09 00:03:14.729644 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.729505 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2fxp\" (UniqueName: \"kubernetes.io/projected/3b7359f6-2691-4826-b282-a4a7be87fc3f-kube-api-access-v2fxp\") pod \"insights-runtime-extractor-zk2kp\" (UID: \"3b7359f6-2691-4826-b282-a4a7be87fc3f\") " pod="openshift-insights/insights-runtime-extractor-zk2kp" Jun 09 00:03:14.729644 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.729578 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3b7359f6-2691-4826-b282-a4a7be87fc3f-crio-socket\") pod \"insights-runtime-extractor-zk2kp\" (UID: \"3b7359f6-2691-4826-b282-a4a7be87fc3f\") " pod="openshift-insights/insights-runtime-extractor-zk2kp" Jun 09 00:03:14.830567 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.830535 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3b7359f6-2691-4826-b282-a4a7be87fc3f-crio-socket\") pod \"insights-runtime-extractor-zk2kp\" (UID: \"3b7359f6-2691-4826-b282-a4a7be87fc3f\") " pod="openshift-insights/insights-runtime-extractor-zk2kp" Jun 09 00:03:14.830731 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.830593 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b7359f6-2691-4826-b282-a4a7be87fc3f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk2kp\" (UID: \"3b7359f6-2691-4826-b282-a4a7be87fc3f\") " pod="openshift-insights/insights-runtime-extractor-zk2kp" Jun 09 00:03:14.830731 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.830641 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b7359f6-2691-4826-b282-a4a7be87fc3f-data-volume\") pod \"insights-runtime-extractor-zk2kp\" (UID: \"3b7359f6-2691-4826-b282-a4a7be87fc3f\") " pod="openshift-insights/insights-runtime-extractor-zk2kp" Jun 09 00:03:14.830731 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.830659 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b7359f6-2691-4826-b282-a4a7be87fc3f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk2kp\" (UID: \"3b7359f6-2691-4826-b282-a4a7be87fc3f\") " pod="openshift-insights/insights-runtime-extractor-zk2kp" Jun 09 00:03:14.830731 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.830669 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3b7359f6-2691-4826-b282-a4a7be87fc3f-crio-socket\") pod \"insights-runtime-extractor-zk2kp\" (UID: \"3b7359f6-2691-4826-b282-a4a7be87fc3f\") " pod="openshift-insights/insights-runtime-extractor-zk2kp" Jun 09 00:03:14.830731 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.830676 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2fxp\" (UniqueName: \"kubernetes.io/projected/3b7359f6-2691-4826-b282-a4a7be87fc3f-kube-api-access-v2fxp\") pod \"insights-runtime-extractor-zk2kp\" (UID: \"3b7359f6-2691-4826-b282-a4a7be87fc3f\") " pod="openshift-insights/insights-runtime-extractor-zk2kp" Jun 09 00:03:14.831057 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.831033 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b7359f6-2691-4826-b282-a4a7be87fc3f-data-volume\") pod \"insights-runtime-extractor-zk2kp\" (UID: \"3b7359f6-2691-4826-b282-a4a7be87fc3f\") " pod="openshift-insights/insights-runtime-extractor-zk2kp" Jun 09 00:03:14.831215 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.831200 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b7359f6-2691-4826-b282-a4a7be87fc3f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zk2kp\" (UID: \"3b7359f6-2691-4826-b282-a4a7be87fc3f\") " pod="openshift-insights/insights-runtime-extractor-zk2kp" Jun 09 00:03:14.833110 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.833090 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b7359f6-2691-4826-b282-a4a7be87fc3f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zk2kp\" (UID: \"3b7359f6-2691-4826-b282-a4a7be87fc3f\") " pod="openshift-insights/insights-runtime-extractor-zk2kp" Jun 09 00:03:14.839384 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.839367 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2fxp\" (UniqueName: \"kubernetes.io/projected/3b7359f6-2691-4826-b282-a4a7be87fc3f-kube-api-access-v2fxp\") pod \"insights-runtime-extractor-zk2kp\" (UID: \"3b7359f6-2691-4826-b282-a4a7be87fc3f\") " pod="openshift-insights/insights-runtime-extractor-zk2kp" Jun 09 00:03:14.960742 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:14.960675 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zk2kp" Jun 09 00:03:15.083883 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:15.083861 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zk2kp"] Jun 09 00:03:15.086223 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:03:15.086196 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b7359f6_2691_4826_b282_a4a7be87fc3f.slice/crio-761c078e438196251bd0dad9fa9e0aaabc5e8c65a2d85bc6e6abdb4a1011b696 WatchSource:0}: Error finding container 761c078e438196251bd0dad9fa9e0aaabc5e8c65a2d85bc6e6abdb4a1011b696: Status 404 returned error can't find the container with id 761c078e438196251bd0dad9fa9e0aaabc5e8c65a2d85bc6e6abdb4a1011b696 Jun 09 00:03:15.604228 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:15.604178 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zk2kp" event={"ID":"3b7359f6-2691-4826-b282-a4a7be87fc3f","Type":"ContainerStarted","Data":"35f4832d3a272dd36e0197ada3d8c2827b117d9afb332b76e472c7683e97c99e"} Jun 09 00:03:15.604444 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:15.604252 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zk2kp" event={"ID":"3b7359f6-2691-4826-b282-a4a7be87fc3f","Type":"ContainerStarted","Data":"761c078e438196251bd0dad9fa9e0aaabc5e8c65a2d85bc6e6abdb4a1011b696"} Jun 09 00:03:16.613177 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:16.613141 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zk2kp" event={"ID":"3b7359f6-2691-4826-b282-a4a7be87fc3f","Type":"ContainerStarted","Data":"464c1ba3cdbd6395e987a43dd22b470b4fb739f4b0760bfb0854c62b0f4f5acf"} Jun 09 00:03:17.618091 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:17.618050 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zk2kp" event={"ID":"3b7359f6-2691-4826-b282-a4a7be87fc3f","Type":"ContainerStarted","Data":"31e02f6bc468e42e27511b3f954bb6e17c091e0d59ea58fa6815e8b1b23855ba"} Jun 09 00:03:17.637726 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:17.637684 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zk2kp" podStartSLOduration=1.378784663 podStartE2EDuration="3.637668687s" totalImagesPullingTime="2.258884024s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:03:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:17.63687768 +0000 UTC m=+238.252941529" watchObservedRunningTime="2026-06-09 00:03:17.637668687 +0000 UTC m=+238.253732522" Jun 09 00:03:28.921516 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:28.921457 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mjwlt"] Jun 09 00:03:28.923748 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:28.923727 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:28.926353 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:28.926331 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 00:03:28.927669 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:28.927640 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 00:03:28.927792 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:28.927640 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g5hh8\"" Jun 09 00:03:28.927792 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:28.927640 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 00:03:28.927792 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:28.927644 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 00:03:28.927792 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:28.927686 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 00:03:28.928291 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:28.928278 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 00:03:29.038357 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.038310 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d63a8ab0-add3-4428-af41-030b7a71e333-node-exporter-textfile\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.038357 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.038360 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6tlk\" (UniqueName: \"kubernetes.io/projected/d63a8ab0-add3-4428-af41-030b7a71e333-kube-api-access-j6tlk\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.038599 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.038426 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d63a8ab0-add3-4428-af41-030b7a71e333-metrics-client-ca\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.038599 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.038465 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d63a8ab0-add3-4428-af41-030b7a71e333-node-exporter-wtmp\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.038599 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.038541 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d63a8ab0-add3-4428-af41-030b7a71e333-node-exporter-tls\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.038599 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.038582 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d63a8ab0-add3-4428-af41-030b7a71e333-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.038792 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.038645 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d63a8ab0-add3-4428-af41-030b7a71e333-sys\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.038792 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.038686 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d63a8ab0-add3-4428-af41-030b7a71e333-root\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.038792 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.038701 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d63a8ab0-add3-4428-af41-030b7a71e333-node-exporter-accelerators-collector-config\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.139418 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.139382 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d63a8ab0-add3-4428-af41-030b7a71e333-node-exporter-textfile\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.139586 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.139422 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6tlk\" (UniqueName: \"kubernetes.io/projected/d63a8ab0-add3-4428-af41-030b7a71e333-kube-api-access-j6tlk\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.139586 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.139549 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d63a8ab0-add3-4428-af41-030b7a71e333-metrics-client-ca\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.139745 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.139587 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d63a8ab0-add3-4428-af41-030b7a71e333-node-exporter-wtmp\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.139745 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.139643 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d63a8ab0-add3-4428-af41-030b7a71e333-node-exporter-tls\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.139745 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.139677 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d63a8ab0-add3-4428-af41-030b7a71e333-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.139745 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.139712 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d63a8ab0-add3-4428-af41-030b7a71e333-sys\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.139929 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.139763 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d63a8ab0-add3-4428-af41-030b7a71e333-root\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.139929 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.139757 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d63a8ab0-add3-4428-af41-030b7a71e333-node-exporter-textfile\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.139929 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.139790 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d63a8ab0-add3-4428-af41-030b7a71e333-node-exporter-accelerators-collector-config\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.139929 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.139806 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d63a8ab0-add3-4428-af41-030b7a71e333-node-exporter-wtmp\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.139929 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.139814 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d63a8ab0-add3-4428-af41-030b7a71e333-sys\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.139929 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.139861 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d63a8ab0-add3-4428-af41-030b7a71e333-root\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.140144 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.140124 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d63a8ab0-add3-4428-af41-030b7a71e333-metrics-client-ca\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.140220 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.140196 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d63a8ab0-add3-4428-af41-030b7a71e333-node-exporter-accelerators-collector-config\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.142014 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.141987 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d63a8ab0-add3-4428-af41-030b7a71e333-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.142097 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.142019 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d63a8ab0-add3-4428-af41-030b7a71e333-node-exporter-tls\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.146435 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.146411 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6tlk\" (UniqueName: \"kubernetes.io/projected/d63a8ab0-add3-4428-af41-030b7a71e333-kube-api-access-j6tlk\") pod \"node-exporter-mjwlt\" (UID: \"d63a8ab0-add3-4428-af41-030b7a71e333\") " pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.233174 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.233110 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mjwlt" Jun 09 00:03:29.242704 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:03:29.242671 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd63a8ab0_add3_4428_af41_030b7a71e333.slice/crio-da45b79aee85465bd98796f270ee8d3eeea0343632af13170f642a6f83de538d WatchSource:0}: Error finding container da45b79aee85465bd98796f270ee8d3eeea0343632af13170f642a6f83de538d: Status 404 returned error can't find the container with id da45b79aee85465bd98796f270ee8d3eeea0343632af13170f642a6f83de538d Jun 09 00:03:29.657850 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:29.657815 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mjwlt" event={"ID":"d63a8ab0-add3-4428-af41-030b7a71e333","Type":"ContainerStarted","Data":"da45b79aee85465bd98796f270ee8d3eeea0343632af13170f642a6f83de538d"} Jun 09 00:03:30.662440 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:30.662404 2515 generic.go:356] "Generic (PLEG): container finished" podID="d63a8ab0-add3-4428-af41-030b7a71e333" containerID="0ae96267d3114df4d350cecb6dad858fb3f0b12b1388594fd70ad1c93c8e546d" exitCode=0 Jun 09 00:03:30.662869 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:30.662463 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mjwlt" event={"ID":"d63a8ab0-add3-4428-af41-030b7a71e333","Type":"ContainerDied","Data":"0ae96267d3114df4d350cecb6dad858fb3f0b12b1388594fd70ad1c93c8e546d"} Jun 09 00:03:30.886685 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:30.886654 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6bf87b895d-rmzwh"] Jun 09 00:03:30.888873 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:30.888858 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:30.891436 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:30.891407 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-48bk5\"" Jun 09 00:03:30.891580 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:30.891471 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 09 00:03:30.891580 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:30.891408 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 09 00:03:30.891580 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:30.891522 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 09 00:03:30.891756 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:30.891572 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 09 00:03:30.891756 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:30.891638 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-d1ihteebm3fd6\"" Jun 09 00:03:30.891756 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:30.891751 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 09 00:03:30.900705 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:30.900684 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6bf87b895d-rmzwh"] Jun 09 00:03:31.055693 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.055588 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7cb7df1f-2c77-4142-a260-06121be0f5a2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.055693 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.055642 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7cb7df1f-2c77-4142-a260-06121be0f5a2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.055919 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.055742 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7cb7df1f-2c77-4142-a260-06121be0f5a2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.055919 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.055777 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ft6v\" (UniqueName: \"kubernetes.io/projected/7cb7df1f-2c77-4142-a260-06121be0f5a2-kube-api-access-5ft6v\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.055919 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.055833 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7cb7df1f-2c77-4142-a260-06121be0f5a2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.055919 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.055864 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7cb7df1f-2c77-4142-a260-06121be0f5a2-secret-grpc-tls\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.055919 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.055893 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7cb7df1f-2c77-4142-a260-06121be0f5a2-secret-thanos-querier-tls\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.056118 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.055928 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cb7df1f-2c77-4142-a260-06121be0f5a2-metrics-client-ca\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.157060 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.157031 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7cb7df1f-2c77-4142-a260-06121be0f5a2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.157060 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.157062 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7cb7df1f-2c77-4142-a260-06121be0f5a2-secret-grpc-tls\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.157268 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.157079 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7cb7df1f-2c77-4142-a260-06121be0f5a2-secret-thanos-querier-tls\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.157268 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.157100 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cb7df1f-2c77-4142-a260-06121be0f5a2-metrics-client-ca\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.157268 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.157141 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7cb7df1f-2c77-4142-a260-06121be0f5a2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.157268 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.157160 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7cb7df1f-2c77-4142-a260-06121be0f5a2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.157268 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.157193 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7cb7df1f-2c77-4142-a260-06121be0f5a2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.157268 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.157218 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ft6v\" (UniqueName: \"kubernetes.io/projected/7cb7df1f-2c77-4142-a260-06121be0f5a2-kube-api-access-5ft6v\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.158123 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.158083 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cb7df1f-2c77-4142-a260-06121be0f5a2-metrics-client-ca\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.159924 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.159898 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7cb7df1f-2c77-4142-a260-06121be0f5a2-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.160029 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.159978 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7cb7df1f-2c77-4142-a260-06121be0f5a2-secret-grpc-tls\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.160199 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.160177 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7cb7df1f-2c77-4142-a260-06121be0f5a2-secret-thanos-querier-tls\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.160251 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.160187 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7cb7df1f-2c77-4142-a260-06121be0f5a2-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.160251 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.160233 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7cb7df1f-2c77-4142-a260-06121be0f5a2-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.160358 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.160248 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7cb7df1f-2c77-4142-a260-06121be0f5a2-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.166129 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.166092 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ft6v\" (UniqueName: \"kubernetes.io/projected/7cb7df1f-2c77-4142-a260-06121be0f5a2-kube-api-access-5ft6v\") pod \"thanos-querier-6bf87b895d-rmzwh\" (UID: \"7cb7df1f-2c77-4142-a260-06121be0f5a2\") " pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.197411 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.197378 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:31.321132 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.321048 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6bf87b895d-rmzwh"] Jun 09 00:03:31.324431 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:03:31.324405 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cb7df1f_2c77_4142_a260_06121be0f5a2.slice/crio-d26a69edb6d1f332e31ffd95b07a21205926b07b90684759326df09aac7ada01 WatchSource:0}: Error finding container d26a69edb6d1f332e31ffd95b07a21205926b07b90684759326df09aac7ada01: Status 404 returned error can't find the container with id d26a69edb6d1f332e31ffd95b07a21205926b07b90684759326df09aac7ada01 Jun 09 00:03:31.671772 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.671734 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mjwlt" event={"ID":"d63a8ab0-add3-4428-af41-030b7a71e333","Type":"ContainerStarted","Data":"6fd7e994ad3cdbe5eadd228bc2b216b717d0c12476e3457f2222119ac0cc36e3"} Jun 09 00:03:31.672214 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.671822 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mjwlt" event={"ID":"d63a8ab0-add3-4428-af41-030b7a71e333","Type":"ContainerStarted","Data":"f18ac04cd0635cf93349fbd557af1215b9039910a696daa7ebaf2cb328711fc1"} Jun 09 00:03:31.672833 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.672810 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" event={"ID":"7cb7df1f-2c77-4142-a260-06121be0f5a2","Type":"ContainerStarted","Data":"d26a69edb6d1f332e31ffd95b07a21205926b07b90684759326df09aac7ada01"} Jun 09 00:03:31.689305 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.689261 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mjwlt" podStartSLOduration=2.639751324 podStartE2EDuration="3.689248998s" totalImagesPullingTime="986.120958ms" totalInitContainerRuntime="63.376716ms" isStatefulPod=true podCreationTimestamp="2026-06-09 00:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:31.688315553 +0000 UTC m=+252.304379389" watchObservedRunningTime="2026-06-09 00:03:31.689248998 +0000 UTC m=+252.305312833" Jun 09 00:03:31.761109 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.761077 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs\") pod \"network-metrics-daemon-np4v6\" (UID: \"1c75857e-660f-4c6b-a33d-6bd990f4089f\") " pod="openshift-multus/network-metrics-daemon-np4v6" Jun 09 00:03:31.763259 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.763238 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1c75857e-660f-4c6b-a33d-6bd990f4089f-metrics-certs\") pod \"network-metrics-daemon-np4v6\" (UID: \"1c75857e-660f-4c6b-a33d-6bd990f4089f\") " pod="openshift-multus/network-metrics-daemon-np4v6" Jun 09 00:03:31.860939 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.860915 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k7v6c\"" Jun 09 00:03:31.869424 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.869396 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-np4v6" Jun 09 00:03:31.992461 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:31.992434 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-np4v6"] Jun 09 00:03:31.995819 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:03:31.995793 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c75857e_660f_4c6b_a33d_6bd990f4089f.slice/crio-0dc2eb4124a65e44d48f53c0095735e72f66ca7fe55d25baffb6ae8590ec2fab WatchSource:0}: Error finding container 0dc2eb4124a65e44d48f53c0095735e72f66ca7fe55d25baffb6ae8590ec2fab: Status 404 returned error can't find the container with id 0dc2eb4124a65e44d48f53c0095735e72f66ca7fe55d25baffb6ae8590ec2fab Jun 09 00:03:32.677786 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:32.677750 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-np4v6" event={"ID":"1c75857e-660f-4c6b-a33d-6bd990f4089f","Type":"ContainerStarted","Data":"0dc2eb4124a65e44d48f53c0095735e72f66ca7fe55d25baffb6ae8590ec2fab"} Jun 09 00:03:33.682536 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:33.682495 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-np4v6" event={"ID":"1c75857e-660f-4c6b-a33d-6bd990f4089f","Type":"ContainerStarted","Data":"d89b8a2a1124dcabd671c3dec0001c75faed18ed19cd75ad4411e606e0a22e7f"} Jun 09 00:03:33.682980 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:33.682549 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-np4v6" event={"ID":"1c75857e-660f-4c6b-a33d-6bd990f4089f","Type":"ContainerStarted","Data":"5c10126a7677f4b663c9e8a0ee5203a940eaedff4fd0874b455661091adc9e51"} Jun 09 00:03:33.700398 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:33.699790 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-np4v6" podStartSLOduration=252.908208204 podStartE2EDuration="4m13.699771148s" totalImagesPullingTime="791.562944ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 23:59:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:33.699709596 +0000 UTC m=+254.315773432" watchObservedRunningTime="2026-06-09 00:03:33.699771148 +0000 UTC m=+254.315834983" Jun 09 00:03:34.687733 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:34.687703 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" event={"ID":"7cb7df1f-2c77-4142-a260-06121be0f5a2","Type":"ContainerStarted","Data":"dce06123af3fbf80c07e3fa265ffe45c77bfe8fcddeb8e934ff052f930a94acc"} Jun 09 00:03:34.688061 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:34.687765 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" event={"ID":"7cb7df1f-2c77-4142-a260-06121be0f5a2","Type":"ContainerStarted","Data":"ea9e1850938b6698412be79b50a81544497e3c364c2db6c5e1439145eb2d7e7e"} Jun 09 00:03:34.688061 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:34.687798 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" event={"ID":"7cb7df1f-2c77-4142-a260-06121be0f5a2","Type":"ContainerStarted","Data":"4907f2295d3e85e75ab1a11c3138360a8520af08105f71a8e76a45c54fafb881"} Jun 09 00:03:35.693729 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:35.693698 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" event={"ID":"7cb7df1f-2c77-4142-a260-06121be0f5a2","Type":"ContainerStarted","Data":"ed7bb0552d2827becfb96c3b65f52a033143b45e924fef8d5cff1864c3cd457c"} Jun 09 00:03:35.694007 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:35.693772 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" event={"ID":"7cb7df1f-2c77-4142-a260-06121be0f5a2","Type":"ContainerStarted","Data":"aa6c008f47bb0146486c3225805612a082543273a29e7cf414b5510f9ed55129"} Jun 09 00:03:36.700123 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:36.700088 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" event={"ID":"7cb7df1f-2c77-4142-a260-06121be0f5a2","Type":"ContainerStarted","Data":"37329baa45ecb0ac44aef5d9c3102cd81db047120fde6e12cddd35f1c09df3eb"} Jun 09 00:03:36.700526 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:36.700249 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:03:36.721599 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:36.721546 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" podStartSLOduration=2.663181904 podStartE2EDuration="6.72153206s" totalImagesPullingTime="4.058350156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:03:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:03:36.719687638 +0000 UTC m=+257.335751473" watchObservedRunningTime="2026-06-09 00:03:36.72153206 +0000 UTC m=+257.337595895" Jun 09 00:03:42.708706 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:03:42.708678 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6bf87b895d-rmzwh" Jun 09 00:04:00.370446 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:04:00.370403 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bfrbb" podUID="16c6b841-08b7-4fd3-9892-e91359f0b9da" Jun 09 00:04:00.774895 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:00.774817 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bfrbb" Jun 09 00:04:04.274859 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:04.274811 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls\") pod \"dns-default-bfrbb\" (UID: \"16c6b841-08b7-4fd3-9892-e91359f0b9da\") " pod="openshift-dns/dns-default-bfrbb" Jun 09 00:04:04.277150 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:04.277124 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16c6b841-08b7-4fd3-9892-e91359f0b9da-metrics-tls\") pod \"dns-default-bfrbb\" (UID: \"16c6b841-08b7-4fd3-9892-e91359f0b9da\") " pod="openshift-dns/dns-default-bfrbb" Jun 09 00:04:04.377937 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:04.377907 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cw7xv\"" Jun 09 00:04:04.385966 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:04.385944 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bfrbb" Jun 09 00:04:04.511513 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:04.511484 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bfrbb"] Jun 09 00:04:04.514661 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:04:04.514635 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16c6b841_08b7_4fd3_9892_e91359f0b9da.slice/crio-e66653ce6a0083b7460fffadb46ec1515080eb0fee8027d070c70c4355c7ec38 WatchSource:0}: Error finding container e66653ce6a0083b7460fffadb46ec1515080eb0fee8027d070c70c4355c7ec38: Status 404 returned error can't find the container with id e66653ce6a0083b7460fffadb46ec1515080eb0fee8027d070c70c4355c7ec38 Jun 09 00:04:04.788782 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:04.788748 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bfrbb" event={"ID":"16c6b841-08b7-4fd3-9892-e91359f0b9da","Type":"ContainerStarted","Data":"e66653ce6a0083b7460fffadb46ec1515080eb0fee8027d070c70c4355c7ec38"} Jun 09 00:04:06.797173 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:06.797135 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bfrbb" event={"ID":"16c6b841-08b7-4fd3-9892-e91359f0b9da","Type":"ContainerStarted","Data":"b3fa7e120f1e36f09a357040f8244b4972b2c5f47db748dde5f057aad452cbf7"} Jun 09 00:04:06.797572 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:06.797233 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bfrbb" event={"ID":"16c6b841-08b7-4fd3-9892-e91359f0b9da","Type":"ContainerStarted","Data":"d1803c69cd7bb64628b86f4f620a430e2df604c5cdbafab1d3641f5dd3ae7fa5"} Jun 09 00:04:06.797572 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:06.797265 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bfrbb" Jun 09 00:04:06.812953 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:06.812905 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bfrbb" podStartSLOduration=251.399318495 podStartE2EDuration="4m12.812891022s" totalImagesPullingTime="1.413572527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 23:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:04:06.812397266 +0000 UTC m=+287.428461101" watchObservedRunningTime="2026-06-09 00:04:06.812891022 +0000 UTC m=+287.428954872" Jun 09 00:04:14.593969 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:14.593938 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mjwlt_d63a8ab0-add3-4428-af41-030b7a71e333/init-textfile/0.log" Jun 09 00:04:14.795210 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:14.795179 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mjwlt_d63a8ab0-add3-4428-af41-030b7a71e333/node-exporter/0.log" Jun 09 00:04:14.994049 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:14.993982 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mjwlt_d63a8ab0-add3-4428-af41-030b7a71e333/kube-rbac-proxy/0.log" Jun 09 00:04:16.803731 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:16.803696 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bfrbb" Jun 09 00:04:18.995028 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:18.995001 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bf87b895d-rmzwh_7cb7df1f-2c77-4142-a260-06121be0f5a2/thanos-query/0.log" Jun 09 00:04:19.194412 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:19.194383 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bf87b895d-rmzwh_7cb7df1f-2c77-4142-a260-06121be0f5a2/kube-rbac-proxy-web/0.log" Jun 09 00:04:19.393985 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:19.393958 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bf87b895d-rmzwh_7cb7df1f-2c77-4142-a260-06121be0f5a2/kube-rbac-proxy/0.log" Jun 09 00:04:19.594321 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:19.594293 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bf87b895d-rmzwh_7cb7df1f-2c77-4142-a260-06121be0f5a2/prom-label-proxy/0.log" Jun 09 00:04:19.797500 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:19.797418 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bf87b895d-rmzwh_7cb7df1f-2c77-4142-a260-06121be0f5a2/kube-rbac-proxy-rules/0.log" Jun 09 00:04:19.812727 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:19.812703 2515 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 00:04:19.995012 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:19.994878 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bf87b895d-rmzwh_7cb7df1f-2c77-4142-a260-06121be0f5a2/kube-rbac-proxy-metrics/0.log" Jun 09 00:04:21.794557 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:21.794531 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bfrbb_16c6b841-08b7-4fd3-9892-e91359f0b9da/dns/0.log" Jun 09 00:04:21.995396 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:21.995371 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bfrbb_16c6b841-08b7-4fd3-9892-e91359f0b9da/kube-rbac-proxy/0.log" Jun 09 00:04:22.202485 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:22.202447 2515 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" podUID="a302388a-ab5f-466a-b4f7-5e86bf8c989e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 00:04:22.994377 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:22.994352 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z9m44_6b0fff56-c56a-4650-afd0-ac7fd0e1a935/dns-node-resolver/0.log" Jun 09 00:04:24.194870 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:24.194842 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vmc2d_dd97edb7-dec0-40fc-85e0-9bb56a3e33eb/node-ca/0.log" Jun 09 00:04:24.795273 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:24.795249 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q4pkm_477599c7-e5d0-41d4-b3e2-93b56c4ae38b/serve-healthcheck-canary/0.log" Jun 09 00:04:32.203183 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:32.203140 2515 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" podUID="a302388a-ab5f-466a-b4f7-5e86bf8c989e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 00:04:42.202535 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:42.202498 2515 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" podUID="a302388a-ab5f-466a-b4f7-5e86bf8c989e" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 00:04:42.202929 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:42.202566 2515 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" Jun 09 00:04:42.203036 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:42.203006 2515 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"cfaa881a2ed02efbcca0cdc72be7ba7356914ed0dbbe888525febd34710235ef"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 09 00:04:42.203076 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:42.203055 2515 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" podUID="a302388a-ab5f-466a-b4f7-5e86bf8c989e" containerName="service-proxy" containerID="cri-o://cfaa881a2ed02efbcca0cdc72be7ba7356914ed0dbbe888525febd34710235ef" gracePeriod=30 Jun 09 00:04:42.921314 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:42.921278 2515 generic.go:356] "Generic (PLEG): container finished" podID="a302388a-ab5f-466a-b4f7-5e86bf8c989e" containerID="cfaa881a2ed02efbcca0cdc72be7ba7356914ed0dbbe888525febd34710235ef" exitCode=2 Jun 09 00:04:42.921476 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:42.921350 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" event={"ID":"a302388a-ab5f-466a-b4f7-5e86bf8c989e","Type":"ContainerDied","Data":"cfaa881a2ed02efbcca0cdc72be7ba7356914ed0dbbe888525febd34710235ef"} Jun 09 00:04:42.921476 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:04:42.921390 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9b894846-9fplm" event={"ID":"a302388a-ab5f-466a-b4f7-5e86bf8c989e","Type":"ContainerStarted","Data":"6d04130f06758c79484f1962190a770b1c69361ef5d023eb9d28bcf33bcaddaa"} Jun 09 00:07:08.571801 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.571770 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84"] Jun 09 00:07:08.574876 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.574765 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" Jun 09 00:07:08.577217 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.577190 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 00:07:08.577469 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.577450 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 00:07:08.577575 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.577559 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 00:07:08.577878 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.577860 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zkkk7\"" Jun 09 00:07:08.577931 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.577896 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 00:07:08.592832 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.592806 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84"] Jun 09 00:07:08.665072 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.665037 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/17483ac7-7aef-4c7d-8c80-08fab53de7dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-569d667bc9-9mx84\" (UID: \"17483ac7-7aef-4c7d-8c80-08fab53de7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" Jun 09 00:07:08.665239 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.665096 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17483ac7-7aef-4c7d-8c80-08fab53de7dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-569d667bc9-9mx84\" (UID: \"17483ac7-7aef-4c7d-8c80-08fab53de7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" Jun 09 00:07:08.665239 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.665137 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/17483ac7-7aef-4c7d-8c80-08fab53de7dc-manifests\") pod \"opendatahub-operator-controller-manager-569d667bc9-9mx84\" (UID: \"17483ac7-7aef-4c7d-8c80-08fab53de7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" Jun 09 00:07:08.665239 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.665173 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfclk\" (UniqueName: \"kubernetes.io/projected/17483ac7-7aef-4c7d-8c80-08fab53de7dc-kube-api-access-pfclk\") pod \"opendatahub-operator-controller-manager-569d667bc9-9mx84\" (UID: \"17483ac7-7aef-4c7d-8c80-08fab53de7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" Jun 09 00:07:08.665239 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.665233 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17483ac7-7aef-4c7d-8c80-08fab53de7dc-tmp\") pod \"opendatahub-operator-controller-manager-569d667bc9-9mx84\" (UID: \"17483ac7-7aef-4c7d-8c80-08fab53de7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" Jun 09 00:07:08.765595 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.765560 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17483ac7-7aef-4c7d-8c80-08fab53de7dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-569d667bc9-9mx84\" (UID: \"17483ac7-7aef-4c7d-8c80-08fab53de7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" Jun 09 00:07:08.765595 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.765596 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/17483ac7-7aef-4c7d-8c80-08fab53de7dc-manifests\") pod \"opendatahub-operator-controller-manager-569d667bc9-9mx84\" (UID: \"17483ac7-7aef-4c7d-8c80-08fab53de7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" Jun 09 00:07:08.765848 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.765638 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfclk\" (UniqueName: \"kubernetes.io/projected/17483ac7-7aef-4c7d-8c80-08fab53de7dc-kube-api-access-pfclk\") pod \"opendatahub-operator-controller-manager-569d667bc9-9mx84\" (UID: \"17483ac7-7aef-4c7d-8c80-08fab53de7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" Jun 09 00:07:08.765848 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.765677 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17483ac7-7aef-4c7d-8c80-08fab53de7dc-tmp\") pod \"opendatahub-operator-controller-manager-569d667bc9-9mx84\" (UID: \"17483ac7-7aef-4c7d-8c80-08fab53de7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" Jun 09 00:07:08.765848 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.765695 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/17483ac7-7aef-4c7d-8c80-08fab53de7dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-569d667bc9-9mx84\" (UID: \"17483ac7-7aef-4c7d-8c80-08fab53de7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" Jun 09 00:07:08.766088 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.766064 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/17483ac7-7aef-4c7d-8c80-08fab53de7dc-manifests\") pod \"opendatahub-operator-controller-manager-569d667bc9-9mx84\" (UID: \"17483ac7-7aef-4c7d-8c80-08fab53de7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" Jun 09 00:07:08.767883 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.767862 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/17483ac7-7aef-4c7d-8c80-08fab53de7dc-tmp\") pod \"opendatahub-operator-controller-manager-569d667bc9-9mx84\" (UID: \"17483ac7-7aef-4c7d-8c80-08fab53de7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" Jun 09 00:07:08.768020 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.768004 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/17483ac7-7aef-4c7d-8c80-08fab53de7dc-webhook-cert\") pod \"opendatahub-operator-controller-manager-569d667bc9-9mx84\" (UID: \"17483ac7-7aef-4c7d-8c80-08fab53de7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" Jun 09 00:07:08.768117 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.768101 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/17483ac7-7aef-4c7d-8c80-08fab53de7dc-apiservice-cert\") pod \"opendatahub-operator-controller-manager-569d667bc9-9mx84\" (UID: \"17483ac7-7aef-4c7d-8c80-08fab53de7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" Jun 09 00:07:08.774765 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.774742 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfclk\" (UniqueName: \"kubernetes.io/projected/17483ac7-7aef-4c7d-8c80-08fab53de7dc-kube-api-access-pfclk\") pod \"opendatahub-operator-controller-manager-569d667bc9-9mx84\" (UID: \"17483ac7-7aef-4c7d-8c80-08fab53de7dc\") " pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" Jun 09 00:07:08.884521 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:08.884489 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" Jun 09 00:07:09.010115 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:09.010087 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84"] Jun 09 00:07:09.013483 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:07:09.013455 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17483ac7_7aef_4c7d_8c80_08fab53de7dc.slice/crio-e89be1b06ecb4884d302a8cf39dd4d7df3e6212439fa54a6c12288afd2648686 WatchSource:0}: Error finding container e89be1b06ecb4884d302a8cf39dd4d7df3e6212439fa54a6c12288afd2648686: Status 404 returned error can't find the container with id e89be1b06ecb4884d302a8cf39dd4d7df3e6212439fa54a6c12288afd2648686 Jun 09 00:07:09.015220 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:09.015201 2515 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 00:07:09.399087 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:09.399053 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" event={"ID":"17483ac7-7aef-4c7d-8c80-08fab53de7dc","Type":"ContainerStarted","Data":"e89be1b06ecb4884d302a8cf39dd4d7df3e6212439fa54a6c12288afd2648686"} Jun 09 00:07:13.415821 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:13.415785 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" event={"ID":"17483ac7-7aef-4c7d-8c80-08fab53de7dc","Type":"ContainerStarted","Data":"8c44372299f4cad3b1b358f2fc24c2e20d346e6021ebe05ae86c773b848a2cd4"} Jun 09 00:07:14.420548 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:14.420515 2515 generic.go:356] "Generic (PLEG): container finished" podID="17483ac7-7aef-4c7d-8c80-08fab53de7dc" containerID="8c44372299f4cad3b1b358f2fc24c2e20d346e6021ebe05ae86c773b848a2cd4" exitCode=0 Jun 09 00:07:14.420957 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:14.420559 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" event={"ID":"17483ac7-7aef-4c7d-8c80-08fab53de7dc","Type":"ContainerDied","Data":"8c44372299f4cad3b1b358f2fc24c2e20d346e6021ebe05ae86c773b848a2cd4"} Jun 09 00:07:15.430294 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:15.430261 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" event={"ID":"17483ac7-7aef-4c7d-8c80-08fab53de7dc","Type":"ContainerStarted","Data":"c5bec6f722a05d8e5a24144b6f96f0b1ca1a76b485791b2cad133360612aa5ea"} Jun 09 00:07:15.430686 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:15.430403 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" Jun 09 00:07:15.454407 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:15.454367 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" podStartSLOduration=2.199914746 podStartE2EDuration="7.454353636s" totalImagesPullingTime="4.282014217s" totalInitContainerRuntime="972.424673ms" isStatefulPod=false podCreationTimestamp="2026-06-09 00:07:08 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:07:15.452403758 +0000 UTC m=+476.068467593" watchObservedRunningTime="2026-06-09 00:07:15.454353636 +0000 UTC m=+476.070417472" Jun 09 00:07:26.435902 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:26.435867 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-569d667bc9-9mx84" Jun 09 00:07:28.751290 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:28.751258 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-tkmhw"] Jun 09 00:07:28.762192 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:28.762164 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-tkmhw"] Jun 09 00:07:28.762313 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:28.762268 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-tkmhw" Jun 09 00:07:28.764712 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:28.764690 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-kjppv\"" Jun 09 00:07:28.764831 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:28.764692 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 09 00:07:28.805724 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:28.805698 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4wq5\" (UniqueName: \"kubernetes.io/projected/4415c1a6-3105-4e83-9051-17490c0aa705-kube-api-access-c4wq5\") pod \"odh-model-controller-6dc94f689f-tkmhw\" (UID: \"4415c1a6-3105-4e83-9051-17490c0aa705\") " pod="opendatahub/odh-model-controller-6dc94f689f-tkmhw" Jun 09 00:07:28.805724 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:28.805727 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4415c1a6-3105-4e83-9051-17490c0aa705-cert\") pod \"odh-model-controller-6dc94f689f-tkmhw\" (UID: \"4415c1a6-3105-4e83-9051-17490c0aa705\") " pod="opendatahub/odh-model-controller-6dc94f689f-tkmhw" Jun 09 00:07:28.907037 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:28.907005 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4wq5\" (UniqueName: \"kubernetes.io/projected/4415c1a6-3105-4e83-9051-17490c0aa705-kube-api-access-c4wq5\") pod \"odh-model-controller-6dc94f689f-tkmhw\" (UID: \"4415c1a6-3105-4e83-9051-17490c0aa705\") " pod="opendatahub/odh-model-controller-6dc94f689f-tkmhw" Jun 09 00:07:28.907037 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:28.907041 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4415c1a6-3105-4e83-9051-17490c0aa705-cert\") pod \"odh-model-controller-6dc94f689f-tkmhw\" (UID: \"4415c1a6-3105-4e83-9051-17490c0aa705\") " pod="opendatahub/odh-model-controller-6dc94f689f-tkmhw" Jun 09 00:07:28.907247 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:07:28.907198 2515 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 09 00:07:28.907283 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:07:28.907249 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4415c1a6-3105-4e83-9051-17490c0aa705-cert podName:4415c1a6-3105-4e83-9051-17490c0aa705 nodeName:}" failed. No retries permitted until 2026-06-09 00:07:29.407232944 +0000 UTC m=+490.023296758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4415c1a6-3105-4e83-9051-17490c0aa705-cert") pod "odh-model-controller-6dc94f689f-tkmhw" (UID: "4415c1a6-3105-4e83-9051-17490c0aa705") : secret "odh-model-controller-webhook-cert" not found Jun 09 00:07:28.917239 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:28.917214 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4wq5\" (UniqueName: \"kubernetes.io/projected/4415c1a6-3105-4e83-9051-17490c0aa705-kube-api-access-c4wq5\") pod \"odh-model-controller-6dc94f689f-tkmhw\" (UID: \"4415c1a6-3105-4e83-9051-17490c0aa705\") " pod="opendatahub/odh-model-controller-6dc94f689f-tkmhw" Jun 09 00:07:29.283645 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:29.283598 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-z7sc6"] Jun 09 00:07:29.286623 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:29.286594 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-z7sc6" Jun 09 00:07:29.289082 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:29.289063 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 09 00:07:29.296631 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:29.296592 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-z7sc6"] Jun 09 00:07:29.310072 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:29.310049 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgzgh\" (UniqueName: \"kubernetes.io/projected/a0e5ebae-30dd-40b7-aaf5-a25c13114140-kube-api-access-lgzgh\") pod \"model-serving-api-5dd488fc48-z7sc6\" (UID: \"a0e5ebae-30dd-40b7-aaf5-a25c13114140\") " pod="opendatahub/model-serving-api-5dd488fc48-z7sc6" Jun 09 00:07:29.310164 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:29.310131 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0e5ebae-30dd-40b7-aaf5-a25c13114140-tls-certs\") pod \"model-serving-api-5dd488fc48-z7sc6\" (UID: \"a0e5ebae-30dd-40b7-aaf5-a25c13114140\") " pod="opendatahub/model-serving-api-5dd488fc48-z7sc6" Jun 09 00:07:29.410961 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:29.410929 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgzgh\" (UniqueName: \"kubernetes.io/projected/a0e5ebae-30dd-40b7-aaf5-a25c13114140-kube-api-access-lgzgh\") pod \"model-serving-api-5dd488fc48-z7sc6\" (UID: \"a0e5ebae-30dd-40b7-aaf5-a25c13114140\") " pod="opendatahub/model-serving-api-5dd488fc48-z7sc6" Jun 09 00:07:29.411114 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:29.410975 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4415c1a6-3105-4e83-9051-17490c0aa705-cert\") pod \"odh-model-controller-6dc94f689f-tkmhw\" (UID: \"4415c1a6-3105-4e83-9051-17490c0aa705\") " pod="opendatahub/odh-model-controller-6dc94f689f-tkmhw" Jun 09 00:07:29.411114 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:29.411001 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0e5ebae-30dd-40b7-aaf5-a25c13114140-tls-certs\") pod \"model-serving-api-5dd488fc48-z7sc6\" (UID: \"a0e5ebae-30dd-40b7-aaf5-a25c13114140\") " pod="opendatahub/model-serving-api-5dd488fc48-z7sc6" Jun 09 00:07:29.411114 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:07:29.411090 2515 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 09 00:07:29.411238 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:07:29.411151 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e5ebae-30dd-40b7-aaf5-a25c13114140-tls-certs podName:a0e5ebae-30dd-40b7-aaf5-a25c13114140 nodeName:}" failed. No retries permitted until 2026-06-09 00:07:29.911133798 +0000 UTC m=+490.527197611 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a0e5ebae-30dd-40b7-aaf5-a25c13114140-tls-certs") pod "model-serving-api-5dd488fc48-z7sc6" (UID: "a0e5ebae-30dd-40b7-aaf5-a25c13114140") : secret "model-serving-api-tls" not found Jun 09 00:07:29.413299 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:29.413273 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4415c1a6-3105-4e83-9051-17490c0aa705-cert\") pod \"odh-model-controller-6dc94f689f-tkmhw\" (UID: \"4415c1a6-3105-4e83-9051-17490c0aa705\") " pod="opendatahub/odh-model-controller-6dc94f689f-tkmhw" Jun 09 00:07:29.422473 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:29.422447 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgzgh\" (UniqueName: \"kubernetes.io/projected/a0e5ebae-30dd-40b7-aaf5-a25c13114140-kube-api-access-lgzgh\") pod \"model-serving-api-5dd488fc48-z7sc6\" (UID: \"a0e5ebae-30dd-40b7-aaf5-a25c13114140\") " pod="opendatahub/model-serving-api-5dd488fc48-z7sc6" Jun 09 00:07:29.673181 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:29.673145 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-tkmhw" Jun 09 00:07:29.793543 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:29.793482 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-tkmhw"] Jun 09 00:07:29.796201 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:07:29.796178 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4415c1a6_3105_4e83_9051_17490c0aa705.slice/crio-5df8e6765754d0b7ed53857306e93fbc5581698baee07539dfe1a57c1861fc86 WatchSource:0}: Error finding container 5df8e6765754d0b7ed53857306e93fbc5581698baee07539dfe1a57c1861fc86: Status 404 returned error can't find the container with id 5df8e6765754d0b7ed53857306e93fbc5581698baee07539dfe1a57c1861fc86 Jun 09 00:07:29.915047 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:29.915014 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0e5ebae-30dd-40b7-aaf5-a25c13114140-tls-certs\") pod \"model-serving-api-5dd488fc48-z7sc6\" (UID: \"a0e5ebae-30dd-40b7-aaf5-a25c13114140\") " pod="opendatahub/model-serving-api-5dd488fc48-z7sc6" Jun 09 00:07:29.917269 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:29.917240 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0e5ebae-30dd-40b7-aaf5-a25c13114140-tls-certs\") pod \"model-serving-api-5dd488fc48-z7sc6\" (UID: \"a0e5ebae-30dd-40b7-aaf5-a25c13114140\") " pod="opendatahub/model-serving-api-5dd488fc48-z7sc6" Jun 09 00:07:30.197808 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:30.197763 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-z7sc6" Jun 09 00:07:30.319987 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:30.319964 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-z7sc6"] Jun 09 00:07:30.322291 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:07:30.322260 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0e5ebae_30dd_40b7_aaf5_a25c13114140.slice/crio-e2183261200121d5c2e095d11e9f51290dcc663d5898f8f7c4729ebd81899108 WatchSource:0}: Error finding container e2183261200121d5c2e095d11e9f51290dcc663d5898f8f7c4729ebd81899108: Status 404 returned error can't find the container with id e2183261200121d5c2e095d11e9f51290dcc663d5898f8f7c4729ebd81899108 Jun 09 00:07:30.487785 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:30.487706 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-z7sc6" event={"ID":"a0e5ebae-30dd-40b7-aaf5-a25c13114140","Type":"ContainerStarted","Data":"e2183261200121d5c2e095d11e9f51290dcc663d5898f8f7c4729ebd81899108"} Jun 09 00:07:30.489328 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:30.489298 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-tkmhw" event={"ID":"4415c1a6-3105-4e83-9051-17490c0aa705","Type":"ContainerStarted","Data":"5df8e6765754d0b7ed53857306e93fbc5581698baee07539dfe1a57c1861fc86"} Jun 09 00:07:33.882928 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:33.882898 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8659c84586-fvq6v"] Jun 09 00:07:33.886427 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:33.886408 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8659c84586-fvq6v" Jun 09 00:07:33.889111 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:33.889085 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-g7f7v\"" Jun 09 00:07:33.889296 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:33.889275 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 00:07:33.890280 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:33.890258 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 00:07:33.890380 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:33.890277 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 00:07:33.890380 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:33.890263 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 00:07:33.893747 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:33.893696 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8659c84586-fvq6v"] Jun 09 00:07:33.950596 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:33.950563 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3d19ba3-577f-4e2b-838f-10e30f28b61e-tmp\") pod \"kube-auth-proxy-8659c84586-fvq6v\" (UID: \"f3d19ba3-577f-4e2b-838f-10e30f28b61e\") " pod="openshift-ingress/kube-auth-proxy-8659c84586-fvq6v" Jun 09 00:07:33.950780 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:33.950621 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g896h\" (UniqueName: \"kubernetes.io/projected/f3d19ba3-577f-4e2b-838f-10e30f28b61e-kube-api-access-g896h\") pod \"kube-auth-proxy-8659c84586-fvq6v\" (UID: \"f3d19ba3-577f-4e2b-838f-10e30f28b61e\") " pod="openshift-ingress/kube-auth-proxy-8659c84586-fvq6v" Jun 09 00:07:33.950780 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:33.950680 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3d19ba3-577f-4e2b-838f-10e30f28b61e-tls-certs\") pod \"kube-auth-proxy-8659c84586-fvq6v\" (UID: \"f3d19ba3-577f-4e2b-838f-10e30f28b61e\") " pod="openshift-ingress/kube-auth-proxy-8659c84586-fvq6v" Jun 09 00:07:34.052091 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:34.052058 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g896h\" (UniqueName: \"kubernetes.io/projected/f3d19ba3-577f-4e2b-838f-10e30f28b61e-kube-api-access-g896h\") pod \"kube-auth-proxy-8659c84586-fvq6v\" (UID: \"f3d19ba3-577f-4e2b-838f-10e30f28b61e\") " pod="openshift-ingress/kube-auth-proxy-8659c84586-fvq6v" Jun 09 00:07:34.052285 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:34.052149 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3d19ba3-577f-4e2b-838f-10e30f28b61e-tls-certs\") pod \"kube-auth-proxy-8659c84586-fvq6v\" (UID: \"f3d19ba3-577f-4e2b-838f-10e30f28b61e\") " pod="openshift-ingress/kube-auth-proxy-8659c84586-fvq6v" Jun 09 00:07:34.052285 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:34.052190 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3d19ba3-577f-4e2b-838f-10e30f28b61e-tmp\") pod \"kube-auth-proxy-8659c84586-fvq6v\" (UID: \"f3d19ba3-577f-4e2b-838f-10e30f28b61e\") " pod="openshift-ingress/kube-auth-proxy-8659c84586-fvq6v" Jun 09 00:07:34.052398 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:07:34.052296 2515 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 09 00:07:34.052398 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:07:34.052380 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3d19ba3-577f-4e2b-838f-10e30f28b61e-tls-certs podName:f3d19ba3-577f-4e2b-838f-10e30f28b61e nodeName:}" failed. No retries permitted until 2026-06-09 00:07:34.552357349 +0000 UTC m=+495.168421162 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/f3d19ba3-577f-4e2b-838f-10e30f28b61e-tls-certs") pod "kube-auth-proxy-8659c84586-fvq6v" (UID: "f3d19ba3-577f-4e2b-838f-10e30f28b61e") : secret "kube-auth-proxy-tls" not found Jun 09 00:07:34.054747 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:34.054723 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f3d19ba3-577f-4e2b-838f-10e30f28b61e-tmp\") pod \"kube-auth-proxy-8659c84586-fvq6v\" (UID: \"f3d19ba3-577f-4e2b-838f-10e30f28b61e\") " pod="openshift-ingress/kube-auth-proxy-8659c84586-fvq6v" Jun 09 00:07:34.060961 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:34.060939 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g896h\" (UniqueName: \"kubernetes.io/projected/f3d19ba3-577f-4e2b-838f-10e30f28b61e-kube-api-access-g896h\") pod \"kube-auth-proxy-8659c84586-fvq6v\" (UID: \"f3d19ba3-577f-4e2b-838f-10e30f28b61e\") " pod="openshift-ingress/kube-auth-proxy-8659c84586-fvq6v" Jun 09 00:07:34.510183 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:34.510089 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-z7sc6" event={"ID":"a0e5ebae-30dd-40b7-aaf5-a25c13114140","Type":"ContainerStarted","Data":"c1030742b93bd2faa2cab2d54435e35afcef1bd42f9dfe95242b44d78f07b328"} Jun 09 00:07:34.510358 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:34.510204 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-z7sc6" Jun 09 00:07:34.511773 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:34.511745 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-tkmhw" event={"ID":"4415c1a6-3105-4e83-9051-17490c0aa705","Type":"ContainerStarted","Data":"99d02313ce93bf5b3bbf4c79bca7db6028e90471fc3f0dc5aadfcfa0a2dab9b5"} Jun 09 00:07:34.511919 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:34.511833 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-tkmhw" Jun 09 00:07:34.544755 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:34.544688 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-z7sc6" podStartSLOduration=1.6324914750000001 podStartE2EDuration="5.544671103s" totalImagesPullingTime="3.912179628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:07:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:07:34.544237888 +0000 UTC m=+495.160301725" watchObservedRunningTime="2026-06-09 00:07:34.544671103 +0000 UTC m=+495.160734916" Jun 09 00:07:34.555776 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:34.555734 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3d19ba3-577f-4e2b-838f-10e30f28b61e-tls-certs\") pod \"kube-auth-proxy-8659c84586-fvq6v\" (UID: \"f3d19ba3-577f-4e2b-838f-10e30f28b61e\") " pod="openshift-ingress/kube-auth-proxy-8659c84586-fvq6v" Jun 09 00:07:34.558354 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:34.558316 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f3d19ba3-577f-4e2b-838f-10e30f28b61e-tls-certs\") pod \"kube-auth-proxy-8659c84586-fvq6v\" (UID: \"f3d19ba3-577f-4e2b-838f-10e30f28b61e\") " pod="openshift-ingress/kube-auth-proxy-8659c84586-fvq6v" Jun 09 00:07:34.561943 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:34.561885 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-tkmhw" podStartSLOduration=2.081724414 podStartE2EDuration="6.561865913s" totalImagesPullingTime="4.480141499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:07:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:07:34.55973435 +0000 UTC m=+495.175798186" watchObservedRunningTime="2026-06-09 00:07:34.561865913 +0000 UTC m=+495.177929754" Jun 09 00:07:34.799587 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:34.799506 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8659c84586-fvq6v" Jun 09 00:07:34.927665 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:34.927566 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8659c84586-fvq6v"] Jun 09 00:07:34.929749 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:07:34.929718 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3d19ba3_577f_4e2b_838f_10e30f28b61e.slice/crio-84b7c0f3444bda985d6ac63a0ed724a75bc4af64196b96b6d699b4e4e489ecf1 WatchSource:0}: Error finding container 84b7c0f3444bda985d6ac63a0ed724a75bc4af64196b96b6d699b4e4e489ecf1: Status 404 returned error can't find the container with id 84b7c0f3444bda985d6ac63a0ed724a75bc4af64196b96b6d699b4e4e489ecf1 Jun 09 00:07:35.517073 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:35.517035 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8659c84586-fvq6v" event={"ID":"f3d19ba3-577f-4e2b-838f-10e30f28b61e","Type":"ContainerStarted","Data":"84b7c0f3444bda985d6ac63a0ed724a75bc4af64196b96b6d699b4e4e489ecf1"} Jun 09 00:07:37.786306 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:37.786272 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-xzf9h"] Jun 09 00:07:37.789418 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:37.789402 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-xzf9h" Jun 09 00:07:37.792162 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:37.792143 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 09 00:07:37.792268 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:37.792173 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-75wg4\"" Jun 09 00:07:37.800850 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:37.800828 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-xzf9h"] Jun 09 00:07:37.882189 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:37.882111 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ecb8bbc-13cd-481c-a98d-6c68478f6c0d-cert\") pod \"kserve-controller-manager-69fc866d76-xzf9h\" (UID: \"0ecb8bbc-13cd-481c-a98d-6c68478f6c0d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-xzf9h" Jun 09 00:07:37.882333 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:37.882210 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx2v6\" (UniqueName: \"kubernetes.io/projected/0ecb8bbc-13cd-481c-a98d-6c68478f6c0d-kube-api-access-kx2v6\") pod \"kserve-controller-manager-69fc866d76-xzf9h\" (UID: \"0ecb8bbc-13cd-481c-a98d-6c68478f6c0d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-xzf9h" Jun 09 00:07:37.982948 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:37.982912 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ecb8bbc-13cd-481c-a98d-6c68478f6c0d-cert\") pod \"kserve-controller-manager-69fc866d76-xzf9h\" (UID: \"0ecb8bbc-13cd-481c-a98d-6c68478f6c0d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-xzf9h" Jun 09 00:07:37.983095 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:37.983030 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx2v6\" (UniqueName: \"kubernetes.io/projected/0ecb8bbc-13cd-481c-a98d-6c68478f6c0d-kube-api-access-kx2v6\") pod \"kserve-controller-manager-69fc866d76-xzf9h\" (UID: \"0ecb8bbc-13cd-481c-a98d-6c68478f6c0d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-xzf9h" Jun 09 00:07:37.983095 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:07:37.983051 2515 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jun 09 00:07:37.983170 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:07:37.983115 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0ecb8bbc-13cd-481c-a98d-6c68478f6c0d-cert podName:0ecb8bbc-13cd-481c-a98d-6c68478f6c0d nodeName:}" failed. No retries permitted until 2026-06-09 00:07:38.48309354 +0000 UTC m=+499.099157353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/0ecb8bbc-13cd-481c-a98d-6c68478f6c0d-cert") pod "kserve-controller-manager-69fc866d76-xzf9h" (UID: "0ecb8bbc-13cd-481c-a98d-6c68478f6c0d") : secret "kserve-webhook-server-cert" not found Jun 09 00:07:38.000126 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:38.000099 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx2v6\" (UniqueName: \"kubernetes.io/projected/0ecb8bbc-13cd-481c-a98d-6c68478f6c0d-kube-api-access-kx2v6\") pod \"kserve-controller-manager-69fc866d76-xzf9h\" (UID: \"0ecb8bbc-13cd-481c-a98d-6c68478f6c0d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-xzf9h" Jun 09 00:07:38.486881 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:38.486841 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ecb8bbc-13cd-481c-a98d-6c68478f6c0d-cert\") pod \"kserve-controller-manager-69fc866d76-xzf9h\" (UID: \"0ecb8bbc-13cd-481c-a98d-6c68478f6c0d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-xzf9h" Jun 09 00:07:38.489221 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:38.489193 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0ecb8bbc-13cd-481c-a98d-6c68478f6c0d-cert\") pod \"kserve-controller-manager-69fc866d76-xzf9h\" (UID: \"0ecb8bbc-13cd-481c-a98d-6c68478f6c0d\") " pod="opendatahub/kserve-controller-manager-69fc866d76-xzf9h" Jun 09 00:07:38.531487 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:38.531457 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8659c84586-fvq6v" event={"ID":"f3d19ba3-577f-4e2b-838f-10e30f28b61e","Type":"ContainerStarted","Data":"a059e1652cb43402c39fd126a473acb2b4f4cab52e95d61b91eb417afa50dd81"} Jun 09 00:07:38.548307 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:38.548261 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8659c84586-fvq6v" podStartSLOduration=2.885143676 podStartE2EDuration="5.548246589s" totalImagesPullingTime="2.663102913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:07:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:07:38.546832312 +0000 UTC m=+499.162896169" watchObservedRunningTime="2026-06-09 00:07:38.548246589 +0000 UTC m=+499.164310453" Jun 09 00:07:38.699487 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:38.699455 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-xzf9h" Jun 09 00:07:38.828994 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:38.828958 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-xzf9h"] Jun 09 00:07:38.832491 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:07:38.832459 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ecb8bbc_13cd_481c_a98d_6c68478f6c0d.slice/crio-7a398967ed5b128237f3e359e6eb3565b3c8394563cb0095794e8be26ca06c50 WatchSource:0}: Error finding container 7a398967ed5b128237f3e359e6eb3565b3c8394563cb0095794e8be26ca06c50: Status 404 returned error can't find the container with id 7a398967ed5b128237f3e359e6eb3565b3c8394563cb0095794e8be26ca06c50 Jun 09 00:07:39.536132 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:39.536086 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-xzf9h" event={"ID":"0ecb8bbc-13cd-481c-a98d-6c68478f6c0d","Type":"ContainerStarted","Data":"7a398967ed5b128237f3e359e6eb3565b3c8394563cb0095794e8be26ca06c50"} Jun 09 00:07:42.549743 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:42.549702 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-xzf9h" event={"ID":"0ecb8bbc-13cd-481c-a98d-6c68478f6c0d","Type":"ContainerStarted","Data":"e12c4f119892d4a13c25ec3023598684ed4f4e7dcbbd8c0fddf2e469d5cc927a"} Jun 09 00:07:42.550115 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:42.549836 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-xzf9h" Jun 09 00:07:42.569624 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:42.569554 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-xzf9h" podStartSLOduration=2.703487038 podStartE2EDuration="5.56953609s" totalImagesPullingTime="2.866049052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:07:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:07:42.56879868 +0000 UTC m=+503.184862515" watchObservedRunningTime="2026-06-09 00:07:42.56953609 +0000 UTC m=+503.185599926" Jun 09 00:07:45.521185 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:45.521153 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-z7sc6" Jun 09 00:07:45.555088 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:45.555064 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-tkmhw" Jun 09 00:07:50.524175 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:50.524138 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-679cf9c744-lw9z5"] Jun 09 00:07:50.527845 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:50.527824 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-679cf9c744-lw9z5" Jun 09 00:07:50.531041 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:50.531019 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-dtb2r\"" Jun 09 00:07:50.531338 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:50.531321 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 00:07:50.534105 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:50.534080 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-679cf9c744-lw9z5"] Jun 09 00:07:50.578368 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:50.578338 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnmjz\" (UniqueName: \"kubernetes.io/projected/7e88c29c-703e-4112-be61-aa86778df5f0-kube-api-access-tnmjz\") pod \"dashboard-redirect-679cf9c744-lw9z5\" (UID: \"7e88c29c-703e-4112-be61-aa86778df5f0\") " pod="opendatahub/dashboard-redirect-679cf9c744-lw9z5" Jun 09 00:07:50.578492 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:50.578376 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/7e88c29c-703e-4112-be61-aa86778df5f0-redirect-config\") pod \"dashboard-redirect-679cf9c744-lw9z5\" (UID: \"7e88c29c-703e-4112-be61-aa86778df5f0\") " pod="opendatahub/dashboard-redirect-679cf9c744-lw9z5" Jun 09 00:07:50.679654 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:50.679624 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnmjz\" (UniqueName: \"kubernetes.io/projected/7e88c29c-703e-4112-be61-aa86778df5f0-kube-api-access-tnmjz\") pod \"dashboard-redirect-679cf9c744-lw9z5\" (UID: \"7e88c29c-703e-4112-be61-aa86778df5f0\") " pod="opendatahub/dashboard-redirect-679cf9c744-lw9z5" Jun 09 00:07:50.679820 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:50.679662 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/7e88c29c-703e-4112-be61-aa86778df5f0-redirect-config\") pod \"dashboard-redirect-679cf9c744-lw9z5\" (UID: \"7e88c29c-703e-4112-be61-aa86778df5f0\") " pod="opendatahub/dashboard-redirect-679cf9c744-lw9z5" Jun 09 00:07:50.680438 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:50.680419 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/7e88c29c-703e-4112-be61-aa86778df5f0-redirect-config\") pod \"dashboard-redirect-679cf9c744-lw9z5\" (UID: \"7e88c29c-703e-4112-be61-aa86778df5f0\") " pod="opendatahub/dashboard-redirect-679cf9c744-lw9z5" Jun 09 00:07:50.687572 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:50.687546 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnmjz\" (UniqueName: \"kubernetes.io/projected/7e88c29c-703e-4112-be61-aa86778df5f0-kube-api-access-tnmjz\") pod \"dashboard-redirect-679cf9c744-lw9z5\" (UID: \"7e88c29c-703e-4112-be61-aa86778df5f0\") " pod="opendatahub/dashboard-redirect-679cf9c744-lw9z5" Jun 09 00:07:50.838749 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:50.838667 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-679cf9c744-lw9z5" Jun 09 00:07:50.983350 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:50.983321 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-679cf9c744-lw9z5"] Jun 09 00:07:50.985707 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:07:50.985677 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e88c29c_703e_4112_be61_aa86778df5f0.slice/crio-d4fa033807bad7470710b69f85ca7602d114311d1e268979494e77c7f7c20efa WatchSource:0}: Error finding container d4fa033807bad7470710b69f85ca7602d114311d1e268979494e77c7f7c20efa: Status 404 returned error can't find the container with id d4fa033807bad7470710b69f85ca7602d114311d1e268979494e77c7f7c20efa Jun 09 00:07:51.584330 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:51.584296 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-679cf9c744-lw9z5" event={"ID":"7e88c29c-703e-4112-be61-aa86778df5f0","Type":"ContainerStarted","Data":"d4fa033807bad7470710b69f85ca7602d114311d1e268979494e77c7f7c20efa"} Jun 09 00:07:52.530766 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:52.530736 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-zdwfj"] Jun 09 00:07:52.536256 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:52.536230 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-zdwfj" Jun 09 00:07:52.539663 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:52.539586 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 09 00:07:52.539922 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:52.539902 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-dcrs9\"" Jun 09 00:07:52.540016 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:52.539978 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 09 00:07:52.551902 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:52.551866 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-zdwfj"] Jun 09 00:07:52.597120 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:52.597084 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfstl\" (UniqueName: \"kubernetes.io/projected/6f6f45bc-039b-4d1d-ac18-f7f36c8ee053-kube-api-access-gfstl\") pod \"servicemesh-operator3-57f65f65fb-zdwfj\" (UID: \"6f6f45bc-039b-4d1d-ac18-f7f36c8ee053\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-zdwfj" Jun 09 00:07:52.597525 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:52.597150 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/6f6f45bc-039b-4d1d-ac18-f7f36c8ee053-operator-config\") pod \"servicemesh-operator3-57f65f65fb-zdwfj\" (UID: \"6f6f45bc-039b-4d1d-ac18-f7f36c8ee053\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-zdwfj" Jun 09 00:07:52.698394 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:52.698347 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfstl\" (UniqueName: \"kubernetes.io/projected/6f6f45bc-039b-4d1d-ac18-f7f36c8ee053-kube-api-access-gfstl\") pod \"servicemesh-operator3-57f65f65fb-zdwfj\" (UID: \"6f6f45bc-039b-4d1d-ac18-f7f36c8ee053\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-zdwfj" Jun 09 00:07:52.698576 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:52.698414 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/6f6f45bc-039b-4d1d-ac18-f7f36c8ee053-operator-config\") pod \"servicemesh-operator3-57f65f65fb-zdwfj\" (UID: \"6f6f45bc-039b-4d1d-ac18-f7f36c8ee053\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-zdwfj" Jun 09 00:07:52.701399 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:52.701366 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/6f6f45bc-039b-4d1d-ac18-f7f36c8ee053-operator-config\") pod \"servicemesh-operator3-57f65f65fb-zdwfj\" (UID: \"6f6f45bc-039b-4d1d-ac18-f7f36c8ee053\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-zdwfj" Jun 09 00:07:52.710871 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:52.710829 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfstl\" (UniqueName: \"kubernetes.io/projected/6f6f45bc-039b-4d1d-ac18-f7f36c8ee053-kube-api-access-gfstl\") pod \"servicemesh-operator3-57f65f65fb-zdwfj\" (UID: \"6f6f45bc-039b-4d1d-ac18-f7f36c8ee053\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-zdwfj" Jun 09 00:07:52.847457 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:52.847423 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-zdwfj" Jun 09 00:07:53.319675 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:53.319649 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-zdwfj"] Jun 09 00:07:53.322862 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:07:53.322838 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f6f45bc_039b_4d1d_ac18_f7f36c8ee053.slice/crio-731d332fcd03ed5e04e1ff5422f240e6268b84be28e0622c8d952ed5068c81a0 WatchSource:0}: Error finding container 731d332fcd03ed5e04e1ff5422f240e6268b84be28e0622c8d952ed5068c81a0: Status 404 returned error can't find the container with id 731d332fcd03ed5e04e1ff5422f240e6268b84be28e0622c8d952ed5068c81a0 Jun 09 00:07:53.594317 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:53.594286 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-679cf9c744-lw9z5" event={"ID":"7e88c29c-703e-4112-be61-aa86778df5f0","Type":"ContainerStarted","Data":"61ff5248ba7d0933c75dd2773d603d139a18340e98bf2b3d0ff29dd21469c351"} Jun 09 00:07:53.595705 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:53.595678 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-zdwfj" event={"ID":"6f6f45bc-039b-4d1d-ac18-f7f36c8ee053","Type":"ContainerStarted","Data":"731d332fcd03ed5e04e1ff5422f240e6268b84be28e0622c8d952ed5068c81a0"} Jun 09 00:07:53.612969 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:53.612926 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-679cf9c744-lw9z5" podStartSLOduration=1.344747603 podStartE2EDuration="3.612912646s" totalImagesPullingTime="2.268165043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:07:53.611935095 +0000 UTC m=+514.227998932" watchObservedRunningTime="2026-06-09 00:07:53.612912646 +0000 UTC m=+514.228976482" Jun 09 00:07:59.628271 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:59.628236 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-zdwfj" event={"ID":"6f6f45bc-039b-4d1d-ac18-f7f36c8ee053","Type":"ContainerStarted","Data":"1a4e470dcb79b079bc5fb81c23d3e84614a4d95ac4f2bb872992b9587157b79a"} Jun 09 00:07:59.628672 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:59.628305 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-zdwfj" Jun 09 00:07:59.648136 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:07:59.648018 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-zdwfj" podStartSLOduration=2.321064828 podStartE2EDuration="7.647998387s" totalImagesPullingTime="5.326933559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:07:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:07:59.646695437 +0000 UTC m=+520.262759274" watchObservedRunningTime="2026-06-09 00:07:59.647998387 +0000 UTC m=+520.264062225" Jun 09 00:08:02.760914 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.760880 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68"] Jun 09 00:08:02.764223 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.764202 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:02.766714 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.766689 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 09 00:08:02.766829 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.766726 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 09 00:08:02.766829 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.766734 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 09 00:08:02.766829 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.766806 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 00:08:02.767083 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.767066 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-k9hts\"" Jun 09 00:08:02.774298 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.774276 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68"] Jun 09 00:08:02.879532 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.879503 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/383dc402-6840-4a6d-9b83-7389dcdc53cc-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-zzx68\" (UID: \"383dc402-6840-4a6d-9b83-7389dcdc53cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:02.879676 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.879539 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/383dc402-6840-4a6d-9b83-7389dcdc53cc-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-zzx68\" (UID: \"383dc402-6840-4a6d-9b83-7389dcdc53cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:02.879676 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.879567 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/383dc402-6840-4a6d-9b83-7389dcdc53cc-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-zzx68\" (UID: \"383dc402-6840-4a6d-9b83-7389dcdc53cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:02.879676 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.879593 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/383dc402-6840-4a6d-9b83-7389dcdc53cc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-zzx68\" (UID: \"383dc402-6840-4a6d-9b83-7389dcdc53cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:02.879676 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.879649 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/383dc402-6840-4a6d-9b83-7389dcdc53cc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-zzx68\" (UID: \"383dc402-6840-4a6d-9b83-7389dcdc53cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:02.879676 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.879670 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/383dc402-6840-4a6d-9b83-7389dcdc53cc-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-zzx68\" (UID: \"383dc402-6840-4a6d-9b83-7389dcdc53cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:02.879864 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.879686 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skpl5\" (UniqueName: \"kubernetes.io/projected/383dc402-6840-4a6d-9b83-7389dcdc53cc-kube-api-access-skpl5\") pod \"istiod-openshift-gateway-75c67f8887-zzx68\" (UID: \"383dc402-6840-4a6d-9b83-7389dcdc53cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:02.980969 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.980925 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/383dc402-6840-4a6d-9b83-7389dcdc53cc-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-zzx68\" (UID: \"383dc402-6840-4a6d-9b83-7389dcdc53cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:02.981144 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.980994 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/383dc402-6840-4a6d-9b83-7389dcdc53cc-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-zzx68\" (UID: \"383dc402-6840-4a6d-9b83-7389dcdc53cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:02.981144 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.981039 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/383dc402-6840-4a6d-9b83-7389dcdc53cc-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-zzx68\" (UID: \"383dc402-6840-4a6d-9b83-7389dcdc53cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:02.981144 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.981070 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/383dc402-6840-4a6d-9b83-7389dcdc53cc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-zzx68\" (UID: \"383dc402-6840-4a6d-9b83-7389dcdc53cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:02.981144 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.981113 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/383dc402-6840-4a6d-9b83-7389dcdc53cc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-zzx68\" (UID: \"383dc402-6840-4a6d-9b83-7389dcdc53cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:02.981144 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.981137 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/383dc402-6840-4a6d-9b83-7389dcdc53cc-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-zzx68\" (UID: \"383dc402-6840-4a6d-9b83-7389dcdc53cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:02.981399 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.981189 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skpl5\" (UniqueName: \"kubernetes.io/projected/383dc402-6840-4a6d-9b83-7389dcdc53cc-kube-api-access-skpl5\") pod \"istiod-openshift-gateway-75c67f8887-zzx68\" (UID: \"383dc402-6840-4a6d-9b83-7389dcdc53cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:02.982058 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.982027 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/383dc402-6840-4a6d-9b83-7389dcdc53cc-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-zzx68\" (UID: \"383dc402-6840-4a6d-9b83-7389dcdc53cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:02.983422 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.983396 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/383dc402-6840-4a6d-9b83-7389dcdc53cc-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-zzx68\" (UID: \"383dc402-6840-4a6d-9b83-7389dcdc53cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:02.983635 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.983594 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/383dc402-6840-4a6d-9b83-7389dcdc53cc-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-zzx68\" (UID: \"383dc402-6840-4a6d-9b83-7389dcdc53cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:02.983635 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.983632 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/383dc402-6840-4a6d-9b83-7389dcdc53cc-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-zzx68\" (UID: \"383dc402-6840-4a6d-9b83-7389dcdc53cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:02.983990 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.983969 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/383dc402-6840-4a6d-9b83-7389dcdc53cc-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-zzx68\" (UID: \"383dc402-6840-4a6d-9b83-7389dcdc53cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:02.989025 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.989002 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/383dc402-6840-4a6d-9b83-7389dcdc53cc-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-zzx68\" (UID: \"383dc402-6840-4a6d-9b83-7389dcdc53cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:02.989412 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:02.989390 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skpl5\" (UniqueName: \"kubernetes.io/projected/383dc402-6840-4a6d-9b83-7389dcdc53cc-kube-api-access-skpl5\") pod \"istiod-openshift-gateway-75c67f8887-zzx68\" (UID: \"383dc402-6840-4a6d-9b83-7389dcdc53cc\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:03.074332 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:03.074256 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:03.206464 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:03.206438 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68"] Jun 09 00:08:03.208981 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:08:03.208953 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod383dc402_6840_4a6d_9b83_7389dcdc53cc.slice/crio-01573e2106832cee4589752dd0accf3fba8f2004bd0590085ac075d7d14c1897 WatchSource:0}: Error finding container 01573e2106832cee4589752dd0accf3fba8f2004bd0590085ac075d7d14c1897: Status 404 returned error can't find the container with id 01573e2106832cee4589752dd0accf3fba8f2004bd0590085ac075d7d14c1897 Jun 09 00:08:03.646136 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:03.646096 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" event={"ID":"383dc402-6840-4a6d-9b83-7389dcdc53cc","Type":"ContainerStarted","Data":"01573e2106832cee4589752dd0accf3fba8f2004bd0590085ac075d7d14c1897"} Jun 09 00:08:06.528889 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:06.528844 2515 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 00:08:06.529164 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:06.528916 2515 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 00:08:06.659963 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:06.659919 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" event={"ID":"383dc402-6840-4a6d-9b83-7389dcdc53cc","Type":"ContainerStarted","Data":"484798a080b23afe99114f2a3eb2a9e79ef5b74e4460287c142abe82963c1461"} Jun 09 00:08:06.660131 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:06.660026 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:06.680676 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:06.680628 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" podStartSLOduration=1.36305654 podStartE2EDuration="4.680598189s" totalImagesPullingTime="3.317541649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:08:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:08:06.6802013 +0000 UTC m=+527.296265136" watchObservedRunningTime="2026-06-09 00:08:06.680598189 +0000 UTC m=+527.296662025" Jun 09 00:08:07.668714 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:07.668663 2515 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-zzx68 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 09 00:08:07.669240 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:07.669214 2515 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" podUID="383dc402-6840-4a6d-9b83-7389dcdc53cc" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 00:08:08.137330 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.137301 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm"] Jun 09 00:08:08.162004 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.161960 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm"] Jun 09 00:08:08.162177 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.162054 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.164646 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.164624 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-4fs2n\"" Jun 09 00:08:08.330382 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.330344 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.330382 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.330381 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.330585 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.330411 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.330585 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.330474 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.330585 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.330549 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.330585 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.330582 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.330745 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.330623 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-247rl\" (UniqueName: \"kubernetes.io/projected/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-kube-api-access-247rl\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.330745 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.330663 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.330745 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.330696 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.431767 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.431667 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.431767 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.431717 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.431767 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.431743 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.431767 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.431766 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.432090 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.431786 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-247rl\" (UniqueName: \"kubernetes.io/projected/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-kube-api-access-247rl\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.432090 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.431807 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.432090 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.431845 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.432090 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.432000 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.432090 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.432042 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.432352 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.432098 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.432352 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.432162 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.432760 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.432734 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.432871 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.432818 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.432871 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.432836 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.434129 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.434108 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.434451 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.434424 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.439224 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.439195 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.439314 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.439295 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-247rl\" (UniqueName: \"kubernetes.io/projected/b516ac97-ef97-4c8f-851d-89c8d9a2ac62-kube-api-access-247rl\") pod \"data-science-gateway-data-science-gateway-class-6d89947867knvqm\" (UID: \"b516ac97-ef97-4c8f-851d-89c8d9a2ac62\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.472302 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.472274 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:08.622193 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.622085 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm"] Jun 09 00:08:08.624127 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:08:08.624100 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb516ac97_ef97_4c8f_851d_89c8d9a2ac62.slice/crio-3287e3f5370545c9632c2d63067822ef062cf23050b87e4156188b4d9f1e0eed WatchSource:0}: Error finding container 3287e3f5370545c9632c2d63067822ef062cf23050b87e4156188b4d9f1e0eed: Status 404 returned error can't find the container with id 3287e3f5370545c9632c2d63067822ef062cf23050b87e4156188b4d9f1e0eed Jun 09 00:08:08.671749 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:08.671700 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" event={"ID":"b516ac97-ef97-4c8f-851d-89c8d9a2ac62","Type":"ContainerStarted","Data":"3287e3f5370545c9632c2d63067822ef062cf23050b87e4156188b4d9f1e0eed"} Jun 09 00:08:10.634628 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:10.634518 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-zdwfj" Jun 09 00:08:10.667879 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:10.667851 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-zzx68" Jun 09 00:08:11.660594 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:11.660557 2515 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 00:08:11.660876 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:11.660650 2515 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 00:08:11.660876 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:11.660683 2515 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 09 00:08:12.690560 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:12.690525 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" event={"ID":"b516ac97-ef97-4c8f-851d-89c8d9a2ac62","Type":"ContainerStarted","Data":"3b5baeebf63ec80277a7b5e7d7d8739e2da10ce743777ec95355c6c85ca929ae"} Jun 09 00:08:12.711066 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:12.711021 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" podStartSLOduration=1.6773532690000001 podStartE2EDuration="4.711006382s" totalImagesPullingTime="3.033653113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:08:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:08:12.709000267 +0000 UTC m=+533.325064131" watchObservedRunningTime="2026-06-09 00:08:12.711006382 +0000 UTC m=+533.327070218" Jun 09 00:08:13.472725 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:13.472673 2515 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:13.477384 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:13.477360 2515 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:13.558733 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:13.558708 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-xzf9h" Jun 09 00:08:13.695125 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:13.695093 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:13.696072 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:13.696053 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6d89947867knvqm" Jun 09 00:08:59.892846 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:59.892811 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dfxtr"] Jun 09 00:08:59.897978 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:59.897954 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dfxtr" Jun 09 00:08:59.900577 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:59.900552 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 00:08:59.900698 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:59.900552 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 00:08:59.900698 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:59.900557 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-tmqgw\"" Jun 09 00:08:59.906401 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:08:59.906376 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dfxtr"] Jun 09 00:09:00.053070 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:00.053026 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pprzx\" (UniqueName: \"kubernetes.io/projected/8136b8d7-8829-4a68-afb4-aabbdea47be3-kube-api-access-pprzx\") pod \"authorino-operator-75cc8d5cb7-dfxtr\" (UID: \"8136b8d7-8829-4a68-afb4-aabbdea47be3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dfxtr" Jun 09 00:09:00.154435 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:00.154342 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pprzx\" (UniqueName: \"kubernetes.io/projected/8136b8d7-8829-4a68-afb4-aabbdea47be3-kube-api-access-pprzx\") pod \"authorino-operator-75cc8d5cb7-dfxtr\" (UID: \"8136b8d7-8829-4a68-afb4-aabbdea47be3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dfxtr" Jun 09 00:09:00.162308 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:00.162277 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pprzx\" (UniqueName: \"kubernetes.io/projected/8136b8d7-8829-4a68-afb4-aabbdea47be3-kube-api-access-pprzx\") pod \"authorino-operator-75cc8d5cb7-dfxtr\" (UID: \"8136b8d7-8829-4a68-afb4-aabbdea47be3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-dfxtr" Jun 09 00:09:00.209591 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:00.209554 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dfxtr" Jun 09 00:09:00.341067 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:00.341042 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-dfxtr"] Jun 09 00:09:00.343755 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:09:00.343726 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8136b8d7_8829_4a68_afb4_aabbdea47be3.slice/crio-1611c794f9f70cd3bbd4904bf679c9cffdcf5e1f68419262ecad0be03d67a956 WatchSource:0}: Error finding container 1611c794f9f70cd3bbd4904bf679c9cffdcf5e1f68419262ecad0be03d67a956: Status 404 returned error can't find the container with id 1611c794f9f70cd3bbd4904bf679c9cffdcf5e1f68419262ecad0be03d67a956 Jun 09 00:09:00.893294 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:00.893258 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dfxtr" event={"ID":"8136b8d7-8829-4a68-afb4-aabbdea47be3","Type":"ContainerStarted","Data":"1611c794f9f70cd3bbd4904bf679c9cffdcf5e1f68419262ecad0be03d67a956"} Jun 09 00:09:03.907351 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:03.907311 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dfxtr" event={"ID":"8136b8d7-8829-4a68-afb4-aabbdea47be3","Type":"ContainerStarted","Data":"6dfdb62a972e7fa8ed6fe0ace858c22b2d530e16322a851809d4cf8038413024"} Jun 09 00:09:03.907784 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:03.907441 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dfxtr" Jun 09 00:09:03.927087 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:03.927038 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dfxtr" podStartSLOduration=2.40366167 podStartE2EDuration="4.927022053s" totalImagesPullingTime="2.523360383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:08:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:09:03.925476983 +0000 UTC m=+584.541540853" watchObservedRunningTime="2026-06-09 00:09:03.927022053 +0000 UTC m=+584.543085890" Jun 09 00:09:05.612238 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:05.612202 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9llhg"] Jun 09 00:09:05.614723 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:05.614706 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9llhg" Jun 09 00:09:05.617341 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:05.617316 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 09 00:09:05.617455 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:05.617379 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qc4gp\"" Jun 09 00:09:05.625017 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:05.624992 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9llhg"] Jun 09 00:09:05.705702 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:05.705662 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgdbk\" (UniqueName: \"kubernetes.io/projected/bbd18594-1698-4868-b724-88103905a8b3-kube-api-access-xgdbk\") pod \"dns-operator-controller-manager-864dd78c4c-9llhg\" (UID: \"bbd18594-1698-4868-b724-88103905a8b3\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9llhg" Jun 09 00:09:05.806942 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:05.806902 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgdbk\" (UniqueName: \"kubernetes.io/projected/bbd18594-1698-4868-b724-88103905a8b3-kube-api-access-xgdbk\") pod \"dns-operator-controller-manager-864dd78c4c-9llhg\" (UID: \"bbd18594-1698-4868-b724-88103905a8b3\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9llhg" Jun 09 00:09:05.817683 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:05.817654 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgdbk\" (UniqueName: \"kubernetes.io/projected/bbd18594-1698-4868-b724-88103905a8b3-kube-api-access-xgdbk\") pod \"dns-operator-controller-manager-864dd78c4c-9llhg\" (UID: \"bbd18594-1698-4868-b724-88103905a8b3\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9llhg" Jun 09 00:09:05.924941 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:05.924867 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9llhg" Jun 09 00:09:06.074701 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:06.074678 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9llhg"] Jun 09 00:09:06.076877 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:09:06.076847 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbd18594_1698_4868_b724_88103905a8b3.slice/crio-e22aca2276f365f9d464b62c545a9de665b19db812d974267494c522cbd8fc37 WatchSource:0}: Error finding container e22aca2276f365f9d464b62c545a9de665b19db812d974267494c522cbd8fc37: Status 404 returned error can't find the container with id e22aca2276f365f9d464b62c545a9de665b19db812d974267494c522cbd8fc37 Jun 09 00:09:06.921357 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:06.921325 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9llhg" event={"ID":"bbd18594-1698-4868-b724-88103905a8b3","Type":"ContainerStarted","Data":"e22aca2276f365f9d464b62c545a9de665b19db812d974267494c522cbd8fc37"} Jun 09 00:09:08.934191 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:08.934151 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9llhg" event={"ID":"bbd18594-1698-4868-b724-88103905a8b3","Type":"ContainerStarted","Data":"59b8a3428e63420c5a8ffaedca08732d1c9f4f4219cfc8fc46f4846a88358b32"} Jun 09 00:09:08.934628 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:08.934224 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9llhg" Jun 09 00:09:08.949475 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:08.949408 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9llhg" podStartSLOduration=1.563459147 podStartE2EDuration="3.949388854s" totalImagesPullingTime="2.385929707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:09:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:09:08.949355984 +0000 UTC m=+589.565419823" watchObservedRunningTime="2026-06-09 00:09:08.949388854 +0000 UTC m=+589.565452691" Jun 09 00:09:14.915167 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:14.915134 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-dfxtr" Jun 09 00:09:19.576547 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:19.576510 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-59g52"] Jun 09 00:09:19.578741 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:19.578724 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-59g52" Jun 09 00:09:19.583542 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:19.583516 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-c7vcv\"" Jun 09 00:09:19.589443 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:19.589418 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-59g52"] Jun 09 00:09:19.613047 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:19.613014 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nws2\" (UniqueName: \"kubernetes.io/projected/c8cb82ee-0443-4e99-b23a-086306fb1354-kube-api-access-4nws2\") pod \"limitador-operator-controller-manager-859d7b78bd-59g52\" (UID: \"c8cb82ee-0443-4e99-b23a-086306fb1354\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-59g52" Jun 09 00:09:19.714369 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:19.714338 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nws2\" (UniqueName: \"kubernetes.io/projected/c8cb82ee-0443-4e99-b23a-086306fb1354-kube-api-access-4nws2\") pod \"limitador-operator-controller-manager-859d7b78bd-59g52\" (UID: \"c8cb82ee-0443-4e99-b23a-086306fb1354\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-59g52" Jun 09 00:09:19.725431 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:19.725406 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nws2\" (UniqueName: \"kubernetes.io/projected/c8cb82ee-0443-4e99-b23a-086306fb1354-kube-api-access-4nws2\") pod \"limitador-operator-controller-manager-859d7b78bd-59g52\" (UID: \"c8cb82ee-0443-4e99-b23a-086306fb1354\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-59g52" Jun 09 00:09:19.893341 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:19.893298 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-c7vcv\"" Jun 09 00:09:19.900883 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:19.900862 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-59g52" Jun 09 00:09:19.941683 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:19.941650 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9llhg" Jun 09 00:09:20.060766 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:20.044796 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-59g52"] Jun 09 00:09:20.060766 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:09:20.047805 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8cb82ee_0443_4e99_b23a_086306fb1354.slice/crio-0716fbb9b7235a4a81a58d81a8f2bdf1d49f6a93109f57b8a2332435cdb31eb7 WatchSource:0}: Error finding container 0716fbb9b7235a4a81a58d81a8f2bdf1d49f6a93109f57b8a2332435cdb31eb7: Status 404 returned error can't find the container with id 0716fbb9b7235a4a81a58d81a8f2bdf1d49f6a93109f57b8a2332435cdb31eb7 Jun 09 00:09:20.990627 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:20.990563 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-59g52" event={"ID":"c8cb82ee-0443-4e99-b23a-086306fb1354","Type":"ContainerStarted","Data":"0716fbb9b7235a4a81a58d81a8f2bdf1d49f6a93109f57b8a2332435cdb31eb7"} Jun 09 00:09:21.996319 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:21.996276 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-59g52" event={"ID":"c8cb82ee-0443-4e99-b23a-086306fb1354","Type":"ContainerStarted","Data":"05178980b5a89fb462ce1a98b5dd7efac5263a0bfc683215bd0be35bacff71c7"} Jun 09 00:09:21.996753 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:21.996361 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-59g52" Jun 09 00:09:22.034299 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:22.034248 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-59g52" podStartSLOduration=1.194607722 podStartE2EDuration="3.034232384s" totalImagesPullingTime="1.839624662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:09:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:09:22.032239737 +0000 UTC m=+602.648303572" watchObservedRunningTime="2026-06-09 00:09:22.034232384 +0000 UTC m=+602.650296257" Jun 09 00:09:33.002693 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:09:33.002662 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-59g52" Jun 09 00:10:59.642981 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:10:59.642948 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 00:10:59.646212 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:10:59.646195 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 00:10:59.648787 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:10:59.648762 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 00:10:59.649080 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:10:59.648969 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 00:10:59.650065 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:10:59.650040 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 00:10:59.650212 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:10:59.650196 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-t56vc\"" Jun 09 00:10:59.652563 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:10:59.652540 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 00:10:59.697370 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:10:59.697340 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwlhl\" (UniqueName: \"kubernetes.io/projected/efe2663b-59fa-4737-b8ce-f7afecfd1dd0-kube-api-access-gwlhl\") pod \"maas-keycloak-0\" (UID: \"efe2663b-59fa-4737-b8ce-f7afecfd1dd0\") " pod="keycloak-system/maas-keycloak-0" Jun 09 00:10:59.797983 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:10:59.797954 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwlhl\" (UniqueName: \"kubernetes.io/projected/efe2663b-59fa-4737-b8ce-f7afecfd1dd0-kube-api-access-gwlhl\") pod \"maas-keycloak-0\" (UID: \"efe2663b-59fa-4737-b8ce-f7afecfd1dd0\") " pod="keycloak-system/maas-keycloak-0" Jun 09 00:10:59.805444 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:10:59.805414 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwlhl\" (UniqueName: \"kubernetes.io/projected/efe2663b-59fa-4737-b8ce-f7afecfd1dd0-kube-api-access-gwlhl\") pod \"maas-keycloak-0\" (UID: \"efe2663b-59fa-4737-b8ce-f7afecfd1dd0\") " pod="keycloak-system/maas-keycloak-0" Jun 09 00:10:59.956449 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:10:59.956378 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 00:11:00.083489 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:00.083465 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 00:11:00.085534 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:11:00.085496 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe2663b_59fa_4737_b8ce_f7afecfd1dd0.slice/crio-b21960ad767306e1c4c1422880b3bee3f06dd0dd4cc6cecba0586e3d9f7500d8 WatchSource:0}: Error finding container b21960ad767306e1c4c1422880b3bee3f06dd0dd4cc6cecba0586e3d9f7500d8: Status 404 returned error can't find the container with id b21960ad767306e1c4c1422880b3bee3f06dd0dd4cc6cecba0586e3d9f7500d8 Jun 09 00:11:00.424720 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:00.424684 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"efe2663b-59fa-4737-b8ce-f7afecfd1dd0","Type":"ContainerStarted","Data":"b21960ad767306e1c4c1422880b3bee3f06dd0dd4cc6cecba0586e3d9f7500d8"} Jun 09 00:11:10.474097 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:10.474064 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"efe2663b-59fa-4737-b8ce-f7afecfd1dd0","Type":"ContainerStarted","Data":"b34634501ed4c16dfc679079f730fc2869c932ce3dffef768978690c7856e870"} Jun 09 00:11:10.495450 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:10.495397 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.318549852 podStartE2EDuration="11.495380237s" totalImagesPullingTime="10.176830385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:10:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:11:10.493860959 +0000 UTC m=+711.109924794" watchObservedRunningTime="2026-06-09 00:11:10.495380237 +0000 UTC m=+711.111444073" Jun 09 00:11:10.957003 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:10.956959 2515 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 00:11:10.958930 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:10.958893 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efe2663b-59fa-4737-b8ce-f7afecfd1dd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 09 00:11:11.957451 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:11.957393 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efe2663b-59fa-4737-b8ce-f7afecfd1dd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 09 00:11:12.957701 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:12.957659 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efe2663b-59fa-4737-b8ce-f7afecfd1dd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 09 00:11:13.956906 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:13.956850 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efe2663b-59fa-4737-b8ce-f7afecfd1dd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 09 00:11:14.956964 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:14.956908 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efe2663b-59fa-4737-b8ce-f7afecfd1dd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 09 00:11:15.957339 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:15.957285 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efe2663b-59fa-4737-b8ce-f7afecfd1dd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 09 00:11:16.957687 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:16.957636 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efe2663b-59fa-4737-b8ce-f7afecfd1dd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 09 00:11:17.957504 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:17.957430 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efe2663b-59fa-4737-b8ce-f7afecfd1dd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 09 00:11:18.957456 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:18.957396 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efe2663b-59fa-4737-b8ce-f7afecfd1dd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 09 00:11:19.957421 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:19.957384 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 00:11:19.957809 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:19.957778 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efe2663b-59fa-4737-b8ce-f7afecfd1dd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 09 00:11:20.956956 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:20.956916 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efe2663b-59fa-4737-b8ce-f7afecfd1dd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 09 00:11:21.956941 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:21.956886 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="efe2663b-59fa-4737-b8ce-f7afecfd1dd0" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.25:9000/health/started\": dial tcp 10.134.0.25:9000: connect: connection refused" Jun 09 00:11:23.075329 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:23.075289 2515 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 00:11:23.093377 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:23.093312 2515 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="efe2663b-59fa-4737-b8ce-f7afecfd1dd0" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 00:11:33.082066 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:33.082030 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 00:11:39.556653 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:39.556598 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-54b98c79b8-m6k5z"] Jun 09 00:11:39.563449 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:39.563427 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54b98c79b8-m6k5z" Jun 09 00:11:39.566099 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:39.566079 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 00:11:39.567140 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:39.567118 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 00:11:39.567231 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:39.567156 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qccps\"" Jun 09 00:11:39.575810 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:39.575787 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54b98c79b8-m6k5z"] Jun 09 00:11:39.652429 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:39.652400 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3667c74-93bf-4ffb-a8c8-eaa34dfbc739-webhook-cert\") pod \"maas-controller-54b98c79b8-m6k5z\" (UID: \"b3667c74-93bf-4ffb-a8c8-eaa34dfbc739\") " pod="opendatahub/maas-controller-54b98c79b8-m6k5z" Jun 09 00:11:39.652583 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:39.652454 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzxvh\" (UniqueName: \"kubernetes.io/projected/b3667c74-93bf-4ffb-a8c8-eaa34dfbc739-kube-api-access-jzxvh\") pod \"maas-controller-54b98c79b8-m6k5z\" (UID: \"b3667c74-93bf-4ffb-a8c8-eaa34dfbc739\") " pod="opendatahub/maas-controller-54b98c79b8-m6k5z" Jun 09 00:11:39.739655 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:39.739624 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f7676c84b-jxdw8"] Jun 09 00:11:39.741844 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:39.741824 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f7676c84b-jxdw8" Jun 09 00:11:39.750417 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:39.750391 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f7676c84b-jxdw8"] Jun 09 00:11:39.753000 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:39.752977 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzxvh\" (UniqueName: \"kubernetes.io/projected/b3667c74-93bf-4ffb-a8c8-eaa34dfbc739-kube-api-access-jzxvh\") pod \"maas-controller-54b98c79b8-m6k5z\" (UID: \"b3667c74-93bf-4ffb-a8c8-eaa34dfbc739\") " pod="opendatahub/maas-controller-54b98c79b8-m6k5z" Jun 09 00:11:39.753104 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:39.753041 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3667c74-93bf-4ffb-a8c8-eaa34dfbc739-webhook-cert\") pod \"maas-controller-54b98c79b8-m6k5z\" (UID: \"b3667c74-93bf-4ffb-a8c8-eaa34dfbc739\") " pod="opendatahub/maas-controller-54b98c79b8-m6k5z" Jun 09 00:11:39.755539 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:39.755513 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3667c74-93bf-4ffb-a8c8-eaa34dfbc739-webhook-cert\") pod \"maas-controller-54b98c79b8-m6k5z\" (UID: \"b3667c74-93bf-4ffb-a8c8-eaa34dfbc739\") " pod="opendatahub/maas-controller-54b98c79b8-m6k5z" Jun 09 00:11:39.762705 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:39.762674 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzxvh\" (UniqueName: \"kubernetes.io/projected/b3667c74-93bf-4ffb-a8c8-eaa34dfbc739-kube-api-access-jzxvh\") pod \"maas-controller-54b98c79b8-m6k5z\" (UID: \"b3667c74-93bf-4ffb-a8c8-eaa34dfbc739\") " pod="opendatahub/maas-controller-54b98c79b8-m6k5z" Jun 09 00:11:39.853542 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:39.853516 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d444d79-6dac-4bfd-8372-7e8837b1efb2-webhook-cert\") pod \"maas-controller-5f7676c84b-jxdw8\" (UID: \"4d444d79-6dac-4bfd-8372-7e8837b1efb2\") " pod="opendatahub/maas-controller-5f7676c84b-jxdw8" Jun 09 00:11:39.853698 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:39.853586 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dqpw\" (UniqueName: \"kubernetes.io/projected/4d444d79-6dac-4bfd-8372-7e8837b1efb2-kube-api-access-7dqpw\") pod \"maas-controller-5f7676c84b-jxdw8\" (UID: \"4d444d79-6dac-4bfd-8372-7e8837b1efb2\") " pod="opendatahub/maas-controller-5f7676c84b-jxdw8" Jun 09 00:11:39.874777 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:39.874743 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54b98c79b8-m6k5z" Jun 09 00:11:39.955100 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:39.955072 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d444d79-6dac-4bfd-8372-7e8837b1efb2-webhook-cert\") pod \"maas-controller-5f7676c84b-jxdw8\" (UID: \"4d444d79-6dac-4bfd-8372-7e8837b1efb2\") " pod="opendatahub/maas-controller-5f7676c84b-jxdw8" Jun 09 00:11:39.955243 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:39.955167 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dqpw\" (UniqueName: \"kubernetes.io/projected/4d444d79-6dac-4bfd-8372-7e8837b1efb2-kube-api-access-7dqpw\") pod \"maas-controller-5f7676c84b-jxdw8\" (UID: \"4d444d79-6dac-4bfd-8372-7e8837b1efb2\") " pod="opendatahub/maas-controller-5f7676c84b-jxdw8" Jun 09 00:11:39.961191 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:39.961019 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d444d79-6dac-4bfd-8372-7e8837b1efb2-webhook-cert\") pod \"maas-controller-5f7676c84b-jxdw8\" (UID: \"4d444d79-6dac-4bfd-8372-7e8837b1efb2\") " pod="opendatahub/maas-controller-5f7676c84b-jxdw8" Jun 09 00:11:39.963966 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:39.963916 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dqpw\" (UniqueName: \"kubernetes.io/projected/4d444d79-6dac-4bfd-8372-7e8837b1efb2-kube-api-access-7dqpw\") pod \"maas-controller-5f7676c84b-jxdw8\" (UID: \"4d444d79-6dac-4bfd-8372-7e8837b1efb2\") " pod="opendatahub/maas-controller-5f7676c84b-jxdw8" Jun 09 00:11:40.002771 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:40.002691 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-54b98c79b8-m6k5z"] Jun 09 00:11:40.005010 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:11:40.004982 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3667c74_93bf_4ffb_a8c8_eaa34dfbc739.slice/crio-89b817cdb8db8ee4cfc0722789df4e9ea40216372def8097ae74574fc3c8e5a4 WatchSource:0}: Error finding container 89b817cdb8db8ee4cfc0722789df4e9ea40216372def8097ae74574fc3c8e5a4: Status 404 returned error can't find the container with id 89b817cdb8db8ee4cfc0722789df4e9ea40216372def8097ae74574fc3c8e5a4 Jun 09 00:11:40.052608 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:40.052584 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f7676c84b-jxdw8" Jun 09 00:11:40.175421 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:40.175394 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f7676c84b-jxdw8"] Jun 09 00:11:40.177368 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:11:40.177333 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d444d79_6dac_4bfd_8372_7e8837b1efb2.slice/crio-0c6020edacff9e3334e343f6c98b17a40c82ef447c3385e515b4018c47076c5a WatchSource:0}: Error finding container 0c6020edacff9e3334e343f6c98b17a40c82ef447c3385e515b4018c47076c5a: Status 404 returned error can't find the container with id 0c6020edacff9e3334e343f6c98b17a40c82ef447c3385e515b4018c47076c5a Jun 09 00:11:40.644569 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:40.644528 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f7676c84b-jxdw8" event={"ID":"4d444d79-6dac-4bfd-8372-7e8837b1efb2","Type":"ContainerStarted","Data":"0c6020edacff9e3334e343f6c98b17a40c82ef447c3385e515b4018c47076c5a"} Jun 09 00:11:40.646872 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:40.646736 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54b98c79b8-m6k5z" event={"ID":"b3667c74-93bf-4ffb-a8c8-eaa34dfbc739","Type":"ContainerStarted","Data":"89b817cdb8db8ee4cfc0722789df4e9ea40216372def8097ae74574fc3c8e5a4"} Jun 09 00:11:43.669506 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:43.669461 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f7676c84b-jxdw8" event={"ID":"4d444d79-6dac-4bfd-8372-7e8837b1efb2","Type":"ContainerStarted","Data":"01564ee514eb29b27a18557818c056a0d005eb62b5af938794bbc6a0f36fe5f5"} Jun 09 00:11:43.669981 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:43.669631 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f7676c84b-jxdw8" Jun 09 00:11:43.670916 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:43.670893 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54b98c79b8-m6k5z" event={"ID":"b3667c74-93bf-4ffb-a8c8-eaa34dfbc739","Type":"ContainerStarted","Data":"c8828c580f7b3c7b26270272a2532b9e2d8d0ffdc9a6c4728263a05c51532955"} Jun 09 00:11:43.671047 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:43.671034 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-54b98c79b8-m6k5z" Jun 09 00:11:43.687523 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:43.687472 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5f7676c84b-jxdw8" podStartSLOduration=2.233196055 podStartE2EDuration="4.687455288s" totalImagesPullingTime="2.454259233s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:11:43.685579688 +0000 UTC m=+744.301643525" watchObservedRunningTime="2026-06-09 00:11:43.687455288 +0000 UTC m=+744.303519125" Jun 09 00:11:43.702053 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:43.702016 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-54b98c79b8-m6k5z" podStartSLOduration=2.084382983 podStartE2EDuration="4.702004287s" totalImagesPullingTime="2.617621304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:11:43.700382104 +0000 UTC m=+744.316445940" watchObservedRunningTime="2026-06-09 00:11:43.702004287 +0000 UTC m=+744.318068122" Jun 09 00:11:54.681333 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:54.681297 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f7676c84b-jxdw8" Jun 09 00:11:54.681790 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:54.681371 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-54b98c79b8-m6k5z" Jun 09 00:11:54.733862 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:54.733830 2515 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54b98c79b8-m6k5z"] Jun 09 00:11:54.734066 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:54.734021 2515 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-54b98c79b8-m6k5z" podUID="b3667c74-93bf-4ffb-a8c8-eaa34dfbc739" containerName="manager" containerID="cri-o://c8828c580f7b3c7b26270272a2532b9e2d8d0ffdc9a6c4728263a05c51532955" gracePeriod=30 Jun 09 00:11:54.970440 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:54.970411 2515 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54b98c79b8-m6k5z" Jun 09 00:11:55.091264 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:55.091235 2515 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3667c74-93bf-4ffb-a8c8-eaa34dfbc739-webhook-cert\") pod \"b3667c74-93bf-4ffb-a8c8-eaa34dfbc739\" (UID: \"b3667c74-93bf-4ffb-a8c8-eaa34dfbc739\") " Jun 09 00:11:55.091419 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:55.091296 2515 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzxvh\" (UniqueName: \"kubernetes.io/projected/b3667c74-93bf-4ffb-a8c8-eaa34dfbc739-kube-api-access-jzxvh\") pod \"b3667c74-93bf-4ffb-a8c8-eaa34dfbc739\" (UID: \"b3667c74-93bf-4ffb-a8c8-eaa34dfbc739\") " Jun 09 00:11:55.093483 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:55.093451 2515 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3667c74-93bf-4ffb-a8c8-eaa34dfbc739-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b3667c74-93bf-4ffb-a8c8-eaa34dfbc739" (UID: "b3667c74-93bf-4ffb-a8c8-eaa34dfbc739"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:11:55.093596 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:55.093524 2515 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3667c74-93bf-4ffb-a8c8-eaa34dfbc739-kube-api-access-jzxvh" (OuterVolumeSpecName: "kube-api-access-jzxvh") pod "b3667c74-93bf-4ffb-a8c8-eaa34dfbc739" (UID: "b3667c74-93bf-4ffb-a8c8-eaa34dfbc739"). InnerVolumeSpecName "kube-api-access-jzxvh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:11:55.192055 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:55.192023 2515 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzxvh\" (UniqueName: \"kubernetes.io/projected/b3667c74-93bf-4ffb-a8c8-eaa34dfbc739-kube-api-access-jzxvh\") on node \"ip-10-0-129-4.ec2.internal\" DevicePath \"\"" Jun 09 00:11:55.192055 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:55.192055 2515 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3667c74-93bf-4ffb-a8c8-eaa34dfbc739-webhook-cert\") on node \"ip-10-0-129-4.ec2.internal\" DevicePath \"\"" Jun 09 00:11:55.726711 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:55.726677 2515 generic.go:356] "Generic (PLEG): container finished" podID="b3667c74-93bf-4ffb-a8c8-eaa34dfbc739" containerID="c8828c580f7b3c7b26270272a2532b9e2d8d0ffdc9a6c4728263a05c51532955" exitCode=0 Jun 09 00:11:55.727125 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:55.726719 2515 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-54b98c79b8-m6k5z" Jun 09 00:11:55.727125 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:55.726746 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54b98c79b8-m6k5z" event={"ID":"b3667c74-93bf-4ffb-a8c8-eaa34dfbc739","Type":"ContainerDied","Data":"c8828c580f7b3c7b26270272a2532b9e2d8d0ffdc9a6c4728263a05c51532955"} Jun 09 00:11:55.727125 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:55.726804 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-54b98c79b8-m6k5z" event={"ID":"b3667c74-93bf-4ffb-a8c8-eaa34dfbc739","Type":"ContainerDied","Data":"89b817cdb8db8ee4cfc0722789df4e9ea40216372def8097ae74574fc3c8e5a4"} Jun 09 00:11:55.727125 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:55.726824 2515 scope.go:117] "RemoveContainer" containerID="c8828c580f7b3c7b26270272a2532b9e2d8d0ffdc9a6c4728263a05c51532955" Jun 09 00:11:55.735655 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:55.735551 2515 scope.go:117] "RemoveContainer" containerID="c8828c580f7b3c7b26270272a2532b9e2d8d0ffdc9a6c4728263a05c51532955" Jun 09 00:11:55.735875 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:11:55.735856 2515 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8828c580f7b3c7b26270272a2532b9e2d8d0ffdc9a6c4728263a05c51532955\": container with ID starting with c8828c580f7b3c7b26270272a2532b9e2d8d0ffdc9a6c4728263a05c51532955 not found: ID does not exist" containerID="c8828c580f7b3c7b26270272a2532b9e2d8d0ffdc9a6c4728263a05c51532955" Jun 09 00:11:55.735931 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:55.735884 2515 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8828c580f7b3c7b26270272a2532b9e2d8d0ffdc9a6c4728263a05c51532955"} err="failed to get container status \"c8828c580f7b3c7b26270272a2532b9e2d8d0ffdc9a6c4728263a05c51532955\": rpc error: code = NotFound desc = could not find container \"c8828c580f7b3c7b26270272a2532b9e2d8d0ffdc9a6c4728263a05c51532955\": container with ID starting with c8828c580f7b3c7b26270272a2532b9e2d8d0ffdc9a6c4728263a05c51532955 not found: ID does not exist" Jun 09 00:11:55.746545 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:55.746523 2515 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-54b98c79b8-m6k5z"] Jun 09 00:11:55.749807 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:55.749788 2515 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-54b98c79b8-m6k5z"] Jun 09 00:11:55.863453 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:11:55.863423 2515 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3667c74-93bf-4ffb-a8c8-eaa34dfbc739" path="/var/lib/kubelet/pods/b3667c74-93bf-4ffb-a8c8-eaa34dfbc739/volumes" Jun 09 00:12:12.036774 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.036741 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-68db8cdb4f-p5xq4"] Jun 09 00:12:12.037192 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.037088 2515 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3667c74-93bf-4ffb-a8c8-eaa34dfbc739" containerName="manager" Jun 09 00:12:12.037192 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.037099 2515 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3667c74-93bf-4ffb-a8c8-eaa34dfbc739" containerName="manager" Jun 09 00:12:12.037192 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.037163 2515 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3667c74-93bf-4ffb-a8c8-eaa34dfbc739" containerName="manager" Jun 09 00:12:12.040104 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.040086 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-68db8cdb4f-p5xq4" Jun 09 00:12:12.042733 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.042704 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jun 09 00:12:12.042854 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.042746 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 09 00:12:12.042854 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.042746 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-g8db8\"" Jun 09 00:12:12.042854 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.042747 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 09 00:12:12.050151 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.050127 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-68db8cdb4f-p5xq4"] Jun 09 00:12:12.233315 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.233286 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3469868a-97d4-4e1e-b243-4e3727447c62-maas-api-tls\") pod \"maas-api-68db8cdb4f-p5xq4\" (UID: \"3469868a-97d4-4e1e-b243-4e3727447c62\") " pod="redhat-ai-gateway-infra/maas-api-68db8cdb4f-p5xq4" Jun 09 00:12:12.233479 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.233339 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8rzb\" (UniqueName: \"kubernetes.io/projected/3469868a-97d4-4e1e-b243-4e3727447c62-kube-api-access-n8rzb\") pod \"maas-api-68db8cdb4f-p5xq4\" (UID: \"3469868a-97d4-4e1e-b243-4e3727447c62\") " pod="redhat-ai-gateway-infra/maas-api-68db8cdb4f-p5xq4" Jun 09 00:12:12.334146 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.334072 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8rzb\" (UniqueName: \"kubernetes.io/projected/3469868a-97d4-4e1e-b243-4e3727447c62-kube-api-access-n8rzb\") pod \"maas-api-68db8cdb4f-p5xq4\" (UID: \"3469868a-97d4-4e1e-b243-4e3727447c62\") " pod="redhat-ai-gateway-infra/maas-api-68db8cdb4f-p5xq4" Jun 09 00:12:12.334146 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.334141 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3469868a-97d4-4e1e-b243-4e3727447c62-maas-api-tls\") pod \"maas-api-68db8cdb4f-p5xq4\" (UID: \"3469868a-97d4-4e1e-b243-4e3727447c62\") " pod="redhat-ai-gateway-infra/maas-api-68db8cdb4f-p5xq4" Jun 09 00:12:12.334311 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:12:12.334234 2515 secret.go:189] Couldn't get secret redhat-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 09 00:12:12.334346 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:12:12.334312 2515 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3469868a-97d4-4e1e-b243-4e3727447c62-maas-api-tls podName:3469868a-97d4-4e1e-b243-4e3727447c62 nodeName:}" failed. No retries permitted until 2026-06-09 00:12:12.834292705 +0000 UTC m=+773.450356536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3469868a-97d4-4e1e-b243-4e3727447c62-maas-api-tls") pod "maas-api-68db8cdb4f-p5xq4" (UID: "3469868a-97d4-4e1e-b243-4e3727447c62") : secret "maas-api-serving-cert" not found Jun 09 00:12:12.342030 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.342004 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8rzb\" (UniqueName: \"kubernetes.io/projected/3469868a-97d4-4e1e-b243-4e3727447c62-kube-api-access-n8rzb\") pod \"maas-api-68db8cdb4f-p5xq4\" (UID: \"3469868a-97d4-4e1e-b243-4e3727447c62\") " pod="redhat-ai-gateway-infra/maas-api-68db8cdb4f-p5xq4" Jun 09 00:12:12.571385 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.571351 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-jk2bc"] Jun 09 00:12:12.574553 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.574538 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" Jun 09 00:12:12.577065 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.577035 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 09 00:12:12.585432 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.585382 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-jk2bc"] Jun 09 00:12:12.738226 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.738193 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbxtx\" (UniqueName: \"kubernetes.io/projected/f9f63d97-2f79-4e6d-97d0-369beea2c2f7-kube-api-access-mbxtx\") pod \"payload-processing-7c6c859784-jk2bc\" (UID: \"f9f63d97-2f79-4e6d-97d0-369beea2c2f7\") " pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" Jun 09 00:12:12.839582 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.839493 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3469868a-97d4-4e1e-b243-4e3727447c62-maas-api-tls\") pod \"maas-api-68db8cdb4f-p5xq4\" (UID: \"3469868a-97d4-4e1e-b243-4e3727447c62\") " pod="redhat-ai-gateway-infra/maas-api-68db8cdb4f-p5xq4" Jun 09 00:12:12.839582 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.839534 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbxtx\" (UniqueName: \"kubernetes.io/projected/f9f63d97-2f79-4e6d-97d0-369beea2c2f7-kube-api-access-mbxtx\") pod \"payload-processing-7c6c859784-jk2bc\" (UID: \"f9f63d97-2f79-4e6d-97d0-369beea2c2f7\") " pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" Jun 09 00:12:12.841897 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.841876 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3469868a-97d4-4e1e-b243-4e3727447c62-maas-api-tls\") pod \"maas-api-68db8cdb4f-p5xq4\" (UID: \"3469868a-97d4-4e1e-b243-4e3727447c62\") " pod="redhat-ai-gateway-infra/maas-api-68db8cdb4f-p5xq4" Jun 09 00:12:12.846735 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.846711 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbxtx\" (UniqueName: \"kubernetes.io/projected/f9f63d97-2f79-4e6d-97d0-369beea2c2f7-kube-api-access-mbxtx\") pod \"payload-processing-7c6c859784-jk2bc\" (UID: \"f9f63d97-2f79-4e6d-97d0-369beea2c2f7\") " pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" Jun 09 00:12:12.885762 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.885735 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" Jun 09 00:12:12.951532 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:12.951461 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-68db8cdb4f-p5xq4" Jun 09 00:12:13.042320 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:13.042295 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-jk2bc"] Jun 09 00:12:13.045395 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:12:13.045366 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9f63d97_2f79_4e6d_97d0_369beea2c2f7.slice/crio-c605277cb05f63d09901f5ac5112982347317c31957a68d6007c6a3fe2cabf08 WatchSource:0}: Error finding container c605277cb05f63d09901f5ac5112982347317c31957a68d6007c6a3fe2cabf08: Status 404 returned error can't find the container with id c605277cb05f63d09901f5ac5112982347317c31957a68d6007c6a3fe2cabf08 Jun 09 00:12:13.047530 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:13.047510 2515 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 00:12:13.089344 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:13.089322 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-68db8cdb4f-p5xq4"] Jun 09 00:12:13.091481 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:12:13.091418 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3469868a_97d4_4e1e_b243_4e3727447c62.slice/crio-0ec61318cf1f16dc7c1b1de6dcf6875de065f3f71031a49b568b600402d9f9cb WatchSource:0}: Error finding container 0ec61318cf1f16dc7c1b1de6dcf6875de065f3f71031a49b568b600402d9f9cb: Status 404 returned error can't find the container with id 0ec61318cf1f16dc7c1b1de6dcf6875de065f3f71031a49b568b600402d9f9cb Jun 09 00:12:13.816943 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:13.816913 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" event={"ID":"f9f63d97-2f79-4e6d-97d0-369beea2c2f7","Type":"ContainerStarted","Data":"c605277cb05f63d09901f5ac5112982347317c31957a68d6007c6a3fe2cabf08"} Jun 09 00:12:13.818339 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:13.818304 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-68db8cdb4f-p5xq4" event={"ID":"3469868a-97d4-4e1e-b243-4e3727447c62","Type":"ContainerStarted","Data":"0ec61318cf1f16dc7c1b1de6dcf6875de065f3f71031a49b568b600402d9f9cb"} Jun 09 00:12:15.830316 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:15.830277 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-68db8cdb4f-p5xq4" event={"ID":"3469868a-97d4-4e1e-b243-4e3727447c62","Type":"ContainerStarted","Data":"99ea4311ab73359345bb8e296371aa60cecb1bd1714ea50a64418453342ccea6"} Jun 09 00:12:15.830830 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:15.830422 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/maas-api-68db8cdb4f-p5xq4" Jun 09 00:12:15.831732 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:15.831705 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" event={"ID":"f9f63d97-2f79-4e6d-97d0-369beea2c2f7","Type":"ContainerStarted","Data":"7c5d3c7d70ccb55b72252e04ad7110f933df752c0a181ffe4bbee986379b995e"} Jun 09 00:12:15.831867 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:15.831752 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" Jun 09 00:12:15.846674 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:15.846634 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-68db8cdb4f-p5xq4" podStartSLOduration=2.015343933 podStartE2EDuration="3.846619119s" totalImagesPullingTime="1.831275186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:12:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:12:15.845282612 +0000 UTC m=+776.461346439" watchObservedRunningTime="2026-06-09 00:12:15.846619119 +0000 UTC m=+776.462682945" Jun 09 00:12:15.859847 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:15.859809 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" podStartSLOduration=1.985872113 podStartE2EDuration="3.859795844s" totalImagesPullingTime="1.873923731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:12:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:12:15.858297174 +0000 UTC m=+776.474361038" watchObservedRunningTime="2026-06-09 00:12:15.859795844 +0000 UTC m=+776.475859679" Jun 09 00:12:21.841874 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:21.841843 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/maas-api-68db8cdb4f-p5xq4" Jun 09 00:12:23.623365 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:23.623332 2515 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 00:12:23.623802 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:23.623523 2515 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="efe2663b-59fa-4737-b8ce-f7afecfd1dd0" containerName="keycloak" containerID="cri-o://b34634501ed4c16dfc679079f730fc2869c932ce3dffef768978690c7856e870" gracePeriod=30 Jun 09 00:12:25.667129 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.667104 2515 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 00:12:25.746288 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.746247 2515 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gwlhl\" (UniqueName: \"kubernetes.io/projected/efe2663b-59fa-4737-b8ce-f7afecfd1dd0-kube-api-access-gwlhl\") pod \"efe2663b-59fa-4737-b8ce-f7afecfd1dd0\" (UID: \"efe2663b-59fa-4737-b8ce-f7afecfd1dd0\") " Jun 09 00:12:25.748389 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.748367 2515 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efe2663b-59fa-4737-b8ce-f7afecfd1dd0-kube-api-access-gwlhl" (OuterVolumeSpecName: "kube-api-access-gwlhl") pod "efe2663b-59fa-4737-b8ce-f7afecfd1dd0" (UID: "efe2663b-59fa-4737-b8ce-f7afecfd1dd0"). InnerVolumeSpecName "kube-api-access-gwlhl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:12:25.847113 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.847090 2515 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gwlhl\" (UniqueName: \"kubernetes.io/projected/efe2663b-59fa-4737-b8ce-f7afecfd1dd0-kube-api-access-gwlhl\") on node \"ip-10-0-129-4.ec2.internal\" DevicePath \"\"" Jun 09 00:12:25.878255 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.878226 2515 generic.go:356] "Generic (PLEG): container finished" podID="efe2663b-59fa-4737-b8ce-f7afecfd1dd0" containerID="b34634501ed4c16dfc679079f730fc2869c932ce3dffef768978690c7856e870" exitCode=143 Jun 09 00:12:25.878393 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.878266 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"efe2663b-59fa-4737-b8ce-f7afecfd1dd0","Type":"ContainerDied","Data":"b34634501ed4c16dfc679079f730fc2869c932ce3dffef768978690c7856e870"} Jun 09 00:12:25.878393 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.878271 2515 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 00:12:25.878393 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.878308 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"efe2663b-59fa-4737-b8ce-f7afecfd1dd0","Type":"ContainerDied","Data":"b21960ad767306e1c4c1422880b3bee3f06dd0dd4cc6cecba0586e3d9f7500d8"} Jun 09 00:12:25.878393 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.878329 2515 scope.go:117] "RemoveContainer" containerID="b34634501ed4c16dfc679079f730fc2869c932ce3dffef768978690c7856e870" Jun 09 00:12:25.887105 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.887090 2515 scope.go:117] "RemoveContainer" containerID="b34634501ed4c16dfc679079f730fc2869c932ce3dffef768978690c7856e870" Jun 09 00:12:25.887359 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:12:25.887339 2515 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b34634501ed4c16dfc679079f730fc2869c932ce3dffef768978690c7856e870\": container with ID starting with b34634501ed4c16dfc679079f730fc2869c932ce3dffef768978690c7856e870 not found: ID does not exist" containerID="b34634501ed4c16dfc679079f730fc2869c932ce3dffef768978690c7856e870" Jun 09 00:12:25.887402 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.887367 2515 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b34634501ed4c16dfc679079f730fc2869c932ce3dffef768978690c7856e870"} err="failed to get container status \"b34634501ed4c16dfc679079f730fc2869c932ce3dffef768978690c7856e870\": rpc error: code = NotFound desc = could not find container \"b34634501ed4c16dfc679079f730fc2869c932ce3dffef768978690c7856e870\": container with ID starting with b34634501ed4c16dfc679079f730fc2869c932ce3dffef768978690c7856e870 not found: ID does not exist" Jun 09 00:12:25.897774 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.897755 2515 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 00:12:25.901250 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.901230 2515 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 00:12:25.921281 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.921256 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 00:12:25.921581 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.921568 2515 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efe2663b-59fa-4737-b8ce-f7afecfd1dd0" containerName="keycloak" Jun 09 00:12:25.921639 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.921582 2515 state_mem.go:107] "Deleted CPUSet assignment" podUID="efe2663b-59fa-4737-b8ce-f7afecfd1dd0" containerName="keycloak" Jun 09 00:12:25.921689 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.921679 2515 memory_manager.go:368] "RemoveStaleState removing state" podUID="efe2663b-59fa-4737-b8ce-f7afecfd1dd0" containerName="keycloak" Jun 09 00:12:25.926103 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.926086 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 00:12:25.928635 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.928616 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 09 00:12:25.928759 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.928594 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-t56vc\"" Jun 09 00:12:25.928759 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.928754 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 00:12:25.928886 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.928771 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 00:12:25.928886 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.928776 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 09 00:12:25.932830 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.932812 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 00:12:25.948293 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.948271 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xntpm\" (UniqueName: \"kubernetes.io/projected/fbe400f2-051a-45e6-a8ef-59a4a4100e17-kube-api-access-xntpm\") pod \"maas-keycloak-0\" (UID: \"fbe400f2-051a-45e6-a8ef-59a4a4100e17\") " pod="keycloak-system/maas-keycloak-0" Jun 09 00:12:25.948400 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:25.948318 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/fbe400f2-051a-45e6-a8ef-59a4a4100e17-test-realms\") pod \"maas-keycloak-0\" (UID: \"fbe400f2-051a-45e6-a8ef-59a4a4100e17\") " pod="keycloak-system/maas-keycloak-0" Jun 09 00:12:26.049200 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:26.049175 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/fbe400f2-051a-45e6-a8ef-59a4a4100e17-test-realms\") pod \"maas-keycloak-0\" (UID: \"fbe400f2-051a-45e6-a8ef-59a4a4100e17\") " pod="keycloak-system/maas-keycloak-0" Jun 09 00:12:26.049337 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:26.049235 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xntpm\" (UniqueName: \"kubernetes.io/projected/fbe400f2-051a-45e6-a8ef-59a4a4100e17-kube-api-access-xntpm\") pod \"maas-keycloak-0\" (UID: \"fbe400f2-051a-45e6-a8ef-59a4a4100e17\") " pod="keycloak-system/maas-keycloak-0" Jun 09 00:12:26.049870 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:26.049853 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/fbe400f2-051a-45e6-a8ef-59a4a4100e17-test-realms\") pod \"maas-keycloak-0\" (UID: \"fbe400f2-051a-45e6-a8ef-59a4a4100e17\") " pod="keycloak-system/maas-keycloak-0" Jun 09 00:12:26.056681 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:26.056661 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xntpm\" (UniqueName: \"kubernetes.io/projected/fbe400f2-051a-45e6-a8ef-59a4a4100e17-kube-api-access-xntpm\") pod \"maas-keycloak-0\" (UID: \"fbe400f2-051a-45e6-a8ef-59a4a4100e17\") " pod="keycloak-system/maas-keycloak-0" Jun 09 00:12:26.236882 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:26.236800 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 09 00:12:26.364535 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:26.364511 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 09 00:12:26.366645 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:12:26.366617 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbe400f2_051a_45e6_a8ef_59a4a4100e17.slice/crio-b47f3352a698c4b3cf5391a9414c2e082d669876a585045e16ca5734745e3fda WatchSource:0}: Error finding container b47f3352a698c4b3cf5391a9414c2e082d669876a585045e16ca5734745e3fda: Status 404 returned error can't find the container with id b47f3352a698c4b3cf5391a9414c2e082d669876a585045e16ca5734745e3fda Jun 09 00:12:26.838056 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:26.838037 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" Jun 09 00:12:26.885259 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:26.885232 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"fbe400f2-051a-45e6-a8ef-59a4a4100e17","Type":"ContainerStarted","Data":"b47f3352a698c4b3cf5391a9414c2e082d669876a585045e16ca5734745e3fda"} Jun 09 00:12:27.865738 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:27.865695 2515 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efe2663b-59fa-4737-b8ce-f7afecfd1dd0" path="/var/lib/kubelet/pods/efe2663b-59fa-4737-b8ce-f7afecfd1dd0/volumes" Jun 09 00:12:27.892389 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:27.892355 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"fbe400f2-051a-45e6-a8ef-59a4a4100e17","Type":"ContainerStarted","Data":"dff8772bde547eacff396ad1a0715965b62ae35fe93b9242d6d235085adb7210"} Jun 09 00:12:27.911714 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:27.911643 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.446900624 podStartE2EDuration="2.911622593s" totalImagesPullingTime="464.721969ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:12:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:12:27.908288305 +0000 UTC m=+788.524352149" watchObservedRunningTime="2026-06-09 00:12:27.911622593 +0000 UTC m=+788.527686430" Jun 09 00:12:28.237493 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:28.237381 2515 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 09 00:12:28.239072 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:28.239031 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fbe400f2-051a-45e6-a8ef-59a4a4100e17" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 09 00:12:29.238342 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:29.238280 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fbe400f2-051a-45e6-a8ef-59a4a4100e17" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 09 00:12:30.238268 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:30.238213 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fbe400f2-051a-45e6-a8ef-59a4a4100e17" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 09 00:12:31.238104 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:31.238053 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fbe400f2-051a-45e6-a8ef-59a4a4100e17" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 09 00:12:32.238221 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:32.237799 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fbe400f2-051a-45e6-a8ef-59a4a4100e17" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 09 00:12:33.237457 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:33.237411 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fbe400f2-051a-45e6-a8ef-59a4a4100e17" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 09 00:12:34.237409 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:34.237363 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fbe400f2-051a-45e6-a8ef-59a4a4100e17" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 09 00:12:35.237406 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:35.237346 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fbe400f2-051a-45e6-a8ef-59a4a4100e17" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 09 00:12:36.237620 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:36.237566 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 09 00:12:36.238111 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:36.237856 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fbe400f2-051a-45e6-a8ef-59a4a4100e17" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 09 00:12:37.238059 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:37.238007 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fbe400f2-051a-45e6-a8ef-59a4a4100e17" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 09 00:12:38.237822 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:38.237775 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fbe400f2-051a-45e6-a8ef-59a4a4100e17" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 09 00:12:39.237650 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:39.237576 2515 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="fbe400f2-051a-45e6-a8ef-59a4a4100e17" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.30:9000/health/started\": dial tcp 10.134.0.30:9000: connect: connection refused" Jun 09 00:12:40.363216 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:40.363164 2515 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 09 00:12:40.383561 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:40.383514 2515 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="fbe400f2-051a-45e6-a8ef-59a4a4100e17" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 00:12:50.369887 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:12:50.369852 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 09 00:13:26.020012 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.019981 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96"] Jun 09 00:13:26.023815 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.023794 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:13:26.027561 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.027539 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f7nfn\"" Jun 09 00:13:26.027712 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.027571 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 09 00:13:26.027712 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.027582 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 00:13:26.027712 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.027662 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 00:13:26.034287 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.034265 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96"] Jun 09 00:13:26.078215 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.078185 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82ff6579-308d-4fdb-b8df-3e3dd74f122f-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nqq96\" (UID: \"82ff6579-308d-4fdb-b8df-3e3dd74f122f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:13:26.078353 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.078225 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82ff6579-308d-4fdb-b8df-3e3dd74f122f-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nqq96\" (UID: \"82ff6579-308d-4fdb-b8df-3e3dd74f122f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:13:26.081624 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.078247 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5slq\" (UniqueName: \"kubernetes.io/projected/82ff6579-308d-4fdb-b8df-3e3dd74f122f-kube-api-access-b5slq\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nqq96\" (UID: \"82ff6579-308d-4fdb-b8df-3e3dd74f122f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:13:26.081624 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.078858 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/82ff6579-308d-4fdb-b8df-3e3dd74f122f-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nqq96\" (UID: \"82ff6579-308d-4fdb-b8df-3e3dd74f122f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:13:26.081624 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.078986 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82ff6579-308d-4fdb-b8df-3e3dd74f122f-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nqq96\" (UID: \"82ff6579-308d-4fdb-b8df-3e3dd74f122f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:13:26.081624 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.079011 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82ff6579-308d-4fdb-b8df-3e3dd74f122f-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nqq96\" (UID: \"82ff6579-308d-4fdb-b8df-3e3dd74f122f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:13:26.179792 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.179759 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82ff6579-308d-4fdb-b8df-3e3dd74f122f-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nqq96\" (UID: \"82ff6579-308d-4fdb-b8df-3e3dd74f122f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:13:26.179972 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.179802 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5slq\" (UniqueName: \"kubernetes.io/projected/82ff6579-308d-4fdb-b8df-3e3dd74f122f-kube-api-access-b5slq\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nqq96\" (UID: \"82ff6579-308d-4fdb-b8df-3e3dd74f122f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:13:26.179972 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.179826 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/82ff6579-308d-4fdb-b8df-3e3dd74f122f-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nqq96\" (UID: \"82ff6579-308d-4fdb-b8df-3e3dd74f122f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:13:26.179972 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.179884 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82ff6579-308d-4fdb-b8df-3e3dd74f122f-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nqq96\" (UID: \"82ff6579-308d-4fdb-b8df-3e3dd74f122f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:13:26.179972 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.179900 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82ff6579-308d-4fdb-b8df-3e3dd74f122f-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nqq96\" (UID: \"82ff6579-308d-4fdb-b8df-3e3dd74f122f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:13:26.179972 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.179942 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82ff6579-308d-4fdb-b8df-3e3dd74f122f-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nqq96\" (UID: \"82ff6579-308d-4fdb-b8df-3e3dd74f122f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:13:26.180312 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.180287 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/82ff6579-308d-4fdb-b8df-3e3dd74f122f-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nqq96\" (UID: \"82ff6579-308d-4fdb-b8df-3e3dd74f122f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:13:26.180390 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.180323 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/82ff6579-308d-4fdb-b8df-3e3dd74f122f-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nqq96\" (UID: \"82ff6579-308d-4fdb-b8df-3e3dd74f122f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:13:26.180390 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.180349 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/82ff6579-308d-4fdb-b8df-3e3dd74f122f-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nqq96\" (UID: \"82ff6579-308d-4fdb-b8df-3e3dd74f122f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:13:26.182069 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.182048 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/82ff6579-308d-4fdb-b8df-3e3dd74f122f-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nqq96\" (UID: \"82ff6579-308d-4fdb-b8df-3e3dd74f122f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:13:26.182342 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.182321 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/82ff6579-308d-4fdb-b8df-3e3dd74f122f-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nqq96\" (UID: \"82ff6579-308d-4fdb-b8df-3e3dd74f122f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:13:26.187647 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.187626 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5slq\" (UniqueName: \"kubernetes.io/projected/82ff6579-308d-4fdb-b8df-3e3dd74f122f-kube-api-access-b5slq\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-nqq96\" (UID: \"82ff6579-308d-4fdb-b8df-3e3dd74f122f\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:13:26.338086 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.338010 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:13:26.469691 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:26.469662 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96"] Jun 09 00:13:26.472443 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:13:26.472414 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ff6579_308d_4fdb_b8df_3e3dd74f122f.slice/crio-1ea1a0a027b773103ee05e1cf5cc33c1c098625c5a0ab83421c91db6703e64aa WatchSource:0}: Error finding container 1ea1a0a027b773103ee05e1cf5cc33c1c098625c5a0ab83421c91db6703e64aa: Status 404 returned error can't find the container with id 1ea1a0a027b773103ee05e1cf5cc33c1c098625c5a0ab83421c91db6703e64aa Jun 09 00:13:27.198174 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:27.198135 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" event={"ID":"82ff6579-308d-4fdb-b8df-3e3dd74f122f","Type":"ContainerStarted","Data":"1ea1a0a027b773103ee05e1cf5cc33c1c098625c5a0ab83421c91db6703e64aa"} Jun 09 00:13:30.215440 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:30.215407 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" event={"ID":"82ff6579-308d-4fdb-b8df-3e3dd74f122f","Type":"ContainerStarted","Data":"b620c26bc6b844e6eab30f4b81d1f73f0abfc7a0427de49bca6b61a1962de2ab"} Jun 09 00:13:31.221810 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:31.221776 2515 generic.go:356] "Generic (PLEG): container finished" podID="82ff6579-308d-4fdb-b8df-3e3dd74f122f" containerID="b620c26bc6b844e6eab30f4b81d1f73f0abfc7a0427de49bca6b61a1962de2ab" exitCode=0 Jun 09 00:13:31.222220 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:31.221855 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" event={"ID":"82ff6579-308d-4fdb-b8df-3e3dd74f122f","Type":"ContainerDied","Data":"b620c26bc6b844e6eab30f4b81d1f73f0abfc7a0427de49bca6b61a1962de2ab"} Jun 09 00:13:33.233350 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:33.233312 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" event={"ID":"82ff6579-308d-4fdb-b8df-3e3dd74f122f","Type":"ContainerStarted","Data":"8b977cebb6807d40430b9a05b854764d63a31b0649517bf1fa43a584471b739c"} Jun 09 00:13:33.251133 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:33.251091 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" podStartSLOduration=2.026231443 podStartE2EDuration="7.251073702s" totalImagesPullingTime="3.86162414s" totalInitContainerRuntime="1.363218119s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:13:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:13:33.250138344 +0000 UTC m=+853.866202183" watchObservedRunningTime="2026-06-09 00:13:33.251073702 +0000 UTC m=+853.867137539" Jun 09 00:13:36.338480 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:36.338449 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:13:36.338979 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:36.338501 2515 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:13:36.350904 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:36.350883 2515 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:13:37.263416 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:13:37.263385 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-nqq96" Jun 09 00:14:00.728705 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:00.728665 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp"] Jun 09 00:14:00.741720 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:00.741694 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp"] Jun 09 00:14:00.741887 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:00.741791 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:00.744229 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:00.744210 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 09 00:14:00.771993 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:00.771966 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/810c1533-3c21-4ca7-afae-db9d41a717e6-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mmrwp\" (UID: \"810c1533-3c21-4ca7-afae-db9d41a717e6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:00.772143 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:00.772010 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk26x\" (UniqueName: \"kubernetes.io/projected/810c1533-3c21-4ca7-afae-db9d41a717e6-kube-api-access-hk26x\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mmrwp\" (UID: \"810c1533-3c21-4ca7-afae-db9d41a717e6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:00.772143 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:00.772039 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/810c1533-3c21-4ca7-afae-db9d41a717e6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mmrwp\" (UID: \"810c1533-3c21-4ca7-afae-db9d41a717e6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:00.772143 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:00.772092 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/810c1533-3c21-4ca7-afae-db9d41a717e6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mmrwp\" (UID: \"810c1533-3c21-4ca7-afae-db9d41a717e6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:00.772143 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:00.772116 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/810c1533-3c21-4ca7-afae-db9d41a717e6-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mmrwp\" (UID: \"810c1533-3c21-4ca7-afae-db9d41a717e6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:00.772316 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:00.772192 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/810c1533-3c21-4ca7-afae-db9d41a717e6-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mmrwp\" (UID: \"810c1533-3c21-4ca7-afae-db9d41a717e6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:00.872584 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:00.872551 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/810c1533-3c21-4ca7-afae-db9d41a717e6-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mmrwp\" (UID: \"810c1533-3c21-4ca7-afae-db9d41a717e6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:00.872584 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:00.872587 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk26x\" (UniqueName: \"kubernetes.io/projected/810c1533-3c21-4ca7-afae-db9d41a717e6-kube-api-access-hk26x\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mmrwp\" (UID: \"810c1533-3c21-4ca7-afae-db9d41a717e6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:00.872828 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:00.872618 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/810c1533-3c21-4ca7-afae-db9d41a717e6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mmrwp\" (UID: \"810c1533-3c21-4ca7-afae-db9d41a717e6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:00.872828 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:00.872679 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/810c1533-3c21-4ca7-afae-db9d41a717e6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mmrwp\" (UID: \"810c1533-3c21-4ca7-afae-db9d41a717e6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:00.872949 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:00.872917 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/810c1533-3c21-4ca7-afae-db9d41a717e6-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mmrwp\" (UID: \"810c1533-3c21-4ca7-afae-db9d41a717e6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:00.873031 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:00.873012 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/810c1533-3c21-4ca7-afae-db9d41a717e6-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mmrwp\" (UID: \"810c1533-3c21-4ca7-afae-db9d41a717e6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:00.873089 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:00.873071 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/810c1533-3c21-4ca7-afae-db9d41a717e6-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mmrwp\" (UID: \"810c1533-3c21-4ca7-afae-db9d41a717e6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:00.873152 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:00.873114 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/810c1533-3c21-4ca7-afae-db9d41a717e6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mmrwp\" (UID: \"810c1533-3c21-4ca7-afae-db9d41a717e6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:00.873350 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:00.873327 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/810c1533-3c21-4ca7-afae-db9d41a717e6-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mmrwp\" (UID: \"810c1533-3c21-4ca7-afae-db9d41a717e6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:00.875074 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:00.875056 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/810c1533-3c21-4ca7-afae-db9d41a717e6-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mmrwp\" (UID: \"810c1533-3c21-4ca7-afae-db9d41a717e6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:00.875327 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:00.875310 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/810c1533-3c21-4ca7-afae-db9d41a717e6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mmrwp\" (UID: \"810c1533-3c21-4ca7-afae-db9d41a717e6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:00.882573 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:00.882549 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk26x\" (UniqueName: \"kubernetes.io/projected/810c1533-3c21-4ca7-afae-db9d41a717e6-kube-api-access-hk26x\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-mmrwp\" (UID: \"810c1533-3c21-4ca7-afae-db9d41a717e6\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:01.052550 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:01.052471 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:01.181910 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:01.181885 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp"] Jun 09 00:14:01.183441 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:14:01.183404 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod810c1533_3c21_4ca7_afae_db9d41a717e6.slice/crio-6c99c4ddf50bdbcc4f938799268cf2c9c7292ac8071a30f6ff8a28c77153ef7d WatchSource:0}: Error finding container 6c99c4ddf50bdbcc4f938799268cf2c9c7292ac8071a30f6ff8a28c77153ef7d: Status 404 returned error can't find the container with id 6c99c4ddf50bdbcc4f938799268cf2c9c7292ac8071a30f6ff8a28c77153ef7d Jun 09 00:14:01.367080 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:01.367048 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" event={"ID":"810c1533-3c21-4ca7-afae-db9d41a717e6","Type":"ContainerStarted","Data":"21f296c16850d38c9610c3daf2930de23de81cc341f039aeabc6316aaf56cc0e"} Jun 09 00:14:01.367251 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:01.367094 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" event={"ID":"810c1533-3c21-4ca7-afae-db9d41a717e6","Type":"ContainerStarted","Data":"6c99c4ddf50bdbcc4f938799268cf2c9c7292ac8071a30f6ff8a28c77153ef7d"} Jun 09 00:14:03.380119 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:03.380079 2515 generic.go:356] "Generic (PLEG): container finished" podID="810c1533-3c21-4ca7-afae-db9d41a717e6" containerID="21f296c16850d38c9610c3daf2930de23de81cc341f039aeabc6316aaf56cc0e" exitCode=0 Jun 09 00:14:03.380475 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:03.380151 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" event={"ID":"810c1533-3c21-4ca7-afae-db9d41a717e6","Type":"ContainerDied","Data":"21f296c16850d38c9610c3daf2930de23de81cc341f039aeabc6316aaf56cc0e"} Jun 09 00:14:04.387577 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:04.387545 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" event={"ID":"810c1533-3c21-4ca7-afae-db9d41a717e6","Type":"ContainerStarted","Data":"f13329aa2ff8eaec37a8a245fe3cf7edcba79a13a4200585978b5585ed977325"} Jun 09 00:14:04.406744 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:04.406699 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" podStartSLOduration=2.918215146 podStartE2EDuration="4.406683175s" totalImagesPullingTime="220.589917ms" totalInitContainerRuntime="1.267878112s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:14:04.404820717 +0000 UTC m=+885.020884554" watchObservedRunningTime="2026-06-09 00:14:04.406683175 +0000 UTC m=+885.022747010" Jun 09 00:14:11.053672 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:11.053569 2515 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:11.053672 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:11.053637 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:11.066109 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:11.066087 2515 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:11.432779 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:11.432749 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-mmrwp" Jun 09 00:14:15.443439 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:15.443410 2515 generic.go:356] "Generic (PLEG): container finished" podID="f9f63d97-2f79-4e6d-97d0-369beea2c2f7" containerID="7c5d3c7d70ccb55b72252e04ad7110f933df752c0a181ffe4bbee986379b995e" exitCode=1 Jun 09 00:14:15.443843 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:15.443460 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" event={"ID":"f9f63d97-2f79-4e6d-97d0-369beea2c2f7","Type":"ContainerDied","Data":"7c5d3c7d70ccb55b72252e04ad7110f933df752c0a181ffe4bbee986379b995e"} Jun 09 00:14:15.443843 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:15.443831 2515 scope.go:117] "RemoveContainer" containerID="7c5d3c7d70ccb55b72252e04ad7110f933df752c0a181ffe4bbee986379b995e" Jun 09 00:14:16.450334 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:16.450298 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" event={"ID":"f9f63d97-2f79-4e6d-97d0-369beea2c2f7","Type":"ContainerStarted","Data":"7b7579cb8b9434ce239ddcce98552c26a544e3a077cdc1e9d8b32ed00baf87c3"} Jun 09 00:14:16.450811 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:16.450511 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" Jun 09 00:14:27.458048 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:14:27.458015 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" Jun 09 00:16:05.229636 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:05.229583 2515 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f7676c84b-jxdw8"] Jun 09 00:16:05.230207 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:05.230005 2515 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5f7676c84b-jxdw8" podUID="4d444d79-6dac-4bfd-8372-7e8837b1efb2" containerName="manager" containerID="cri-o://01564ee514eb29b27a18557818c056a0d005eb62b5af938794bbc6a0f36fe5f5" gracePeriod=30 Jun 09 00:16:05.482649 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:05.482624 2515 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f7676c84b-jxdw8" Jun 09 00:16:05.536932 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:05.536905 2515 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dqpw\" (UniqueName: \"kubernetes.io/projected/4d444d79-6dac-4bfd-8372-7e8837b1efb2-kube-api-access-7dqpw\") pod \"4d444d79-6dac-4bfd-8372-7e8837b1efb2\" (UID: \"4d444d79-6dac-4bfd-8372-7e8837b1efb2\") " Jun 09 00:16:05.537103 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:05.536957 2515 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d444d79-6dac-4bfd-8372-7e8837b1efb2-webhook-cert\") pod \"4d444d79-6dac-4bfd-8372-7e8837b1efb2\" (UID: \"4d444d79-6dac-4bfd-8372-7e8837b1efb2\") " Jun 09 00:16:05.538958 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:05.538932 2515 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d444d79-6dac-4bfd-8372-7e8837b1efb2-kube-api-access-7dqpw" (OuterVolumeSpecName: "kube-api-access-7dqpw") pod "4d444d79-6dac-4bfd-8372-7e8837b1efb2" (UID: "4d444d79-6dac-4bfd-8372-7e8837b1efb2"). InnerVolumeSpecName "kube-api-access-7dqpw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 00:16:05.539085 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:05.538989 2515 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d444d79-6dac-4bfd-8372-7e8837b1efb2-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4d444d79-6dac-4bfd-8372-7e8837b1efb2" (UID: "4d444d79-6dac-4bfd-8372-7e8837b1efb2"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 00:16:05.638238 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:05.638163 2515 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dqpw\" (UniqueName: \"kubernetes.io/projected/4d444d79-6dac-4bfd-8372-7e8837b1efb2-kube-api-access-7dqpw\") on node \"ip-10-0-129-4.ec2.internal\" DevicePath \"\"" Jun 09 00:16:05.638238 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:05.638189 2515 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4d444d79-6dac-4bfd-8372-7e8837b1efb2-webhook-cert\") on node \"ip-10-0-129-4.ec2.internal\" DevicePath \"\"" Jun 09 00:16:05.962368 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:05.962291 2515 generic.go:356] "Generic (PLEG): container finished" podID="4d444d79-6dac-4bfd-8372-7e8837b1efb2" containerID="01564ee514eb29b27a18557818c056a0d005eb62b5af938794bbc6a0f36fe5f5" exitCode=0 Jun 09 00:16:05.962368 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:05.962346 2515 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f7676c84b-jxdw8" Jun 09 00:16:05.962550 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:05.962346 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f7676c84b-jxdw8" event={"ID":"4d444d79-6dac-4bfd-8372-7e8837b1efb2","Type":"ContainerDied","Data":"01564ee514eb29b27a18557818c056a0d005eb62b5af938794bbc6a0f36fe5f5"} Jun 09 00:16:05.962550 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:05.962472 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f7676c84b-jxdw8" event={"ID":"4d444d79-6dac-4bfd-8372-7e8837b1efb2","Type":"ContainerDied","Data":"0c6020edacff9e3334e343f6c98b17a40c82ef447c3385e515b4018c47076c5a"} Jun 09 00:16:05.962550 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:05.962501 2515 scope.go:117] "RemoveContainer" containerID="01564ee514eb29b27a18557818c056a0d005eb62b5af938794bbc6a0f36fe5f5" Jun 09 00:16:05.970877 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:05.970862 2515 scope.go:117] "RemoveContainer" containerID="01564ee514eb29b27a18557818c056a0d005eb62b5af938794bbc6a0f36fe5f5" Jun 09 00:16:05.971117 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:16:05.971099 2515 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01564ee514eb29b27a18557818c056a0d005eb62b5af938794bbc6a0f36fe5f5\": container with ID starting with 01564ee514eb29b27a18557818c056a0d005eb62b5af938794bbc6a0f36fe5f5 not found: ID does not exist" containerID="01564ee514eb29b27a18557818c056a0d005eb62b5af938794bbc6a0f36fe5f5" Jun 09 00:16:05.971170 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:05.971153 2515 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01564ee514eb29b27a18557818c056a0d005eb62b5af938794bbc6a0f36fe5f5"} err="failed to get container status \"01564ee514eb29b27a18557818c056a0d005eb62b5af938794bbc6a0f36fe5f5\": rpc error: code = NotFound desc = could not find container \"01564ee514eb29b27a18557818c056a0d005eb62b5af938794bbc6a0f36fe5f5\": container with ID starting with 01564ee514eb29b27a18557818c056a0d005eb62b5af938794bbc6a0f36fe5f5 not found: ID does not exist" Jun 09 00:16:05.978592 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:05.978569 2515 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5f7676c84b-jxdw8"] Jun 09 00:16:05.984115 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:05.984092 2515 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5f7676c84b-jxdw8"] Jun 09 00:16:06.758184 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:06.758155 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5f7676c84b-5c59x"] Jun 09 00:16:06.758578 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:06.758492 2515 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d444d79-6dac-4bfd-8372-7e8837b1efb2" containerName="manager" Jun 09 00:16:06.758578 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:06.758502 2515 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d444d79-6dac-4bfd-8372-7e8837b1efb2" containerName="manager" Jun 09 00:16:06.758578 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:06.758569 2515 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d444d79-6dac-4bfd-8372-7e8837b1efb2" containerName="manager" Jun 09 00:16:06.761567 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:06.761545 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f7676c84b-5c59x" Jun 09 00:16:06.763945 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:06.763923 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 00:16:06.763945 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:06.763930 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 00:16:06.765232 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:06.765216 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qccps\"" Jun 09 00:16:06.770906 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:06.770885 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f7676c84b-5c59x"] Jun 09 00:16:06.847085 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:06.847058 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/081a583f-880e-4b73-97d0-4bae77e0c00d-webhook-cert\") pod \"maas-controller-5f7676c84b-5c59x\" (UID: \"081a583f-880e-4b73-97d0-4bae77e0c00d\") " pod="opendatahub/maas-controller-5f7676c84b-5c59x" Jun 09 00:16:06.847231 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:06.847102 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7k44\" (UniqueName: \"kubernetes.io/projected/081a583f-880e-4b73-97d0-4bae77e0c00d-kube-api-access-g7k44\") pod \"maas-controller-5f7676c84b-5c59x\" (UID: \"081a583f-880e-4b73-97d0-4bae77e0c00d\") " pod="opendatahub/maas-controller-5f7676c84b-5c59x" Jun 09 00:16:06.948351 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:06.948318 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/081a583f-880e-4b73-97d0-4bae77e0c00d-webhook-cert\") pod \"maas-controller-5f7676c84b-5c59x\" (UID: \"081a583f-880e-4b73-97d0-4bae77e0c00d\") " pod="opendatahub/maas-controller-5f7676c84b-5c59x" Jun 09 00:16:06.948507 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:06.948362 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7k44\" (UniqueName: \"kubernetes.io/projected/081a583f-880e-4b73-97d0-4bae77e0c00d-kube-api-access-g7k44\") pod \"maas-controller-5f7676c84b-5c59x\" (UID: \"081a583f-880e-4b73-97d0-4bae77e0c00d\") " pod="opendatahub/maas-controller-5f7676c84b-5c59x" Jun 09 00:16:06.950725 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:06.950697 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/081a583f-880e-4b73-97d0-4bae77e0c00d-webhook-cert\") pod \"maas-controller-5f7676c84b-5c59x\" (UID: \"081a583f-880e-4b73-97d0-4bae77e0c00d\") " pod="opendatahub/maas-controller-5f7676c84b-5c59x" Jun 09 00:16:06.955883 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:06.955865 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7k44\" (UniqueName: \"kubernetes.io/projected/081a583f-880e-4b73-97d0-4bae77e0c00d-kube-api-access-g7k44\") pod \"maas-controller-5f7676c84b-5c59x\" (UID: \"081a583f-880e-4b73-97d0-4bae77e0c00d\") " pod="opendatahub/maas-controller-5f7676c84b-5c59x" Jun 09 00:16:07.072671 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:07.072567 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5f7676c84b-5c59x" Jun 09 00:16:07.200244 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:07.200216 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5f7676c84b-5c59x"] Jun 09 00:16:07.202380 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:16:07.202350 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod081a583f_880e_4b73_97d0_4bae77e0c00d.slice/crio-ee188099d386c3222049cc2f32cdb9aba63f9ed964453ec8cdae5df36436639d WatchSource:0}: Error finding container ee188099d386c3222049cc2f32cdb9aba63f9ed964453ec8cdae5df36436639d: Status 404 returned error can't find the container with id ee188099d386c3222049cc2f32cdb9aba63f9ed964453ec8cdae5df36436639d Jun 09 00:16:07.865990 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:07.865961 2515 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d444d79-6dac-4bfd-8372-7e8837b1efb2" path="/var/lib/kubelet/pods/4d444d79-6dac-4bfd-8372-7e8837b1efb2/volumes" Jun 09 00:16:07.974758 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:07.974718 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f7676c84b-5c59x" event={"ID":"081a583f-880e-4b73-97d0-4bae77e0c00d","Type":"ContainerStarted","Data":"d2784ef7b774727458e5c181308af2d5590c107661923afbfe27d50627a4b624"} Jun 09 00:16:07.974907 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:07.974776 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5f7676c84b-5c59x" event={"ID":"081a583f-880e-4b73-97d0-4bae77e0c00d","Type":"ContainerStarted","Data":"ee188099d386c3222049cc2f32cdb9aba63f9ed964453ec8cdae5df36436639d"} Jun 09 00:16:07.974907 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:07.974800 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5f7676c84b-5c59x" Jun 09 00:16:07.991711 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:07.991573 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5f7676c84b-5c59x" podStartSLOduration=1.461676672 podStartE2EDuration="1.991559977s" totalImagesPullingTime="529.883305ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 00:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:16:07.989829861 +0000 UTC m=+1008.605893697" watchObservedRunningTime="2026-06-09 00:16:07.991559977 +0000 UTC m=+1008.607623812" Jun 09 00:16:16.012179 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:16.012148 2515 generic.go:356] "Generic (PLEG): container finished" podID="f9f63d97-2f79-4e6d-97d0-369beea2c2f7" containerID="7b7579cb8b9434ce239ddcce98552c26a544e3a077cdc1e9d8b32ed00baf87c3" exitCode=1 Jun 09 00:16:16.012590 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:16.012207 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" event={"ID":"f9f63d97-2f79-4e6d-97d0-369beea2c2f7","Type":"ContainerDied","Data":"7b7579cb8b9434ce239ddcce98552c26a544e3a077cdc1e9d8b32ed00baf87c3"} Jun 09 00:16:16.012590 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:16.012256 2515 scope.go:117] "RemoveContainer" containerID="7c5d3c7d70ccb55b72252e04ad7110f933df752c0a181ffe4bbee986379b995e" Jun 09 00:16:16.012590 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:16.012536 2515 scope.go:117] "RemoveContainer" containerID="7b7579cb8b9434ce239ddcce98552c26a544e3a077cdc1e9d8b32ed00baf87c3" Jun 09 00:16:16.012807 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:16:16.012783 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jk2bc_openshift-ingress(f9f63d97-2f79-4e6d-97d0-369beea2c2f7)\"" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" podUID="f9f63d97-2f79-4e6d-97d0-369beea2c2f7" Jun 09 00:16:17.456837 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:17.456799 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" Jun 09 00:16:17.457233 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:17.457120 2515 scope.go:117] "RemoveContainer" containerID="7b7579cb8b9434ce239ddcce98552c26a544e3a077cdc1e9d8b32ed00baf87c3" Jun 09 00:16:17.457332 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:16:17.457310 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jk2bc_openshift-ingress(f9f63d97-2f79-4e6d-97d0-369beea2c2f7)\"" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" podUID="f9f63d97-2f79-4e6d-97d0-369beea2c2f7" Jun 09 00:16:18.985095 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:18.985060 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5f7676c84b-5c59x" Jun 09 00:16:27.857877 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:27.857844 2515 scope.go:117] "RemoveContainer" containerID="7b7579cb8b9434ce239ddcce98552c26a544e3a077cdc1e9d8b32ed00baf87c3" Jun 09 00:16:28.074121 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:28.074076 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" event={"ID":"f9f63d97-2f79-4e6d-97d0-369beea2c2f7","Type":"ContainerStarted","Data":"9b0e91770da88da0b5575445fc7d3bb4fe6d58af2d16ddcfcd724ebfedbfd487"} Jun 09 00:16:28.074328 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:28.074311 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" Jun 09 00:16:39.080768 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:16:39.080741 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" Jun 09 00:18:28.649384 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:28.649352 2515 generic.go:356] "Generic (PLEG): container finished" podID="f9f63d97-2f79-4e6d-97d0-369beea2c2f7" containerID="9b0e91770da88da0b5575445fc7d3bb4fe6d58af2d16ddcfcd724ebfedbfd487" exitCode=1 Jun 09 00:18:28.649861 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:28.649425 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" event={"ID":"f9f63d97-2f79-4e6d-97d0-369beea2c2f7","Type":"ContainerDied","Data":"9b0e91770da88da0b5575445fc7d3bb4fe6d58af2d16ddcfcd724ebfedbfd487"} Jun 09 00:18:28.649861 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:28.649483 2515 scope.go:117] "RemoveContainer" containerID="7b7579cb8b9434ce239ddcce98552c26a544e3a077cdc1e9d8b32ed00baf87c3" Jun 09 00:18:28.649861 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:28.649784 2515 scope.go:117] "RemoveContainer" containerID="9b0e91770da88da0b5575445fc7d3bb4fe6d58af2d16ddcfcd724ebfedbfd487" Jun 09 00:18:28.650025 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:18:28.650003 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jk2bc_openshift-ingress(f9f63d97-2f79-4e6d-97d0-369beea2c2f7)\"" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" podUID="f9f63d97-2f79-4e6d-97d0-369beea2c2f7" Jun 09 00:18:29.079660 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:29.079555 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" Jun 09 00:18:29.656099 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:29.656075 2515 scope.go:117] "RemoveContainer" containerID="9b0e91770da88da0b5575445fc7d3bb4fe6d58af2d16ddcfcd724ebfedbfd487" Jun 09 00:18:29.656458 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:18:29.656292 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jk2bc_openshift-ingress(f9f63d97-2f79-4e6d-97d0-369beea2c2f7)\"" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" podUID="f9f63d97-2f79-4e6d-97d0-369beea2c2f7" Jun 09 00:18:32.886410 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:32.886371 2515 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" Jun 09 00:18:32.886871 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:32.886745 2515 scope.go:117] "RemoveContainer" containerID="9b0e91770da88da0b5575445fc7d3bb4fe6d58af2d16ddcfcd724ebfedbfd487" Jun 09 00:18:32.886954 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:18:32.886935 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jk2bc_openshift-ingress(f9f63d97-2f79-4e6d-97d0-369beea2c2f7)\"" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" podUID="f9f63d97-2f79-4e6d-97d0-369beea2c2f7" Jun 09 00:18:37.965031 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:37.965004 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-679cf9c744-lw9z5_7e88c29c-703e-4112-be61-aa86778df5f0/nginx/0.log" Jun 09 00:18:38.076282 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:38.076256 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-xzf9h_0ecb8bbc-13cd-481c-a98d-6c68478f6c0d/manager/0.log" Jun 09 00:18:38.312635 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:38.312536 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5f7676c84b-5c59x_081a583f-880e-4b73-97d0-4bae77e0c00d/manager/0.log" Jun 09 00:18:38.423456 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:38.423427 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-z7sc6_a0e5ebae-30dd-40b7-aaf5-a25c13114140/server/0.log" Jun 09 00:18:38.544904 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:38.544876 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-tkmhw_4415c1a6-3105-4e83-9051-17490c0aa705/manager/0.log" Jun 09 00:18:38.663145 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:38.663119 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-569d667bc9-9mx84_17483ac7-7aef-4c7d-8c80-08fab53de7dc/copy-manifests/0.log" Jun 09 00:18:38.670095 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:38.670065 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-569d667bc9-9mx84_17483ac7-7aef-4c7d-8c80-08fab53de7dc/manager/0.log" Jun 09 00:18:40.325953 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:40.325879 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-dfxtr_8136b8d7-8829-4a68-afb4-aabbdea47be3/manager/0.log" Jun 09 00:18:40.438100 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:40.438069 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9llhg_bbd18594-1698-4868-b724-88103905a8b3/manager/0.log" Jun 09 00:18:41.029320 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:41.029288 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-59g52_c8cb82ee-0443-4e99-b23a-086306fb1354/manager/0.log" Jun 09 00:18:41.380279 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:41.380247 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6d89947867knvqm_b516ac97-ef97-4c8f-851d-89c8d9a2ac62/istio-proxy/0.log" Jun 09 00:18:41.493348 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:41.493317 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zzx68_383dc402-6840-4a6d-9b83-7389dcdc53cc/discovery/0.log" Jun 09 00:18:41.605619 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:41.605559 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8659c84586-fvq6v_f3d19ba3-577f-4e2b-838f-10e30f28b61e/kube-auth-proxy/0.log" Jun 09 00:18:42.074576 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:42.074547 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jk2bc_f9f63d97-2f79-4e6d-97d0-369beea2c2f7/payload-processing/2.log" Jun 09 00:18:42.638094 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:42.638064 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-nqq96_82ff6579-308d-4fdb-b8df-3e3dd74f122f/storage-initializer/0.log" Jun 09 00:18:42.645362 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:42.645333 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-nqq96_82ff6579-308d-4fdb-b8df-3e3dd74f122f/main/0.log" Jun 09 00:18:43.098613 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:43.098573 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-mmrwp_810c1533-3c21-4ca7-afae-db9d41a717e6/storage-initializer/0.log" Jun 09 00:18:43.105893 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:43.105863 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-mmrwp_810c1533-3c21-4ca7-afae-db9d41a717e6/main/0.log" Jun 09 00:18:43.858278 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:43.858244 2515 scope.go:117] "RemoveContainer" containerID="9b0e91770da88da0b5575445fc7d3bb4fe6d58af2d16ddcfcd724ebfedbfd487" Jun 09 00:18:43.858762 ip-10-0-129-4 kubenswrapper[2515]: E0609 00:18:43.858475 2515 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-jk2bc_openshift-ingress(f9f63d97-2f79-4e6d-97d0-369beea2c2f7)\"" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" podUID="f9f63d97-2f79-4e6d-97d0-369beea2c2f7" Jun 09 00:18:50.308422 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:50.308394 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-h7fk4_63467802-5568-4564-b2ed-b70d3e63703a/global-pull-secret-syncer/0.log" Jun 09 00:18:50.459556 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:50.459526 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-q4fjc_46b88042-1753-4c68-b563-aea071370d78/konnectivity-agent/0.log" Jun 09 00:18:50.500443 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:50.500412 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-4.ec2.internal_2c664d5f65d16a479fdf40d82fa5ea09/haproxy/0.log" Jun 09 00:18:54.026984 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:54.026950 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-zdwfj_6f6f45bc-039b-4d1d-ac18-f7f36c8ee053/sail-operator/0.log" Jun 09 00:18:55.373092 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:55.373058 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-dfxtr_8136b8d7-8829-4a68-afb4-aabbdea47be3/manager/0.log" Jun 09 00:18:55.420810 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:55.420781 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9llhg_bbd18594-1698-4868-b724-88103905a8b3/manager/0.log" Jun 09 00:18:55.614219 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:55.614188 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-59g52_c8cb82ee-0443-4e99-b23a-086306fb1354/manager/0.log" Jun 09 00:18:57.695959 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:57.695933 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mjwlt_d63a8ab0-add3-4428-af41-030b7a71e333/node-exporter/0.log" Jun 09 00:18:57.726002 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:57.725966 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mjwlt_d63a8ab0-add3-4428-af41-030b7a71e333/kube-rbac-proxy/0.log" Jun 09 00:18:57.753662 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:57.753639 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mjwlt_d63a8ab0-add3-4428-af41-030b7a71e333/init-textfile/0.log" Jun 09 00:18:58.312211 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:58.312185 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bf87b895d-rmzwh_7cb7df1f-2c77-4142-a260-06121be0f5a2/thanos-query/0.log" Jun 09 00:18:58.333448 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:58.333418 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bf87b895d-rmzwh_7cb7df1f-2c77-4142-a260-06121be0f5a2/kube-rbac-proxy-web/0.log" Jun 09 00:18:58.357561 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:58.357536 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bf87b895d-rmzwh_7cb7df1f-2c77-4142-a260-06121be0f5a2/kube-rbac-proxy/0.log" Jun 09 00:18:58.378596 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:58.378571 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bf87b895d-rmzwh_7cb7df1f-2c77-4142-a260-06121be0f5a2/prom-label-proxy/0.log" Jun 09 00:18:58.403638 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:58.403593 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bf87b895d-rmzwh_7cb7df1f-2c77-4142-a260-06121be0f5a2/kube-rbac-proxy-rules/0.log" Jun 09 00:18:58.424806 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:58.424784 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bf87b895d-rmzwh_7cb7df1f-2c77-4142-a260-06121be0f5a2/kube-rbac-proxy-metrics/0.log" Jun 09 00:18:58.857794 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:58.857768 2515 scope.go:117] "RemoveContainer" containerID="9b0e91770da88da0b5575445fc7d3bb4fe6d58af2d16ddcfcd724ebfedbfd487" Jun 09 00:18:59.804333 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:59.804301 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" event={"ID":"f9f63d97-2f79-4e6d-97d0-369beea2c2f7","Type":"ContainerStarted","Data":"e3e2562421cbbe6f20e58993c3f3248710ba8594de897e8723095d20d9ae5c9e"} Jun 09 00:18:59.804525 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:18:59.804508 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" Jun 09 00:19:01.554540 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:01.554505 2515 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq"] Jun 09 00:19:01.558355 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:01.558335 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq" Jun 09 00:19:01.560942 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:01.560923 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b7dvg\"/\"kube-root-ca.crt\"" Jun 09 00:19:01.561078 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:01.561057 2515 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-b7dvg\"/\"default-dockercfg-gj2w4\"" Jun 09 00:19:01.562150 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:01.562134 2515 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-b7dvg\"/\"openshift-service-ca.crt\"" Jun 09 00:19:01.568319 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:01.568296 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq"] Jun 09 00:19:01.647157 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:01.647121 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26dw4\" (UniqueName: \"kubernetes.io/projected/1d7cbdfb-d318-4a3d-9dd0-039c058f88ea-kube-api-access-26dw4\") pod \"perf-node-gather-daemonset-m4xbq\" (UID: \"1d7cbdfb-d318-4a3d-9dd0-039c058f88ea\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq" Jun 09 00:19:01.647343 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:01.647193 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d7cbdfb-d318-4a3d-9dd0-039c058f88ea-sys\") pod \"perf-node-gather-daemonset-m4xbq\" (UID: \"1d7cbdfb-d318-4a3d-9dd0-039c058f88ea\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq" Jun 09 00:19:01.647343 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:01.647216 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1d7cbdfb-d318-4a3d-9dd0-039c058f88ea-proc\") pod \"perf-node-gather-daemonset-m4xbq\" (UID: \"1d7cbdfb-d318-4a3d-9dd0-039c058f88ea\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq" Jun 09 00:19:01.647343 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:01.647234 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d7cbdfb-d318-4a3d-9dd0-039c058f88ea-lib-modules\") pod \"perf-node-gather-daemonset-m4xbq\" (UID: \"1d7cbdfb-d318-4a3d-9dd0-039c058f88ea\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq" Jun 09 00:19:01.647343 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:01.647263 2515 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1d7cbdfb-d318-4a3d-9dd0-039c058f88ea-podres\") pod \"perf-node-gather-daemonset-m4xbq\" (UID: \"1d7cbdfb-d318-4a3d-9dd0-039c058f88ea\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq" Jun 09 00:19:01.748429 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:01.748393 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26dw4\" (UniqueName: \"kubernetes.io/projected/1d7cbdfb-d318-4a3d-9dd0-039c058f88ea-kube-api-access-26dw4\") pod \"perf-node-gather-daemonset-m4xbq\" (UID: \"1d7cbdfb-d318-4a3d-9dd0-039c058f88ea\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq" Jun 09 00:19:01.748666 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:01.748454 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d7cbdfb-d318-4a3d-9dd0-039c058f88ea-sys\") pod \"perf-node-gather-daemonset-m4xbq\" (UID: \"1d7cbdfb-d318-4a3d-9dd0-039c058f88ea\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq" Jun 09 00:19:01.748666 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:01.748469 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1d7cbdfb-d318-4a3d-9dd0-039c058f88ea-proc\") pod \"perf-node-gather-daemonset-m4xbq\" (UID: \"1d7cbdfb-d318-4a3d-9dd0-039c058f88ea\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq" Jun 09 00:19:01.748666 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:01.748488 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d7cbdfb-d318-4a3d-9dd0-039c058f88ea-lib-modules\") pod \"perf-node-gather-daemonset-m4xbq\" (UID: \"1d7cbdfb-d318-4a3d-9dd0-039c058f88ea\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq" Jun 09 00:19:01.748666 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:01.748510 2515 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1d7cbdfb-d318-4a3d-9dd0-039c058f88ea-podres\") pod \"perf-node-gather-daemonset-m4xbq\" (UID: \"1d7cbdfb-d318-4a3d-9dd0-039c058f88ea\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq" Jun 09 00:19:01.748666 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:01.748573 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d7cbdfb-d318-4a3d-9dd0-039c058f88ea-sys\") pod \"perf-node-gather-daemonset-m4xbq\" (UID: \"1d7cbdfb-d318-4a3d-9dd0-039c058f88ea\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq" Jun 09 00:19:01.748666 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:01.748573 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1d7cbdfb-d318-4a3d-9dd0-039c058f88ea-proc\") pod \"perf-node-gather-daemonset-m4xbq\" (UID: \"1d7cbdfb-d318-4a3d-9dd0-039c058f88ea\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq" Jun 09 00:19:01.748897 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:01.748671 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1d7cbdfb-d318-4a3d-9dd0-039c058f88ea-podres\") pod \"perf-node-gather-daemonset-m4xbq\" (UID: \"1d7cbdfb-d318-4a3d-9dd0-039c058f88ea\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq" Jun 09 00:19:01.748897 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:01.748689 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1d7cbdfb-d318-4a3d-9dd0-039c058f88ea-lib-modules\") pod \"perf-node-gather-daemonset-m4xbq\" (UID: \"1d7cbdfb-d318-4a3d-9dd0-039c058f88ea\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq" Jun 09 00:19:01.755577 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:01.755546 2515 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26dw4\" (UniqueName: \"kubernetes.io/projected/1d7cbdfb-d318-4a3d-9dd0-039c058f88ea-kube-api-access-26dw4\") pod \"perf-node-gather-daemonset-m4xbq\" (UID: \"1d7cbdfb-d318-4a3d-9dd0-039c058f88ea\") " pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq" Jun 09 00:19:01.868773 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:01.868743 2515 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq" Jun 09 00:19:02.000949 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:02.000920 2515 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq"] Jun 09 00:19:02.003285 ip-10-0-129-4 kubenswrapper[2515]: W0609 00:19:02.003249 2515 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1d7cbdfb_d318_4a3d_9dd0_039c058f88ea.slice/crio-07f5b4d00fc94eb1a897a245f61cff2bc8c7a08f63b29348978fa5e2fb8e8c62 WatchSource:0}: Error finding container 07f5b4d00fc94eb1a897a245f61cff2bc8c7a08f63b29348978fa5e2fb8e8c62: Status 404 returned error can't find the container with id 07f5b4d00fc94eb1a897a245f61cff2bc8c7a08f63b29348978fa5e2fb8e8c62 Jun 09 00:19:02.819529 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:02.819491 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq" event={"ID":"1d7cbdfb-d318-4a3d-9dd0-039c058f88ea","Type":"ContainerStarted","Data":"dbfccc236f1650376105fbfecd2f4255befeeae3ae09a181b81a0f4a010031a2"} Jun 09 00:19:02.819931 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:02.819553 2515 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq" event={"ID":"1d7cbdfb-d318-4a3d-9dd0-039c058f88ea","Type":"ContainerStarted","Data":"07f5b4d00fc94eb1a897a245f61cff2bc8c7a08f63b29348978fa5e2fb8e8c62"} Jun 09 00:19:02.819931 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:02.819583 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq" Jun 09 00:19:02.835491 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:02.835441 2515 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq" podStartSLOduration=1.835425505 podStartE2EDuration="1.835425505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 00:19:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 00:19:02.833253376 +0000 UTC m=+1183.449317212" watchObservedRunningTime="2026-06-09 00:19:02.835425505 +0000 UTC m=+1183.451489340" Jun 09 00:19:02.924619 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:02.924577 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bfrbb_16c6b841-08b7-4fd3-9892-e91359f0b9da/dns/0.log" Jun 09 00:19:02.945309 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:02.945282 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bfrbb_16c6b841-08b7-4fd3-9892-e91359f0b9da/kube-rbac-proxy/0.log" Jun 09 00:19:03.063202 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:03.063170 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-z9m44_6b0fff56-c56a-4650-afd0-ac7fd0e1a935/dns-node-resolver/0.log" Jun 09 00:19:03.649271 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:03.649246 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vmc2d_dd97edb7-dec0-40fc-85e0-9bb56a3e33eb/node-ca/0.log" Jun 09 00:19:04.557628 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:04.557593 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6d89947867knvqm_b516ac97-ef97-4c8f-851d-89c8d9a2ac62/istio-proxy/0.log" Jun 09 00:19:04.610168 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:04.610137 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zzx68_383dc402-6840-4a6d-9b83-7389dcdc53cc/discovery/0.log" Jun 09 00:19:04.632209 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:04.632183 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8659c84586-fvq6v_f3d19ba3-577f-4e2b-838f-10e30f28b61e/kube-auth-proxy/0.log" Jun 09 00:19:04.758864 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:04.758834 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jk2bc_f9f63d97-2f79-4e6d-97d0-369beea2c2f7/payload-processing/3.log" Jun 09 00:19:04.759555 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:04.759540 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jk2bc_f9f63d97-2f79-4e6d-97d0-369beea2c2f7/payload-processing/2.log" Jun 09 00:19:05.423974 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:05.423946 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q4pkm_477599c7-e5d0-41d4-b3e2-93b56c4ae38b/serve-healthcheck-canary/0.log" Jun 09 00:19:06.079776 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:06.079744 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zk2kp_3b7359f6-2691-4826-b282-a4a7be87fc3f/kube-rbac-proxy/0.log" Jun 09 00:19:06.099228 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:06.099202 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zk2kp_3b7359f6-2691-4826-b282-a4a7be87fc3f/exporter/0.log" Jun 09 00:19:06.120570 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:06.120546 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zk2kp_3b7359f6-2691-4826-b282-a4a7be87fc3f/extractor/0.log" Jun 09 00:19:08.337033 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:08.337004 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-679cf9c744-lw9z5_7e88c29c-703e-4112-be61-aa86778df5f0/nginx/0.log" Jun 09 00:19:08.360998 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:08.360970 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-xzf9h_0ecb8bbc-13cd-481c-a98d-6c68478f6c0d/manager/0.log" Jun 09 00:19:08.449437 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:08.449412 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5f7676c84b-5c59x_081a583f-880e-4b73-97d0-4bae77e0c00d/manager/0.log" Jun 09 00:19:08.469704 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:08.469676 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-z7sc6_a0e5ebae-30dd-40b7-aaf5-a25c13114140/server/0.log" Jun 09 00:19:08.516994 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:08.516967 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-tkmhw_4415c1a6-3105-4e83-9051-17490c0aa705/manager/0.log" Jun 09 00:19:08.542766 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:08.542745 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-569d667bc9-9mx84_17483ac7-7aef-4c7d-8c80-08fab53de7dc/manager/0.log" Jun 09 00:19:08.563070 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:08.563051 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-569d667bc9-9mx84_17483ac7-7aef-4c7d-8c80-08fab53de7dc/copy-manifests/0.log" Jun 09 00:19:08.834739 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:08.834711 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-b7dvg/perf-node-gather-daemonset-m4xbq" Jun 09 00:19:10.810920 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:10.810840 2515 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-jk2bc" Jun 09 00:19:15.122360 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:15.122331 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6d89947867knvqm_b516ac97-ef97-4c8f-851d-89c8d9a2ac62/istio-proxy/0.log" Jun 09 00:19:15.181380 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:15.181347 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zzx68_383dc402-6840-4a6d-9b83-7389dcdc53cc/discovery/0.log" Jun 09 00:19:15.190821 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:15.190800 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8659c84586-fvq6v_f3d19ba3-577f-4e2b-838f-10e30f28b61e/kube-auth-proxy/0.log" Jun 09 00:19:15.277281 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:15.277254 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jk2bc_f9f63d97-2f79-4e6d-97d0-369beea2c2f7/payload-processing/3.log" Jun 09 00:19:15.277960 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:15.277940 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jk2bc_f9f63d97-2f79-4e6d-97d0-369beea2c2f7/payload-processing/2.log" Jun 09 00:19:16.357592 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:16.357566 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6d89947867knvqm_b516ac97-ef97-4c8f-851d-89c8d9a2ac62/istio-proxy/0.log" Jun 09 00:19:16.399160 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:16.399131 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zzx68_383dc402-6840-4a6d-9b83-7389dcdc53cc/discovery/0.log" Jun 09 00:19:16.410087 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:16.410061 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8659c84586-fvq6v_f3d19ba3-577f-4e2b-838f-10e30f28b61e/kube-auth-proxy/0.log" Jun 09 00:19:16.504196 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:16.504168 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jk2bc_f9f63d97-2f79-4e6d-97d0-369beea2c2f7/payload-processing/3.log" Jun 09 00:19:16.504979 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:16.504960 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jk2bc_f9f63d97-2f79-4e6d-97d0-369beea2c2f7/payload-processing/2.log" Jun 09 00:19:17.468125 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:17.468054 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pmqbj_e80985b9-2bd7-4d72-8059-a32ce4290fe7/kube-multus-additional-cni-plugins/0.log" Jun 09 00:19:17.488354 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:17.488326 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pmqbj_e80985b9-2bd7-4d72-8059-a32ce4290fe7/egress-router-binary-copy/0.log" Jun 09 00:19:17.512184 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:17.512151 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pmqbj_e80985b9-2bd7-4d72-8059-a32ce4290fe7/cni-plugins/0.log" Jun 09 00:19:17.533763 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:17.533735 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pmqbj_e80985b9-2bd7-4d72-8059-a32ce4290fe7/bond-cni-plugin/0.log" Jun 09 00:19:17.555250 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:17.555227 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pmqbj_e80985b9-2bd7-4d72-8059-a32ce4290fe7/routeoverride-cni/0.log" Jun 09 00:19:17.576674 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:17.576652 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pmqbj_e80985b9-2bd7-4d72-8059-a32ce4290fe7/whereabouts-cni-bincopy/0.log" Jun 09 00:19:17.601204 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:17.601182 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pmqbj_e80985b9-2bd7-4d72-8059-a32ce4290fe7/whereabouts-cni/0.log" Jun 09 00:19:17.633579 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:17.633554 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bmm98_44bcb831-f0a8-40bd-ab4a-44cbd680d9e5/kube-multus/0.log" Jun 09 00:19:17.691975 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:17.691948 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-np4v6_1c75857e-660f-4c6b-a33d-6bd990f4089f/network-metrics-daemon/0.log" Jun 09 00:19:17.710850 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:17.710826 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-np4v6_1c75857e-660f-4c6b-a33d-6bd990f4089f/kube-rbac-proxy/0.log" Jun 09 00:19:18.007132 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:18.007107 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6d89947867knvqm_b516ac97-ef97-4c8f-851d-89c8d9a2ac62/istio-proxy/0.log" Jun 09 00:19:18.044854 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:18.044827 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-zzx68_383dc402-6840-4a6d-9b83-7389dcdc53cc/discovery/0.log" Jun 09 00:19:18.056968 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:18.056933 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8659c84586-fvq6v_f3d19ba3-577f-4e2b-838f-10e30f28b61e/kube-auth-proxy/0.log" Jun 09 00:19:18.144553 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:18.144522 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jk2bc_f9f63d97-2f79-4e6d-97d0-369beea2c2f7/payload-processing/3.log" Jun 09 00:19:18.145228 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:18.145213 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-jk2bc_f9f63d97-2f79-4e6d-97d0-369beea2c2f7/payload-processing/2.log" Jun 09 00:19:18.746721 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:18.746688 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hh52h_24c10154-7f2b-4b8c-8000-2d4d7b781451/ovn-controller/0.log" Jun 09 00:19:18.765856 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:18.765833 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hh52h_24c10154-7f2b-4b8c-8000-2d4d7b781451/ovn-acl-logging/0.log" Jun 09 00:19:18.790870 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:18.790842 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hh52h_24c10154-7f2b-4b8c-8000-2d4d7b781451/kube-rbac-proxy-node/0.log" Jun 09 00:19:18.813212 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:18.813187 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hh52h_24c10154-7f2b-4b8c-8000-2d4d7b781451/kube-rbac-proxy-ovn-metrics/0.log" Jun 09 00:19:18.835852 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:18.835828 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hh52h_24c10154-7f2b-4b8c-8000-2d4d7b781451/northd/0.log" Jun 09 00:19:18.858202 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:18.858177 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hh52h_24c10154-7f2b-4b8c-8000-2d4d7b781451/nbdb/0.log" Jun 09 00:19:18.879434 ip-10-0-129-4 kubenswrapper[2515]: I0609 00:19:18.879406 2515 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hh52h_24c10154-7f2b-4b8c-8000-2d4d7b781451/sbdb/0.log"